Control Systems and Control Devices
The control system for planetarium projectors prioritizes and executes intended commands by analyzing voice inputs from multiple terminals, addressing echo-induced errors.
Patent Information
- Application Number
- JP2020199585
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2020-12-01
- Publication Date
- 2024-11-19
- Estimated Expiration
- 2040-12-01
AI Technical Summary
Existing voice-operated planetarium projectors are prone to executing unintended commands due to echoes, leading to unwanted operations.
A control system with multiple terminals and a control device that receives and analyzes voice commands, prioritizes commands based on timing, accuracy, volume, frequency, and specific command nature to ensure intended operations are executed.
Prevents unintended projector operations by selecting and executing the most accurate and timely command, reducing duplicate executions caused by dome echoes.
Smart Images

Figure 0007586693000001 
Figure 0007586693000002 
Figure 0007586693000003
Abstract
Description
[Technical field]
[0001] FIELD OF THE DISCLOSURE This disclosure relates to controlling a projector, and more particularly, to controlling the execution of commands to a projector. [Background technology]
[0002] Planetariums use a projector to project the constellations and the movement of the stars onto a dome-shaped curved screen. Usually, a guide explains the constellations projected by the projector while operating the planetarium to advance the projection scene.
[0003] One method of operating a planetarium is through voice input using a console device or a terminal such as a tablet. The guide can operate the projector by speaking into the terminal the words that correspond to the commands that the guide wants the projector to execute.
[0004] Regarding voice operation of a planetarium, for example, Japanese Patent Application Laid-Open No. 11-296073 (Patent Document 1) discloses a system that "is an operation system for a planetarium theater, and is equipped with a means for recognizing and executing operation commands by voice, and a means for providing operation guidance by voice" (see [Abstract]). [Prior art documents] [Patent documents]
[0005] [Patent Document 1] Japanese Patent Application Publication No. 11-296073 Summary of the Invention [Problem to be solved by the invention]
[0006] According to the technology disclosed in Patent Document 1, there is a possibility that the same voice may be detected multiple times due to reverberation from the dome, causing the projector to execute the same command multiple times. In such a case, the projector may perform an operation that is not intended by the guide. Therefore, there is a need for a technology that prevents the projector from performing an operation that is not intended by the guide.
[0007] The present disclosure has been made in view of the above-described background, and an object of one aspect is to provide a technique for preventing a projector from performing operations unintended by a guide. [Means for solving the problem]
[0008] A control system according to an embodiment includes a plurality of terminals each having a voice recognition function and a control device for controlling a projector. The control device receives a first command for the projector from a first terminal, receives a second command for the projector from a second terminal, and, if the first command and the second command are the same command, causes the projector to execute only an operation associated with the first command if the first command is received earlier than the second command.
[0009] According to one aspect, the terminal stores a command table including a plurality of commands and keywords associated with each of the plurality of commands, acquires voice information, generates first text information from the voice information using a voice recognition function, searches the command table using the first text information as a search word, selects a first command associated with the first keyword included in the command table, and transmits the first command to the control device. The first command includes information on the recognition accuracy of the first keyword in the first text information. Having the projector execute only the operation associated with the first command includes having the projector execute the operation associated with the first command when the recognition accuracy of the first command is equal to or higher than a threshold.
[0010] According to one aspect, when the recognition accuracy of each of the first command and the second command is below a threshold, the control device causes the projector to execute only the operation associated with the first command when the first command and the second command are the same command.
[0011] According to one aspect, the process of causing the projector to execute only the operation associated with the first command is executed when the difference between the timing of receiving the first command and the timing of receiving the second command is within a predetermined time.
[0012] According to one aspect, the first command and the second command include volume information, and when the first command and the second command are the same command and the control device receives the first command and the second command at the same time, the control device causes the projector to execute only an operation associated with the command having a larger value of the volume information.
[0013] According to one aspect, when the first command and the second command are the same command, and the control device receives the first command at the same timing as the second command, the control device causes the projector to execute only the operation associated with the first command based on the fact that the control device has received more commands from the first terminal than the second terminal in the past.
[0014] According to one aspect, the process of causing the projector to execute only the operation associated with the first command is executed if the first command and the second command are specific commands of the projector, and is not executed if the first command and the second command are not specific commands.
[0015] According to one aspect, when the control device receives the same command a certain number of times or more from a plurality of terminals, the control device causes the projector to execute only an operation associated with the command that was received earliest.
[0016] According to another embodiment, a control device is provided. The control device includes a communication unit, a memory that stores a command table including a plurality of commands for the projector and keywords associated with each of the plurality of commands, and a control unit. The communication unit receives first voice information of the projector from a first terminal, and receives second voice information of the projector from a second terminal. The control unit acquires first text information from the first voice information and second text information from the second voice information by a voice recognition function, searches the command table using the first text information as a search word to acquire the first command, searches the command table using the second text information as a search word to acquire the second command, and, if the first command and the second command are the same command, causes the projector to execute only an operation associated with the first command when the timing of receiving the first voice information is earlier than the timing of receiving the second voice information.
[0017] According to one aspect, causing the projector to execute only the operation associated with the first command includes causing the projector to execute the operation associated with the first command when the recognition accuracy for a keyword included in the command table of the first voice information is equal to or greater than a threshold value.
[0018] According to one aspect, when the recognition accuracy of each of the first voice information and the second voice information is below a threshold, the control device causes the projector to execute only the operation associated with the first command when the first command and the second command are the same command.
[0019] According to one aspect, the process of causing the projector to execute only the operation associated with the first command is executed when the difference between the timing of receiving the first audio information and the timing of receiving the second audio information is within a predetermined time.
[0020] According to one aspect, the first audio information and the second audio information include volume information, and when the first command and the second command are the same command and the timing of receiving the first audio information is equal to the timing of receiving the second audio information, the control device causes the projector to execute only an operation associated with a command obtained from the audio information having a larger value of the volume information.
[0021] According to one aspect, when the first command and the second command are the same command, and the timing of receiving the first audio information is equal to the timing of receiving the second audio information, the control device causes the projector to execute only the operation associated with the first command based on the fact that more audio information has been received from the first terminal in the past than from the second terminal.
[0022] According to one aspect, the process of causing the projector to execute only the operation associated with the first command is executed if the first command and the second command are specific commands, and is not executed if the first command and the second command are not specific commands.
[0023] According to one aspect, when the control device receives the same voice information from multiple terminals a certain number of times or more, it causes the projector to execute only the operation associated with the command obtained from the voice information received earliest. Effect of the Invention
[0024] According to an embodiment, it is possible to prevent the projector from performing operations unintended by the guide.
[0025] The above and other objects, features, aspects and advantages of the present disclosure will become apparent from the following detailed description of the disclosure taken in conjunction with the accompanying drawings. [Brief description of the drawings]
[0026] [Figure 1] FIG. 1 shows an example of a configuration of a planetarium system 10 according to an embodiment. [Diagram 2] 1 is a diagram illustrating a first example of functional blocks of a terminal 101 and a control device 100. FIG. [Diagram 3] 13 is a diagram illustrating a second example of functional blocks of the terminal 101 and the control device 100. FIG. [Figure 4] FIG. 4 is a diagram showing an example of a hardware configuration of a device 400 that can be used as the terminal 101 and the control device 100. [Diagram 5] FIG. 1 is a diagram showing a typical example of reverberation inside a planetarium dome. [Figure 6] FIG. 4 is a diagram showing an example of a command execution procedure by the control device 100. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0027] Hereinafter, an embodiment of the technical idea according to the present disclosure will be described with reference to the drawings. In the following description, the same components are denoted by the same reference numerals. The names and functions of the components are also the same. Therefore, detailed descriptions thereof will not be repeated.
[0028] 1 is a diagram showing an example of the configuration of a planetarium system 10 according to the present embodiment. Planetarium system 10 according to the present embodiment can be operated from a plurality of terminals 101 by voice.
[0029] A planetarium system 10 according to the present embodiment will be described with reference to Fig. 1. The planetarium system 10 includes a control device 100, a terminal 101, an optical planetarium projector 106, an external device 130, a control device 113 for a digital planetarium projector 115, and the digital planetarium projector 115. The optical planetarium projector 106 and the digital planetarium projector 115 are sometimes collectively referred to as "projectors."
[0030] The optical planetarium projector 106 includes an equipment control unit 107, a motor control unit 108, a motor 109, an LED (Light Emitting Diode) control unit 110, and an LED 111. The control device 113 of the digital planetarium projector includes a digital control unit 114. The digital planetarium projector 115 includes a projection control unit 116 and a projection unit 117.
[0031] It should be noted that the planetarium system 10 does not necessarily have to include the external device 130. The planetarium system 10 may selectively include the optical planetarium projector 106, or the control device 113 for the digital planetarium projector 115 and the digital planetarium projector 115, or may include both.
[0032] The terminal 101 acquires voice information of the guide via a microphone and an amplifier (not shown). The terminal 101 also converts the acquired voice information into text and searches for a command, and transmits the command to the control device 100. The command here is a command for the projector. The control device 100 can cause the projector to execute an operation linked to the command.
[0033] In one aspect, the terminal 101 may directly transmit voice information to the control device 100. In another aspect, the terminal 101 may be a tablet, a smartphone, a laptop computer, a desktop computer, or any other device. In another aspect, the terminal 101 may communicate with the control device 100 by wireless communication or wired communication.
[0034] The control device 100 transmits commands acquired from the terminal 101 to each projector, causing each projector to execute an operation linked to the command. The control device 100 can also communicate with multiple terminals 101. When the control device 100 receives the same command from multiple terminals 101 within a certain period of time (at a predetermined time interval), it selects only the command that was received first, and causes the projector to execute an operation linked to the selected command.
[0035] As an example, it is assumed that the control device 100 receives command A from terminal 101A and command B from terminal 101B within a certain period of time. If commands A and B are the same command and the timing of receiving command A (timestamp) is earlier than the timing of receiving command B, the control device 100 selects command A. Then, the control device 100 causes the projector to execute the operation associated with command A. Through this process, the control device 100 can suppress duplicate execution of the same command when, for example, the voice of the guide is acquired by both terminals 101A and 101B due to echoes from the dome of the planetarium.
[0036] In one aspect, the control device 100 may directly acquire voice information from the terminal 101. In this case, the control device 100 converts the acquired voice information into text and searches for commands. Furthermore, when the control device 100 receives a plurality of pieces of voice information from a plurality of terminals 101 within a certain period of time (at a predetermined time interval), and the analysis results of each piece of voice information indicate the same command, the control device 100 selects only the command obtained from the voice information received first, and causes the projector to execute an operation associated with the selected command.
[0037] As an example, the control device 100 receives audio information A from the terminal 101A and audio information B from the terminal 101B within a certain time. The control device 100 acquires text information A and B from the audio information A and B, respectively, by audio analysis. The control device 100 searches a command DB (Database) (not shown) including commands and keywords linked to the commands using the text information A and B as search words, and acquires commands A and B, respectively. If commands A and B are the same command and the timing of receiving the audio information A is earlier than the timing of receiving the audio information B, the control device 100 selects command A. Then, the control device 100 causes the projector to execute the operation linked to command A.
[0038] The optical planetarium projector 106 projects constellation pictures and the like onto a dome-shaped curved screen. The equipment control unit 107 controls various devices connected to the optical planetarium projector 106. The equipment control unit 107 also controls a motor control unit 108 and an LED control unit 110 provided in the optical planetarium projector 106. The equipment control unit 107 receives a command from the control device 100, and based on the command, causes the various devices connected to the optical planetarium projector 106, the motor control unit 108, and the LED control unit 110 to execute an operation associated with the command.
[0039] The motor control unit 108 drives a motor 109 for operating the optical planetarium projector 106. The LED control unit 110 lights an LED 111 for projecting an image. The external device 130 is connected to the optical planetarium projector 106 for use. In one aspect, a lifter, an emergency light, an aroma generator, an audio player, a projector, or the like may be used as the external device 130. In another aspect, the external device 130 may be connected to the control device 113 of the digital planetarium projector 115 for use.
[0040] The digital planetarium projector control device 113 controls the digital planetarium projector 115. The digital control unit 114 receives commands from the projector control unit 103. Based on the received commands, the digital control unit 114 transmits control signals to the digital planetarium projector 115 to operate the digital planetarium projector 115.
[0041] Unlike the optical planetarium projector 106, the digital planetarium projector 115 uses a projector instead of an LED and a lens. The projection control unit 116 controls the projection unit 117 based on a control signal received from the digital control unit 114. The projection unit 117 projects a constellation picture onto a screen.
[0042] Fig. 2 is a diagram showing a first example of functional blocks of the terminal 101 and the control device 100. The functions of the terminal 101 and the control device 100 will be described with reference to Fig. 2. In a certain aspect, each configuration shown in Fig. 2 may be realized as software, and in that case, may be executed on the hardware shown in Fig. 4, for example.
[0043] The terminal 101 comprises an operation unit 201 , a voice input unit 202 , a voice analysis engine 203 , a command search unit 204 , a command DB 205 , a search result display unit 206 , a command input unit 207 , and a command transmission unit 208 .
[0044] The operation unit 201 accepts an input from the commentator to switch an audio input function on / off, etc. In one aspect, the operation unit 201 can be realized by a button, a touch panel, or any other input device.
[0045] The audio input unit 202 accepts audio input from a commentator. The audio input unit 202 outputs the acquired audio information to the audio analysis engine 203. In one aspect, the audio input unit 202 may be realized by a microphone and an amplifier of the terminal 101. In another aspect, the audio input unit 202 may output volume information such as an input level of a microphone together with the audio information.
[0046] The voice analysis engine 203 generates text data from the acquired voice information. As an example, assume that the commentator utters "Show the Orion constellation." In this case, the voice analysis engine 203 analyzes the acquired voice information and generates text information "Show the Orion constellation." The voice analysis engine 203 outputs the text information to the command search unit 204.
[0047] Even if the voice analysis engine 203 is unable to completely recognize the voice information, it can replace only the recognized voice information with text information. As an example, the voice analysis engine 203 may only recognize a part of the utterance "Show me the Orion constellation" and output the text information "Orion constellation."
[0048] The command search unit 204 searches the command DB 205 using the acquired text information as a search word. The command DB 205 stores various commands for the projector and keywords associated with each command. The command DB 205 compares the search word with the keyword, and selects a keyword that has a high degree of match with the search word (hereinafter, the degree of match between the search word and the keyword is referred to as "recognition accuracy").
[0049] In one aspect, the command DB 205 may select all keywords whose recognition accuracy is equal to or higher than a predetermined threshold (e.g., 80% or higher). For example, assume that the keyword "Orion" is registered in the command DB 205, and text information "Orion" is obtained by voice recognition. In this case, the recognition accuracy of the search word "Orion" and the keyword "Orion" is 80% (4 out of 5 characters match). If the recognition accuracy is equal to or higher than a predetermined threshold, the command DB 205 returns a command linked to the keyword "Orion" to the command search unit 204 as a search result. In another aspect, if there are multiple keywords whose recognition accuracy is equal to or higher than a predetermined threshold, the command DB 205 may select all of these multiple keywords. In another aspect, the command DB 205 may also select keywords whose recognition accuracy is less than a predetermined threshold.
[0050] The command DB 205 returns the command associated with the selected keyword to the command search unit 204 as a search result. At that time, the command DB 205 may also return the recognition accuracy together with the command. Hereinafter, the recognition accuracy returned together with the command will be referred to as the "recognition accuracy of the command." The command search unit 204 outputs the acquired command to the command input unit 207.
[0051] The command input unit 207 displays all the commands on a display or the like. Then, the command input unit 207 accepts an input from the commentator to select a command. The command input unit 207 outputs the command selected by the commentator to the command transmission unit 208.
[0052] The command transmitting unit 208 transmits the acquired command to the command receiving unit 209 of the control device 100. In one aspect, the command transmitting unit 208 may transmit volume information, an ID (identifier) of the terminal 101, the recognition accuracy at the time of command search, or any combination thereof, together with the command to the command receiving unit 209. In another aspect, when transmitting a plurality of commands, the command transmitting unit 208 may transmit each command in association with the volume information and the recognition accuracy at the time of command search. In another aspect, the command may include these pieces of information.
[0053] The control device 100 includes a command receiving unit 209, a command selecting unit 210, and a device control unit 211. The command receiving unit 209 receives a command from the terminal 101. The command receiving unit 209 outputs the received command and information indicating the timing of receiving the command, such as a timestamp at the time of reception, to the command selecting unit. In a certain aspect, the command receiving unit 209 may receive, together with the command, volume information, the ID of the terminal 101, recognition accuracy at the time of command search, or any combination of these.
[0054] When the command selection unit 210 receives the same command multiple times within a predetermined time interval, the command selection unit 210 selects a command to be executed from the received multiple commands. The command selection unit 210 may select a command to be executed by, for example, any of the following methods or a combination of these methods. The command selection unit 210 transmits the selected command to the device control unit 211.
[0055] (First command selection method) In a certain aspect, the command selection unit 210 may select the command with the earliest time stamp. As an example, assume that the control device 100 receives command A from the terminal 101A and command B from the terminal 101B within a predetermined fixed time. If commands A and B are the same command and the reception timing (time stamp) of command A is earlier than the reception timing of command B, the control device 100 selects command A. Note that in the case where the control device 100 has the configuration shown in FIG. 3 (where the control device 100 receives voice information), when the control device 100 receives a plurality of pieces of voice information and the same command is obtained from each piece of voice information, the command selection unit 210 selects the command obtained from the voice information with the earliest time stamp.
[0056] For example, even if a commentator speaks only once, multiple terminals 101 may detect the commentator's speech due to echoes from the dome, etc. Therefore, when the same command is acquired multiple times within a predetermined time interval, the command selection unit 210 can suppress duplicate execution of the same command by selecting only the command with the earliest time stamp.
[0057] (How to select the second command) In another aspect, the command selection unit 210 may select the command with the earliest time stamp from among the commands whose command recognition accuracy is equal to or higher than a threshold. For example, assume that the control device 100 receives identical commands A, B, C, and D from multiple terminals 101 within a predetermined time interval. The received time stamps are assumed to be commands A, B, C, and D in that order. The recognition accuracy of commands A and C is less than the threshold, and the recognition accuracy of commands B and D is equal to or higher than the threshold. In this case, the command selection unit 210 may select command B, which has the earliest time stamp, from among commands B and D whose command recognition accuracy is equal to or higher than the threshold.
[0058] If the guide's speech is unclear or there is noise, the accuracy of the voice recognition of the terminal 101 may decrease. Therefore, the command selection unit 210 can suppress the execution of unintended commands by suppressing the execution of commands with low recognition accuracy.
[0059] (Third command selection method) In another aspect, when the control device 100 receives the same command from a plurality of terminals 101 simultaneously, the command selection unit 210 may select the command to be executed based on the volume information. For example, when the control device 100 receives command A from terminal 101A and command B from terminal 101B simultaneously, it is assumed that commands A and B are the same command. In this case, the command selection unit 210 may select command A if the value of the volume information associated with command A is greater than the value of the volume information associated with command B. Note that when the control device 100 has the configuration shown in FIG. 3 (when the control device 100 receives voice information), the command selection unit 210 may select the command to be executed based on the volume information associated with the voice information.
[0060] The fact that the volume information of command A is large indicates that command A is highly likely to have been sent from the terminal 101 used by the main commentator. Therefore, when the control device 100 simultaneously receives the same commands, the command selection unit 210 can preferentially select the command with the larger volume information value.
[0061] (The fourth command selection method) In another aspect, when the control device 100 receives the same command from a plurality of terminals 101 at the same time, the command selection unit 210 may select a command to be executed based on the frequency with which each terminal 101 transmits a command. For example, when the control device 100 receives command A from terminal 101A and command B from terminal 101B at the same time, it is assumed that commands A and B are the same command. In this case, the command selection unit 210 may select command A if the total number of commands received from terminal 101A in the past is greater than the total number of commands received from terminal 101B in the past. Note that when the control device 100 has the configuration shown in FIG. 3 (when the control device 100 receives voice information), the command selection unit 210 may select a command to be executed based on the frequency with which each terminal 101 transmits voice information.
[0062] The fact that the total number of commands received from terminal 101A is large indicates that terminal 101A is likely to be used by the main commentator. Therefore, when control device 100 receives the same command simultaneously, command selection unit 210 can select a command based on the frequency with which each terminal 101 transmits a command.
[0063] (5th command selection method) In another aspect, when the control device 100 receives the same command from a plurality of terminals 101, the command selection unit 210 may select the command as the command to be executed, where the command recognition accuracy is below a threshold.
[0064] For example, suppose that the control device 100 receives command A from terminal 101A and command B from terminal 101B. Assume that commands A and B are the same command, and that the recognition accuracy of both is below a threshold. Also assume that the timestamp of command A is earlier than the timestamp of command B. In this case, the command selection unit 210 may select command A.
[0065] The fifth command selection method can be said to be a modified example of the second command selection method. In the second command selection method, if the recognition accuracy of the received command A is equal to or higher than a threshold (e.g., 80% or higher), and if the timestamp of the command A is the earliest, the command A is executed. In contrast, the fifth command selection method is different in that if the recognition accuracy of the received command A is less than a threshold (e.g., less than 80%), the command A is executed only if the same command as the command A is received from another terminal 101. Note that, in the case where the control device 100 has the configuration shown in FIG. 3 (when the control device 100 receives voice information), the command selection unit 210 may select the command obtained from the voice information with the earliest timestamp as the command to be executed when the same command with a recognition accuracy less than the threshold is obtained multiple times from the multiple voice information received by the control device 100.
[0066] Even if the recognition accuracy of a certain command is below the threshold, the fact that the control device 100 has received the same command from multiple terminals 101 means that the command is highly likely to have been correctly selected by voice recognition. Therefore, when the control device 100 receives the same command from multiple terminals 101, for which the command recognition accuracy is below the command threshold, the command selection unit 210 can select the command with the earliest timestamp among the multiple identical commands as the command to be executed.
[0067] (6th command selection method) In another aspect, when the control device 100 receives a large number of identical commands, the command selection unit 210 executes only the command with the earliest time stamp among the multiple commands received by the control device 100. When the control device 100 has the configuration shown in Fig. 3 (when the control device 100 receives voice information), the command selection unit 210 executes only the command obtained from the voice information with the earliest time stamp among the multiple pieces of voice information received by the control device 100.
[0068] For example, it is conceivable that the terminal 101 picks up a large number of voices of children inside a dome and transmits the same command multiple times to the control device 100. Therefore, the command selection unit 210 can suppress duplicate execution of the same command by selecting only the command with the earliest timestamp among the large number of identical commands received.
[0069] (7th command selection method) In another aspect, the command selection unit 210 may execute the first to sixth command selection methods or a combination of these processes only when the acquired command is a specific command. For example, the command selection unit 210 may execute the first to sixth command selection methods or a combination of these processes when it acquires a command for projector motion processing (such as processing for moving the position of a celestial body), and may not execute the first to sixth command selection methods or a combination of these processes when it acquires a command for projector dimming processing (such as adjusting the brightness of a light). Note that when the control device 100 has the configuration shown in FIG. 3 (when the control device 100 receives voice information), the command selection unit 210 may execute the first to sixth command selection methods or a combination of these processes only when the command obtained from the received voice information is a specific command.
[0070] The dimming process is, for example, a process for specifying the brightness of the projector's light, and no problem occurs even if such a process is executed repeatedly. However, if the motion process is repeated an unintended number of times, problems such as the display position of a celestial body being shifted may occur. Therefore, the command selection unit 210 executes the selection process only when necessary, and does not execute the selection process when unnecessary, thereby suppressing duplicate execution of the same command and shortening the processing time.
[0071] The device control unit 211 transmits the acquired command to each projector or a control device for each projector. In one aspect, the device control unit 211 may transmit a control signal to each projector or a control device for each projector to cause each projector to execute an operation linked to the command. In one aspect, the device control unit 211 may transmit a command to the device control unit 107 and the control device 113. In another aspect, the device control unit 107 and the control device 113 may have the function of the device control unit 211.
[0072] Fig. 3 is a diagram showing a second example of functional blocks of the terminal 101 and the control device 100. The functions of the terminal 101 and the control device 100 will be described with reference to Fig. 3. In a certain aspect, each configuration shown in Fig. 3 may be executed as software by, for example, the hardware shown in Fig. 4. The configuration shown in Fig. 3 differs from the configuration shown in Fig. 2 in that the control device 100 has a voice recognition function.
[0073] The terminal 101 does not have a voice recognition function and directly transmits voice information to the control device 100. Therefore, the terminal 101 has a voice transmitting unit 303 instead of the voice analysis engine 203, the command search unit 204, the command DB 205, the search result display unit 206, the command input unit 207, and the command transmitting unit 208. The voice transmitting unit 303 transmits the voice information acquired from the voice input unit 202 to the voice receiving unit 304 of the control device 100. In one aspect, the voice transmitting unit 303 may transmit volume information and the ID of the terminal 101 together with the voice information to the voice receiving unit 304. In another aspect, the voice information may include these pieces of information.
[0074] The control device 100 has a voice recognition function. Therefore, instead of the command receiving unit 209, the control device 100 has a voice receiving unit 304, a voice analysis engine 203, a command search unit 204, and a command DB 205. The voice receiving unit 304 outputs received voice information to the voice analysis engine 203. The operations of the voice analysis engine 203, the command search unit 204, and the command DB 205 are the same as those shown in FIG. 2. The command search unit 204 outputs a command that is a search result to the command selection unit 210. The command selection unit 210 uses the timestamp of each piece of voice information as the timestamp of each command.
[0075] 4 is a diagram showing an example of a hardware configuration of a device 400 that can be used as the terminal 101 and the control device 100. In one aspect, the device 400 may be a PC (Personal Computer), a smartphone, a tablet, or any other information processing device. For example, the control device 100 may be realized by the device 400 that is a PC, and the terminal 101 may be realized by the device 400 that is a tablet.
[0076] The device 400 includes a CPU (Central Processing Unit) 401 , a primary storage device 402 , a secondary storage device 403 , an external device interface 404 , an input interface 405 , an output interface 406 , and a communication interface 407 .
[0077] The CPU 401 processes programs and data stored in the primary storage device 402. The primary storage device 402 stores the programs executed and data referenced by the CPU 401. In one aspect, a dynamic random access memory (DRAM) may be used as the primary storage device 402.
[0078] The secondary storage device 403 stores programs, data, etc. for a long period of time. Since the secondary storage device 403 is generally slower than the primary storage device 402, data that is directly used by the CPU 401 is stored in the primary storage device 402, and other data is stored in the secondary storage device 403. In a certain aspect, a non-volatile storage device such as an HDD (Hard Disk Drive) or an SSD (Solid State Drive) may be used as the secondary storage device 403.
[0079] The external device interface 404 is used when connecting an auxiliary device to the control device 100. Generally, a USB (Universal Serial Bus) interface is often used as the external device interface 404.
[0080] The input interface 405 is used to connect a keyboard, a mouse, etc. A USB interface may be used as the input interface 405. In one aspect, the input interface 405 may be connected to a touch panel 408, a microphone 409, a keyboard 410, a mouse 411, or any other input device.
[0081] The output interface 406 is used to connect an output device such as a display. In one aspect, a High-Definition Multimedia Interface (HDMI) (registered trademark) or a Digital Visual Interface (DVI) may be used as the output interface 406. In one aspect, the output interface 406 may be connected to a speaker 412, a display 413, or any other output device.
[0082] The communication interface 407 is used to communicate with an external communication device. In one aspect, a LAN (Local Area Network) port, a Wi-Fi (Wireless Fidelity) (registered trademark) transceiver, or the like may be used as the output interface 406.
[0083] FIG. 5 is a diagram showing a typical example of echoes in a dome of a planetarium. In the example shown in FIG. 5, two terminals 101A and 101B are used in a dome 500. Since the dome 500 easily echoes sound, for example, the voice of a guide holding the terminal 101B may echo and reach the terminal 101A. In addition, the terminals 101A and 101B may pick up the voices of the audience and transmit unexpected commands to the control device 100. The planetarium system 10 according to the present embodiment can suppress the execution of unexpected commands caused by the echoes of sound from the dome 500 by using the configuration described in FIG. 2 and FIG. 3.
[0084] Fig. 6 is a diagram showing an example of a procedure for executing a command by the control device 100. In one aspect, the CPU 401 may load a program for performing the processing of Fig. 6 from the secondary storage device 403 to the primary storage device 402 and execute the program. In another aspect, some or all of the processing may be realized as a combination of circuit elements configured to perform the processing.
[0085] In step S605, CPU 401 acquires a command from terminal 101. In one aspect, CPU 401 may receive volume information, the ID of terminal 101, the recognition accuracy, and information on a combination of these together with the command. In another aspect, when control device 100 has the configuration shown in Fig. 3, CPU 401 may receive voice information from terminal 101. In that case, CPU 401 executes voice recognition processing and command search processing before the processing of step S610.
[0086] In step S607, CPU 401 determines whether the received command is a specific command (such as exercise processing). If CPU 401 determines that the received command is a specific command (YES in step S607), it transfers control to step S610. If not (NO in step S607), CPU 401 transfers control to step S620. The process of step S607 corresponds to the seventh command selection method described with reference to FIG. 2.
[0087] In step S610, CPU 401 determines whether the command recognition accuracy is equal to or greater than a predetermined threshold. If CPU 401 determines that the command recognition accuracy is equal to or greater than a predetermined threshold (YES in step S610), it transfers control to step S615. If not (NO in step S610), CPU 401 transfers control to step S660.
[0088] In step S615, CPU 401 determines whether there is a command with the earliest time stamp. For example, when control device 100 receives commands A and B within a certain time interval, if the time stamp of command A is earlier than the time stamp of command B, command A becomes the command with the earliest time stamp. If the time stamp of command A is equal to the time stamp of command B, there is no command with the earliest time stamp.
[0089] If CPU 401 determines that there is a command with the earliest time stamp (YES in step S615), it transfers control to step S617. If not (NO in step S615), CPU 401 transfers control to step S625.
[0090] In step S617, CPU 401 selects the command with the earliest time stamp as the command to be executed. The processes in steps S610 to S617 correspond to the first, second and sixth command selection methods described with reference to FIG.
[0091] In step S620, the CPU 401 causes the projector or the external device 130 to execute an operation associated with the command. In one aspect, the control device 100 may transmit the command to a control device of the projector or the external device 130 via the communication interface 407. Alternatively, the control device 100 may transmit a control signal for causing the projector or the control device of the external device 130 to execute an operation associated with the command via the communication interface 407.
[0092] In step S625, CPU 401 determines whether or not there is speech at or above a threshold (a predetermined volume). CPU 401 may determine whether or not the volume of the speech corresponding to the command is at or above a threshold, based on volume information received together with the command. In one aspect, the presence of speech at or above the threshold means that a command associated with volume information of a value at or above the threshold has been received. In another aspect, when control device 100 has a voice recognition function, the presence of speech at or above the threshold means that control device 100 has received voice information of a volume at or above the threshold.
[0093] If CPU 401 determines that there is speech equal to or greater than the threshold (YES in step S625), it transfers control to step S630. If not (NO in step S625), CPU 401 transfers control to step S645.
[0094] In step S630, CPU 401 determines whether or not there is a certain amount of the same utterance within a certain time. In one aspect, when control device 100 receives command A from terminal 101A and command B from terminal 101B, and commands A and B are the same command, CPU 401 may determine that there is the same utterance. This is because the fact that terminals 101A and 101B have selected the same command means that terminals 101A and 101B have acquired voice information with the same or similar content. In another aspect, when control device 100 has a voice recognition function, CPU 401 may determine whether or not there is the same utterance based on text information obtained from each piece of voice information received by control device 100.
[0095] If CPU 401 determines that a certain amount of the same utterance exists within the certain time period (YES in step S630), CPU 401 transfers control to step S635. If not (NO in step S630), CPU 401 transfers control to step S640.
[0096] In step S635, CPU 401 randomly selects a command to be executed from the plurality of received commands. In step S640, CPU 401 selects the command with the maximum volume from the plurality of received commands. The command with the maximum volume is a command with the maximum value of volume information associated with the command. The processes in steps S625 to S640 correspond to the third command selection method described with reference to FIG. 2.
[0097] In step S645, CPU 401 determines whether or not there is a frequently used terminal 101. In one aspect, CPU 401 may determine, based on the IDs and past communication histories of terminals 101, the terminal 101 that has transmitted the most commands or the terminal 101 that has transmitted a certain number of commands or more.
[0098] If CPU 401 determines that a frequently used terminal 101 is present (YES in step S645), it transfers control to step S650. If not (NO in step S645), CPU 401 transfers control to step S655.
[0099] In step S650, CPU 401 selects a command received from terminal 101 that is used frequently as a command to be executed. In step S655, CPU 401 randomly selects a command to be executed from the multiple commands received. The processes in steps S645 to S655 correspond to the fourth command selection method described with reference to FIG. 2.
[0100] In step S660, CPU 401 determines whether or not a certain amount of the same utterances have been detected. In one aspect, when control device 100 receives command A from terminal 101A and command B from terminal 101B, and commands A and B are the same command, CPU 401 may determine that the same utterances have occurred. In another aspect, when control device 100 has a voice recognition function, CPU 401 may determine whether or not the same utterances have occurred based on text information obtained from each piece of voice information received by control device 100.
[0101] If CPU 401 determines that a certain amount or more of the same utterances have been present within a certain period of time (YES in step S660), CPU 401 transfers control to step S665, otherwise (NO in step S660), CPU 401 ends the process.
[0102] In step S665, CPU 401 selects the command with the earliest time stamp from among the multiple identical commands (multiple identical utterances) as the command to be executed. The processes in steps S660 and S655 correspond to the fifth command selection method described with reference to FIG. 2.
[0103] As described above, when the planetarium system 10 according to the present embodiment receives identical commands within a certain period of time, it selects only the command with the earliest time stamp and executes that command. In this way, the planetarium system 10 can suppress duplicate execution of the same command caused by echoes from the dome, etc. Note that the application of the contents disclosed in the present embodiment is not limited to planetarium systems. In a certain aspect, the contents disclosed in the present embodiment can be applied to any device used in movie theaters, amusement facilities, etc.
[0104] The embodiments disclosed herein should be considered to be illustrative and not restrictive in all respects. The scope of the present disclosure is indicated by the claims, not by the above description, and is intended to include all modifications within the meaning and scope of the claims. In addition, the disclosure contents described in the embodiments and each modified example are intended to be implemented, as far as possible, either alone or in combination. [Explanation of symbols]
[0105] 10 Planetarium system, 100, 113 Control device, 101 Terminal, 103 Machine control unit, 106 Optical planetarium projector, 107, 211 Equipment control unit, 108 Motor control unit, 109 Motor, 110 Control unit, 114 Digital control unit, 115 Digital planetarium projector, 116 Projection control unit, 117 Projection unit, 130 External device, 201 Operation unit, 202 Voice input unit, 203 Voice analysis engine, 204 Command search unit, 205 Command DB, 206 Search result display unit, 207 Command input unit, 208 Command transmission unit, 209 Command reception unit, 210 Command selection unit, 303 Voice transmission unit, 304 Voice reception unit, 400 Device, 401 CPU, 402 Primary storage device, 403 Secondary storage device, 404 External device interface, 405 input interface, 406 output interface, 407 communication interface, 408 touch panel, 409 microphone, 410 keyboard, 411 mouse, 412 speaker, 413 display, 500 dome.
Claims
1. A plurality of terminals each having a voice recognition function; a control device for controlling the projector, The control device includes: receiving a first command for the projector from a first terminal; receiving a second command for the projector from a second terminal; Temporarily storing the first command and the second command in a storage unit; A control system which, when the first command and the second command stored in the memory unit are the same command, causes the projector to execute only an operation associated with the first command when the reception timing of the first command is earlier than the reception timing of the second command.
2. The terminal includes: A command table including a plurality of commands and a keyword associated with each of the plurality of commands is stored; Acquire audio information, generating first text information from the speech information by the speech recognition function; searching the command table using the first text information as a search word; selecting the first command associated with the first keyword included in the command table; Sending the first command to the control device; the first command includes information on recognition accuracy for the first keyword in the first text information, The control system of claim 1 , wherein causing the projector to execute only operations associated with the first command includes causing the projector to execute operations associated with the first command when the recognition accuracy of the first command is equal to or greater than a threshold value.
3. 3. The control system according to claim 2, wherein when the recognition accuracy of each of the first command and the second command is less than the threshold, and when the first command and the second command are the same command, the control device causes the projector to execute only the operation associated with the first command.
4. A control system according to any one of claims 1 to 3, wherein the process of causing the projector to execute only the operation associated with the first command is executed when the difference between the timing of receiving the first command and the timing of receiving the second command is within a predetermined time.
5. the first command and the second command include volume information; The control system according to any one of claims 1 to 4, wherein when the first command and the second command are the same command, and when the reception timing of the first command and the reception timing of the second command are the same, the control device causes the projector to execute only the operation associated with the command having the larger value of the volume information.
6. A control system according to any one of claims 1 to 5, wherein when the first command and the second command are the same command, and when the timing of receiving the first command is equal to the timing of receiving the second command, the control device causes the projector to execute only the operation associated with the first command based on the fact that the control device has received more commands from the first terminal than from the second terminal in the past.
7. A control system according to any one of claims 1 to 6, wherein the process of causing the projector to execute only operations associated with the first command is executed when the first command and the second command are specific commands for the projector, and is not executed when the first command and the second command are not the specific commands.
8. A control system according to any one of claims 1 to 7, wherein when the control device receives an identical command from multiple terminals a certain number of times or more, the control device causes the projector to execute only the operation associated with the command received earliest.
9. The Communications Department and a secondary storage unit that stores a command table including a plurality of commands for the projector and keywords associated with each of the plurality of commands; A control unit; a primary storage unit that temporarily stores data referenced by the control unit, The communication unit is receiving first audio information of the projector from a first terminal; receiving second audio information of the projector from a second terminal; The control unit is acquiring first text information and second text information from the first voice information and the second voice information stored in the primary storage unit by a voice recognition function; searching the command table using the first text information as a search word to obtain a first command; searching the command table using the second text information as a search word to obtain a second command; A control device that, when the first command and the second command are the same command, causes the projector to execute only the operation associated with the first command when the timing of receiving the first audio information is earlier than the timing of receiving the second audio information.
10. The control device according to claim 9, wherein causing the projector to execute only operations associated with the first command includes causing the projector to execute operations associated with the first command when recognition accuracy of the first voice information for a keyword included in the command table is equal to or greater than a threshold value.
11. The control device according to claim 10, wherein when the recognition accuracy of each of the first voice information and the second voice information is less than the threshold, and when the first command and the second command are the same command, the control device causes the projector to execute only an operation associated with the first command.
12. A control device as described in any one of claims 9 to 11, wherein the process of causing the projector to execute only operations associated with the first command is executed when the difference between the timing of receiving the first audio information and the timing of receiving the second audio information is within a predetermined time.
13. the first audio information and the second audio information include volume information; A control device according to any one of claims 9 to 12, wherein when the first command and the second command are the same command, and when the timing of receiving the first audio information is equal to the timing of receiving the second audio information, the control device causes the projector to execute only an operation associated with the command obtained from the audio information having the larger value of the volume information.
14. A control device as described in any one of claims 9 to 13, wherein when the first command and the second command are the same command, and when the timing of receiving the first audio information is equal to the timing of receiving the second audio information, the control device causes the projector to execute only the operation associated with the first command based on the fact that more audio information has been received from the first terminal in the past than from the second terminal.
15. A control device as described in any one of claims 9 to 14, wherein the process of causing the projector to execute only operations associated with the first command is executed when the first command and the second command are specific commands, and is not executed when the first command and the second command are not the specific commands.
16. A control device as described in any one of claims 9 to 15, which, when the same voice information is received a certain number of times or more from multiple terminals, causes the projector to execute only the operation associated with the command obtained from the voice information received earliest.
Citation Information
Patent Citations
Voice recognizing device
JP1993040498A
Operation system for planetarium theater
JP1999296073A
Facilities control system
JP2000310999A
Planetarium and program for controlling it
JP2002278445A
Electronic equipment and voice operating method
JP2004301895A
