Measuring apparatus, measuring method, measuring program, and measuring system

Abstract

To provide a technology that simply measures a difference in arrival timing of sound and light.SOLUTION: A measuring apparatus 50 includes a sound pickup part 52, a light receiving part 54, and a generation part 56. The sound pickup part 52 detects a sound and converts the detected sound into a first signal that is an electrical signal. The light receiving part 54 detects light and converts detected light into a second signal that is an electrical signal. The generation part 56 generates difference information indicating a difference between timing of detecting a sound and timing of detecting light on the basis of the first signal and the second signal.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present invention relates to a measurement device, a measurement method, a measurement program, and a measurement system. [Background technology]

[0002] In venues such as concert halls and theaters, sound and light are output in a synchronized manner to be perceived by audience members and other viewers. In particular, in recent years, with the widespread use of LED (Light Emitting Diode) lighting as a light source, it has become common to flash light at higher frequencies. Such synchronized sound and light may be output using data such as content recorded with audio and video signals. Patent Document 1 describes a technology for generating data in which audio and video signals are converted into files, and verifying whether the file conversion process is performed correctly. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2011-223365 Summary of the Invention [Problem to be solved by the invention]

[0004] Even when sound and light are intended to be perceived simultaneously by the viewer, they may be perceived by the viewer at different times. This is mainly due to a difference in the output timing of sound and light. Specifically, the difference in time between when content data is processed and output as sound and when the content data is processed and output as light can be a problem. Patent Document 1 describes a filing device that performs data processing taking into account the time required for filed data to be decoded.

[0005] However, the cause of the discrepancy in the output timing of sound and light is not limited to the time difference in data processing within a single device. For example, the audio and video equipment installed in a venue may each be composed of multiple devices connected to each other for data communication. Furthermore, the devices that make up each of these audio and video equipment may differ from venue to venue. The discrepancy in the output timing of sound and light may also be caused by factors such as the time difference in data communication between the devices that make up each of these audio and video equipment. Furthermore, the time difference between the time it takes for the output sound and light to reach the viewer may also have an impact. It is difficult to adjust the output timing of sound and light taking these effects into account each time the audio and video equipment is configured.

[0006] The present invention has been made in view of the above circumstances, and one of its exemplary purposes is to provide a technique for easily measuring the difference in arrival timing between sound and light. [Means for solving the problem]

[0007] One aspect of the present invention is a measurement device that includes a sound collection unit that detects sound and converts the detected sound into a first electrical signal, a light receiving unit that detects light and converts the detected light into a second electrical signal, and a generation unit that generates deviation information indicating a deviation between the timing at which the sound is detected and the timing at which the light is detected based on the first and second signals.

[0008] The sound pickup unit may detect output sound output from an external sound output device, and the light receiving unit may detect output light output from an external light output device.

[0009] The sound pickup unit may detect output sound at a position distant from the sound output device.

[0010] The generation unit may further generate a control signal for controlling at least one of the timing at which the output sound is output from the sound output device and the timing at which the output light is output from the light output device, based on the deviation information. The device may further include an output unit for outputting the control signal.

[0011] The generation unit may generate, as the control signal, a signal that controls the timing at which the output sound is detected by the sound collection unit to be later than the timing at which the output light is detected by the light receiving unit.

[0012] The generation unit may generate, as a control signal, a signal that controls the timing at which the output sound is detected by the sound collection unit to be delayed from the timing at which the output light is detected by the light receiving unit by a time corresponding to the value obtained by multiplying the distance between the sound output device and the sound collection unit by a coefficient that increases as the distance between the sound output device and the sound collection unit becomes closer.

[0013] The generating unit may generate display information showing a waveform representing the first signal and a waveform representing the second signal with their time axes aligned, and the display information may include deviation information. The system may further include an output unit that outputs the display information.

[0014] Another aspect of the present invention is a measurement method including the steps of detecting sound and converting the detected sound into a first electrical signal, detecting light and converting the detected light into a second electrical signal, and generating information indicating a difference between the timing at which the sound is detected and the timing at which the light is detected based on the first and second signals.

[0015] Another aspect of the present invention is a measurement program that causes a computer to execute the following steps: detecting sound and converting the detected sound into a first electrical signal; detecting light and converting the detected light into a second electrical signal; and generating information indicating a difference between the timing at which the sound was detected and the timing at which the light was detected based on the first and second signals.

[0016] Another aspect of the present invention is a measurement system comprising: a sound output device that outputs output sound; a light output device that outputs output light; and a measurement device that detects the output sound and the output light, wherein the measurement device comprises: a sound collection unit that converts the detected output sound into a first electrical signal; a light receiving unit that converts the detected output light into a second electrical signal; a generation unit that generates deviation information indicating a deviation between the timing at which the output sound is detected and the timing at which the output light is detected based on the first and second signals, and generates a control signal based on the deviation information to control at least one of the timing at which the output sound is output from the sound output device and the timing at which the output light is output from the light output device; and an output unit that outputs the control signal.

[0017] Any combination of the above components, and any transformation of the present invention into a method, device, system, recording medium, computer program, etc., are also valid aspects of the present invention. [Effects of the Invention]

[0018] According to the present invention, it is possible to provide a technique for easily measuring the difference in arrival timing of sound and light. [Brief explanation of the drawings]

[0019] [Figure 1] 1 is a block diagram showing a schematic configuration of a measurement system according to an embodiment of the present disclosure. [Figure 2] FIG. 2 is a diagram illustrating an example of content. [Figure 3] 2 is a diagram showing an example of display information generated by the measurement device shown in FIG. 1. FIG. [Figure 4] 1. FIG. 4 is a sequence diagram showing a first example of the processing flow of each device included in the measurement system shown in FIG. [Figure 5] 1. FIG. 4 is a sequence diagram showing a second example of the processing flow of each device included in the measurement system shown in FIG. [Figure 6] FIG. 2 is a diagram illustrating an example of the distance between a sound output device and a sound collection unit. [Figure 7]7 is a flowchart showing an example in which a generating unit generates different control signals according to the distance shown in FIG. 6. DETAILED DESCRIPTION OF THE INVENTION

[0020] [Embodiment] Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. Specific numerical values and the like shown in the embodiments are merely examples for facilitating understanding of the invention, and do not limit the present invention unless otherwise specified. In the description of the drawings, identical elements are given the same reference numerals, and redundant explanations are omitted as appropriate. In addition, elements not directly related to the present invention are omitted from the drawings.

[0021] FIG. 1 is a block diagram showing a schematic configuration of a measurement system 1 according to an embodiment of the present disclosure. The measurement system 1 includes a control device 10, a sound output device 20 that outputs sound, a light output device 30 that outputs light, and a measurement device 50 that detects the sound and the light. Hereinafter, the sound output from the sound output device 20 will also be referred to simply as "output sound." Similarly, the light output from the light output device 30 will also be referred to simply as "output light." The measurement system 1 is a system that measures the difference between the timing at which the measurement device 50 detects the sound output from the sound output device 20 and the timing at which the measurement device 50 detects the light output from the light output device 30. In the example shown in this embodiment, the sound output device 20 and the light output device 30 are described as devices installed on a stage in a concert hall, theater, or the like, and intended to be perceived by viewers, such as spectators, in the auditorium. However, the devices are not limited to such applications.

[0022] Each functional block shown in this embodiment can be realized, for example, by a combination of hardware and software. The hardware of each functional block included in the measurement system 1 is realized by elements and mechanical devices, including processors such as a computer's CPU (Central Processing Unit) and GPU (Graphics Processing Unit), and memories such as ROM (Read Only Memory) and RAM (Random Access Memory). The software of each functional block included in the measurement system 1 is realized by a computer program or the like. This software can be provided by being recorded on a computer-readable recording medium, or can be transmitted and received with a server via a wired or wireless network, or can be transmitted and received as data broadcasting via terrestrial or satellite digital broadcasting.

[0023] Control device 10 is communicatively connected to sound output device 20 and light output device 30, and controls the timing at which sound output device 20 outputs output sound and the timing at which light output device 30 outputs output light. Control device 10 may also include a playback device such as a DVD (Digital Versatile Disc) player that plays content such as videos containing sound information and light information. In this case, control device 10 transmits sound information included in the content to be played to sound output device 20, and transmits light information included in the content to be played to light output device 30. As a result, control device 10 causes sound output device 20 to output output sound and light output device 30 to output output light with content and timing according to the content to be played.

[0024] In the example shown in this embodiment, the content is information generated so that sound and light are continuously presented to the viewer at synchronized timing. The control device 10 may play content that has been generated in advance, or may play content that is being generated in real time. An example of content that is generated in real time is content that is generated to match the rhythm of a performance by a performer on stage.

[0025] FIG. 2 is a diagram schematically illustrating an example of content. The content shown in FIG. 2 is measurement content generated to more reliably perform measurements using the measurement system 1. As shown in FIG. 2, the content includes video information and sound information. The video information includes information that alternates between a period in which 59 frames of a black image are displayed and a period in which one frame of a white image is displayed. The video information is in the NTSC (National Television Standards Committee) format, and displays images at 30 frames per second. The sound information includes information that outputs a 500 Hz square wave for 33 milliseconds at the same timing as the period in which the white image is displayed in the video information, i.e., for the same period of time that the white image is displayed.

[0026] 1, the control device 10 may adjust the output timing of sound information and light information included in the content based on a control signal received from a measuring device 50 (described later). Adjustment of the output timing of sound information and light information will be described in detail later.

[0027] The sound output device 20 outputs an output sound to the outside in response to control from the control device 10. The sound output device 20 includes, for example, a speaker. The sound output device 20 may also include acoustic equipment other than a speaker, such as an amplifier, an effector, or a mixer. The sound output device 20 may also be an acoustic facility made up of multiple devices. In the example shown in this embodiment, the sound output device 20 includes a speaker installed on the stage, and outputs an output sound mainly in the direction where the audience is expected to be present.

[0028] The light output device 30 outputs output light to the outside in response to control from the control device 10. The light output device 30 may include an image projection device such as a projector and a projection target such as a screen. In this case, the output light may include direct light from the image projected from the image projection device and indirect light from the image reflected from the projection target. The light output device 30 may include a light source such as LED lighting. In this case, the output light may include direct light from the light source and scattered light scattered by smoke generated around the stage. The light output device 30 may include a display device such as an LED display. In this case, the output light may include light from the image from the display device. The light output device 30 may also be a video system composed of multiple devices. Using an LED as a light source for the light output device 30 is preferable because it shortens the response time from the input of a signal from the control device 10 to the output of output light.

[0029] As described above, the content is information generated so that sound and light are presented to the viewer at continuous, synchronized timing. Therefore, the sound output by sound output device 20 and the light output by light output device 30 include those that are perceived by the viewer simultaneously.

[0030] The measuring device 50 includes a sound pickup unit 52 , a light receiving unit 54 , a generation unit 56 , a communication unit 58 , a display unit 60 , and a storage unit 62 .

[0031] The sound collection unit 52 detects sound and converts the detected sound into a first signal, which is an electrical signal. The sound collection unit 52 includes, for example, a microphone. The sound collection unit 52 particularly detects output sound output from the external sound output device 20. The sound collection unit 52 is disposed at a position separated from the sound output device 20 and detects the output sound from the sound output device 20 at that position. The sound collection unit 52 may include an omnidirectional microphone such as a sound collection microphone, or may include a directional microphone such as a gun microphone. When the sound collection unit 52 includes a directional microphone, the sound collection unit 52 may be disposed in an orientation that most strongly collects sound from the direction in which the sound output device 20 is located. The sound collection unit 52 may be disposed at a position where, for example, an audience or other viewers are expected to be present.

[0032] The light-receiving unit 54 detects light and converts the detected light into a second signal, which is an electrical signal. The light-receiving unit 54 includes a photodetector such as a photodiode. The light-receiving unit 54 particularly detects output light output from the external light output device 30. The light-receiving unit 54 may convert the detected light into an electrical signal and then amplify the electrical signal using an amplifier or the like to generate the second signal. The location of the light-receiving unit 54 is not particularly limited, but the light-receiving unit 54 may be located, for example, within a predetermined range that includes the location of the light output device 30 and a location where a viewer is expected to be present. Because the speed of light propagating through air is sufficiently faster than the speed of sound, if the light-receiving unit 54 is located within the predetermined range, the timing at which the light-receiving unit 54 detects the output light is approximately the same as the timing at which the output light reaches the location where a viewer is expected to be present.

[0033] The generation unit 56 generates display information that shows, with the time axes aligned, a waveform indicating the first signal converted from sound by the sound collection unit 52 and a waveform indicating the second signal converted from light by the light receiving unit 54. The display information includes deviation information that indicates the deviation between the timing at which the sound collection unit 52 detects sound and the timing at which the light receiving unit 54 detects light. In other words, the generation unit 56 generates the deviation information based on the first signal and the second signal.

[0034] Fig. 3 is a diagram showing an example of display information generated by the measurement device 50. The display information shown in Fig. 3 is generated in response to detection of output sound and output light based on the content shown in Fig. 2 above. The upper part of Fig. 3 shows the electrical signal converted by the light receiving unit 54, and the lower part of Fig. 3 shows the electrical signal converted by the sound collecting unit 52. In Fig. 3, the horizontal axis represents the time axis, and the vertical axis represents the signal value.

[0035] As shown in FIG. 3, after the waveform S1 of the first signal is generated, the waveform S2 of the second signal is generated. Here, the waveform S1 of the first signal and the waveform S2 of the second signal are each composed of multiple consecutive square waves. The first signal is generated based on the output sound from the sound output device 20. The second signal is generated based on the output light from the light output device 30. The timing at which the first square wave included in the waveform S1 of the first signal fully rises is defined as the timing t1 at which the sound collection unit 52 detects the output sound. The timing at which the waveform S2 of the second signal fully rises for the first time is defined as the timing t2 at which the light receiving unit 54 detects the output light. In this case, the time difference Δt between the timing t1 at which the sound collection unit 52 detects the output sound and the timing t2 at which the light receiving unit 54 detects the output light is shown in FIG. 3. In this way, the display information includes information on the time difference Δt.

[0036] 1 , the generation unit 56 further generates a control signal for controlling at least one of the timing at which the output sound is output from the sound output device 20 and the timing at which the output light is output from the light output device 30, based on the delay information. For example, if the delay information indicates that the timing at which the sound collection unit 52 detects the output sound occurs before the timing at which the light receiving unit 54 detects the output light, the control signal may be a signal for controlling the timing at which the output light is output from the light output device 30 to be earlier than the timing at which the output sound is output from the sound output device 20. Alternatively, if the delay information indicates that the timing at which the sound collection unit 52 detects the output sound occurs after the timing at which the light receiving unit 54 detects the output light, the control signal may be a signal for controlling the timing at which the output light is output from the light output device 30 to be later than the timing at which the output sound is output from the sound output device 20.

[0037] Communication unit 58 outputs a control signal to control device 10. Communication unit 58 may output the control signal directly to at least one of sound output device 20 and light output device 30. The output of the control signal from communication unit 58 may be via wired communication or wireless communication. Known communication techniques may be used for these communications.

[0038] The display unit 60 displays and outputs the display information. The display unit 60 may be any display device. The communication unit 58 and the display unit 60 function as an output unit. The output unit may output the display information to an external display device.

[0039] The storage unit 62 stores programs and the like used to control the measuring device 50. The stored information of the programs and the like stored in the storage unit 62 is used by the generating unit 56. The programs and the like used by the generating unit 56 may be input from the outside via the communication unit 58. In this case, the measuring device 50 does not necessarily have to include the storage unit 62. Although not shown in the figure, the measuring device 50 may also include an operation unit and the like that accepts user operations.

[0040] 4 is a sequence diagram showing a first example of the processing flow of each device included in measurement system 1. When control device 10 plays content (S10), control device 10 transmits sound information included in the played content to sound output device 20 (S12), and also transmits light information included in the played content to light output device 30 (S14). The processing of step S12 and the processing of step S14 are performed substantially simultaneously, but depending on the difference between the processing time of the sound information and the processing time of the light information, one of the processes may be performed first.

[0041] Sound output device 20 outputs sound based on the received sound information to the outside (S16). Measurement device 50 uses sound collection unit 52 to detect the output sound and convert it into a first signal (S18). Thereafter, light output device 30 outputs light based on the received light information to the outside (S20). Measurement device 50 uses light receiving unit 54 to detect the output light and convert it into a second signal (S22). In the first example shown in FIG. 4, the processing time in light output device 30 is longer than the processing time in sound output device 20, and the processing of step S20 is executed later than the processing of step S16.

[0042] The measurement device 50 uses the generation unit 56 to generate deviation information based on the first signal and the second signal (S24). The measurement device 50 uses the generation unit 56 to generate a control signal based on the deviation information (S26). The measurement device 50 uses the communication unit 58 to transmit the control signal to the control device 10 (S28). The control device 10 adjusts the output timing of the sound information and light information included in the content based on the received control signal (S30). This allows the control device 10 to control the output timing of the output sound output from the sound output device 20 and the output light output from the light output device 30 from the next time onwards.

[0043] FIG. 5 is a sequence diagram showing a second example of the processing flow of each device included in measurement system 1. The second example shown in FIG. 5 differs from the first example shown in FIG. 4 in the execution order of steps S16 to S22. That is, in the second example shown in FIG. 5, after the processing of step S14, light output device 30 outputs light based on the received optical information to the outside (S20). Measurement device 50 detects the output light using light receiving unit 54 and converts it into a second signal (S22). Thereafter, sound output device 20 outputs sound based on the received sound information to the outside (S16). Measurement device 50 detects the output sound using sound collection unit 52 and converts it into a first signal (S18). Thus, in the second example shown in FIG. 5, the processing time of light output device 30 is shorter than the processing time of sound output device 20, and the processing of step S20 is executed earlier than the processing of step S16.

[0044] In the above example, the control signal may be a signal that controls the timing at which the output sound is detected by the sound collection unit 52 and the timing at which the output light is detected by the light receiving unit 54 to be simultaneous. However, based on the following findings, the control signal may also be a signal that controls the timing at which the output sound is detected by the sound collection unit 52 to be later than the timing at which the output light is detected by the light receiving unit 54.

[0045] Reference 1 reports that in order to synchronize video and sound in animation, it is effective to delay the sound by 2 to 3 frames, or 80 to 125 milliseconds in time, compared to the video. Reference 2 also reports that when it is desired to present light and sound simultaneously to a viewer at a certain timing, presenting the sound 60 milliseconds later than the light will allow the viewer to perceive the light and sound simultaneously.

[0046] (References) 1.Williams, R. (2002). The Animator's Survival Kit (Faler and Faler, London), pp. 310-311. 2.Yoichi Sugita, Yoiti Suzuki “Implicit estimation of sound-arrival time” Nature, 421(6926), p.911 (2003).

[0047] Based on the reports in References 1 and 2, as described above, the control signal may be a signal that controls the timing at which the output sound is detected by the sound collection unit 52 to be later than the timing at which the output light is detected by the light receiving unit 54. This makes it easier for the viewer to recognize that the output light and output sound are presented simultaneously.

[0048] In particular, based on the report in Reference 2, the control signal may be a signal that controls so that the timing at which the output sound is detected by the sound collection unit 52 is delayed from the timing at which the output light is detected by the light receiving unit 54 by a time period corresponding to the value obtained by multiplying the distance between the sound output device 20 and the sound collection unit 52 by a coefficient that increases as the distance between the sound output device 20 and the sound collection unit 52 becomes closer. Specifically, the generation unit 56 may generate the control signal by the following process.

[0049] 6 is a diagram showing an example of the distance L between the sound output device 20 and the sound collection unit 52. As shown in FIG. 6, when the sound collection unit 52 detects an output sound at a position where the viewer H is assumed to be present, the distance L between the sound output device 20 and the sound collection unit 52 is the distance L between the sound output device 20 and the viewer H.

[0050] 7 is a flowchart showing an example in which the generation unit 56 generates different control signals depending on the distance L (see FIG. 6). The generation unit 56 acquires information on the distance L between the sound output device 20 and the viewer H (S50). The information on the distance L may be input by a user operation, may be stored in advance in the storage unit 62 of the measurement device 50, or may be measured using any distance measuring means.

[0051] If the distance L is less than 20 m (Y in S52), the generation unit 56 generates a control signal that delays the timing at which the output sound is detected by the sound collection unit 52 from the timing at which the output light is detected by the light receiving unit 54 by a time (in milliseconds) corresponding to three times the value of the distance L (S54).

[0052] If the distance L is 20 m or more (N in S52) and less than 30 m (Y in S56), the generation unit 56 generates a control signal that delays the timing at which the output sound is detected by the sound collection unit 52 from the timing at which the output light is detected by the light receiving unit 54 by a time (in milliseconds) corresponding to 2.5 times the distance L (S58).

[0053] If the distance L is 30 m or more (N in S56) and less than 40 m (Y in S60), the generation unit 56 generates a control signal that delays the timing at which the output sound is detected by the sound collection unit 52 from the timing at which the output light is detected by the light receiving unit 54 by a time (in milliseconds) corresponding to twice the value of the distance L (S60).

[0054] If the distance L is 40 m or more (N in S60), the generation unit 56 generates a control signal that delays the timing at which the output sound is detected by the sound collection unit 52 by 60 milliseconds from the timing at which the output light is detected by the light receiving unit 54 (S60).

[0055] As described above, the measuring device 50 according to this embodiment includes a sound collection unit 52, a light receiving unit 54, and a generation unit 56. The sound collection unit 52 detects sound and converts the detected sound into a first electrical signal. The light receiving unit 54 detects light and converts the detected light into a second electrical signal. The generation unit 56 generates deviation information indicating the deviation between the timing at which the sound is detected and the timing at which the light is detected, based on the first and second signals. This allows the measuring device 50 to generate information on the deviation between the timing at which the sound is detected and the timing at which the light is detected, based on the electrical signals converted from the detected sound and the electrical signals converted from the detected light. This allows the measuring device 50 to easily measure the deviation between the arrival timing of sound and light.

[0056] Furthermore, in the measuring device 50 according to this embodiment, the sound collection unit 52 may detect output sound output from the external sound output device 20. The light receiving unit 54 may detect output light output from the external light output device 30. This allows the measuring device 50 to easily measure the difference in arrival timing between the output sound and output light outside the sound output device 20 and light output device 30.

[0057] Furthermore, in the measuring device 50 according to this embodiment, the sound pickup unit 52 may detect the output sound at a position distant from the sound output device 20. This allows the measuring device 50 to detect the output sound at a position a predetermined distance away from the sound output device 20, for example, a position where a viewer is assumed to be present. Therefore, the measuring device 50 can easily measure the lag in the timing at which the output sound and output light reach the viewer.

[0058] Furthermore, in the measurement device 50 according to this embodiment, the generation unit 56 may further generate a control signal for controlling at least one of the timing at which output sound is output from the sound output device 20 and the timing at which output light is output from the light output device 30, based on the deviation information, and the measurement device 50 may further include an output unit for outputting the control signal. This allows the measurement device 50 to control the timing of output from at least one of the sound output device 20 and the light output device 30, based on the measured deviation information.

[0059] Furthermore, in the measuring device 50 according to this embodiment, the generation unit 56 may generate, as a control signal, a signal that controls the timing at which the output sound is detected by the sound collection unit 52 to be later than the timing at which the output light is detected by the light receiving unit 54. This allows the viewer to easily recognize that the output light and output sound are presented simultaneously, for example, when the sound collection unit 52 detects the output sound at a position where a viewer is assumed to be present, because the output sound reaches the viewer later than the output light.

[0060] Furthermore, in the measurement device 50 according to this embodiment, the generation unit 56 may control, as a control signal, to delay the timing at which the output sound is detected by the sound collection unit 52 from the timing at which the output light is detected by the light receiving unit 54 by a time corresponding to a value obtained by multiplying the distance between the sound output device 20 and the sound collection unit 52 by a coefficient that increases as the distance between the sound output device 20 and the sound collection unit 52 becomes shorter. This makes it easier for the viewer to recognize that the output light and the output sound are presented simultaneously.

[0061] The measurement system 1 according to this embodiment includes a sound output device 20 that outputs output sound, a light output device 30 that outputs output light, and a measurement device 50 that detects the output sound and the output light. The measurement device 50 includes a sound collection unit 52, a light receiving unit 54, a generation unit 56, and an output unit. The sound collection unit 52 converts the detected output sound into a first electrical signal. The light receiving unit 54 converts the detected output light into a second electrical signal. The generation unit 56 generates deviation information indicating a deviation between the timing at which the output sound is detected and the timing at which the output light is detected based on the first and second signals, and generates a control signal based on the deviation information to control at least one of the timing at which the sound is output from the sound output device 20 and the timing at which the output light is output from the light output device 30. The output unit outputs the control signal. This allows measurement system 1 to control the timing of output from at least one of sound output device 20 and light output device 30 based on the difference between the timing at which output sound output from sound output device 20 reaches measurement device 50 and the timing at which output light output from light output device 30 reaches measurement device 50. Therefore, measurement system 1 can easily measure the difference in the arrival timing of sound and light, and can use the information on the measured difference in arrival timing to control the output timing of sound and light from the next time onwards.

[0062] The present invention has been described above based on the embodiments. These embodiments are merely examples, and it will be understood by those skilled in the art that various modifications are possible in the combination of the components and treatment processes, and that such modifications are also within the scope of the present invention.

[0063] For example, in the present embodiment, the sound output device 20 outputs an output sound and the light output device 30 outputs an output light based on content played by the control device 10. However, the sound output device 20 may output an output sound regardless of the content, and the light output device 30 may output an output light regardless of the content. Furthermore, the sound output device 20 may directly adjust the output timing of the output sound based on a control signal from the measurement device 50, and the light output device 30 may directly adjust the output timing of the output light based on a control signal from the measurement device 50. In this case, the measurement system 1 does not necessarily have to include the control device 10.

[0064] An example of the sound output device 20 outputting output sound regardless of content is when the sound produced by a performer such as a musical instrument player or singer is acquired by a microphone or the like included in the sound output device 20 and output from a speaker included in the sound output device 20. An example of the sound output device 20 directly adjusting the output timing of the output sound based on the control signal is when the sound output device 20 adjusts the time from when the sound is acquired from the performer to when the output sound is output.

[0065] The measurement system 1 may include a plurality of sound output devices 20 arranged at different positions. Similarly, the measurement system 1 may include a plurality of light output devices 30 arranged at different positions. Even in this case, the measurement device 50 can generate deviation information indicating the deviation between the timing at which the output sound is detected and the timing at which the output light is detected for each combination of output sound and output light that are output to be perceived simultaneously.

[0066] The measuring device 50 may be movable. In particular, the sound collection unit 52 may be capable of detecting the output sound at any position. This allows the output sound to be detected at each of multiple positions where listeners are expected to be present. The measuring device 50 may also be equipped with multiple sound collection units 52 located at different positions, and may generate deviation information for each of the multiple sound collection units 52. Based on this multiple deviation information, the measuring device 50 may generate a control signal that minimizes the average value of the deviation between the arrival timing of the output sound and the arrival timing of the output light at multiple positions, or may determine at which position the deviation is smallest. [Explanation of symbols]

[0067] 1 measurement system, 10 control device, 20 sound output device, 30 light output device, 50 measurement device, 52 sound collection unit, 54 light receiving unit, 56 generation unit, 58 communication unit, 60 display unit, 62 memory unit.

Claims

1. a sound pickup unit that detects sound and converts the detected sound into a first signal that is an electrical signal; a light receiving unit that detects light and converts the detected light into a second signal that is an electrical signal; a generation unit that generates deviation information indicating a deviation between the timing at which the sound is detected and the timing at which the light is detected, based on the first signal and the second signal; A measuring device comprising:

2. the sound collection unit detects an output sound output from an external sound output device, the light receiving unit detects output light output from an external light output device; The measuring device according to claim 1 .

3. the sound collection unit detects the output sound at a position distant from the sound output device; The measuring device according to claim 2 .

4. the generation unit further generates a control signal for controlling at least one of a timing at which the output sound is output from the sound output device and a timing at which the output light is output from the light output device, based on the deviation information; further comprising an output unit that outputs the control signal; The measuring device according to claim 3 .

5. the generation unit generates, as the control signal, a signal for controlling the timing at which the output sound is detected by the sound collection unit to be later than the timing at which the output light is detected by the light receiving unit.

5. The measuring device according to claim 4.

6. the generation unit generates, as the control signal, a signal that controls the timing at which the output sound is detected by the sound collection unit to be delayed from the timing at which the output light is detected by the light receiving unit by a time period corresponding to a value obtained by multiplying the distance between the sound output device and the sound collection unit by a coefficient that increases as the distance between the sound output device and the sound collection unit becomes shorter. The measuring device according to claim 5 .

7. the generation unit generates display information showing a waveform representing the first signal and a waveform representing the second signal with time axes aligned, the display information including the deviation information; further comprising an output unit that outputs the display information; 4. The measuring device according to claim 1.

8. Detecting sound and converting the detected sound into a first signal that is an electrical signal; detecting light and converting the detected light into a second signal, which is an electrical signal; generating information indicating a difference between the timing at which the sound is detected and the timing at which the light is detected based on the first signal and the second signal; Measurement methods including:

9. Detecting sound and converting the detected sound into a first signal that is an electrical signal; detecting light and converting the detected light into a second signal, which is an electrical signal; generating information indicating a difference between the timing at which the sound is detected and the timing at which the light is detected based on the first signal and the second signal; A measurement program that causes a computer to execute the above.

10. a sound output device that outputs an output sound; a light output device that outputs output light; a measuring device that detects the output sound and the output light, The measuring device is a sound pickup unit that converts the detected output sound into a first signal that is an electrical signal; a light receiving unit that converts the detected output light into a second signal that is an electrical signal; a generation unit that generates, based on the first signal and the second signal, deviation information indicating a deviation between the timing at which the output sound is detected and the timing at which the output light is detected, and generates, based on the deviation information, a control signal that controls at least one of the timing at which the output sound is output from the sound output device and the timing at which the output light is output from the light output device; an output unit that outputs the control signal; A measurement system comprising:

Images