Imaging device, control method, and program

Abstract

To realize a state where a sound corresponding to a voice instruction by a user is less likely recorded with moving image data in a recording medium even in a case where the user provides the voice instruction to an image capturing apparatus having a voice control function.SOLUTION: An image capturing apparatus includes: first sound input means; second sound input means different from the first sound input means; image capturing means, and control means configured to generate moving image data with sounds from moving image data generated by the image capturing means and sound data generated by the first sound input means. In a case where a sound corresponding to a voice instruction to control the image capturing apparatus is detected from sound data input to the second sound input means, the control means controls the image capturing apparatus on the basis of the voice instruction.SELECTED DRAWING: Figure 3

Description

Technical Field

[0001] The present invention relates to an imaging device capable of generating audio data and video data, a control method thereof, and a program related thereto.

Background Art

[0002] Among imaging devices, there are those having a first microphone and capable of connecting to a second microphone. Such an imaging device can generate video-with-audio data from the video data generated by the imaging unit and the audio data generated by the first microphone or the second microphone, and record the generated video-with-audio data on a recording medium. Patent Document 1 discloses an imaging device having a first microphone and capable of connecting to a second microphone.

[0003] In addition, among imaging devices, there are those having an audio control function. An imaging device having an audio control function can perform processing corresponding to an audio instruction given by a user to the imaging device.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0005] For example, when a user gives an audio instruction to an imaging device having an audio control function while the imaging device is recording video-with-audio data on a recording medium, there is a risk that the audio corresponding to the audio instruction will be recorded on the recording medium together with the video data.

[0006] Therefore, an object of the present invention is to make it difficult for the audio corresponding to an audio instruction to be recorded on a recording medium together with video data even when a user gives an audio instruction to an imaging device having an audio control function.

Means for Solving the Problem

[0007] An imaging device according to the present invention includes a first voice input means, a second voice input means different from the first voice input means, an imaging means, and a control means for generating video data with voice from the video data generated by the imaging means and the voice data generated by the first voice input means. When a voice corresponding to a voice instruction for controlling the imaging device is detected from the voice data input to the second voice input means, the control means controls the imaging device based on the voice instruction. Further, the control means determines, based on user settings, the means for receiving audio data from an external device to be either the first audio input means or the second audio input means. to do.

Advantages of the Invention

[0008] According to the present invention, even when a user gives a voice instruction to an imaging device having a voice control function, it is possible to make it difficult for the voice corresponding to the voice instruction to be recorded on a recording medium together with the video data.

Brief Description of the Drawings

[0009]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Modes for Carrying Out the Invention

[0010] Hereinafter, embodiments of the present invention will be described with reference to the drawings. However, the present invention is not limited to the following embodiments.

[0011] [First Embodiment] <Configuration of Imaging Device 100> FIG. 1 is a block diagram for explaining a configuration example of an imaging device 100 in the first embodiment. In the first embodiment and other embodiments, a case where the imaging device 100 is an electronic device operable as a digital camera will be described, but the imaging device 100 is not limited to a digital camera. For example, the imaging device 100 may be a device that operates as any one of a smartphone, a personal computer, and a tablet terminal. For example, the imaging device 100 includes a microphone 107 that operates as a first voice input means, and a communication unit 111 or a connection unit 112 that operates as a second voice input means.

[0012] The control unit 101 has hardware (for example, a processor) for executing a program stored in the memory 103. The control unit 101 controls the imaging device 100 by executing the program stored in the memory 103.

[0013] The imaging unit 102 includes, for example, a lens unit, an imaging element for converting an optical image of a subject imaged on an imaging surface through the lens unit into an electrical signal, and an image processing unit for generating still image data or moving image data from the electrical signal generated by the imaging element. As the imaging element, generally, a CMOS (Complementary Metal Oxide Semiconductor) or a CCD (Charge Coupled Device) is used. In the first embodiment and other embodiments, a series of processes of generating still image data or moving image data by the imaging unit 102 and outputting it from the imaging unit 102 are referred to as "shooting". The still image data or moving image data generated by the imaging unit 102 is recorded on the recording medium 110 in accordance with the DCF (Design rule for Camera File system) standard.

[0014] The memory 103 is a non-volatile memory that stores programs and the like executed by the control unit 101. Also, electronic sound data is stored in the memory 103. The electronic sound data stored in the memory 103 includes electronic sound data corresponding to a focusing sound output when the subject is in focus, an electronic shutter sound output when a still image shooting or a moving image shooting is instructed, and an operation sound output when the imaging device 100 is operated.

[0015] The memory 104 is a buffer memory that temporarily stores still image data or moving image data generated by the imaging unit 102, a memory that temporarily stores an image displayed on the display unit 106, and a memory used as a work area of the control unit 101 and the like. Also, the memory 104 is also used as a buffer memory that temporarily records audio data generated by the microphone 107 and audio data generated by the communication unit 111 or the connection unit 112.

[0016] The operation unit 105 is a user interface for receiving instructions from the user for the imaging device 100. The operation unit 105 includes a power switch for turning on or off the power of the imaging device 100, and a release switch for instructing still image shooting or moving image shooting. Also, the operation unit 105 includes a playback button for instructing the playback of still image data or moving image data, and a selection button for selecting the operation mode of the imaging device 100. The operation modes of the imaging device 100 include, for example, a still image shooting mode and a moving image shooting mode. Also, the touch panel formed on the display unit 106 can be included in the operation unit 105.

[0017] The operation unit 105 includes operation members (such as buttons) that can adjust the volume and the like of the sound output from the speaker 108. The control unit 101 performs a process of adjusting the volume and the like of the sound output from the speaker 108 by receiving a user operation via this operation member. The operation unit 105 further includes operation members (such as buttons) that can adjust the volume and the like of the sound output from the speaker of an external device connected via the communication unit 111 or the connection unit 112. The control unit 101 performs a process of adjusting the volume and the like of the sound output from the speaker of the external device by receiving a user operation via this operation member. The operation unit 105 further includes operation members (such as buttons) for turning on or off the wireless communication function of the communication unit 111.

[0018] The display unit 106 performs display of still image data or moving image data generated by the imaging unit 102, character display for interactive operations, and the like. Further, the control unit 101 can cause the display unit 106 to function as an electronic viewfinder by sequentially displaying the image data output from the imaging unit 102 on the display unit 106. Thereby, the imaging device 100 can provide a live view function to the user. Hereinafter, the image displayed on the display unit 106 in the live view is referred to as an LV image. The display unit 106 does not necessarily have to be built in the imaging device 100 and may be configured to be externally connected to the imaging device 100. In any case, the imaging device 100 has at least a display control function for controlling the display of the display unit 106.

[0019] The microphone 107 is a microphone device that picks up sound waves such as voices and generates voice data. When the imaging device 100 is in the video shooting mode, the control unit 101 can generate video data with voice from the video data generated by the imaging unit 102 and the voice data generated by the microphone 107 or the microphone of an external device. The video data with voice generated by the control unit 101 is recorded on the recording medium 110 by the control unit 101. When the imaging device 100 is in the still image shooting mode, the control unit 101 records the still image data generated by the imaging unit 102 on the recording medium 110. When the imaging device 100 is in the still image shooting mode, the control unit 101 can also record the still image data generated by the imaging unit 102 and the voice data generated by the microphone 107 in association with each other on the recording medium 110. In the first embodiment, the microphone 107 is a microphone that the imaging device 100 has. Note that the process of the microphone 107 generating voice data from sound waves may be partially shared by other hardware (for example, the control unit 101).

[0020] The speaker 108 is an electroacoustic transducer that can output electronic sound data. The electronic sound data may be any of music, warning sounds, focusing sounds, electronic shutter sounds, and operation sounds. These electronic sound data are stored in the memory 103. The speaker 108 can output the electronic sound data selected by the control unit 101. By listening to the sound output from the speaker 108, the user can, for example, notice that the subject is in focus, an error occurring in the imaging device 100, etc.

[0021] The power supply unit 109 can supply power to each element of the imaging device 100 under the control of the control unit 101. The power supply unit 109 has, for example, a lithium-ion battery, an alkaline manganese dry battery, or the like.

[0022] The recording medium 110 can record, for example, still image data or moving image data output from the imaging unit 102 together with audio data. The recording medium 110 is, for example, a memory card (such as an SD card, a CF card, etc.) or an auxiliary recording device (such as a hard disk drive, a solid state drive, etc.). The recording medium 110 may be configured to be detachable from the imaging device 100, or may be built into the imaging device 100. That is, the imaging device 100 only needs to have means for accessing at least the recording medium 110.

[0023] The communication unit 111 is an interface for wirelessly connecting to an external device. The control unit 101 can transmit and receive data to and from an external device via the communication unit 111. For example, the control unit 101 can transmit still image data, moving image data, or audio data recorded on the recording medium 110 to an external device via the communication unit 111. Also for example, the control unit 101 can receive audio data generated by a microphone of an external device via the communication unit 111. The audio data generated by the microphone of the external device is input from the external device to the control unit 101 via the communication unit 111. Here, the external device connected to the communication unit 111 or the connection unit 112 is a device having a microphone. The external device is, for example, an information processing device (such as a smartphone, a PC, etc.), an external microphone device, a device having a speaker and a microphone (such as an earphone microphone, a headset, etc.). In the first embodiment, the communication unit 111 includes an interface for communicating with an external device according to the Bluetooth standard. Hereinafter, communication conforming to the Bluetooth standard is referred to as Bluetooth communication. The control unit 101 performs wireless communication with an external device by controlling the communication unit 111. Note that the wireless communication method used in the communication unit 111 is not limited to a wireless communication method conforming to the Bluetooth standard, and may be, for example, a wireless communication method conforming to the IEEE802.11 standard (such as wireless LAN, etc.).

[0024] Here, Bluetooth communication will be described. The connection form of communication devices in Bluetooth communication is a star - type network with a master - slave system. Hereinafter, a communication device operating as a master is called a master device, and a communication device operating as a slave is called a slave device. The master device manages, for example, the participation of slave devices in the network and sets various parameters in the wireless connection with the slave devices. The master device can be connected to multiple slave devices simultaneously. On the other hand, a slave device connects to only one master device. In the first embodiment, for example, the imaging device 100 serves as the master device, and an external device connected to the imaging device 100 serves as the slave device.

[0025] In Bluetooth communication, before performing wireless communication, the master device needs to pair with the slave device. Pairing is a process in which the master device and the slave device register each other's identification information (record in a predetermined area). In the first embodiment, when the imaging device 100 pairs with an external device, the identification information of the paired external device is stored in the memory 103. In the first embodiment, when the imaging device 100 pairs with, for example, headphones, after recording the identification information of the headphones, it determines that the pairing is completed by establishing a wireless connection between the headphones and the imaging device 100.

[0026] Also, in the first embodiment, when the imaging device 100 and an external device are wirelessly connected by Bluetooth, the user operates the external device so that it can be detected by the imaging device 100, and then operates the imaging device 100 to detect the external device. After the imaging device 100 detects the external device, the user operates the imaging device 100 and the external device to wirelessly connect the imaging device 100 and the external device. By such a procedure, the imaging device 100 can establish a wireless connection with the external device.

[0027] The connection unit 112 is an interface for wired connection with an external device. The control unit 101 can transmit and receive data with the external device via the connection unit 112. For example, the control unit 101 can transmit still image data, moving image data, or audio data recorded on the recording medium 110 to the external device via the connection unit 112. Also for example, the control unit 101 can receive audio data generated by a microphone of the external device via the connection unit 112. The audio data generated by the microphone of the external device is input from the external device to the control unit 101 via the connection unit 112. The connection unit 112 is composed of, for example, a phone connector (e.g., a microphone terminal, a headphone terminal, etc.), a USB terminal, or an accessory socket (hot shoe). The imaging device 100 can be wired-connected to an external microphone device, a device having a speaker and a microphone (earphone microphone, headset, etc.), or an information processing device (smartphone, PC, etc.) via the connection unit 112. Also, the connection unit 112 has a detection unit that detects whether or not an external device is connected. The control unit 101 can detect, via this detection unit, that the external device and the imaging device 100 are connected or disconnected, that the external device and the imaging device 100 are connected, that the external device and the imaging device 100 are not connected, etc.

[0028] Note that the control unit 101 can detect the type (device type) of the external device after establishing the connection between the external device and the imaging device 100. For example, in Bluetooth communication, the control unit 101 can detect whether the external device has a headphone, a microphone, or a headset by using the Service Discovery Protocol (SDP). Also for example, when wireless LAN is adopted for communication via the communication unit 111, the control unit 101 can detect the type (device type) of the external device by receiving the type (device type) of the external device from the external device.

[0029] Also, for example, in the case of wired communication via the connection unit 112, when the connection unit 112 is a USB terminal, the control unit 101 receives a device descriptor from an external device that has established a wired connection. By referring to this device descriptor, the control unit 101 can detect whether the external device has a microphone and can determine whether the external device has a speaker. Also, when the connection unit 112 is a phone connector, by receiving identification information from an external device that has established a wired connection, the control unit 101 can determine whether the external device has, for example, a speaker, a microphone, or a headset.

[0030] Next, an example of the appearance of the imaging device 100 will be described. FIG. 2(A) is a diagram showing an example of the front external view of the imaging device 100. FIG. 2(B) is a diagram showing an example of the back external view of the imaging device 100. The release switch 105a, the playback button 105b, the direction keys 105c, and the touch panel 105d are operation members included in the operation unit 105. The release switch 105a, the playback button 105b, the direction keys 105c, and the touch panel 105d are operation members for inputting various operation instructions to the control unit 101. Also, a still image or a moving image captured by the imaging unit 102 is displayed on the display unit 106. Also, as an example of the connection unit 112, an accessory socket, a phone connector, and a USB terminal are presented.

[0031] <Audio control function> As described above, the imaging device 100 has an audio control function. The audio control function is a function in which the control unit 101 performs processing corresponding to a user's voice instruction picked up by the microphone 107. For example, when the audio control function is valid, if the control unit 101 detects that the voice data generated by the microphone 107 contains a voice instruction "Take a still image", the control unit 101 controls the imaging unit 102 to take a still image. Also, for example, when the control unit 101 detects that the voice data generated by the microphone 107 contains a voice instruction "Increase the volume", the control unit 101 controls to increase the volume of the sound output from the speaker 108. Note that the voice data used for the audio control function may be input from an external device having a microphone to the control unit 101. As described above, with the audio control function, the imaging device 100 can perform control such as changing various settings and executing various processes.

[0032] In the first embodiment, when the audio control function is valid, the control unit 101 recognizes a predetermined voice (hereinafter referred to as a wake word) included in the voice data, and then recognizes a voice instruction following the predetermined voice. In the first embodiment, the control unit 101 has a program (hereinafter referred to as a voice recognition program) for recognizing the content of the voice instruction, and controls each component of the imaging device 100 according to the voice instruction recognized by the voice recognition program. The control unit 101 converts the voice instruction recognized by the voice recognition program into, for example, a command for controlling the imaging device 100 and executes the command. This voice recognition program is stored in the memory 103. Note that when recognizing a voice instruction, the control unit 101 may transmit the voice data to an external server connected via the Internet and use the external server to recognize the content of the voice instruction.

[0033] Note that the imaging device 100 may enable the voice control function in response to receiving a predetermined user operation. For example, if the operation unit 105 has a physical button for receiving an operation to enable the voice control function, the imaging device 100 may enable the voice control function while the user presses the button. For example, the imaging device 100 may display an item for enabling the voice control function on the display unit 106, and the imaging device 100 may enable the voice control function in response to the user operating the item via the touch panel. Also, for example, when receiving an instruction to start the voice control function from an external device, the control unit 101 may enable the voice control function. Note that when enabling the voice control function in response to receiving a user operation, the imaging device 100 may not recognize the wake word and may recognize only voice instructions.

[0034] For example, the following instructions are assumed as voice instructions regarding the recording of video data with voice. Examples of voice instructions · Start shooting and end shooting · Change shooting parameters · End shooting after a predetermined time (e.g., after 1 minute) or at a specific time · Generate data (voice memo, tag, attribute information, etc.) to be added to the video data with voice · Display the remaining shooting time · Display the remaining capacity of the recording medium 110 · Image search for the object (subject) being photographed · Display the translation result of the characters being photographed · Send the photographed still image data or video data to a predetermined destination (e.g., cloud storage or one's own email address)

[0035] <Operations of the imaging device 100> Next, with reference to FIG. 3, an example of a process of setting either the microphone 107 or the microphone of the external device as the microphone used for the voice control function or the microphone used for generating video data with audio will be described. This process is realized by the control unit 101 executing a program stored in the memory 103.

[0036] In step S301, the control unit 101 determines whether an external device having a microphone is connected to the imaging device 100. If the control unit 101 determines that an external device having a microphone is not connected to the imaging device 100, the process of step S302 is performed (NO in step S301). If the control unit 101 determines that an external device having a microphone is connected to the imaging device 100, the process of step S303 is performed (YES in step S301).

[0037] In step S302, the control unit 101 sets the microphone 107 as the microphone used for generating video data with audio. Thereby, the control unit 101 can generate video data with audio from the video data generated by the imaging unit 102 and the audio data generated by the microphone 107. The video data with audio generated by the control unit 101 is recorded on the recording medium 110. That is, the user can use the microphone 107 for generating video data with audio. In this case, the control unit 101 does not set the microphone 107 as the microphone used for the voice control function. By such control, it is possible to prevent the user from giving a voice instruction to the microphone 107. Thereby, the control unit 101 can make it difficult for the voice corresponding to the user's voice instruction to be recorded on the recording medium 110 together with the video data.

[0038] In step S303, the control unit 101 determines whether the connection method with the external device is a wireless connection method or a wired connection method. For example, the control unit 101 determines whether the external device and the imaging device 100 are connected via the communication unit 111 or via the connection unit 112. When the external device and the imaging device 100 are connected via the communication unit 111, the control unit 101 determines that the connection method between the external device and the imaging device 100 is a wireless connection method. If the control unit 101 determines that the connection method between the external device and the imaging device 100 is a wireless connection method, the process of step S304 is performed. Also, when the external device and the imaging device 100 are connected via the connection unit 112, the control unit 101 determines that the connection method between the external device and the imaging device 100 is a wired connection method. If the control unit 101 determines that the connection method between the external device and the imaging device 100 is a wired connection method, the process of step S306 is performed.

[0039] First, a case where it is determined in step S303 that the connection method between the imaging device 100 and the external device is a wireless connection method will be described.

[0040] In step S304, the control unit 101 sets the microphone of the external device as the microphone used for the voice control function. Thereby, the control unit 101 can detect whether the voice corresponding to the user's voice instruction is included in the voice data generated by the microphone of the external device.

[0041] In step S305, the control unit 101 sets the microphone 107 as the microphone used for generating video data with voice. Thereby, when the imaging device 100 is in the process of shooting a video, the control unit 101 can generate video data with voice from the video data generated by the imaging unit 102 and the voice data generated by the microphone 107. The generated video data with voice is recorded on the recording medium 110.

[0042] As a result, when the connection method between the imaging device 100 and the external device is a wireless connection method, the user can use the microphone of the external device for the voice control function and use the microphone 107 for generating video data with audio. Here, the reason why the imaging device 100 uses the two microphones in this way will be explained.

[0043] The reason for using the microphone of the external device for the voice control function is that it is assumed that the external device is close to the user. For example, as a use case, it is assumed that the user wears the wirelessly connected external device on himself / herself and approaches the microphone 107 so as not to approach it, and uses the imaging device 100 so that the voice corresponding to the voice instruction is not recorded in the video data with audio. In the first embodiment, based on such an assumption, when the connection method of the external device is a wireless connection method, the control unit 101 sets the microphone that the imaging device 100 uses the microphone of the external device for the voice control function.

[0044] In this way, when the imaging device 100 is in the middle of video shooting and uses the microphone of the external device for the voice control function, the control unit 101 can detect whether the voice corresponding to the user's voice instruction is included in the voice data generated by the microphone of the external device. And when the voice corresponding to the voice instruction is detected from the voice data generated by the microphone of the external device, the control unit 101 can perform the process corresponding to the voice instruction. However, when the voice corresponding to the voice instruction is not detected from the voice data generated by the microphone of the external device, the control unit 101 does not accept the voice instruction even if the voice corresponding to the voice instruction is included in the voice data generated by the microphone 107. As a result, the user can input a voice instruction to the microphone of the external device even when the imaging device 100 is in the middle of video shooting, and the imaging device 100 can make it difficult for the voice corresponding to the voice instruction to be recorded on the recording medium 110 together with the video data.

[0045] Next, a case will be described in which it is determined in step S303 that the connection method between the imaging device 100 and the external device is a wired connection method.

[0046] In step S306, the control unit 101 sets the microphone 107 as a microphone used for the voice control function. Thereby, the control unit 101 can detect whether the voice corresponding to the user's voice instruction is included in the voice data generated by the microphone 107.

[0047] In step S307, the control unit 101 sets the microphone of the external device as a microphone used for generating video data with voice. Thereby, when the imaging device 100 is in the middle of video shooting, the control unit 101 can generate video data with voice from the video data generated by the imaging unit 102 and the voice data generated by the microphone of the external device. The generated video data with voice is recorded on the recording medium 110.

[0048] Thereby, when the connection method between the imaging device 100 and the external device is a wired connection method, the user can use the microphone 107 for the voice control function and use the microphone of the external device for generating video data with voice. Here, the reason why the imaging device 100 uses the two microphones properly will be described.

[0049] The reason for setting the microphone of the external device as the microphone used for generating video data with audio is that it is assumed that the external device captures the audio of the subject. The external device connected to the imaging device 100 by wire is either a microphone device (such as a gun microphone) suitable for the purpose of capturing the audio of the subject or a microphone device to which an accessory for noise reduction (such as a shock mount or a windscreen) is attached. Such a microphone device is connected to the imaging device 100 by the user in order to capture the audio of the subject with high quality and less noise. Therefore, in the first embodiment, when the connection method with the external device is a wired connection method, the control unit 101 sets the microphone of the external device as the microphone used for generating video data with audio.

[0050] The reason for setting the microphone 107 as the microphone used for the audio control function is to enable the use of the audio control function even during the generation of video data with audio. For example, as an assumed use case, during the generation of video with audio, there is a situation where the user's hands are occupied because the user holds the imaging device 100. Even in such a case, the user can input a voice instruction in a low voice to the microphone 107, and while making it difficult for the voice corresponding to the user's voice instruction to be recorded on the recording medium 110 together with the video data, the audio control function can be used. In the first embodiment, based on such an assumption, when the connection method of the external device is a wired connection method, the control unit 101 sets the imaging device 100 to use the microphone 107 as the microphone for the audio control function.

[0051] In this way, when the imaging device 100 is in the process of video shooting and the microphone 107 is used for the voice control function, the control unit 101 can detect whether the voice corresponding to the user's voice instruction is included in the voice data generated by the microphone 107. And when the voice corresponding to the voice instruction is detected from the voice data generated by the microphone 107, the control unit 101 can perform the process corresponding to the voice instruction. However, when the voice corresponding to the voice instruction is not detected from the voice data generated by the microphone 107, the control unit 101 does not accept the voice instruction even if the voice corresponding to the voice instruction is included in the voice data generated by the microphone of the external device. Thereby, the user can input a voice instruction to the microphone 107 even during video shooting, and can control the imaging device 100 by the voice instruction. Also, in this case, the control unit 101 can record the voice of the subject with high quality and less noise by using the microphone of the external device for generating the video data with voice.

[0052] In addition, when the external device and the imaging device 100 are wirelessly connected, the imaging device 100 may perform the following voice processing. For example, voice processing may be performed on the voice data generated by the microphone 107 to make the voice corresponding to the user's voice instruction less prominent by using the voice data generated by the microphone of the external device and the microphone 107. Also, when the external device and the imaging device 100 are wired-connected, the imaging device 100 may perform the following voice processing. For example, voice processing may be performed on the voice data generated by the microphone of the external device to make the voice corresponding to the user's voice instruction less prominent by using the voice data generated by the microphone 107 and the microphone of the external device.

[0053] As described above, according to the first embodiment, when the external device and the imaging device 100 are connected, the microphone 107 and the microphone of the external device can be used for different purposes, so that the usability can be improved. For example, even if the user controls the imaging device 100 by the voice control function when the imaging device 100 is shooting a video, the imaging device 100 can make it difficult for the voice corresponding to the user's voice instruction to be recorded on the recording medium 110 together with the video data.

[0054] [Second Embodiment] Hereinafter, the second embodiment will be described. In recent years, due to the popularization of smartphones, devices having a microphone and a speaker (such as headsets and earphone microphones) are becoming more and more popular. Such devices are designed such that the speaker is close to the user's ear and the microphone is close to the user's mouth. If the imaging device 100 can receive the voice instruction input to the microphone of such a device, the imaging device 100 can reduce the possibility that the user's voice instruction is recorded on the recording medium 110 together with the video data. Therefore, in the second embodiment, a method will be described that enables selection of whether to use the microphone 107 and the microphone of the external device for the voice control function or for the generation of video data with voice based on whether the external device having a microphone has a speaker.

[0055] FIG. 1 is a block diagram showing a configuration example of the imaging device 100 in the second embodiment. Note that the configuration example of the imaging device 100 in the second embodiment is the same as the configuration example of the imaging device 100 in the first embodiment, and thus the description thereof will be omitted.

[0056] With reference to FIG. 4, an example of a process of setting the microphone 107 and the microphone of the external device to either a microphone used for the voice control function or a microphone used for the generation of video data with voice will be described. This process is realized by the control unit 101 executing a program stored in the memory 103.

[0057] In step S401, the control unit 101 determines whether an external device having a microphone is connected to the imaging device 100. If the control unit 101 determines that an external device having a microphone is not connected to the imaging device 100, the process of step S402 is performed (NO in step S401). If the control unit 101 determines that an external device having a microphone is connected to the imaging device 100, the process of step S403 is performed (YES in step S401).

[0058] In step S402, the control unit 101 sets the microphone 107 as the microphone used for generating video data with audio. Thereby, when the imaging device 100 is in the middle of video shooting, the control unit 101 can generate video data with audio from the video data generated by the imaging unit 102 and the audio data generated by the microphone 107. The video data with audio generated by the control unit 101 is recorded on the recording medium 110. That is, the user can use the microphone 107 for generating video data with audio. In this case, the control unit 101 does not set the microphone 107 as the microphone used for the voice control function. By such control, it is possible to prevent the user from giving a voice instruction to the microphone 107. Thereby, the control unit 101 can make it difficult for the voice corresponding to the user's voice instruction to be recorded on the recording medium 110 together with the video data.

[0059] In step S403, the control unit 101 determines whether the external device has a speaker. For example, when the type of the external device detected after establishing the connection between the external device and the imaging device 100 is a headset or an earphone microphone, the control unit 101 determines that the external device has a speaker. For example, when the type of the external device detected after establishing the connection between the external device and the imaging device 100 is a microphone device, the control unit 101 determines that the external device does not have a speaker. If the control unit 101 determines that the external device has a speaker, the process of step S404 is performed (YES in step S403). If the control unit 101 determines that the external device does not have a speaker, the process of step S406 is performed (NO in step S403). Note that in the second embodiment, unlike the first embodiment, the control unit 101 does not determine whether the connection method with the external device is a wired connection method or a wireless connection method.

[0060] First, the case where it is determined in step S403 that the external device has a speaker will be described.

[0061] In step S404, the control unit 101 sets the microphone of the external device as the microphone to be used for the voice control function. Thereby, the control unit 101 can detect whether the voice corresponding to the user's voice instruction is included in the voice data generated by the microphone of the external device.

[0062] In step S405, the control unit 101 sets the microphone 107 as the microphone to be used for generating video data with voice. Thereby, when the imaging device 100 is in the process of video shooting, the control unit 101 can generate video data with voice from the video data generated by the imaging unit 102 and the voice data generated by the microphone 107. The generated video data with voice is recorded on the recording medium 110.

[0063] As a result, when the external device having a microphone also has a speaker, the user can use the microphone of the external device for the voice control function and use the microphone 107 for generating video data with audio.

[0064] In this way, when the imaging device 100 is in the process of video shooting and the microphone of the external device is used for the voice control function, the control unit 101 can detect whether the voice corresponding to the user's voice instruction is included in the voice data generated by the microphone of the external device. And when the voice corresponding to the voice instruction is detected from the voice data generated by the microphone of the external device, the control unit 101 can perform the process corresponding to the voice instruction. However, when the voice corresponding to the voice instruction is not detected from the voice data generated by the microphone of the external device, the control unit 101 will not accept the voice instruction even if the voice corresponding to the voice instruction is included in the voice data generated by the microphone 107. Thereby, the user can control the imaging device 100 by inputting a voice instruction to the microphone of the external device.

[0065] Next, the case where it is determined in step S403 that the external device does not have a speaker will be described.

[0066] In step S406, the control unit 101 sets the microphone 107 as the microphone to be used for the voice control function. Thereby, the control unit 101 can detect whether the voice corresponding to the user's voice instruction is included in the voice data generated by the microphone 107.

[0067] In step S407, the control unit 101 sets the microphone of the external device as the microphone to be used for generating video data with audio. Thereby, when the imaging device 100 is in the process of video shooting, the control unit 101 can generate video data with audio from the video data generated by the imaging unit 102 and the voice data generated by the microphone of the external device. The generated video data with audio is recorded on the recording medium 110.

[0068] Thus, when the external device having a microphone does not have a speaker, the user can use the microphone 107 for the voice control function and use the microphone of the external device for generating video data with audio.

[0069] The reason for using the microphone of the external device for generating video data with audio when the external device having a microphone does not have a speaker is that it is assumed that such an external device connected to the imaging device is used to pick up the sound of the subject. That is, it is assumed that such an external device is either a microphone device (such as a gun microphone) suitable for the purpose of picking up the sound of the subject or a microphone device to which accessories for noise reduction (such as a shock mount, a windscreen, etc.) are attached. Such a microphone device is connected to the imaging device 100 by the user in order to pick up the voice of the subject with high quality and less noise. Therefore, in the second embodiment, when the external device having a microphone does not have a speaker, the control unit 101 sets the microphone of the external device to be used for generating video data with audio.

[0070] In this way, when the imaging device 100 is in the process of video shooting and the microphone 107 is used for the voice control function, the control unit 101 can detect whether the voice corresponding to the user's voice instruction is included in the voice data generated by the microphone 107. And when the voice corresponding to the voice instruction is detected from the voice data generated by the microphone 107, the control unit 101 can perform the process corresponding to the voice instruction. However, when the voice corresponding to the voice instruction is not detected from the voice data generated by the microphone 107, the control unit 101 does not accept the voice instruction even if the voice corresponding to the voice instruction is included in the voice data generated by the microphone of the external device. Thereby, the user can control the imaging device 100 by inputting a voice instruction to the microphone 107.

[0071] In the second embodiment, when the voice corresponding to the voice instruction is detected from the voice data generated by the microphone of the external device, the control unit 101 controls the external device so that predetermined voice data is transmitted to the external device and output from the speaker of the external device. Here, the predetermined voice data is, for example, voice data for notifying the user that the imaging device 100 has received the user's voice instruction. Thereby, the user can know that the imaging device 100 has received the user's voice instruction by the sound wave output from the speaker of the external device.

[0072] In the second embodiment, when the external device having a microphone also has a speaker, the imaging device 100 uses the microphone of the external device for the voice control function whether the external device is wired-connected or wireless-connected to the imaging device 100.

[0073] In the second embodiment, the use case of using the voice control function when the imaging device 100 is in the video shooting mode has been described, but the use case of using the voice control function is not limited to this. For example, the imaging device 100 may also use the voice control function when the operation mode of the imaging device 100 is an operation mode of recording voice data on the recording medium 110. Thus, when the voice instruction used for the voice control function affects the operability, convenience, etc. of other functions, the operation of the imaging device 100 in the second embodiment is particularly effective.

[0074] In addition, when an external device such as a headset microphone is connected to the imaging device 100, the imaging device 100 may perform the following audio processing. For example, using the audio data generated by the microphone of the external device and the microphone 107, audio processing may be performed on the audio data generated by the microphone 107 to make the audio corresponding to the user's voice instruction less prominent. Also, when an external device such as a gun microphone is connected to the imaging device 100, the imaging device 100 may perform the following audio processing. For example, using the audio data generated by the microphone 107 and the microphone of the external device, audio processing may be performed on the audio data generated by the microphone of the external device to make the audio corresponding to the user's voice instruction less prominent.

[0075] As described above, according to the second embodiment, when an external device having a microphone further has a speaker, the imaging device 100 can utilize the microphone of the external device for the voice control function, so that the usability can be improved. For example, even if the user controls the imaging device 100 by the voice control function while the imaging device 100 is shooting a video, the imaging device 100 can make it difficult for the audio corresponding to the user's voice instruction to be recorded on the recording medium 110 together with the video data.

[0076] [Third Embodiment] Hereinafter, the third embodiment will be described. In the third embodiment, a method will be described that enables selection based on user settings stored in the memory 103 as to whether to use the microphone 107 and the microphone of the external device for the voice control function or for the generation of audio-added video data. Note that the user settings stored in the memory 103 can be changed by the user operating the operation unit 105.

[0077] FIG. 1 is a block diagram showing a configuration example of the imaging device 100 in the third embodiment. Note that the configuration example of the imaging device 100 in the third embodiment is the same as the configuration example of the imaging device 100 in the first embodiment, and thus the description thereof is omitted.

[0078] In the third embodiment, when an external device and the imaging device 100 are connected, the control unit 101 can select whether to acquire audio data recorded together with video data from either the microphone 107 or the external device. For example, the control unit 101 can select whether to acquire audio data recorded together with video data from either the microphone 107 or the external device according to a user operation received by the operation unit 105.

[0079] With reference to FIG. 5, an example of a process of setting whether the microphone 107 or the microphone of the external device is used as a microphone for the audio control function or as a microphone for generating video data with audio will be described. This process is realized by the control unit 101 executing a program stored in the memory 103.

[0080] In step S501, the control unit 101 determines whether an external device having a microphone is connected to the imaging device 100. If the control unit 101 determines that an external device having a microphone is not connected to the imaging device 100, the process of step S502 is performed (NO in step S501). If the control unit 101 determines that the external device is connected to the imaging device 100, the process of step S503 is performed (YES in step S501).

[0081] In step S502, the control unit 101 sets the microphone 107 as the microphone used for generating the video data with audio. Thereby, when the imaging device 100 is shooting a video, the control unit 101 can generate video data with audio from the video data generated by the imaging unit 102 and the audio data generated by the microphone 107. The video data with audio generated by the control unit 101 is recorded on the recording medium 110. That is, the user can use the microphone 107 for generating the video data with audio. In this case, the control unit 101 does not set the microphone 107 as the microphone used for the voice control function. By such control, it is possible to prevent the user from giving a voice instruction to the microphone 107. Thereby, the control unit 101 can make it difficult for the voice corresponding to the user's voice instruction to be recorded on the recording medium 110 together with the video data.

[0082] In step S503, the control unit 101 determines whether to use the microphone of the external device for the voice control function or use the microphone 107 for the voice control function based on the user settings stored in the memory 103. This user setting is, for example, a setting for determining whether to use the microphone used for the voice control function as the microphone of the external device or the microphone 107. In the third embodiment, it is assumed that the user has stored this setting in the memory 103 in advance before starting video shooting. If the control unit 101 determines to use the microphone of the external device for the voice control function, the process of step S504 is performed (YES in step S503). If the control unit 101 determines to use the microphone 107 for the voice control function, the process of step S506 is performed (NO in step S503). In the third embodiment, different from the first embodiment, the control unit 101 does not determine whether the connection method with the external device is a wired connection method or a wireless connection method.

[0083] First, the case where it is determined in step S503 that the microphone of the external device is used for the voice control function will be described.

[0084] In step S504, the control unit 101 sets the microphone of the external device as the microphone to be used for the voice control function. Thereby, the control unit 101 can detect whether the voice corresponding to the user's voice instruction is included in the voice data generated by the microphone of the external device.

[0085] In step S505, the control unit 101 sets the microphone 107 as the microphone to be used for generating video data with voice. Thereby, when the imaging device 100 is in the video shooting state, the control unit 101 can generate video data with voice from the video data generated by the imaging unit 102 and the voice data generated by the microphone 107. The generated video data with voice is recorded on the recording medium 110.

[0086] Thereby, the user can use the microphone of the external device for the voice control function and use the microphone 107 for generating video data with voice.

[0087] Thus, when the imaging device 100 is in the video shooting state and the microphone of the external device is used for the voice control function, the control unit 101 can detect whether the voice corresponding to the user's voice instruction is included in the voice data generated by the microphone of the external device. And when the voice corresponding to the voice instruction is detected from the voice data generated by the microphone of the external device, the control unit 101 can perform the process corresponding to the voice instruction. Thereby, the user can control the imaging device 100 by inputting a voice instruction to the microphone of the external device.

[0088] Next, the case where it is determined in step S503 that the microphone 107 is to be used for the voice control function will be described.

[0089] In step S506, the control unit 101 sets the microphone 107 as the microphone to be used for the voice control function. Thereby, the control unit 101 can detect whether the voice corresponding to the user's voice instruction is included in the voice data generated by the microphone 107.

[0090] In step S507, the control unit 101 sets the microphone of the external device as the microphone to be used for generating video data with audio. Thereby, when the imaging device 100 is in the middle of video shooting, the control unit 101 can generate video data with audio from the video data generated by the imaging unit 102 and the audio data generated by the microphone of the external device. The generated video data with audio is recorded on the recording medium 110.

[0091] Thereby, the user can use the microphone 107 for the voice control function and use the microphone of the external device for generating video data with audio.

[0092] Thus, when the imaging device 100 is in the middle of video shooting and the microphone 107 is used for the voice control function, the control unit 101 can detect whether the voice corresponding to the user's voice instruction is included in the audio data generated by the microphone 107. And when the voice corresponding to the voice instruction is detected from the audio data generated by the microphone 107, the control unit 101 can perform the process corresponding to the voice instruction. Thereby, the user can control the imaging device 100 by inputting a voice instruction to the microphone 107.

[0093] As described above, according to the third embodiment, since the user can select for which use to use the microphone 107 and the microphone of the external device respectively, the usability can be improved. For example, even if the user controls the imaging device 100 by the voice control function when the imaging device 100 is in the middle of video shooting, the imaging device 100 can make it difficult for the voice corresponding to the user's voice instruction to be recorded on the recording medium 110 together with the video data.

[0094] [Other Embodiments] The above-described embodiments can also be realized by a program supplied to a system or apparatus via a network or a storage medium and executed by one or more processors in the system or apparatus. Further, the above-described embodiments can also be realized by using a circuit (e.g., ASIC) that realizes one or more functions of the above-described embodiments.

Explanation of Signs

[0095] 100 Imaging device 101 Control unit 102 Imaging unit 107 Microphone 111 Communication unit 112 Connection unit

Claims

1. a first voice input means; a second voice input means different from the first voice input means; imaging means; control means for generating voice - attached video data from the video data generated by the imaging means and the voice data generated by the first voice input means; an imaging device having: when voice corresponding to a voice instruction for controlling the imaging device is detected from the voice data input to the second voice input means, the control means controls the imaging device based on the voice instruction; the control means determines, based on user settings, a means for receiving voice data from an external device to be either the first voice input means or the second voice input means. An imaging device characterized by the above.

2. When voice corresponding to a voice instruction for controlling the imaging device is not detected from the voice data input to the second voice input means, even if the voice corresponding to the voice instruction for controlling the imaging device is included in the voice data generated by the first voice input means, the imaging device according to claim 1 is characterized in that the voice instruction is not accepted.

3. The imaging device according to claim 1 or 2, wherein the second voice input means has wireless communication means for receiving voice data from an external device.

4. The imaging device according to claim 3, wherein the wireless communication means communicates with an external device according to the Bluetooth standard.

5. The imaging device according to claim 3 or 4, wherein the first voice input means is a microphone included in the imaging device.

6. The imaging device according to claim 1 or 2, wherein the first voice input means has wired communication means for receiving voice data from an external device.

7. The imaging device according to claim 6, wherein the second voice input means is a microphone included in the imaging device.

8. When voice corresponding to a voice instruction for controlling the imaging device is detected from the voice data input to the second voice input means from an external device, the control means controls the external device so that predetermined voice data is output from the external device. The imaging device according to any one of claims 1 to 7.

9. a first voice input means; a second voice input means different from the first voice input means; imaging means A control method for an imaging device having: generating audio-visual data from the video data generated by the imaging means and the audio data generated by the first audio input means; when audio corresponding to an audio instruction for controlling the imaging device is detected from the audio data input to the second audio input means, controlling the imaging device based on the audio instruction; determining, based on user settings, which of the first audio input means or the second audio input means is to receive audio data from an external device; A control method characterized by comprising the above. **Claim 10** a first audio input means; a second audio input means different from the first audio input means; imaging means In a computer of an imaging device having: generating audio-visual data from the video data generated by the imaging means and the audio data generated by the first audio input means; when audio corresponding to an audio instruction for controlling the imaging device is detected from the audio data input to the second audio input means, controlling the imaging device based on the audio instruction; determining, based on user settings, which of the first audio input means or the second audio input means is to receive audio data from an external device; A program for causing the above to be executed.

Images