Imaging device, control method, and program
By synchronizing audio data transmission with image capture, the imaging device addresses the timing discrepancy between image taking and sound output, enhancing user understanding of image timing.
Patent Information
- Application Number
- JP2020129814
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Priority Date
- 2019-08-19
- Filing Date
- 2020-07-31
- Publication Date
- 2024-11-12
- Estimated Expiration
- 2040-07-31
AI Technical Summary
There is a discrepancy in timing between when a digital camera captures an image and when an external speaker outputs the electronic shutter sound, leading to potential misunderstanding by the user.
The imaging device wirelessly connects to an external speaker and controls the speaker to output audio data indicating an image has been taken, synchronizing the sound output with the image capture.
This synchronization reduces the time difference between image capture and sound output, ensuring the user accurately knows the timing of image capture.
Smart Images

Figure 0007580964000001 
Figure 0007580964000002 
Figure 0007580964000003
Abstract
Description
[Technical field]
[0001] The present invention relates to an imaging device capable of wireless communication. [Background technology]
[0002] In recent years, there are speakers with wireless communication functions, such as wireless headphones and wireless speakers. A user can connect an electronic device, such as a smartphone or a television, to a speaker with wireless communication functions and listen to music or television audio from the speaker. Patent Document 1 discloses wireless communication between a digital audio player (DAP) and headphones.
[0003] For example, when a digital camera is wirelessly connected to headphones and audio data of a video recorded on the digital camera is played back through the headphones, the audio data is generally played back with a certain amount of delay from the time the user instructs playback of the video. [Prior art documents] [Patent documents]
[0004] [Patent Document 1] JP 2019-33305 A Summary of the Invention [Problem to be solved by the invention]
[0005] For example, when a digital camera is wirelessly connected to headphones and an image is captured by the digital camera, the user can hear the electronic shutter sound through the headphones. At this time, the electronic shutter sound is also reproduced with a certain delay from the timing when the user instructs the capture. However, since the electronic shutter sound is a sound that indicates the timing when the digital camera captures an image, if there is a discrepancy between the timing when the digital camera captures an image and the timing when the electronic shutter sound is reproduced, the user may misinterpret the timing when the image was captured.
[0006] SUMMARY OF THE PRESENT EMBODIMENT An object of the present invention is to reduce the time difference between when an imaging device captures an image and when a speaker wirelessly connected to the imaging device outputs audio data. [Means for solving the problem]
[0007] In order to solve the above problem, the imaging device of the present invention has a communication means for wirelessly connecting to an external speaker, an imaging means, and a control means, wherein the control means judges whether or not to capture images using the imaging means, and the control means transmits audio data indicating that images have been captured by the imaging means to the external speaker with which a wireless connection has been established, via the communication means, between the start and completion of the judgment as to whether or not to capture images using the imaging means, and the control means controls the external speaker via the communication means to enter a state in which it does not output sound in response to the establishment of a wireless connection with the external speaker, and when it is judged that images will be captured using the imaging means, the control means controls the external speaker via the communication means to enter a state in which sound can be output. Effect of the Invention
[0008] According to the present invention, it is possible to reduce the time difference between when an imaging device captures an image and when a speaker wirelessly connected to the imaging device outputs audio data. [Brief description of the drawings]
[0009] [Figure 1] FIG. 1 is a diagram showing an example of a system configuration including a digital camera and wireless headphones according to a first embodiment. [Diagram 2] 1A is a block diagram showing an example of the configuration of a digital camera according to a first embodiment, FIG. 1B is an example of an external view of the front of the digital camera according to the first embodiment, and FIG. 1C is an example of an external view of the back of the digital camera according to the first embodiment. [Diagram 3](A) An example of a screen display for setting the shutter mode, electronic sound output, and silent mode of the digital camera in the first embodiment. (B) An example of a screen display for setting the shutter mode of the digital camera in the first embodiment. (C) An example of a screen display for setting the electronic sound output in the first embodiment. (D) An example of a screen display for setting the silent mode of the digital camera in the first embodiment. [Figure 4] 1A is an example of a setting screen of a digital camera to which no wireless headphones are connected in the first embodiment, and FIG. 1B is an example of a setting screen of a digital camera to which wireless headphones are connected. [Diagram 5] 6 is a flowchart showing an example of a series of processes from when a digital camera in the first embodiment establishes a wireless connection with wireless headphones to when the connection is terminated. [Figure 6] 6 is a flowchart showing an example of processing in which the digital camera according to the first embodiment outputs an electronic shutter sound to wireless headphones during imaging processing. [Figure 7] 4 is a sequence diagram showing an example of wireless communication processing between a digital camera and wireless headphones in the first embodiment. FIG. [Figure 8] FIG. 4 is a diagram illustrating an example of a process in which the wireless headphones output audio in the first embodiment. [Figure 9] 10 is a flowchart showing an example of a series of processes from when a digital camera establishes a wireless connection with wireless headphones to when the connection is cut off in the second embodiment. [Figure 10] 13 is a flowchart showing an example of processing for outputting an electronic shutter sound to wireless headphones that take a short time to output sound during imaging processing by a digital camera according to the second embodiment. [Figure 11] FIG. 11 is a sequence diagram showing an example of wireless communication processing between a digital camera and wireless headphones that output sound quickly in the second embodiment. [Figure 12]FIG. 13 is a diagram showing an example of a system configuration diagram including a digital camera, wireless headphones, and a smartphone in a third embodiment. [Figure 13] 13A is a block diagram showing an example of a configuration of a smartphone according to a third embodiment, and FIG. 13B is an example of an external view of the front of the smartphone according to the third embodiment. [Figure 14] 13 is a flowchart showing an example of a series of processes from when a smartphone in a third embodiment establishes a wireless connection with a digital camera and wireless headphones to when the connection is terminated. [Figure 15] 13 is a flowchart showing an example of a process in which a smartphone outputs an electronic shutter sound to wireless headphones when an image is captured by a digital camera according to a third embodiment. [Figure 16] FIG. 13 is a sequence diagram showing an example of wireless communication processing between a smartphone and a digital camera and wireless headphones in the third embodiment. [Figure 17] 13 is a flowchart showing an example of a process in which a smartphone outputs an electronic shutter sound to wireless headphones when an image is captured by a digital camera according to a fourth embodiment. [Figure 18] FIG. 13 is a sequence diagram showing an example of wireless communication processing between a smartphone and a digital camera and wireless headphones in the fourth embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0010] A preferred embodiment of the present invention will be described in detail below with reference to the accompanying drawings. Here, external speakers that are wirelessly connected to the digital camera 100 will be referred to as wireless headphones. Also, external speakers that are wired and connected to the digital camera 100 will be referred to as wired headphones.
[0011] [First embodiment] FIG. 1 is a diagram showing an example of a system configuration including a digital camera 100 and wireless headphones 200 according to the first embodiment.
[0012] The digital camera 100 can be wirelessly connected to the wireless headphones 200 in accordance with the Bluetooth (registered trademark) standard. In this wireless connection in accordance with the Bluetooth standard, the digital camera 100 can transmit audio data, music data, and the like to the wireless headphones 200 in synchronous communication. In addition, in the wireless connection in accordance with the Bluetooth standard, the digital camera 100 can transmit control data such as volume control and output instructions to the wireless headphones 200 in asynchronous communication. This allows the user to wirelessly connect the wireless headphones 200 to the digital camera 100 and listen to electronic sounds, music, and the like from the digital camera 100 via the wireless headphones 200.
[0013] <Configuration of Digital Camera 100> 2A is a block diagram showing an example of the configuration of a digital camera 100, which is an example of a communication device of this embodiment. Note that, although a digital camera is described here as an example of a communication device, the communication device is not limited to this. For example, the communication device is a smartphone, a personal computer, a smart watch, a tablet terminal, etc. In this way, the communication device of this embodiment is a device that can be connected to an external speaker such as a headphone, like the above-mentioned device.
[0014] The control unit 101 controls each unit of the digital camera 100 in accordance with input signals and programs described below. The control unit 101 can convert audio data recorded in a non-volatile memory 103 and a recording medium 110 described below into an audio signal, and output the audio signal via a speaker 108, a communication unit 111, and a connection unit 112. Note that instead of the control unit 101 controlling the entire device, the entire device may be controlled by multiple hardware devices sharing the processing.
[0015] The imaging unit 102 is composed of, for example, an optical system that controls an optical lens unit, an aperture, zoom, focus, etc., and an imaging element for converting light (image) introduced through the optical lens unit into an electrical image signal. The imaging element is generally a complementary metal oxide semiconductor (CMOS) or a charge coupled device (CCD). Under the control of the control unit 101, the imaging unit 102 converts the subject light imaged by the lens included in the imaging unit 102 into an electrical signal using the imaging element, performs noise reduction processing, etc., and outputs the digital data as image data or video data. The imaging unit 102 also has a shutter that can freely control the exposure time of the imaging element under the control of the control unit 101. This shutter is, for example, a focal plane shutter or a lens shutter. In this embodiment, a series of processes for capturing and outputting the image data is called "shooting". In the digital camera 100 of this embodiment, image data and video data are recorded in a recording medium 110 described later in accordance with the DCF (Design rule for Camera File system) standard.
[0016] The non-volatile memory 103 is an electrically erasable and recordable non-volatile memory, and stores programs executed by the control unit 101, which will be described later. The non-volatile memory 103 also stores audio data. This audio data is data of electronic sounds, such as a focusing sound output when a subject is focused, an electronic shutter sound output when an image is captured, and an operation sound output when the digital camera 100 is operated. In this embodiment, the electronic shutter sound is an onomatopoeic sound that resembles the sound of the shutter of the imaging unit 102 opening and closing. However, this electronic shutter sound is only required to allow the user to recognize that an image has been captured. Therefore, the electronic shutter sound may be significantly different in tone, length, etc. from the actual opening and closing sound of the shutter. In this embodiment, the audio data is recorded in PCM format, MP3 format, etc.
[0017] The working memory 104 is used as a buffer memory for temporarily storing image data and video data captured by the imaging unit 102, as an image display memory for the display unit 106, a working area for the control unit 101, and the like.
[0018] The operation unit 105 is a user interface (UI) for receiving instructions for the digital camera 100 from a user. The operation unit 105 may include, for example, a power switch for the user to instruct on / off of the power supply of the digital camera 100, a release switch for instructing shooting, a playback button for instructing playback of image data, and the like. A touch panel formed on the display unit 106 may also be included in the operation unit 105. The release switch has SW1 and SW2. When the release switch is in a so-called half-pressed state, SW1 is turned on. This accepts a preparation instruction for performing a preparation operation for imaging, such as AF (autofocus) processing, AE (auto exposure) processing, AWB (auto white balance) processing, and EF (flash pre-flash) processing. When the release switch is in a so-called full-pressed state, SW2 is turned on. An imaging instruction for performing an imaging operation is accepted by such a user operation.
[0019] Furthermore, the operation unit 105 has a mode changeover switch, which changes the operation mode of the control unit 101 to one of a still image shooting mode, a video shooting mode, a playback mode, etc. Modes included in the still image shooting mode include an auto shooting mode, an auto scene determination mode, a manual mode, an aperture priority mode (Av mode), a shutter speed priority mode (Tv mode), and a program AE mode. In addition, there are various scene modes, custom modes, silent modes, etc., which are shooting settings according to shooting scenes. By operating the mode changeover switch, the user can directly switch to one of these modes. Alternatively, after switching to a list screen of shooting modes with the mode changeover switch, one of the displayed modes may be selected and then switched using other operating members.
[0020] The operation unit 105 also includes buttons for adjusting the volume and the like of sounds output from a speaker 108, a communication unit 111, and a connection unit 112, which will be described later. By accepting user operations via these buttons, the control unit 101 executes a process for adjusting the amplitude and the like of an audio signal and a process for determining whether or not to output an audio signal. The operation unit 105 also includes a button for instructing on / off of a wireless communication function via the communication unit 111.
[0021] Display unit 106 displays a viewfinder image during shooting, displays captured image data, displays characters for interactive operations, etc. Display unit 106 does not necessarily have to be built into digital camera 100, and may be configured to be externally connected to digital camera 100. Digital camera 100 can be connected to an internal or external display unit 106, and it is sufficient that it has at least a display control function for controlling the display of display unit 106.
[0022] The microphone 107 is used to input sound waves such as sound and voice to the digital camera 100. The microphone 107 converts the sound and voice into an electrical signal and inputs it to the digital camera 100. The control unit 101 generates audio data from the input electrical signal. For example, the control unit 101 can record this audio data in synchronization with video data captured by the imaging unit 102. For example, the control unit 101 can record this audio data in association with image data captured by the imaging unit 102. The microphone 107 may be configured to be detachable from the digital camera 100, or may be built into the digital camera 100. That is, it is sufficient that the digital camera 100 has at least a means for receiving an electrical signal from the microphone 107. The frequency of the sound waves that the microphone 107 can convert into an electrical signal is not limited to frequencies audible to humans, and may also include frequencies that are not audible frequencies, such as so-called ultrasonic waves and ultra-low frequencies.
[0023] The speaker 108 is an electroacoustic transducer that can output electronic sounds. Examples of electronic sounds include music, warning sounds, focusing sounds, electronic shutter sounds, and operation sounds. In this embodiment, the control unit 101 can convert audio data recorded in the nonvolatile memory 103 into audio signals and output the audio signals from the speaker 108. The function of outputting electronic sounds from the speaker 108 is an example of an output function. For example, by listening to the sounds output from the speaker 108, the user can notice that a subject has been focused on or that an error has occurred in the digital camera 100.
[0024] The power supply unit 109 is controlled by the control unit 101 to supply power to each element of the digital camera 100. The power supply unit 109 is, for example, a power source such as a lithium ion battery or an alkaline manganese dry battery.
[0025] The recording medium 110 can record, for example, image data output from the imaging unit 102. The recording medium 110 is, for example, an SD card or a CF card. The recording medium 110 may be configured to be detachable from the digital camera 100, or may be built into the digital camera 100. In other words, it is sufficient for the digital camera 100 to have at least a means for accessing the recording medium 110.
[0026] The communication unit 111 is an interface for wirelessly connecting to an external device. The digital camera 100 of this embodiment can exchange data with the external device via the communication unit 111. For example, image data generated by the imaging unit 102 and audio data recorded in the non-volatile memory 103 can be transmitted to the external device via the communication unit 111. The external device is, for example, an information device such as a smartphone or a PC, an external speaker such as an earphone or a headphone, and a flash. In this embodiment, the communication unit 111 includes an interface for communicating with the external device according to the Bluetooth (registered trademark) standard. Hereinafter, wireless communication conforming to the Bluetooth standard is referred to as Bluetooth communication. The control unit 101 realizes wireless communication with the external device by controlling the communication unit 111. The communication method is not limited to Bluetooth, and includes wireless communication methods such as so-called wireless LAN and infrared communication conforming to the IEEE802.11 standard.
[0027] Bluetooth will now be described. Two communication devices that communicate via Bluetooth are divided into a central role and a peripheral role. Communication devices in Bluetooth are connected in a star-shaped network of a master-slave system. A communication device that operates as a central device (hereinafter referred to as a central device) becomes the master, and a communication device that operates as a peripheral device (hereinafter referred to as a peripheral device) becomes the slave. The central device manages the participation of peripheral devices in the network and sets various parameters for wireless connection with peripheral devices. The central device can be connected to multiple peripheral devices simultaneously. In this embodiment, the digital camera 100 becomes the central device, and external speakers such as earphones and headphones and a strobe become the peripheral devices.
[0028] In Bluetooth communication, the digital camera 100 needs to be paired with a peripheral device. Pairing is a process in which the central device and the peripheral device mutually register (record in a predetermined area) their identification information. The digital camera 100 of this embodiment records the identification information of the paired peripheral device in the non-volatile memory 103. In this embodiment, the digital camera 100 determines that pairing is complete by establishing a wireless connection with the headphones after mutually registering the identification information of the headphones with the digital camera 100, for example. In addition, when the digital camera 100 wirelessly connects to the paired peripheral device, the user performs an operation to make the peripheral device searchable from the digital camera 100, and then performs an operation to have the digital camera 100 search for the peripheral device. Then, when the digital camera 100 detects the peripheral device, the digital camera 100 can establish a wireless connection with the peripheral device.
[0029] The connection unit 112 is an interface for wired connection to an external device. The digital camera 100 of this embodiment can exchange data with the external device via the connection unit 112. For example, the control unit 101 can transmit image data generated by the imaging unit 102 and audio data recorded in the non-volatile memory 103 to the external device via the connection unit 112. Also, for example, the control unit 101 can receive audio signals and audio data from an external device such as a microphone via the connection unit 112. The connection unit 112 is composed of, for example, a phone connector (so-called microphone terminal or headphone terminal) and a USB terminal. The digital camera 100 can be wired to an external speaker such as an earphone or a headphone, an external microphone, and an information device such as a smartphone or a PC via the connection unit 112. Also, the connection unit 112 has a detection unit (not shown) that detects whether an external device is connected or not. Through this detection unit, the control unit 101 can detect that an external device is connected or disconnected, that an external device is connected, or that an external device is not connected.
[0030] When the digital camera 100 is connected to an external device such as a microphone or headphones, the control unit 101 can detect the type of the device after establishing a connection with the external device. In Bluetooth communication via the communication unit 111, the control unit 101 can detect whether the external device can operate as, for example, headphones or a microphone by using Service Discovery Protocol (SDP). Also, for example, in wireless LAN communication via the communication unit 111, the control unit 101 can detect the device type of the external device by receiving the device type of the external device from the external device.
[0031] Furthermore, for example, when the connection unit 112 is a USB terminal, the control unit 101 receives a device descriptor from the external device with which a wired connection has been established. By referring to this device descriptor, the control unit 101 can detect whether the external device is a headphone or not. However, when the external devices that can be wirelessly connected to the digital camera 100 are limited to external speakers such as headphones, the control unit 101 can determine whether headphones have been detected by establishing a wireless connection with the external device. Furthermore, a terminal (phone connector) for an external speaker is a terminal that is premised on the fact that the connected device is a speaker. And a terminal (phone connector) for an external microphone is a terminal that is premised on the fact that the connected device is a microphone. When an external device is wired-connected to such a terminal that is designated for a connected device, the control unit 101 can determine whether headphones, a microphone, or the like have been detected by establishing a wired connection with the external device.
[0032] Next, the external appearance of the digital camera 100 will be described. Fig. 2(B) is an external view of the front of the digital camera 100, and Fig. 2(C) is an external view of the rear of the digital camera 100. The release switch 105a, playback button 105b, directional keys 105c, and touch panel 105d are operation members included in the above-mentioned operation unit 105. In addition, an image obtained as a result of imaging by the imaging unit 102 is displayed on the display unit 106.
[0033] The digital camera 100 has power states of a power-on state and a sleep state. In this embodiment, the sleep state is a state in which power is not supplied to the imaging unit 102, the display unit 106, etc. of the digital camera 100, for example. This sleep state is at least a more power-saving state than the power-on state. The digital camera 100 transitions to the sleep state when the power switch of the operation unit 105 is turned off by the user. When the sleep state is transitioned to by turning off the power switch, the digital camera 100 returns from the sleep state to the power-on state when the power switch is turned on. In addition, when a certain period of time has passed in the power-on state without any operation by the user, the digital camera 100 automatically transitions to the sleep state to save power. In this embodiment, the function that executes this operation is called an auto power-off function. In this embodiment, the sleep state transitioned to by this auto power-off function is called an auto power-off state. In the auto power-off state, the digital camera 100 returns from the sleep state to the power-on state in response to the user operating a member of the operation unit 105, such as a release switch or a playback button. In this embodiment, when the digital camera 100 transitions to the sleep state by turning off the power switch, the digital camera 100 does not transition to the power on state even if the user operates a member of the operation unit 105 such as the release switch or playback button.
[0034] An example of the configuration of the digital camera 100 has been described above.
[0035] <Shutter mode explanation> Here, we will explain the shutter modes of the digital camera 100. The digital camera 100 has two shutter modes: an electronic shutter mode and a mechanical shutter mode.
[0036] In the mechanical shutter mode, the control unit 101 exposes the image sensor to light and captures an image by controlling the opening and closing of a shutter included in the imaging unit 102. Imaging in the mechanical shutter mode has the advantage that the captured image data is less susceptible to so-called rolling shutter distortion and has less noise.
[0037] In the electronic shutter mode, the control unit 101 captures an image without opening or closing the shutter. When capturing an image in the electronic shutter mode, the shutter is in an open state. The control unit 101 controls the exposure time of the image sensor included in the image capturing unit 102 by referring to a timing unit (not shown). Capturing an image in the electronic shutter mode has the advantages of being able to use a faster shutter speed than in the mechanical shutter mode and of being less susceptible to vibrations when capturing an image.
[0038] When capturing an image in the electronic shutter mode, the shutter is not opened or closed, so no shutter sound is generated. Therefore, when capturing an image in the electronic shutter mode, in order to notify the user that an image has been captured, the control unit 101 outputs the electronic shutter sound recorded in the non-volatile memory 103 via the speaker 108, the communication unit 111, and the connection unit 112. When outputting the electronic shutter sound from the speaker 108, the digital camera 100 controls the timing at which an image is captured by the imaging unit 102 and the timing at which the electronic shutter sound is output from the speaker 108 to be approximately the same. This allows the user to know the timing at which the image was captured.
[0039] Furthermore, after the release switch is fully pressed (SW2 is turned on), if digital camera 100 determines that the imaging conditions are met, it captures an image using imaging unit 102. The imaging conditions are met, for example, when there is little camera shake, when the subject is in focus, when the exposure is such that there is little whiteout or blackout, etc. In electronic shutter mode, after digital camera 100 determines that the imaging conditions are met, it outputs an electronic shutter sound from speaker 108 when capturing an image using imaging unit 102.
[0040] <Silent mode explanation> Here, the silent mode, which is an operating state of the digital camera 100 of this embodiment, will be described. In the silent mode, the digital camera 100 operates to suppress the generation of noise. This silent mode is an operating state suitable for taking pictures in places where silence is required, such as sporting events and museums. In the silent mode, the digital camera 100 does not output electronic sounds from the speaker 108. The user can turn the silent mode on and off by operating the digital camera 100 via the operation unit 105.
[0041] Furthermore, in this embodiment, in silent mode, the digital camera 100 operates in electronic shutter mode. This is because in electronic shutter mode, the shutter is not opened or closed, and therefore the digital camera 100 can take pictures without making much noise. On the other hand, in mechanical shutter mode, the shutter opens and closes when taking pictures, so it is difficult for the digital camera 100 to take pictures without making noise. Here, in silent mode, when taking pictures, the control unit 101 controls the speaker 108 not to output the electronic shutter sound. In addition, in silent mode, the digital camera 100 does not execute light emission processes such as flash pre-emission and AF assist light. This is because in places where quietness is required, such as sporting events and museums, flash photography (strobe photography) may be prohibited for, for example, athletes playing or paintings in museums.
[0042] However, even in silent mode, digital camera 100 can output electronic sounds to headphones or the like via communication unit 111 and connection unit 112. This is because even if digital camera 100 outputs electronic sounds to headphones or the like, the electronic sounds are considered to be heard only by the user of digital camera 100, and therefore the electronic sounds output from the headphones are unlikely to become noise.
[0043] Note that the digital camera 100 of this embodiment may transition to silent mode when it is determined that the volume of sound output from the speaker 108 has been changed to 0 (no output) as a result of the user operating the operation unit 105. This allows the user to operate the digital camera 100 in silent mode by changing the volume of sound output from the speaker 108.
[0044] <Shutter mode, electronic sound output and silent mode settings> An example of a method for setting the shutter mode, the output of electronic sound, and the silent mode will be described. FIGS. 3A to 3D are examples of menu screens of the digital camera 100 for setting the shutter mode, the output of electronic sound, and the silent mode. FIGS. 4A and 4B are examples of menu screens of the digital camera 100 when the digital camera 100 transitions to the silent mode. In response to receiving an operation for transitioning to the menu screen from the user via the operation unit 105, the control unit 101 displays the menu screen on, for example, the display unit 106. The user can change each setting by operating the operation unit 105. In this embodiment, the control unit 101 displays the menu screen as shown in FIG. 3A. An item 200 is an item for setting the shutter mode. An item 210 is an item for setting whether the digital camera 100 outputs electronic sound to the headphones. An item 220 is an item for setting whether the digital camera 100 operates in the silent mode. In this embodiment, when a certain item is selected, the control unit 101 controls the display unit 106 not to display other items. This makes it easier for the user to select an option for the selected item.
[0045] In FIG. 3(A), when the user selects item 200 via the operation unit 105, the control unit 101 displays a menu for selecting either the mechanical shutter mode or the electronic shutter mode as shown in FIG. 3(B). When the user selects option 201, the digital camera 100 is changed to a setting for taking pictures in the mechanical shutter mode. In this case, the control unit 101 controls not to output the electronic shutter sound to the speaker 108 regardless of the electronic sound setting. This is because, for example, when a user takes a picture, if the user hears both the opening and closing sound of the shutter of the imaging unit 102 and the electronic shutter sound, the user may not know which sound was used to take the picture. When the user selects option 202, the digital camera 100 is changed to a setting for taking pictures in the electronic shutter mode. In this case, if the silent mode is not selected, the control unit 101 controls to output the electronic sound to the speaker 108.
[0046] In FIG. 3(A), when the user selects item 210 via the operation unit 105, the control unit 101 displays a menu for selecting whether or not to output electronic sounds, as shown in FIG. 3(C). When the user selects option 211 ("on"), the control unit 101 controls the digital camera 100 to output electronic sounds from the speaker 108 unless the camera is in silent mode. When the user selects option 212 ("shutter only"), the control unit 101 controls the digital camera 100 to output electronic shutter sounds from the speaker 108 when the camera is not in silent mode. On the other hand, the control unit 101 controls the digital camera 100 not to output other electronic sounds. When the user selects option 213 ("off"), the control unit 101 controls the digital camera 100 not to output electronic sounds from the speaker 108 and the external speaker. In this way, the user can enable (on) or disable (off) the electronic sound output function of the digital camera 100 by selecting the option of item 210.
[0047] In FIG. 3(A), when the user selects item 220 via the operation unit 105, the control unit 101 displays a menu for selecting whether to operate in silent mode (on or off) as shown in FIG. 3(D). When the user selects option 221 ("on"), the digital camera 100 operates in silent mode. When the user selects option 222 ("off"), the digital camera 100 cancels silent mode. When the user selects option 221 ("on"), the control unit 101 operates in electronic shutter mode and controls so as not to output electronic sounds from the speaker 108. For example, when silent mode is on, the control unit 101 displays items 200 and 210 in a shaded manner as shown in FIG. 4(A), and displays so that the settings related to the shutter mode and electronic sounds cannot be changed.
[0048] Here, when an external speaker such as a headphone is connected, even if the digital camera 100 is operating in silent mode, the control unit 101 can output the electronic sound to the external speaker. In this embodiment, for example, when a headphone is connected to the digital camera 100 in silent mode, the control unit 101 automatically changes the setting so that the electronic sound is output to the headphone. In this case, as shown in FIG. 4B, for example, unlike the screen shown in FIG. 4A, the control unit 101 displays the item 210 without shading. Here, when the setting of the item 210 is changed by a user operation, the control unit 101 controls whether or not to output the electronic sound to the headphone according to the setting. However, in silent mode, the control unit 101 does not output the electronic sound from the speaker 108 regardless of the setting of the item 210. Therefore, even if the setting of the same item is the same, the processing of the control unit 101 is automatically switched depending on whether or not the headphone is connected.
[0049] In this way, when a user operation to operate in silent mode is accepted, the control unit 101 automatically controls the digital camera 100 to operate in electronic shutter mode and not to output electronic sounds. However, if headphones are connected to the digital camera 100, the control unit 101 can output electronic sounds to the headphones. This allows the user to hear the electronic sounds even while operating the digital camera 100 in silent mode. In particular, since the digital camera can output the electronic shutter sound from the headphones even in silent mode, in which no sound is output to the surroundings, the user can know when the digital camera 100 has taken a picture.
[0050] In this embodiment, in order to indicate that a user operation is not accepted, the control unit 101 displays the item with a shading in Fig. 4(A) and Fig. 4(B), but a display method other than shading may be used. For example, the control unit 101 does not display an item that does not accept a user operation. Also, for example, when an item that does not accept a user operation is selected by a user operation, the control unit 101 displays a warning such as "Cannot be changed in silent mode." Also, for example, even when an item that does not accept a user operation is selected by a user operation, the control unit 101 notifies the user that the selected item cannot be changed by not returning a response to the user.
[0051] Next, wireless communication between the digital camera 100 and the wireless headphones 200 will be described. Here, as an example, a use case will be described in which the user hears an electronic sound from the wireless headphones 200. This use case is, for example, a use case in which the user is in a situation where he or she needs to take pictures quietly and operates the digital camera 100 in silent mode. In this use case, the digital camera 100 outputs an electronic sound to the wireless headphones 200 in response to the user operating the operation unit 105. For example, when the release switch is half-pressed, the digital camera 100 outputs a focusing sound to the wireless headphones 200 in response to focusing on a subject by AF processing. When the release switch is fully pressed, the digital camera 100 outputs an electronic shutter sound to the wireless headphones 200 in response to capturing an image. In addition, for example, when the imaging parameters are changed in response to the user operating the operation unit 105, the digital camera 100 outputs an electronic sound indicating that the user operation has been accepted to the wireless headphones. In this way, the digital camera 100 of this embodiment can output audio data to the wireless headphones 200 in response to the user operation.
[0052] Here, the output process of the audio data of the wireless headphones 200 will be described. The wireless headphones 200 require a certain amount of time from receiving the audio data to outputting it. This is mainly because the wireless headphones 200 record the audio data in a buffer for a certain amount of time before outputting the audio data in order to prevent error detection of the audio data and interruption of the sound output. For this reason, when the digital camera 100 transmits audio data of the electronic shutter sound to the wireless headphones 200 in response to the satisfaction of the imaging conditions as in the normal electronic shutter mode, there is a risk that the following will occur. That is, the timing at which the wireless headphones 200 output the electronic shutter sound may be significantly delayed compared to the timing at which the digital camera 100 captures an image. In other words, there is a risk that the user may misinterpret the timing at which the digital camera 100 captured an image due to a large difference between the timing at which the digital camera 100 captured an image and the timing at which the user heard the electronic shutter sound. Therefore, in this embodiment, after the release switch is fully pressed, the digital camera 100 transmits the audio data before the determination of whether the imaging conditions are satisfied is completed. This makes it possible to reduce the time difference between the timing at which the user hears the electronic shutter sound and the timing at which the digital camera 100 captures an image.
[0053] <Wireless connection process with wireless headphones 200> First, an example of a series of processes from when the digital camera 100 establishes a wireless connection with the wireless headphones 200 until when it is disconnected will be described with reference to Fig. 5. This process of the digital camera 100 is realized by software recorded in the non-volatile memory 103 being loaded into the working memory 104 and executed by the control unit 101. For example, this process is triggered by the digital camera 100 receiving an operation from the user via the operation unit 105 instructing the digital camera 100 to establish a wireless connection with the wireless headphones.
[0054] In step S501, the control unit 101 searches for wireless headphones via the communication unit 111. For example, when wirelessly connecting to paired wireless headphones, the control unit 101 executes a call process using Bluetooth. In this call process, the control unit 101 transmits a call packet including identification information of the paired wireless headphones. Also, for example, when there is a possibility of wirelessly connecting to wireless headphones that are not paired, the control unit 101 executes an inquiry process using Bluetooth. In this inquiry process, the control unit 101 broadcasts an IQ packet.
[0055] In step S502, the control unit 101 determines whether or not wireless headphones have been detected. For example, the control unit 101 determines whether or not a response packet to the paging packet or IQ packet transmitted in step S501 has been received via the communication unit 111. If the control unit 101 determines that wireless headphones have been detected, the process proceeds to step S505. If the control unit 101 determines that wireless headphones have not been detected, the process proceeds to step S503.
[0056] In step S503, the control unit 101 determines whether a predetermined time has elapsed since the search for wireless headphones was started. For example, the control unit 101 determines whether one minute or more has elapsed since the call packet or IQ packet was transmitted. If the control unit 101 determines that the predetermined time has elapsed since the search for wireless headphones was started, the process proceeds to step S504. If the control unit 101 determines that the predetermined time has not elapsed since the search for wireless headphones was started, the process returns to step S502.
[0057] In step S504, the control unit 101 notifies the user that the wireless headphones were not detected. For example, the control unit 101 displays a message such as "wireless headphones not found" on the display unit 106 to notify the user that the wireless headphones were not detected. Next, a case where the control unit 101 detects wireless headphones in step S502 (a case where the process proceeds to step S505) will be described.
[0058] In step S505, the control unit 101 establishes a wireless connection with the wireless headphones via the communication unit 111. In this sequence, the control unit 101 will be described for the case where it establishes a wireless connection with the wireless headphones 200. For example, when a response packet is received from the wireless headphones 200 in response to a call packet, the control unit 101 transitions from a page hopping sequence to a channel hopping sequence and establishes a wireless connection with the wireless headphones 200. Also, for example, when a response packet is received from the wireless headphones 200 in response to an IQ packet, the control unit 101 executes pairing processing and establishes a wireless connection with the wireless headphones 200. This pairing processing is the same as the processing in which the central device and the peripheral device are paired as described above. After this step, the control unit 101 determines the profile to be used based on the profile information corresponding to the wireless headphones 200.
[0059] In step S506, the control unit 101 determines whether the wireless headphones 200 can receive audio data and control data. For example, in Bluetooth communication, the control unit 101 determines whether the wireless headphones 200 supports two protocols, A2DP and AVRCP. Here, A2DP is an abbreviation for Advanced Audio Distribution Profile, and AVRCP is an abbreviation for Audio / Video Remote Control Profile. Note that the control unit 101 can obtain information on the profile supported by the wireless headphones 200 from the wireless headphones 200 by using the above-mentioned SDP. If the control unit 101 determines that the wireless headphones 200 can receive audio data and control data, the process proceeds to step S507. If the control unit 101 determines that the wireless headphones 200 cannot receive audio data and control data, the process proceeds to step S508.
[0060] Here, the reason for determining whether the wireless headphones 200 can receive audio data and control data will be described. As described above, the wireless headphones 200 require a certain amount of time from receiving audio data to outputting the audio data. On the other hand, when the wireless headphones 200 receive control data, they immediately execute the control instructed by the control data. This is because the instructions by the control data include instructions that require immediacy, such as an instruction to start outputting audio data, an instruction to stop outputting audio data, and an instruction to adjust the output volume. In this embodiment, the digital camera 100 uses the control data to reduce the time difference between the timing at which the digital camera 100 captures an image and the timing at which the wireless headphones 200 output an electronic shutter sound.
[0061] In step S507, the control unit 101 starts communication processing with the wireless headphones 200 via the communication unit 111. For example, in wireless communication according to Bluetooth, the control unit 101 communicates according to two protocols, A2DP and AVRCP. When the control unit 101 disconnects the wireless connection with the wireless headphones 200, the processing proceeds to step S508. The control unit 101 may disconnect the wireless connection with the wireless headphones 200, for example, when a user operates the operation unit 105 to disconnect the wireless connection with the wireless headphones 200, when the control unit 101 does not receive a packet from the wireless headphones 200 for a predetermined period of time, etc.
[0062] In step S508, the control unit 101 disconnects the wireless connection with the wireless headphones 200, and ends the processing of this sequence. Next, a case where the control unit 101 determines in step S506 that the wireless headphones 200 cannot receive audio data and control data will be described.
[0063] In step S509, the control unit 101 notifies the user that the wirelessly connected wireless headphones 200 cannot be used, and ends the process. For example, the control unit 101 displays a message on the display unit 106 notifying the user that the wireless headphones 200 cannot be used, such as "Communication with this wireless headphone is not possible." In this case, the control unit 101 also disconnects the wireless connection with the wireless headphones 200.
[0064] The above describes the wireless connection process between the digital camera 100 and the wireless headphones 200 in this embodiment. Next, an example of communication between the digital camera 100 and the wireless headphones 200 in step S507 in Fig. 5 will be described. In this embodiment, as an example of this communication, a process of transmitting an electronic shutter sound to the wireless headphones 200 when the digital camera 100, which has established a wireless connection with the wireless headphones 200, captures an image will be described as an example.
[0065] <Image capture processing using wireless headphones 200> An example of the process in which the digital camera 100 transmits an electronic shutter sound to the wireless headphones 200 during imaging processing will be described with reference to Fig. 6. This process in the digital camera 100 is realized by software recorded in the non-volatile memory 103 being loaded into the work memory 104 and executed by the control unit 101. For example, this process is started when the process in step S507 in Fig. 5 is executed.
[0066] In step S601, the control unit 101 controls the wireless headphones 200 so as not to output sound. For example, in Bluetooth communication, the control unit 101 transmits a MUTE command to the wireless headphones 200 via the communication unit 111 in accordance with AVRCP. Also, for example, in Bluetooth communication, the control unit 101 transmits a VOLUME command via the communication unit 111 in accordance with AVRCP so that the output volume of the wireless headphones 200 becomes 0. As a result, even if the wireless headphones 200 receives audio data, it will not output the audio data. The reason for this processing will be described later.
[0067] In step S602, the control unit 101 executes processing for maintaining a wireless connection with the wireless headphones 200. For example, in Bluetooth communication, the control unit 101 transmits audio data indicating silence via the communication unit 111 in accordance with A2DP. The processing in this step is processing for preventing the wireless connection between the digital camera 100 and the wireless headphones 200 from being disconnected in a state in which the control unit 101 is not transmitting data to or from the wireless headphones 200, such as a state in which the control unit 101 is not transmitting audio data for a predetermined period of time.
[0068] The reason why the control unit 101 executes this process is that the wireless headphones have a general function of automatically disconnecting the wireless connection with the wireless headphone when no communication is performed with the wirelessly connected device for a predetermined period of time. For example, while taking a picture, there is a period during which the user does not operate the digital camera 100, for example, deciding the composition of the picture or waiting for a photo opportunity. During that period, the digital camera 100 does not need to output audio data to the wireless headphone 200. Here, if a predetermined period of time has elapsed without the digital camera 100 transmitting data to the wireless headphone 200, the wireless headphone 200 will terminate the wireless connection with the digital camera 100, assuming that no communication has been performed for the predetermined period of time. Therefore, the digital camera 100 of this embodiment executes a process for maintaining the wireless connection with the wireless headphone 200 during the imaging process. Note that this predetermined period of time is generally about several minutes. In this embodiment, the predetermined period of time is assumed to be three minutes, for example.
[0069] In step S603, the control unit 101 determines whether or not the user has instructed the control unit 101 to capture an image. For example, the control unit 101 determines whether or not SW2 has been turned on. If the control unit 101 determines that the user has instructed the control unit 101 to capture an image, the process proceeds to step S604. If the control unit 101 determines that the user has not instructed the control unit 101 to capture an image, the process proceeds to step S611.
[0070] In step S604, the control unit 101 starts a process of determining whether or not the image capturing conditions are satisfied.
[0071] In step S605, the control unit 101 transmits the electronic shutter sound to the wireless headphones 200. For example, in Bluetooth communication, the control unit 101 transmits audio data of the electronic shutter sound via the communication unit 111 in accordance with A2DP. As described above, the wireless headphones 200 require a certain amount of time from receiving the audio data to outputting it, so the electronic shutter sound is not yet output in this step. Even if a sufficient amount of time has passed since the wireless headphones 200 received the audio data, the wireless headphones 200 are in a state not to output sound in step S601, so the electronic shutter sound is not output from the wireless headphones 200. Note that in parallel with this step, the control unit 101 executes a process of determining whether or not the imaging conditions are satisfied.
[0072] In step S606, the control unit 101 determines whether the determination of whether the imaging conditions are satisfied has been completed. The imaging conditions are satisfied, for example, when the subject is in focus or when the exposure is such that there is little whiteout or blackout, as described above. In this step as well, the control unit 101 executes the process of determining whether the imaging conditions are satisfied. If the control unit 101 determines that the determination of whether the imaging conditions are satisfied has been completed, the process proceeds to step S608. If the control unit 101 determines that the determination of whether the imaging conditions are satisfied has not been completed, the process proceeds to step S607.
[0073] In step S607, the control unit 101 determines whether or not a predetermined time has passed since the control unit 101 transmitted the electronic shutter sound. If the control unit 101 determines that the predetermined time has not passed since the control unit 101 transmitted the electronic shutter sound, the process returns to step S606, and the control unit 101 continues the process of determining whether or not the image capturing conditions are satisfied. If the control unit 101 determines that the predetermined time has passed since the control unit 101 transmitted the electronic shutter sound, the process returns to step S605, and the control unit 101 transmits the electronic shutter sound again. This is because, if a predetermined time or more has passed since the control unit 101 transmitted the electronic shutter sound, it is highly likely that the wireless headphones 200 has completed the output process of the electronic shutter sound.
[0074] Here, if a predetermined time or more has passed since the control unit 101 transmitted the electronic shutter sound, the process of step S601 is particularly effective. In this case, at the time of the processes of steps S605 and S606, the digital camera 100 has not yet completed the determination of whether the imaging conditions are satisfied, and has not yet captured an image. If the wireless headphones 200 are in a state capable of outputting electronic sounds in this state, the wireless headphones 200 will output the electronic shutter sound, which may lead the user to mistakenly believe that the imaging process has been completed. Therefore, in this state, it is desirable for the wireless headphones 200 not to output the electronic shutter sound yet. However, if the wireless headphones 200 are in a state capable of outputting electronic sounds, the wireless headphones 200 will output the electronic shutter sound a predetermined time after receiving the audio data, regardless of whether the imaging conditions of the digital camera 100 are satisfied. Since the digital camera 100 and the wireless headphones 200 are independent devices, it is difficult for the digital camera 100 to control the timing of outputting the electronic shutter sound of the wireless headphones 200 according to the state of its own processing after transmitting the electronic shutter sound. Therefore, in the process of step S601, the digital camera 100 performs control in advance via the communication unit 111 so as not to output sound from the wireless headphones 200. This reduces the possibility that the wireless headphones 200 will output the electronic shutter sound at an inappropriate time, even if the digital camera 100 transmits the electronic shutter sound before the imaging conditions are satisfied.
[0075] In step S608, the control unit 101 determines whether the imaging conditions are satisfied. If the control unit 101 determines that the imaging conditions are satisfied, the process proceeds to step S609. If the control unit 101 determines that the imaging conditions are not satisfied, the process proceeds to step S612.
[0076] In step S609, the control unit 101 controls the wireless headphones 200 so that sound can be output. For example, in Bluetooth communication, if the MUTE command was sent in step S601, the control unit 101 sends a command to cancel the MUTE command to the wireless headphones 200 via the communication unit 111 in accordance with AVRCP. Also, for example, in Bluetooth communication, the control unit 101 sends a VOLUME command via the communication unit 111 in accordance with AVRCP so that the output volume of the wireless headphones 200 becomes an arbitrary volume greater than 0. The processing of this step puts the wireless headphones 200 in a state where it can output electronic sound.
[0077] In step S610, the control unit 101 causes the imaging unit 102 to capture an image.
[0078] In step S611, the control unit 101 waits for a predetermined time. The purpose of the process of this step is to have the control unit 101 wait until the wireless headphones 200 output the electronic shutter sound. Therefore, when the process of step S610 is completed, if it is determined that the wireless headphones 200 are definitely outputting the electronic shutter sound, the control unit 101 does not need to execute the process of this step.
[0079] In step S612, the control unit 101 controls the wireless headphones 200 so as not to output sound. The process of this step is similar to the process of step S601 in FIG.
[0080] In step S613, the control unit 101 determines whether or not to disconnect the wireless connection with the wireless headphones 200. For example, the control unit 101 determines whether or not the user has performed an operation to disconnect the wireless connection with the wireless headphones 200 through the operation unit 105. If the control unit 101 disconnects the wireless connection with the wireless headphones 200, the processing of this sequence ends. If the control unit 101 does not disconnect the wireless connection with the wireless headphones 200, the processing returns to step S602.
[0081] The above describes an example of imaging processing using the wireless headphones 200 of the digital camera 100. This allows the digital camera 100 to reduce the time difference between when an image is captured and when the wireless headphones 200 output an electronic shutter sound.
[0082] In addition, in step S602, if it is determined that the wireless connection with the wireless headphones 200 will not be disconnected, the control unit 101 may not execute the process of step S602. For example, if an electronic sound was output to the wireless headphones 200 10 seconds ago, the control unit 101 can determine that the wireless connection with the wireless headphones 200 will not be disconnected. This is because, as described above, the time period in which the wireless headphones 200 in this embodiment automatically disconnects the wireless connection with the other device is 3 minutes, and 10 seconds is sufficiently shorter than 3 minutes.
[0083] In addition, while the control unit 101 is determining whether the imaging conditions are satisfied (the processing from step S604 to step S608), the control unit 101 does not need to execute processing for maintaining the wireless connection with the wireless headphones 200. This is because, in general, it takes no more than one minute for the control unit 101 to determine whether the imaging conditions are satisfied. Therefore, for the same reason as above, in the processing from step S604 to step S608, the control unit 101 can determine that the wireless connection with the wireless headphones 200 will not be disconnected. In addition, while determining whether the imaging conditions are satisfied (the processing from step S604 to step S608), the control unit 101 may control the imaging unit 102 in parallel. For example, if the control unit 101 can determine that the subject is not in focus at the time when the user instructs to shoot in step S603, the control unit 101 executes AF processing on the subject in parallel with the processing for determining whether the imaging conditions are satisfied. This AF processing may enable the control unit 101 to resolve the state in which the subject is not in focus, which is a state in which the imaging conditions are not satisfied. Then, when the state where the imaging conditions are not satisfied is resolved by focusing on the subject through AF processing, the control unit 101 can execute imaging processing in step S610. In this way, even while determining whether the imaging conditions are satisfied, the control unit 101 executes processing to resolve the state where the imaging conditions are not satisfied, thereby reducing the risk that the control unit 101 will not be able to execute the user's imaging instruction. Note that while this AF processing is being executed, the control unit 101 determines that it is in a state where it is determining whether the imaging conditions are satisfied.
[0084] An example of a sequence of wireless communication processing between the digital camera 100 and the wireless headphones 200 will be described with reference to Fig. 7. The sequence shown in Fig. 7 corresponds to an example of processing by the digital camera 100 described with reference to the flowcharts of Fig. 5 and Fig. 6. The sequence in Fig. 7 corresponds to a case where the image capturing conditions are satisfied in step S608 in Fig. 6.
[0085] In step S701, the digital camera 100 makes a connection request to the wireless headphones 200. For example, in Bluetooth communication, the digital camera 100 transmits a call packet. The process of this step corresponds to the process of step S501 in FIG.
[0086] In step S702, the wireless headphones 200 respond to the connection request from the digital camera 100. For example, in Bluetooth communication, the wireless headphones 200 transmit a response packet in response to a call packet received from the digital camera 100. The processing of this step corresponds to, for example, the processing of step S502 in FIG.
[0087] In step S703, the digital camera 100 and the wireless headphones 200 establish a wireless connection. For example, in Bluetooth communication, the digital camera 100 and the wireless headphones 200 establish this wireless connection. Note that in Bluetooth communication, from this step onwards, the digital camera 100 and the wireless headphones 200 communicate according to a predetermined protocol. The predetermined protocols are, for example, two protocols, A2DP and AVRCP. The processing in this step corresponds to, for example, the processing in steps S505 and S506 in FIG. 5.
[0088] In step S704, the digital camera 100 controls the wireless headphones 200 so as not to output sound. For example, in Bluetooth communication, the control unit 101 transmits a MUTE command to the wireless headphones 200 via the communication unit 111 in accordance with AVRCP. The processing of this step corresponds to, for example, the processing of step S601 in FIG. 6.
[0089] In step S705, the digital camera 100 executes a process for maintaining a wireless connection with the wireless headphones 200. For example, the digital camera 100 transmits audio data indicating silence. The digital camera 100 repeats the process of this step until an image capture instruction is received from the user. The process of this step corresponds to the process of step S602 in FIG. 6, for example.
[0090] In step S706, the user instructs the digital camera 100 to capture an image. For example, the user fully presses the release switch on the operation unit 105. The process of this step corresponds to, for example, the process of step S603 in FIG.
[0091] In step S707, the digital camera 100 transmits audio data of the electronic shutter sound to the wireless headphones 200. The process of this step corresponds to, for example, the process of step S605 in FIG.
[0092] In step S708, the digital camera 100 completes the determination of whether or not the image capturing conditions are satisfied. The process of this step corresponds to, for example, the process of step S608 in FIG.
[0093] In step S709, the digital camera 100 controls the wireless headphones 200 so that sound can be output. For example, in Bluetooth communication, if the MUTE command was sent in step S704, the control unit 101 sends a command to cancel the MUTE command to the wireless headphones 200 via the communication unit 111 in accordance with AVRCP. The wireless headphones 200 are controlled by the digital camera 100, and are able to output audio data from this step onwards. The processing in this step corresponds to, for example, the processing in step S609 in FIG. 6.
[0094] In step S710, the digital camera 100 captures an image. The process of this step corresponds to, for example, the process of step S611 in FIG.
[0095] In step S711, the wireless headphones 200 output an electronic shutter sound. Note that the time from the process of step S707 to the process of step S711 is equal to or less than the time for the wireless headphones 200 to output the electronic shutter sound. Here, the process of step S710 and the process of step S711 are executed in parallel.
[0096] In step S712, the digital camera 100 controls the wireless headphones 200 so as not to output sound. The process of this step is similar to the process of step S704. Also, the process of this step corresponds to the process of step S612 in FIG.
[0097] In step S713, the digital camera disconnects the wireless connection with the wireless headphones 200, and ends the processing of this sequence. The processing of this step corresponds to the processing of step S508 in FIG.
[0098] An example of a series of processes for communication between the digital camera 100 and the wireless headphones 200 in this embodiment has been described above.
[0099] An example of the process in which the wireless headphones 200 output sound will now be described with reference to Fig. 8. Fig. 8 is a diagram showing an example of the relationship between packets received by the wireless headphones 200 from the digital camera 100 and the timing of the operation of the wireless headphones 200. Here, a series of processes from when the wireless headphones 200 establish a wireless connection with the digital camera 100 to when the wireless headphones 200 output the electronic shutter sound will be described.
[0100] At time T801, the wireless headphones 200 receive control data instructing the digital camera 100 not to output sound. For example, in Bluetooth communication, the wireless headphones 200 receive a MUTE command. The process at time T801 corresponds to, for example, the process at step S704 in FIG.
[0101] At time T802, the wireless headphones 200 execute the instructions of the control data received at time T801. From this time, the wireless headphones 200 enter a state in which they do not output audio data. Here, the time from when the wireless headphones 200 receives the control data to when they execute it (the time from time T801 to time T802) is defined as time X.
[0102] At time T803, the wireless headphones 200 receive audio data indicating silence (audio data A). The wireless headphones 200 records this audio data A in the buffer. The process at time T803 corresponds to, for example, the process at step S705 in FIG.
[0103] At time T804, the wireless headphones 200 start output processing of the audio data A. However, since the wireless headphones 200 are in a state not to output audio data at time T802, the audio data A is not actually output. Furthermore, since the audio data A is audio data indicating silence, even if the wireless headphones 200 are in a state in which they can output audio data due to a user operation or other reason, no sound is output from the wireless headphones 200. Here, the time from when the wireless headphones 200 receive the audio data to when it executes it (the time from time T803 to time T804) is defined as time Y.
[0104] At time T805, the wireless headphones 200 receive audio data of the electronic shutter sound (audio data B). The process at time T805 corresponds to, for example, the process at step S707 in FIG.
[0105] At time T806, the wireless headphones 200 receive control data instructing them to output sound. For example, in Bluetooth communication, if the wireless headphones 200 receives a MUTE command at time T801, the wireless headphones 200 transmits control data to cancel the MUTE command. The process at time T806 corresponds to, for example, the process at step S710 in FIG. 7.
[0106] At time T807, the wireless headphones 200 execute the instructions of the control data received at time T806. From this time, the wireless headphones 200 are ready to output audio data. Note that the wireless headphones 200 of this embodiment deletes audio data from the buffer after time Y has elapsed while not outputting audio data.
[0107] At time T808, the wireless headphones 200 output audio data of the electronic shutter sound. The process at time T806 corresponds to, for example, the process at step S712 in Fig. 7. Note that, close to time T808, the digital camera 100 is executing an image capture process.
[0108] The above describes an example of the process of outputting sound by the wireless headphones 200. Since the time X is shorter than the time Y as shown in Fig. 8, the digital camera 100 can output the electronic shutter sound at the right time through the wireless headphones 200 by using the control data.
[0109] In this embodiment, an example has been described in which two profiles, A2DP and AVRCP, are used in Bluetooth communication. In addition to these two profiles, HSP (HeadSet Profile) or HFP (Hands-Free Profile) may also be used in Bluetooth communication. In this case, the control data uses AT commands defined in HSP or HFP.
[0110] In this embodiment, before the user instructs the digital camera 100 to capture an image, the digital camera 100 controls the wireless headphones 200 so as not to output sound. As another method, the digital camera 100 may control the wireless headphones 200 so as not to output sound after the user instructs the digital camera 100 to capture an image. In this case, the user can hear the sound indicating that the subject has been focused on, the operation sound, and the like, before fully pressing the release switch.
[0111] Moreover, the operation of the digital camera 100 of this embodiment is more preferable for still image shooting than for video shooting. In video shooting, a video of any duration can be shot, so the user can start shooting with a certain amount of time to spare. On the other hand, in still image shooting, the so-called shutter chance may be fleeting, so it is considered that the user places more importance on the timing of shooting. By using the method shown in this embodiment for still image shooting, the digital camera 100 can more accurately notify the user of the timing of capturing a still image even when using wireless headphones. In video shooting, in order to notify the user as soon as possible that shooting has started, the digital camera 100 transmits audio data of an electronic sound indicating that video shooting has started to the wireless headphones in response to the start of video shooting.
[0112] [Second embodiment] In the second embodiment, the digital camera 100 changes the timing of transmitting the audio data of the electronic shutter sound according to the delay of the wireless headphones. Generally, some wireless headphones have a short time from receiving the audio data to outputting it, and some have a long time from receiving the audio data to outputting it, depending on the performance of the wireless headphones. If the wireless headphones have a short time from receiving the audio data to outputting it, even if the electronic shutter sound is received after the imaging conditions are satisfied, the possibility of the digital camera 100 reproducing the electronic shutter sound with a large difference from the timing of imaging is low. On the other hand, if the headphones have a long time from receiving the audio data to outputting it, the possibility of the digital camera 100 reproducing the electronic shutter sound with a large difference from the timing of imaging is high if the electronic shutter sound is not received before the imaging conditions are satisfied. Therefore, in this embodiment, the digital camera 100 changes the timing of transmitting the electronic shutter sound according to the time from receiving the audio data to outputting it by the wireless headphones. The configurations of the digital camera 100 and the wireless headphones 200 used in this embodiment are the same as those in the first embodiment.
[0113] An example of a method for measuring the time from when the wireless headphones 200 receive audio data to when it outputs the data will be described. The digital camera 100 transmits audio data for measurement to the wireless headphones 200 via the communication unit 111. The timing when the digital camera 100 transmits the audio data is set as time T1. The digital camera 100 then collects the audio data for measurement output from the wireless headphones 200 via the microphone 107. The timing when the digital camera 100 collects the audio data for measurement is set as time T2. The digital camera 100 can measure the time from when the wireless headphones 200 receive audio data to when it outputs the audio data by calculating using the difference between the time T2 and the time T1, the processing time of the sound collected by the microphone 107, and the like. Alternatively, the digital camera 100 may perform the calculation from information on the performance of the wireless headphones 200, such as a spec sheet available on the Internet, for example.
[0114] <Wireless connection process with wireless headphones 200> An example of a series of processes from when the digital camera 100 establishes a wireless connection with the wireless headphones 200 until when it is disconnected will be described with reference to Fig. 9. This process of the digital camera 100 is realized by software recorded in the non-volatile memory 103 being loaded into the working memory 104 and executed by the control unit 101. For example, this process is triggered by the digital camera 100 receiving an operation from the user via the operation unit 105 instructing the digital camera 100 to establish a wireless connection with the wireless headphones.
[0115] The processes from step S901 to step S905 are similar to the processes from step S501 to step S505 in FIG. 5, respectively, and therefore description thereof will be omitted.
[0116] In step S906, the control unit 101 determines whether the wireless headphones 200 can receive audio data and control data. For example, in Bluetooth communication, the control unit 101 determines whether the wireless headphones 200 supports two protocols, A2DP and AVRCP. If the control unit 101 determines that the wireless headphones 200 can receive audio data and control data, the process proceeds to step S907. If the control unit 101 determines that the wireless headphones 200 cannot receive audio data and control data, the process proceeds to step S911.
[0117] In step S907, the control unit 101 judges whether the time from when the wireless headphones 200 receive audio data to when it outputs it is long. In this embodiment, if the time from when the wireless headphones 200 receive audio data to when it outputs it is unknown, the digital camera 100 judges that the time from when the wireless headphones 200 receive audio data to when it outputs it is long. If the control unit 101 judges that the time from when the wireless headphones 200 receive audio data to when it outputs it is long, the process proceeds to step S908. If the control unit 101 judges that the time from when the wireless headphones 200 receive audio data to when it outputs it is short, the process proceeds to step S909.
[0118] In step S908, the control unit 101 starts communication processing in the case of communicating with wireless headphones that take a long time from receiving audio data to outputting it. This communication processing is the same as the sequence described in the first embodiment with reference to FIG. 6. Then, when the control unit 101 disconnects the wireless connection with the wireless headphones 200, the processing proceeds to step S910. The control unit 101 may disconnect the wireless connection with the wireless headphones 200, for example, when a user operates the operation unit 105 to disconnect the wireless connection with the wireless headphones 200, when the control unit 101 does not receive a packet from the wireless headphones 200 for a predetermined period of time, etc.
[0119] In step S909, the control unit 101 starts a communication process for communicating with wireless headphones that have a short time between receiving and outputting audio data. This communication process will be described later with reference to Fig. 10. When the control unit 101 disconnects the wireless connection with the wireless headphones 200, the process proceeds to step S910.
[0120] The processes in steps S910 and S911 are similar to those in steps S508 and S509 in FIG. 5, respectively, and therefore will not be described.
[0121] The above describes the wireless connection process between the digital camera 100 and the wireless headphones 200 in this embodiment. Next, an example of communication between the digital camera 100 and the wireless headphones 200 in step S909 in Fig. 9 will be described. Note that the example of communication between the digital camera 100 and the wireless headphones 200 in step S908 in Fig. 9 is similar to the process described using Fig. 6, so a description thereof will be omitted.
[0122] <Image capture process using wireless headphones 200 that take a short time to output sound> An example of a process in which the digital camera 100 outputs an electronic shutter sound to the wireless headphones 200 that output the sound quickly during the imaging process will be described with reference to Fig. 10. This process in the digital camera 100 is realized by software recorded in the non-volatile memory 103 being loaded into the working memory 104 and executed by the control unit 101. For example, this process is started when the process in step S907 in Fig. 9 is executed.
[0123] In step S1000, the control unit 101 controls the wireless headphones 200 so that sound can be output. For example, in Bluetooth communication, when the MUTE command is transmitted in step S601, the control unit 101 transmits a command to cancel the MUTE command to the wireless headphones 200 via the communication unit 111 in accordance with AVRCP. Also, for example, in Bluetooth communication, the control unit 101 transmits a VOLUME command via the communication unit 111 in accordance with AVRCP so that the output volume of the wireless headphones 200 becomes an arbitrary volume greater than 0.
[0124] In step S1001, the control unit 101 executes a process for maintaining a wireless connection with the wireless headphones 200. For example, in Bluetooth communication, the control unit 101 transmits audio data indicating silence via the communication unit 111 in accordance with A2DP. Also, when the subject is focused on or when the user operates the operation unit 105, the control unit 101 transmits audio data indicating an operation sound, not audio data indicating silence. In addition, the process of this step may be any process for preventing the wireless connection with the wireless headphones 200 from being disconnected. Note that, when it is determined that the wireless connection with the wireless headphones 200 will not be disconnected, the control unit 101 does not need to execute the process of this step.
[0125] In step S1002, the control unit 101 determines whether or not a user has instructed the control unit 101 to capture an image. For example, the control unit 101 determines whether or not SW2 has been turned on. If the control unit 101 determines that a user has instructed the control unit 101 to capture an image, the process proceeds to step S1003. If the control unit 101 determines that a user has not instructed the control unit 101 to capture an image, the process proceeds to step S1006.
[0126] In step S1003, the control unit 101 determines whether the imaging conditions are satisfied. The imaging conditions are satisfied when, for example, the subject is in focus or the exposure is such that there is little whiteout or blackout, as described in the first embodiment. If the control unit 101 determines that the imaging conditions are satisfied, the process proceeds to step S1004. If the control unit 101 determines that the determination of whether the imaging conditions are satisfied has not been completed, the process proceeds to step S1006.
[0127] In step S1004, the control unit 101 transmits the electronic shutter sound to the wireless headphones 200. For example, in Bluetooth communication, the control unit 101 transmits audio data of the electronic shutter sound via the communication unit 111 in accordance with A2DP.
[0128] In step S1005, the control unit 101 causes the imaging unit 102 to capture an image.
[0129] In step S1006, the control unit 101 determines whether or not to disconnect the wireless connection with the wireless headphones 200. For example, the control unit 101 determines whether or not the user has performed an operation to disconnect the wireless connection with the wireless headphones 200 through the operation unit 105. If the control unit 101 disconnects the wireless connection with the wireless headphones 200, the processing of this sequence ends. If the control unit 101 does not disconnect the wireless connection with the wireless headphones 200, the processing returns to step S1001.
[0130] The above describes an example of imaging processing using the wireless headphones 200 that quickly output sound from the digital camera 100. When wirelessly connecting to the wireless headphones 200 that quickly output sound to the digital camera 100, the user can hear electronic sounds from the wireless headphones 200 in addition to the electronic shutter sound.
[0131] In step S1000, if the wireless headphones 200 cannot be controlled to output sound, the control unit 101 may notify the user of this by using, for example, the display unit 106. This allows the user to know that the electronic shutter sound cannot be heard from the wireless headphones 200.
[0132] An example of a sequence of wireless communication processing between the digital camera 100 and the wireless headphones 200 that output sound quickly will be described with reference to Fig. 11. The sequence shown in Fig. 11 corresponds to an example of processing by the digital camera 100 that has been described with reference to the flowcharts of Fig. 9 and Fig. 10. The sequence in Fig. 11 corresponds to a case where the imaging conditions are satisfied in step S1003 in Fig. 10.
[0133] The processing from steps S1101 to S1103 is similar to the processing from steps S701 to S703 in FIG. 7, and therefore the description thereof will be omitted.
[0134] In step S1104, the digital camera 100 controls the wireless headphones 200 so that sound can be output. For example, in Bluetooth communication, when the MUTE command is transmitted in step S704, the control unit 101 transmits a command to cancel the MUTE command to the wireless headphones 200 via the communication unit 111 in accordance with AVRCP. The wireless headphones 200 are controlled by the digital camera 100, and are thereby enabled to output audio data from this step onwards. The processing in this step corresponds to the processing in step S1000 in FIG. 10, for example.
[0135] In step S1105, the digital camera 100 executes processing to maintain a wireless connection with the wireless headphones 200. For example, the digital camera 100 transmits audio data indicating silence. Also, for example, when the subject is focused on or when the user operates the operation unit 105, the control unit 101 transmits audio data indicating an operation sound, rather than audio data indicating silence. The digital camera 100 repeats the processing of this step until an image capture instruction is received from the user.
[0136] In step S1106, the user instructs the digital camera 100 to capture an image. For example, the user fully presses the release switch on the operation unit 105. The process of this step corresponds to, for example, the process of step S1002 in FIG.
[0137] In step S1107, the digital camera 100 determines whether or not the image capturing conditions are satisfied. The process of this step corresponds to the process of step S1003 in FIG.
[0138] In step S1108, the digital camera 100 transmits audio data of the electronic shutter sound to the wireless headphones 200. The process of this step corresponds to, for example, the process of step S1004 in FIG.
[0139] In step S1109, the digital camera 100 captures an image. The process of this step corresponds to, for example, the process of step S1005 in FIG.
[0140] In step S1110, the wireless headphones 200 output an electronic shutter sound. Here, the process of step S1109 and the process of step S1110 are executed in parallel.
[0141] The process of step S1111 is similar to the process of step S714 in FIG. 7, and therefore the description thereof will be omitted.
[0142] An example of a series of processes for communication between the digital camera 100 and the wireless headphones 200 that output sound in a short time in this embodiment has been described above.
[0143] [Third embodiment] In the third embodiment, the digital camera 100 and the wireless headphones 200 do not directly communicate with each other via wireless communication, but the smartphone 300 communicates with the digital camera 100 and the wireless headphones 200 individually via wireless communication.
[0144] FIG. 12 is a diagram showing an example of a system configuration including a digital camera 100, a wireless headphone 200, and a smartphone 300 according to the third embodiment.
[0145] The smartphone 300 can be wirelessly connected to the wireless headphones 200 in accordance with the Bluetooth standard. In this wireless connection in accordance with the Bluetooth standard, audio data, music data, and the like can be transmitted to the wireless headphones 200 in synchronous communication. In addition, in the wireless connection in accordance with the Bluetooth standard, control data such as volume control and output instructions can be transmitted to the wireless headphones 200 in asynchronous communication. This allows the user to wirelessly connect the wireless headphones 200 to the smartphone 300 and listen to electronic sounds, music, and the like from the smartphone 300 via the wireless headphones 200.
[0146] <Configuration of Smartphone 300> 13A is a block diagram showing a configuration example of a smartphone 300, which is an example of a communication device of this embodiment. Note that, although a smartphone is described here as an example of a communication device, the communication device is not limited to this. For example, the communication device is a personal computer, a smart watch, a tablet terminal, etc. In this way, the communication device of this embodiment is a device that can be connected to an external speaker such as a headphone, like the above-mentioned device.
[0147] The control unit 301 controls each unit of the smartphone 300 according to a program described later.
[0148] The non-volatile memory 303 is an electrically erasable and recordable non-volatile memory, and stores programs, etc., which are executed by the control unit 301 and will be described later. The non-volatile memory 303 also stores audio data. This audio data is data for electronic sounds, such as the sound of an electronic shutter, that are output when information notifying that an image has been captured is received from the digital camera 100.
[0149] The work memory 304 is used as a work area for the control unit 301 .
[0150] The operation unit 305 is a user interface (UI) for receiving instructions from a user for the smartphone 300. The operation unit 305 may include, for example, a power switch for instructing to turn on / off the power of the smartphone 300. The operation unit 305 may also include a touch panel formed on the display unit 306.
[0151] The display unit 306 displays characters for interactive operations.
[0152] The speaker 308 is an electroacoustic transducer that can output electronic sounds. Examples of electronic sounds include music, warning sounds, focusing sounds, electronic shutter sounds, and operation sounds. In this embodiment, the control unit 301 can convert audio data recorded in the nonvolatile memory 303 into an audio signal and output the audio signal from the speaker 308.
[0153] The power supply unit 309 is controlled by the control unit 301 to supply power to each element of the smartphone 300. The power supply unit 309 is, for example, a power source such as a lithium ion battery or an alkaline manganese dry battery.
[0154] The first communication unit 311 is an interface for wirelessly connecting to an external device. The smartphone 300 of this embodiment can exchange data with the external device via the first communication unit 311. For example, audio data recorded in the non-volatile memory 303 can be transmitted to the external device via the first communication unit 311. The external device is, for example, an external speaker such as an earphone or a headphone. In this embodiment, the first communication unit 311 includes an interface for communicating with the external device according to the Bluetooth standard. The control unit 301 realizes wireless communication with the external device by controlling the first communication unit 311. The communication method is not limited to Bluetooth, and includes wireless communication methods such as so-called wireless LAN and infrared communication according to the IEEE802.11 standard.
[0155] The second communication unit 313 is a wireless communication interface having the same functions as the first communication unit 311 .
[0156] In this embodiment, the smartphone 300 is provided with two wireless communication interfaces, a first communication unit 311 and a second communication unit 313, and thereby can simultaneously perform wireless communication with two devices. Here, in this embodiment, the smartphone 300 communicates with the digital camera 100 via the first communication unit 311, and communicates with the wireless headphones 200 via the second communication unit 313.
[0157] The connection unit 312 is an interface for wired connection to an external device. The smartphone 300 of this embodiment can exchange data with the external device via the connection unit 312. The smartphone 300 can be wired via the connection unit 312 to an external speaker such as an earphone or a headphone, an external microphone, and an information device such as a smartphone or a PC.
[0158] Next, a description will be given of the external appearance of the smartphone 300. Fig. 13(B) is a diagram showing an example of an external view of the front of the smartphone 300. The operation button 105a and the touch panel 305b are operation members included in the operation unit 105 described above.
[0159] An example of the configuration of the smartphone 300 has been described above.
[0160] Next, wireless communication between the digital camera 100 and the smartphone 300, and wireless communication between the wireless headphones 200 and the smartphone 300 will be described. As an example of a use case, a user captures an image with the digital camera 100, and the digital camera 100 notifies the smartphone 300 that the image has been captured. Upon receiving the notification, the smartphone 300 transmits electronic sound data such as an electronic shutter sound to the wireless headphones 200. The user can hear the electronic shutter sound from the wireless headphones 200.
[0161] In the third embodiment, the digital camera 100 and the wireless headphones 200 do not directly communicate with each other by wireless communication, but the smartphone 300 mediates the wireless communication between the digital camera 100 and the wireless headphones 200 .
[0162] <Wireless connection processing between the digital camera 100 and the wireless headphones 200> An example of a series of processes from when the smartphone 300 establishes a wireless connection with the digital camera 100 and the wireless headphones 200 to when it disconnects the connection will be described with reference to FIG.
[0163] In step S1401, the control unit 301 searches for the digital camera 100 via the first communication unit 311. Details of the search process are the same as those in step S501, and therefore will not be repeated.
[0164] In step S1402, the control unit 301 determines whether or not the digital camera 100 has been detected. If the control unit 301 determines that the digital camera 100 has been detected, the process proceeds to step S1405. If the control unit 301 determines that the digital camera 100 has not been detected, the process proceeds to step S1403.
[0165] In step S1403, the control unit 301 determines whether or not a predetermined time has elapsed since starting the search for the digital camera 100. If the control unit 301 determines that the predetermined time has elapsed since starting the search for the digital camera 100, the process proceeds to step S1404. If the control unit 301 determines that the predetermined time has not elapsed since starting the search for the digital camera 100, the process returns to step S1402.
[0166] In step S1404, the control unit 301 notifies the user that it has not detected the digital camera 100. Next, a case where the control unit 301 detects the digital camera 100 in step S1402 will be described.
[0167] In step S 1405 , the control unit 301 establishes a wireless connection with the digital camera 100 via the first communication unit 311 .
[0168] In step S1406, the control unit 301 determines whether the digital camera 100 can transmit notification data related to the imaging process. For example, the notification data related to the imaging process is data notifying that a user has instructed to start imaging, that imaging will be performed, or that imaging will not be performed. If the control unit 301 determines that the digital camera 100 can transmit notification data related to the imaging process, the process proceeds to step S1408. If the control unit 301 determines that the digital camera 100 cannot transmit notification data related to the imaging process, the process proceeds to step S1407.
[0169] In step S1407, the control unit 301 notifies the user that the wirelessly connected digital camera 100 cannot be used, and ends the process. For example, the control unit 301 displays a message on the display unit 306 indicating that the digital camera 100 cannot be used. In this case, the control unit 301 disconnects the wireless connection with the digital camera 100.
[0170] Steps S1408 to S1414 are processes related to the wireless connection between the smartphone 300 and the wireless headphones 200. These processes are equivalent to the processes of steps S501 to S506 and step S509 in FIG. 5 of the first embodiment, and therefore detailed explanations will be omitted. The smartphone 300 performs the same process as the digital camera 100 on the wireless headphones 200. The smartphone 300 also uses the second communication unit 313 for wireless communication with the wireless headphones 200.
[0171] In step S1415, the control unit 301 starts communication processing with the digital camera 100 via the first communication unit 311, and starts communication processing with the wireless headphones 200 via the second communication unit 313. Details of the processing will be described later with reference to Fig. 15. Then, when the control unit 301 disconnects the wireless connection with the digital camera 100 and the wireless headphones 200, the processing proceeds to step S1416.
[0172] In step S1416, the control unit 301 disconnects the wireless connection with the digital camera 100 and the wireless headphones 200, and ends the processing of this sequence.
[0173] The wireless connection process between the smartphone 300, the digital camera 100, and the wireless headphones 200 in this embodiment has been described above.
[0174] Next, an example of communication between the smartphone 300, the digital camera 100, and the wireless headphones 200 in step S1415 in Fig. 14 will be described. In this embodiment, as an example of this communication, a process in which the smartphone 300 receives notification data related to imaging processing from the digital camera 100 and transmits an electronic shutter sound to the wireless headphones 200 when the digital camera 100 captures an image will be described as an example.
[0175] <Audio Data Transmission Processing Using Digital Camera 100 and Wireless Headphones 200> An example of a process in which the smartphone 300 transmits an electronic shutter sound to the wireless headphones 200 during imaging processing by the digital camera 100 will be described with reference to FIG.
[0176] In step S1501, the control unit 301 controls the wireless headphones 200 so as not to output sound. For example, in Bluetooth communication, the control unit 301 transmits a MUTE command to the wireless headphones 200 via the communication unit 111 in accordance with AVRCP. This causes the wireless headphones 200 to enter a state in which it does not output audio data even if the wireless headphones 200 receives the audio data.
[0177] In step S1502, the control unit 301 executes a process for maintaining a wireless connection with the wireless headphones 200. For example, in Bluetooth communication, the control unit 301 transmits audio data indicating silence via the second communication unit 313 in accordance with A2DP. The process of this step is a process for preventing the wireless connection between the smartphone 300 and the wireless headphones 200 from being disconnected.
[0178] In step S1503, the control unit 301 determines whether or not a notification packet indicating that an instruction to start imaging has been issued has been received from the digital camera 100 via the first communication unit 311. If the control unit 301 determines that a notification packet indicating that an instruction to start imaging has been issued has been received, the process proceeds to step S1504. If the control unit 301 determines that a notification packet indicating that an instruction to start imaging has been issued has not been received, the process proceeds to step S1510.
[0179] In step S1504, the control unit 301 transmits the electronic shutter sound to the wireless headphones 200. For example, in Bluetooth communication, the control unit 301 transmits audio data of the electronic shutter sound in accordance with A2DP via the second communication unit 313. As described above, the wireless headphones 200 require a certain amount of time from receiving the audio data to outputting it, so in this step, the electronic shutter sound is not yet output.
[0180] In step S1505, the control unit 301 determines whether or not a notification packet to the effect that imaging will be executed has been received from the digital camera 100 via the first communication unit 311. If the control unit 301 determines that a notification packet to the effect that imaging will be executed has been received from the digital camera 100, the process proceeds to step S1507. If the control unit 301 determines that a notification packet to the effect that imaging will be executed has not been received from the digital camera 100, the process proceeds to step S1506.
[0181] In step S1506, the control unit 301 determines whether or not a notification packet to the effect that imaging will not be performed has been received from the digital camera 100 via the first communication unit 311. If the control unit 301 determines that a notification packet to the effect that imaging will not be performed has been received from the digital camera 100, the process proceeds to step S1510. If the control unit 301 determines that a notification packet to the effect that imaging will not be performed has not been received from the digital camera 100, the process proceeds to step S1511.
[0182] In step S1511, control unit 301 determines whether a predetermined time has passed since transmitting the electronic shutter sound. If control unit 301 determines that the predetermined time has not passed since transmitting the electronic shutter sound, processing returns to step S1505, and control unit 301 continues processing to determine whether a notification packet to execute image capture has been received from digital camera 100. If control unit 301 determines that the predetermined time has passed since transmitting the electronic shutter sound, processing proceeds to step S1510. In this case, control unit 301 determines that image capture has not been completed in the image capture processing of digital camera 100.
[0183] In step S1507, the control unit 301 controls the wireless headphones 200 so that sound can be output. For example, in Bluetooth communication, if the MUTE command was sent in step S1501, the control unit 301 sends a command to cancel the MUTE command to the wireless headphones 200 via the second communication unit 313 in accordance with AVRCP. The processing in this step puts the wireless headphones 200 in a state in which it can output electronic sound.
[0184] In step S1508, the control unit 301 waits for a predetermined time. The purpose of the process in this step is to make the control unit 301 wait until the wireless headphones 200 output the electronic shutter sound.
[0185] In step S1509, the control unit 301 controls the wireless headphones 200 not to output sound. It is assumed here that when the process of step S1509 is executed, the wireless headphones 200 has finished outputting the electronic shutter sound.
[0186] In step S1510, the control unit 301 determines whether or not to disconnect the wireless connection with the wireless headphones 200. For example, the control unit 301 determines whether or not the user has performed an operation to disconnect the wireless connection with the wireless headphones 200 using the operation unit 305. If the control unit 301 disconnects the wireless connection with the wireless headphones 200, the processing of this sequence ends. If the control unit 301 does not disconnect the wireless connection with the wireless headphones 200, the processing returns to step S1502.
[0187] The above describes an example of imaging processing using the digital camera 100 and the wireless headphones 200 via the smartphone 300. This allows the smartphone 300 to reduce the time difference between when the digital camera 100 captures an image and when the wireless headphones 200 output an electronic shutter sound.
[0188] An example of a sequence of wireless communication processing between the digital camera 100, the wireless headphones 200, and the smartphone 300 will be described with reference to Fig. 16. The sequence shown in Fig. 16 corresponds to an example of processing by the smartphone 300 described with reference to the flowcharts of Figs. 14 and 15.
[0189] In step S1601, the smartphone 300 makes a connection request to the digital camera 100. For example, in Bluetooth communication, the smartphone 300 transmits a call packet. The process of this step corresponds to, for example, the process of step S1401 in FIG.
[0190] In step S1602, the digital camera 100 responds to the connection request from the smartphone 300. For example, in Bluetooth communication, the digital camera 100 transmits a response packet in response to a call packet received from the smartphone 300. The processing of this step corresponds to, for example, the processing of step S1402 in FIG.
[0191] In step S1603, the smartphone 300 and the digital camera 100 establish a wireless connection. For example, in Bluetooth communication, the smartphone 300 and the digital camera 100 establish this wireless connection. Note that in Bluetooth communication, after this step, the smartphone 300 and the digital camera 100 communicate according to a predetermined protocol. The processing in this step corresponds to, for example, the processing in steps S1405 and S1406 in FIG. 14.
[0192] In step S1604, the smartphone 300 executes a process for maintaining the wireless connection with the digital camera 100.
[0193] In step S1605, the smartphone 300 sends a connection request to the wireless headphones 200. For example, in Bluetooth communication, the smartphone 300 transmits a call packet. The process of this step corresponds to, for example, the process of step S1408 in FIG.
[0194] In step S1606, the wireless headphones 200 respond to the connection request from the smartphone 300. For example, in Bluetooth communication, the wireless headphones 200 transmit a response packet in response to a call packet received from the smartphone 300. The process of this step corresponds to, for example, the process of step S1409 in FIG.
[0195] In step S1607, the smartphone 300 and the wireless headphones 200 establish a wireless connection. For example, in Bluetooth communication, the smartphone 300 and the wireless headphones 200 establish this wireless connection. Note that in Bluetooth communication, after this step, the smartphone 300 and the wireless headphones 200 communicate with each other according to a predetermined protocol. The process of this step corresponds to, for example, the processes of steps S1412 and S1413 in FIG. 14.
[0196] In step S1608, the smartphone 300 controls the wireless headphones 200 so as not to output sound. For example, in Bluetooth communication, the control unit 301 transmits a MUTE command to the wireless headphones 200 via the second communication unit 313 in accordance with AVRCP. The process of this step corresponds to, for example, the process of step S1501 in FIG. 15.
[0197] In step S1609, the smartphone 300 executes a process for maintaining the wireless connection with the wireless headphones 200.
[0198] In step S1610, the user instructs digital camera 100 to start capturing images. For example, the user presses the release switch on operation unit 105 all the way down.
[0199] In step S1611, the digital camera 100 transmits a notification packet indicating that a command to start capturing images has been issued by the user to the smartphone 300. The process of this step corresponds to, for example, the process of step S1503 in FIG.
[0200] In step S1612, the smartphone 300 transmits audio data of the electronic shutter sound to the wireless headphones 200. The process of this step corresponds to, for example, the process of step S1504 in FIG.
[0201] In step S1613, digital camera 100 completes the determination of whether the image capture conditions are met.
[0202] In step S1614, the digital camera 100 transmits a notification packet indicating that imaging will be performed to the smartphone 300. The process of this step corresponds to, for example, the process of step S1505 in FIG.
[0203] In step S1615, digital camera 100 captures an image.
[0204] In step S1616, the smartphone 300 controls the wireless headphones 200 so that sound can be output. After this step, the wireless headphones 200 is able to output audio data by being controlled by the smartphone 300. The process of this step corresponds to, for example, the process of step S1507 in FIG.
[0205] In step S1617, the wireless headphones 200 output the electronic shutter sound.
[0206] In step S1618, the smartphone 300 controls the wireless headphones 200 so as not to output sound. The process of this step is similar to the process of step S1608. Also, the process of this step corresponds to the process of step S1509 in FIG.
[0207] In step S1619, the smartphone 300 disconnects the wireless connection with the wireless headphones 200.
[0208] In step S1620, the smartphone 300 disconnects the wireless connection with the digital camera 100 and ends the processing of this sequence. The processing of this step corresponds to, for example, the processing of step S1416 in FIG.
[0209] An example of a series of processes for communication between the smartphone 300 and the digital camera 100 and the wireless headphones 200 in this embodiment has been described above.
[0210] [Fourth embodiment] The fourth embodiment differs from the third embodiment in the way in which the user issues an image capture instruction. In the fourth embodiment, the user uses the operation unit 305 of the smartphone 300 to instruct the digital camera 100 to capture an image.
[0211] <Wireless connection processing between the digital camera 100 and the wireless headphones 200> A series of processes from when the smartphone 300 establishes a wireless connection with the digital camera 100 and the wireless headphones 200 until when it disconnects the connection is the same as that shown in FIG. 14, and therefore a description thereof will be omitted.
[0212] <Audio Data Transmission Processing Using Digital Camera 100 and Wireless Headphones 200> An example of a process in which the smartphone 300 transmits an electronic shutter sound to the wireless headphones 200 during imaging processing by the digital camera 100 will be described with reference to FIG. 17, focusing on the process parts that differ from FIG.
[0213] The processes in steps S1701 and S1702 in FIG. 17 are equivalent to the processes in steps S1501 and S1502 in FIG. 15, respectively, and therefore description thereof will be omitted.
[0214] In step S1703, the control unit 301 determines whether or not an image capture instruction has been input from the operation unit 305 to the digital camera 100. If the control unit 301 determines that an image capture instruction has been input from the operation unit 305 to the digital camera 100, the process proceeds to step S1712. If the control unit 301 determines that an image capture instruction has not been input from the operation unit 305 to the digital camera 100, the process proceeds to step S1509.
[0215] Steps S1704 to S1711 in FIG. 17 are equivalent to steps S1504 to S1511 in FIG. 15, respectively, and therefore description thereof will be omitted.
[0216] In step S1712, the control unit 301 transmits a notification packet to the digital camera 100 via the first communication unit 311, notifying the digital camera 100 that an image capture instruction has been issued.
[0217] An example of a sequence of wireless communication processing between the digital camera 100, the wireless headphones 200, and the smartphone 300 will be described with reference to FIG. 18, focusing on the processing steps that differ from FIG.
[0218] Steps S1801 to S1809 in FIG. 18 are the same as steps S1601 to S160 in FIG. 16, and therefore description thereof will be omitted.
[0219] In step S1810, the user instructs the smartphone 300 to start capturing images using the digital camera 100. For example, the user selects an item displayed on the display unit 306 for instructing the digital camera 100 to start capturing images by pressing the touch panel of the operation unit 305.
[0220] In step S1811, based on an image capture instruction input from the user via the operation unit 305, the smartphone 300 transmits a notification packet to the digital camera 100 via the first communication unit 311 to the effect that an image capture instruction has been received.
[0221] The processing in steps S1812 to S1820 in FIG. 18 is equivalent to the processing in steps S1612 to S1620 in FIG. 16, and therefore description thereof will be omitted.
[0222] This enables the smartphone 300 to reduce the time difference between when the digital camera 100 captures an image and when the wireless headphones 200 output the electronic shutter sound.
[0223] In this embodiment, the wireless headphones 200 are controlled so as not to output sound in a normal state, and are controlled so as to output the electronic shutter sound only when it is determined that imaging can be performed with the digital camera 100. On the other hand, conversely, the wireless headphones 200 may be controlled so as to output sound in a normal state, and are controlled so as not to output the electronic shutter sound only when it is determined that imaging cannot be performed with the digital camera 100.
[0224] [Other embodiments] The present invention can also be realized by a process in which a program for implementing one or more of the functions of the above-described embodiments is supplied to a system or device via a network or a storage medium, and one or more processors in a computer of the system or device read and execute the program. The present invention can also be realized by a circuit (e.g., ASIC) that implements one or more of the functions.
[0225] The present invention is not limited to the above-described embodiment, and the components can be modified and embodied in the implementation stage without departing from the gist of the invention. In addition, various inventions can be formed by appropriately combining the multiple components disclosed in the above-described embodiment. For example, some components may be deleted from all the components shown in the embodiment. Furthermore, components from different embodiments may be appropriately combined.
Claims
1. A communication means for wirelessly connecting to an external speaker; An imaging means; A control means, The control means determines whether or not to capture an image by the imaging means, the control means transmits, during a period from when a determination as to whether or not to perform imaging by the imaging means is started to when the determination is completed, audio data indicating that imaging has been performed by the imaging means to the external speaker with which a wireless connection has been established, via the communication means; the control means controls the external speaker via the communication means in response to establishing a wireless connection with the external speaker so as to put the external speaker into a state in which no sound is output; When it is determined that an image is to be captured by the imaging means, the control means controls the external speaker via the communication means so that sound can be output.
1. An imaging device comprising:
2. When it is determined that the imaging means is not to capture an image, the control means maintains the external speaker, to which a wireless connection is established by the communication means, in a state in which sound is not output.
2. The imaging device according to claim 1 .
3. When it is determined that an image is to be captured by the imaging means, the control means controls the external speaker, which has established a wireless connection, via the communication means so as to be in a state in which the external speaker can output sound before the imaging means captures the image.
3. The imaging device according to claim 1, wherein the first and second lenses are arranged in a first direction.
4. The control means controls, via the communication means, the external speaker to which a wireless connection is established so as not to output sound when an image is captured by the imaging means.
4. The imaging device according to claim 1, wherein the first and second lenses are arranged in a first direction.
5. When the control means controls the external speaker so as not to output sound, the control means transmits audio data indicating silence to the external speaker with which a wireless connection has been established via the communication means.
5. The imaging device according to claim 1, wherein the first and second lenses are arranged in a first direction.
6. A communication means for wirelessly connecting to an external speaker; An imaging means; A control means, The control means determines whether or not to capture an image by the imaging means, The control means determines whether the time from when the external speaker receives the audio data to when the external speaker outputs the audio is short or long, when it is determined that the time for which the external speaker outputs sound is long, the control means transmits, to the external speaker via the communication means, audio data indicating that the imaging means has captured an image, from the start of a determination as to whether or not to capture an image by the imaging means until the completion of the determination as to whether or not to capture an image by the imaging means; When the control means determines that the time for which the external speaker outputs sound is short, in response to completion of a determination as to whether or not to capture an image by the imaging means after determining that the imaging means will capture an image, the control means transmits audio data indicating that the imaging means has captured an image to the external speaker via the communication means.
1. An imaging device comprising:
7. The control means captures a still image when the imaging means captures an image.
7. The imaging device according to claim 1, wherein the first and second lenses are arranged in a first direction.
8. Further, the device has an operation means for accepting a user operation, When the control means receives an image capturing instruction from a user via the operation means, the control means starts to determine whether or not to capture an image using the image capturing means.
8. The imaging device according to claim 1, wherein the first and second lenses are arranged in a first direction.
9. the operating means is a release switch, The control means determines that an image capture instruction has been received in response to the release switch being fully pressed.
9. The imaging device according to claim 8.
10. The control means controls the imaging means to focus on a subject while determining whether or not to capture an image by the imaging means.
10. The imaging device according to claim 1, wherein the first and second lenses are arranged in a first direction.
11. The communication means is a wireless connection in accordance with Bluetooth (registered trademark).
11. The imaging device according to claim 1,
12. Further, the device has a speaker. When the control means controls the speaker not to output sound, the control means controls the external speaker to which the wireless connection is established by the communication means to output sound.
12. The imaging device according to claim 1, wherein the first and second lenses are arranged in a first direction.
13. Further, the device has a speaker. When a wireless connection with the external speaker is established by the communication means, the control means controls the speaker not to output sound and controls the external speaker to output sound.
12. The imaging device according to claim 1, wherein the first and second lenses are arranged in a first direction.
14. A communication means for wirelessly connecting an external speaker; An imaging means; A control method for an imaging apparatus having a control unit, comprising: a step of determining whether or not to capture an image by the imaging means; transmitting, via the communication means to the external speaker with which a wireless connection has been established, audio data indicating that an image has been captured by the imaging means after starting a determination as to whether or not to capture an image by the imaging means and before completing the determination as to whether or not to capture an image by the imaging means; a step of controlling the external speaker via the communication means so as not to output sound in response to the establishment of a wireless connection with the external speaker by the control means; a step of controlling the external speaker via the communication means so as to output sound when the control means determines that the imaging means is to capture an image; A control method comprising the steps of:
15. A computer-readable program for causing a computer to function as each of the means of the imaging apparatus according to any one of claims 1 to 13.
Citation Information
Patent Citations
Ear mount type music reproducing device, and music reproduction system
JP2001169380A
Electronic camera and electronic camera system
JP2004096166A
Electronic equipment system, camera system, remote control device, electronic equipment and camera
JP2005173328A
Mobile terminal device
JP2010021935A
Electronic apparatus and method for controlling the electronic apparatus
JP2017117108A
