Imaging device, information processing device, control method and program for imaging device

Abstract

This prevents audio played back by an information processing device capable of playing back images and audio received from an imaging device from being picked up by the imaging device itself. [Solution] The imaging device includes an imaging means for capturing images and acquiring image data, a sound acquisition means for capturing sound and acquiring sound data, and a transmission means for transmitting the motion image data, including the image data and sound data obtained by capturing images, to an information processing device. The transmission means stops transmitting the sound data from the motion image data when it has started recording motion image data or when the distance to the information processing device is below a predetermined threshold.

Description

Technical Field

[0001] The present invention relates to an imaging device, an information processing device, a control method for an imaging device, and a program.

Background Art

[0002] There is a technology in which an information processing device such as a smartphone, a tablet terminal, or a personal computer is communicably connected to an imaging device by wire or wirelessly, and the imaging device is remotely controlled from the information processing device. In addition, there is a configuration in which the information processing device can receive a live view image and audio of the imaging device. In such a configuration, by displaying the live view image of the imaging device on the display of the information processing device, the user can control the imaging device while confirming the image captured by the imaging device on the information processing device. When performing this remote control, if the distance between the imaging device and the information processing device that displays and reproduces the live view image and audio received from the imaging device is short, the imaging device may pick up the audio reproduced and output from the information processing device.

[0003] Patent Document 1 discloses a mobile communication terminal that stops transmitting a moving image and changes it to a still image when making a voice call by phone during playback of the moving image. Patent Document 2 discloses an imaging control method for controlling so as not to emit a recording start sound when issuing an instruction to start recording from an information processing device to a plurality of imaging devices.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Patent Document 2

Summary of the Invention

Problems to be Solved by the Invention

[0005] However, conventional methods have not considered the case where audio received and played back from an imaging device is picked up and recorded by the imaging device. The present invention aims to prevent audio played back by an information processing device capable of playing back images and audio received from an imaging device from being picked up by the imaging device. [Means for solving the problem]

[0006] The imaging device according to the present invention comprises an imaging means for capturing images and acquiring image data, a sound acquisition means for capturing sound and acquiring sound data, and a transmission means for transmitting motion image data, including the image data and sound data obtained by capturing images, to an information processing device, wherein the transmission means stops transmitting the sound data from the motion image data when recording of the motion image data has started or when the distance to the information processing device is below a predetermined threshold. [Effects of the Invention]

[0007] According to the present invention, it is possible to prevent the sound reproduced by an information processing device that can reproduce images and sounds received from an imaging device from being picked up by the imaging device. [Brief explanation of the drawing]

[0008] [Figure 1] This figure shows an example of the camera configuration in this embodiment. [Figure 2] This figure shows an example of the configuration of the terminal device in this embodiment. [Figure 3] This diagram illustrates an example of communication between a camera and a terminal device. [Figure 4] This flowchart shows an example of camera processing in this embodiment. [Modes for carrying out the invention]

[0009] Embodiments of the present invention will be described below with reference to the drawings. The following description will use a system as an example, comprising a camera 100 as an imaging device and a terminal device 200 as an information processing device capable of reproducing and outputting images and sound based on video data received from the camera 100. The camera 100 can be a still camera or video camera whose main function is so-called shooting, or it can be a camera-equipped mobile phone or a so-called tablet device. The terminal device 200 can be a general personal computer, or it can be a mobile device such as a so-called smartphone, a so-called tablet device, or a television.

[0010] Figure 1 is a block diagram showing an example configuration of camera 100. Camera 100 includes a CPU (Central Processing Unit) 101, volatile memory 102, non-volatile memory 103, camera unit 104, camera signal processing unit 105, communication interface 106, and connector / antenna 107. Camera 100 also includes a recording medium interface 108, recording medium 109, input interface 110, operation unit 111, output interface 112, display 113, microphone 114, audio signal processing unit 115, and internal bus 120. Each part of camera 100 is controlled by a program running on the CPU 101. Furthermore, each part connected to the internal bus 120 is connected to each other so that data can be communicated via the internal bus 120.

[0011] The CPU 101 uses the volatile memory 102 as work memory to execute programs stored in the non-volatile memory 103 or recording medium 109, and controls various parts of the camera 100. The volatile memory 102 stores programs, variables, temporary data for work, etc., that the CPU 101 needs when it is operating. The volatile memory 102 is composed of, for example, DRAM (Dynamic Random Access Memory). The non-volatile memory 103 stores various programs and data necessary for the CPU 101 to operate. The non-volatile memory 103 is composed of, for example, flash memory.

[0012] The camera unit 104 forms an optical image of the subject, converts the optical image into an analog electrical signal, and then into a digital signal. The camera signal processing unit 105, based on control by the CPU 101, compresses and encodes the digital signal converted by the camera unit 104 in a predetermined bitrate and format. The camera signal processing unit 105 also decodes the compressed and encoded data based on control by the CPU 101. The camera unit 104 and the camera signal processing unit 105 are examples of imaging means.

[0013] The communication interface 106 communicates with an external device (e.g., terminal device 200) via the connector / antenna 107, based on control by the CPU 101. The communication interface 106 is an example of a transmission means. The recording medium interface 108 is connected to a recording medium 109, and based on control by the CPU 101, it reads data from the connected recording medium 109 and writes data to the recording medium 109. The recording medium 109 is, for example, an HDD (Hard Disk Drive) or non-volatile memory. The recording medium 109 to which the recording medium interface 108 can be connected may be a removable non-volatile memory such as a memory card, connected via a socket (not shown).

[0014] The input interface 110 receives user input from the operation unit 111 and generates control signals corresponding to the received user input, which are then supplied to the CPU 101. For example, the operation unit 111 includes input devices that accept user input, such as a zoom lever or keyboard for text information input, a pointing device such as a mouse or touch panel, and a posture sensor for acquiring posture information. The operation unit 111 also includes remotely controllable devices such as an infrared remote control. The touch panel, for example, is an input device configured to output coordinate information corresponding to the position of contact with a planarly configured input unit. This allows the camera 100 to perform actions in response to user input.

[0015] The output I / F 112 outputs a display signal to the display 113 to display a GUI (Graphical User Interface) or similar display data generated by the CPU 101 according to a program. The output I / F 112 also outputs a display signal to the display 113 to display a live view image or similar display data, which consists of digital signals obtained from the camera unit 104. In live view mode, the subject image captured by the camera 100 is displayed in near real-time. The display 113 displays images or similar displays based on the display signals output by the output I / F 112. When a touch panel is used as the operation unit 111, the operation unit 111 and the display 113 can be integrated. For example, the touch panel can be configured so that its light transmittance does not interfere with the display on the display 113, and mounted on the upper layer of the display surface of the display 113. Then, the input coordinates on the touch panel are associated with the display coordinates on the display 113. This allows for the configuration of a GUI that makes it appear as if the user can directly operate the screen displayed on the display 113.

[0016] The microphone 114 converts sound vibrations into electrical signals, picking up sound and outputting electrical signals related to the picked-up sound. The audio signal processing unit 115 digitizes the electrical signals converted by the microphone 114 and performs various correction processes. The microphone 114 and the audio signal processing unit 115 are examples of sound pickup means.

[0017] FIG. 2 is a block diagram showing a configuration example of the terminal device 200. The terminal device 200 includes a CPU 201, a volatile memory 202, a non-volatile memory 203, a communication I / F 204, a connector / antenna 205, a recording medium I / F 206, and a recording medium 207. Further, the terminal device 200 includes an input I / F 208, an operation unit 209, an output I / F 210, a display 211, an audio signal processing unit 212, a speaker 213, and an internal bus 220. Each part of the terminal device 200 is controlled by a program operating on the CPU 201. Also, each part connected to the internal bus 220 is communicably connected to each other via the internal bus 220 for data communication.

[0018] The CPU 201, the volatile memory 202, and the non-volatile memory 203 are substantially the same as the CPU 101, the volatile memory 102, and the non-volatile memory 103 shown in FIG. 1. Also, the communication I / F 204, the connector / antenna 205, the recording medium I / F 206, and the recording medium 207 are substantially the same as the communication I / F 106, the connector / antenna 107, the recording medium I / F 108, and the recording medium 109 shown in FIG. 1. Also, the input I / F 208, the operation unit 209, the output I / F 210, and the display 211 are substantially the same as the input I / F 110, the operation unit 111, the output I / F 112, and the display 113 shown in FIG. 1. Therefore, descriptions of these components are omitted.

[0019] The audio signal processing unit 212 performs various signal processes such as correction processing on an electrical signal related to the sound output from the speaker 213. The speaker 213 converts the digitized electrical signal into sound vibration and outputs sound corresponding to the electrical signal. The audio signal processing unit 212 and the speaker 213 are an example of a playback means. The communication I / F 204 is an example of a receiving means.

[0020] Hereinafter, the remote control of the camera 100 in this embodiment will be described. In the camera 100, when the user operates the operation unit 111 to instruct remote control of the camera 100, the camera 100 brings the communication I / F 106 into a communicable state under the control of the CPU 101. Further, in the terminal device 200, when the user operates the operation unit 209 to instruct the startup of a program such as an application browser necessary for communication connection processing and remote control, the CPU 201 of the terminal device 200 receives the user operation on the operation unit 209 and controls the communication I / F 204 according to the program stored in the non-volatile memory 203 or the recording medium 207, starts communication with the camera 100, and performs connection processing. When the connection processing between the camera 100 and the terminal device 200 is completed, the camera 100 and the terminal device 200 start processing necessary for remote control of the camera 100.

[0021] FIG. 3 is a diagram for explaining an example in which the camera 100 transmits image data 301 and audio data 304 related to a live view stored in the volatile memory 102 to the terminal device 200 under the control of the CPU 101 in remote control.

[0022] The terminal device 200 displays the live view image 301 received from the camera 100 via the network 300 in the image display area 302 on the display 211 under the control of the CPU 201. Further, the terminal device 200 reproduces the audio data 304 received from the camera 100 via the network 300 with the speaker 213 under the control of the CPU 201. In the terminal device 200, for example, an icon group 303 for performing remote control is displayed on the display 211, and the user can transmit a control instruction to the camera 100 by the control signal 305 by operating these icon groups 303.

[0023] FIG. 4 is a flowchart showing an example of the processing of the camera 100 in this embodiment. The processing of the flowchart shown in FIG. 4 is realized by the CPU 101 of the camera 100 operating based on a program stored in the non-volatile memory 103 or the recording medium 109 and controlling each part of the camera 100.

[0024] In step S401, the CPU 101, upon confirming that the connection process between the camera 100 and the terminal device 200 is complete and communication is possible, begins transmitting the motion image data, including audio data, obtained by the camera 100 to the terminal device 200. Specifically, the CPU 101 begins transmitting the image data related to the image captured by the camera unit 104 and the audio data related to the sound picked up by the microphone 114 to the terminal device 200.

[0025] In step S402, the CPU 101 determines whether or not it has started recording (REC operation) the video data captured by the camera 100. If the CPU 101 determines that it has not started recording video data (NO), the process proceeds to step S403. On the other hand, if the CPU 101 determines that it has started recording video data (YES), the process proceeds to step S405.

[0026] In step S403, the CPU 101 determines whether the communication mode between the camera 100 and the terminal device 200 is the nearby mode. Here, nearby mode is a mode that indicates that the distance between the camera 100 and the terminal device 200 is close and below a predetermined threshold. In this embodiment, the communication mode can be set by the user using the operation unit 111 on the camera 100, but the CPU 101 may also determine the distance between the camera 100 and the terminal device 200 and set the communication mode. For example, the CPU 101 may determine the distance between the camera 100 and the terminal device 200 and set the communication mode to nearby mode if the distance is below a predetermined threshold. Note that any known method, such as measurement by radio wave intensity, can be used to measure the distance between the camera 100 and the terminal device 200. If the CPU 101 determines that the communication mode is nearby mode (YES), the process proceeds to step S404. On the other hand, if the CPU 101 determines that the communication mode is not nearby mode, i.e., far mode (NO), the process proceeds to step S405.

[0027] In step S404, the CPU 101 stops transmitting audio data from the camera 100 to the terminal device 200. That is, the CPU 101 stops transmitting audio data from the camera 100 to the terminal device 200 and transmits only the image data to the terminal device 200. After executing the process in step S404, the process proceeds to step S408.

[0028] In step S405, the CPU 101 authorizes the transmission of audio data from the camera 100 to the terminal device 200. Therefore, if the transmission of audio data from the camera 100 to the terminal device 200 was stopped, the transmission of audio data from the camera 100 to the terminal device 200 will start after the processing in step S405. After the processing in step S405 is completed, the process proceeds to step S408.

[0029] In step S406, which is the step to which the CPU 101 proceeds if it determines in step S402 that recording of video data has not started, the CPU 101 stops transmitting audio data from the camera 100 to the terminal device 200. That is, the CPU 101 stops transmitting the audio data from the video data sent from the camera 100 to the terminal device 200 and transmits the video data to the terminal device 200.

[0030] In step S407, the CPU 101 determines whether the recording of video data (REC operation) has finished. If the CPU 101 determines that the recording of video data has not finished (NO), the process in step S407 is repeated. If the CPU 101 determines that the recording of video data has finished (YES), the process proceeds to step S408.

[0031] In step S408, the CPU 101 determines whether or not to terminate the connection between the camera 100 and the terminal device 200. For example, if the CPU 101 receives a command to terminate the connection (remote control) due to user operation on the camera 100 or the terminal device 200, the CPU 101 determines to terminate the connection between the camera 100 and the terminal device 200. If the CPU 101 determines not to terminate the connection between the camera 100 and the terminal device 200 (NO), the process returns to step S402. On the other hand, if the CPU 101 determines to terminate the connection between the camera 100 and the terminal device 200 (YES), the process shown in the flowchart in Figure 4 is terminated.

[0032] As explained above, when the distance between camera 100 and terminal device 200, which displays and plays back the live view image and audio received from camera 100, is short, camera 100 stops transmitting audio to terminal device 200. Also, when camera 100 is recording moving image data obtained by capturing images, camera 100 stops transmitting audio to terminal device 200. This prevents audio received and played back by terminal device 200 from being picked up by camera 100, and prevents audio played back by terminal device 200 from being recorded. Furthermore, by stopping the transmission of audio from camera 100 to terminal device 200, the amount of data to be communicated can be reduced.

[0033] In addition, as described above, if camera 100 is recording video data or if the distance between camera 100 and terminal device 200 is short, the transmission of audio data to terminal device 200 is stopped, but the volume of playback on terminal device 200 may be controlled. For example, the volume of playback on the speaker 213 of terminal device 200 may be changed according to the distance between camera 100 and terminal device 200, for example, by decreasing the volume of playback in proportion to the decrease in distance. Alternatively, camera 100 may notify terminal device 200 that it is recording video data or that the distance between camera 100 and terminal device 200 is short, and upon receiving this notification, terminal device 200 may change the volume of playback on speaker 213 to zero.

[0034] Furthermore, if the transmission of audio data from camera 100 to terminal device 200 is stopped, volume information related to the audio data may be transmitted from camera 100 to terminal device 200, and an audio level meter indicating the volume level may be displayed on the display 211 of terminal device 200.

[0035] Furthermore, if a notification is received from the terminal device 200 indicating that headphones or the like are attached to the terminal device 200 and that there is no concern about sound leaking to the outside, the processes in steps S404 and S406 of Figure 4 may be disabled. In other words, the transmission of audio data to the terminal device 200 may not be stopped regardless of whether the camera 100 has started recording video data or the distance between the camera 100 and the terminal device 200.

[0036] (Other embodiments of the present invention) The present invention can also be realized by supplying a program that implements one or more of the functions of the above-described embodiments to a system or device via a network or storage medium, and by a process in which one or more processors in the computer of that system or device read and execute the program. It can also be realized by a circuit (e.g., an ASIC) that implements one or more functions.

[0037] It should be noted that the embodiments described above are merely examples of how the present invention can be implemented, and the technical scope of the present invention should not be interpreted as being limited by them. In other words, the present invention can be implemented in various forms without departing from its technical concept or its main features.

[0038] The disclosure of this embodiment includes the following configurations and methods, etc. (Composition 1) An imaging means for capturing images and acquiring image data, A sound acquisition means that captures sound and acquires sound data, The system includes a transmission means for transmitting the image data and the audio data obtained by imaging to an information processing device, The imaging device is characterized in that the transmission means stops transmitting the audio data from the video data when it has started recording the video data or when the distance to the information processing device is below a predetermined threshold. (Configuration 2) The imaging device according to configuration 1, characterized by having a determination means for determining whether the distance to the information processing device is below a predetermined threshold. (Composition 3) The imaging apparatus according to configuration 1 or 2, characterized in that when the transmission means stops transmitting the audio data, it transmits volume information relating to the audio data to the information processing device. (Composition 4) The imaging device according to any one of configurations 1 to 3, characterized in that when the information processing device receives notification that headphones are being worn, the transmitting means does not stop transmitting the audio data, regardless of whether it has started recording the video data or is at a distance from the information processing device. (Composition 5) An information processing device that communicates with an imaging device described in any one of items 1 to 4 of the configuration, Receiving means for receiving the motion image data transmitted from the imaging device, It has a playback means for playing back the received video data, The playback means is characterized by changing the volume at which the audio data is played back according to the distance between the imaging device and the information processing device. (Composition 6) The information processing device according to configuration 5, characterized in that when the playback means receives notification from the imaging device that it has started recording the motion image data or that the distance to the information processing device is below a predetermined threshold, it changes the volume of the audio data playback to zero. (Method 1) The imaging process involves capturing an image using an imaging means to acquire image data, A sound acquisition process that acquires sound data by acquiring sound using a sound acquisition means, The system includes a transmission step of transmitting the image data and the video data, including the audio data, obtained by imaging, to an information processing device. A control method for an imaging device, characterized in that, in the transmission step, if recording of the moving image data has started, or if the distance to the information processing device is below a predetermined threshold, the transmission of the audio data from the moving image data is stopped. (Program 1) In the imaging device's computer, An imaging step in which an image is captured by an imaging means and image data is acquired, A sound acquisition step involves acquiring sound data by acquiring sound using a sound acquisition means, The system is made to perform a transmission step of transmitting the image data and the video data, including the audio data, obtained by imaging, to an information processing device. The transmission step includes a program that, if recording of the video data has started, or if the distance to the information processing device is below a predetermined threshold, causes the program to execute control to stop the transmission of the audio data from the video data. [Explanation of Symbols]

[0039] 100: Camera (imaging device) 200: Terminal device (information processing device) 101: CPU 102: Volatile memory 103: Non-volatile memory 104: Camera unit 105: Camera signal processing unit 106: Communication interface 108: Recording medium interface 110: Input interface 111: Operation unit 112: Output interface 113: Display 114: Microphone 115: Audio signal processing unit

Claims

1. An imaging means for capturing images and acquiring image data, A sound acquisition means that captures sound and acquires sound data, The system includes a transmission means for transmitting the image data and the audio data obtained by imaging to an information processing device, The imaging device is characterized in that the transmission means stops transmitting the audio data from the video data when it has started recording the video data or when the distance to the information processing device is below a predetermined threshold.

2. The imaging device according to claim 1, characterized in that it has a determination means for determining whether the distance to the information processing device is below a predetermined threshold.

3. The imaging apparatus according to claim 1, characterized in that when the transmission means stops transmitting the audio data, it transmits volume information relating to the audio data to the information processing device.

4. The imaging device according to claim 1, characterized in that when the information processing device receives notification that headphones are being worn, the transmitting means does not stop transmitting the audio data, regardless of whether it has started recording the video data or is at a distance from the information processing device.

5. An information processing device that communicates with an imaging device according to any one of claims 1 to 4, Receiving means for receiving the motion image data transmitted from the imaging device, It has a playback means for playing back the received video data, The playback means is characterized by changing the volume at which the audio data is played back according to the distance between the imaging device and the information processing device.

6. The information processing apparatus according to claim 5, characterized in that when the playback means receives notification from the imaging device that it has started recording the motion image data or that the distance to the information processing apparatus is below a predetermined threshold, it changes the volume of the audio data playback to zero.

7. The imaging process involves capturing an image using an imaging means to acquire image data, A sound acquisition process that acquires sound data by acquiring sound using a sound acquisition means, The system includes a transmission step of transmitting the image data and the video data, including the audio data, obtained by imaging, to an information processing device. A control method for an imaging device, characterized in that, in the transmission step, if recording of the moving image data has started, or if the distance to the information processing device is below a predetermined threshold, the transmission of the audio data from the moving image data is stopped.

8. In the imaging device's computer, An imaging step in which an image is captured by an imaging means and image data is acquired, A sound acquisition step involves acquiring sound data by acquiring sound using a sound acquisition means, The system is made to perform a transmission step of transmitting the image data and the video data, including the audio data, obtained by imaging, to an information processing device. The transmission step includes a program that, if recording of the video data has started, or if the distance to the information processing device is below a predetermined threshold, causes the program to execute control to stop the transmission of the audio data from the video data.

Images