Imaging device, control method thereof, and program

By introducing the delete candidate marks and communication functions in the remote shooting system, the problem that the remote shooting device cannot recognize the pictures to be deleted when the storage space is insufficient, and the automatic deletion and recording function that can be recognized by the user is realized.

JP7657595B2Active Publication Date: 2025-04-07CANON KK
View PDF 7 Cites 0 Cited by

Patent Information

Application Number
JP2021005634
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2021-01-18
Publication Date
2025-04-07
Estimated Expiration
2041-01-18

AI Technical Summary

Technical Problem

In the prior art, the remote shooting device automatically deletes pictures when there is insufficient storage space, and the user cannot recognize the pictures to be deleted and the pictures to be recorded.

Method used

A remote shooting system is designed, including shooting, recording, deletion and communication functions. When the storage space is insufficient, the system automatically deletes pictures with specific marks, and transmits the attribute information of the pictures to external devices through the communication function for users to identify.

Benefits of technology

It realizes that when automatically deleting pictures, users can identify the pictures to be deleted and recorded, avoiding the problem of image deletion that users cannot predict.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007657595000001
    Figure 0007657595000001
  • Figure 0007657595000002
    Figure 0007657595000002
  • Figure 0007657595000003
    Figure 0007657595000003
Patent Text Reader

Abstract

To make it possible for a user of an external device to recognize an image to be recorded or deleted when a recorded image is automatically deleted.SOLUTION: An imaging apparatus includes: imaging means for capturing an image of a subject; recording means for performing control to record the captured image on a recording unit; deletion means for automatically deleting the image recorded on the recording unit; and control means for controlling transmission to an external device via a communication unit to display on the external device, information on at least one of an image that is a candidate for automatic deletion by the deletion means and an image that is not a candidate for automatic deletion by the deletion means of images that are recorded in the recording unit including images before being automatically deleted by the deletion means.SELECTED DRAWING: Figure 7
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to an imaging apparatus, a control method thereof, a program, and a recording medium. [Background technology]

[0002] Generally, images captured by an imaging device are recorded in a recording unit such as a recording medium. When the remaining free recording capacity of the recording unit of the imaging device becomes insufficient, the imaging device is unable to capture new images. In particular, in an imaging device that captures images remotely without a user's instruction to capture images, the user is not nearby, so that even if the remaining free recording capacity of the recording unit becomes insufficient, the user cannot immediately deal with the problem.

[0003] To address this problem, Patent Document 1 discloses a technology that can automatically erase images based on erasure priority when it is determined that there is no free space in a storage device that stores images, thereby increasing the free space in the storage device. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2007-295181 A Summary of the Invention [Problem to be solved by the invention]

[0005] However, the technology disclosed in Patent Document 1 has a problem in that when an imaging device that captures images remotely automatically deletes images, the user of the external device cannot recognize what images are being deleted and what images are being recorded. The present invention has been made in consideration of the above-mentioned problems, and aims to enable a user of an external device to recognize the images that are recorded or deleted when recorded images are automatically deleted. [Means for solving the problem]

[0006] The present invention Imaging device The present invention relates to a method for controlling an image capturing means for capturing an image of a subject, a recording means for controlling the image captured to be recorded in a recording unit, a deleting means for automatically deleting an image recorded in the recording unit, and a method for deleting an image recorded in the recording unit, the method comprising: ,before Images that are not candidates for automatic deletion by the deletion method Statue A control means for controlling the information to be transmitted to an external device via a communication unit so as to be displayed on the external device. The imaging means automatically captures an image of a subject when a predetermined shooting condition is satisfied, and the deleting means deletes images that are candidates for automatic deletion from among the images recorded in the recording section when the remaining free recording capacity that can be recorded in the recording section becomes less than a predetermined capacity, and does not delete images that are candidates for automatic deletion from among the images recorded in the recording section when communication is being performed via the communication section even if the remaining free recording capacity that can be recorded in the recording section becomes less than the predetermined capacity. It is characterized by: Effect of the Invention

[0007] According to the present invention, when a recorded image is automatically deleted, the user of the external device can recognize the image to be recorded or deleted. [Brief description of the drawings]

[0008] [Figure 1] FIG. 1 is a schematic diagram illustrating an example of a configuration of a remote photography system. [Diagram 2] FIG. 2 is a block diagram showing an example of a functional configuration of the remote photography system. [Diagram 3] 4 is a flowchart illustrating an example of a control process according to the first embodiment. [Figure 4] 10 is a flowchart illustrating an example of an automatic shooting process. [Diagram 5] 13 is a flowchart illustrating an example of a scene determination process. [Figure 6] 13 is a flowchart illustrating an example of a deletion candidate flagging process. [Figure 7] 10 is a flowchart illustrating an example of processing of the remote photography system. [Figure 8] FIG. 13 is a diagram showing an example of a list of all images displayed on a smartphone. [Figure 9] 10 is a flowchart illustrating an example of a control process according to a second embodiment. [Figure 10]13 is a flowchart illustrating an example of a deletion candidate list creation process. [Figure 11] FIG. 13 is a diagram illustrating an example of a deletion candidate list. [Figure 12] 13 is a flowchart illustrating an example of an image deletion process. [Figure 13] 10 is a flowchart illustrating an example of processing of the remote photography system. [Figure 14] FIG. 13 is a diagram showing an example of a list of deletion candidates displayed on a smartphone. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] Hereinafter, preferred embodiments of the present invention will be described with reference to the accompanying drawings. [First embodiment] FIG. 1A is a schematic diagram showing an example of the configuration of a remote photography system according to the first embodiment. The remote photography system includes an imaging device 100 and a smartphone 110 serving as an external device for remotely controlling the imaging device 100. The imaging device 100 and the smartphone 110 are connected to each other so as to be able to communicate with each other.

[0010] The imaging device 100 includes a lens barrel 101 , a tilt unit 102 , a pan unit 103 , and a control unit 104 . The lens barrel 101 has a group of photographing lenses and an image sensor as an imaging optical system. The group of photographing lenses includes movable lenses such as a focus lens and a variable magnification lens, and a drive circuit for the movable lenses. The movable lenses are driven by a control unit 104. The lens barrel 101 captures images under the control of the control unit 104, and outputs the captured images to the control unit 104. The lens barrel 101 is also attached to a tilt unit 102 so as to be rotatable around a horizontal axis.

[0011] The tilt unit 102 functions as a tilt drive section. The tilt unit 102 drives the lens barrel 101 to rotate around a horizontal axis (tilt direction) perpendicular to the optical axis of the imaging optical system in accordance with instructions from the control unit 104. The elevation angle or depression angle of the lens barrel 101 (optical axis) is changed by the tilt unit 102. The tilt unit 102 is also attached to the pan unit 103 so as to be rotatable around a vertical axis.

[0012] The pan unit 103 functions as a pan drive unit. The pan unit 103 drives the tilt unit 102 to rotate around a vertical axis (pan direction) perpendicular to the optical axis of the imaging optical system in accordance with instructions from the control unit 104. The azimuth angle of the lens barrel 101 (optical axis) attached to the tilt unit 102 changes when the pan unit 103 rotates the tilt unit 102.

[0013] 1(b) is a diagram showing an orthogonal coordinate system with the optical axis of the imaging optical system as the Z axis and the intersection of the imaging element and the optical axis as the origin. The tilt unit 102 has a rotation axis around the X axis (pitch direction), and the pan unit 103 has a rotation axis around the Y axis (yaw direction).

[0014] The control unit 104 controls the driving of the movable lens included in the lens barrel 101, the shooting operation by the lens barrel 101, and the operations of the tilt unit 102 and the pan unit 103 in response to instructions from an operation unit provided in the smartphone 110 or the imaging device 100. The control unit 104 transmits images shot by the lens barrel 101 and various information on the imaging device 100 to the smartphone 110. The control unit 104 also collects surrounding sounds from a mounted microphone (not shown) and analyzes them to recognize them as commands, and controls the imaging device 100 based on the contents of the commands. Note that in FIG. 1(a), the control unit 104 is provided on a base supporting the pan unit 103, but the control unit 104 may be provided on the lens barrel 101, the tilt unit 102, or the pan unit 103.

[0015] The smartphone 110 is an example of an electronic device capable of remotely controlling the imaging device 100. The smartphone 110 can remotely control the imaging device 100 by executing, for example, a remote shooting application. The smartphone 110 and the imaging device 100 can communicate with each other by direct wireless or wired communication 105, or communication 106 via a computer network, a telephone network, or the like. The imaging device 100 and the smartphone 110 communicate with each other using any communication protocol supported by both of them.

[0016] Fig. 2 is a block diagram showing an example of the functional configuration of the remote photography system, in which the same components as those in Fig. 1 are denoted by the same reference numerals. First, the configuration of the imaging device 100 will be described. The lens barrel 101 has a lens unit 201 (imaging optical system) and an imaging section 202. The lens barrel 101 is rotated by a tilt unit 102 and a pan unit 103, whereby the optical axis direction is adjusted. Movable lenses such as a focus lens and a variable magnification lens included in the lens unit 201 are driven by a lens driving section 205 of the control unit 104. The lens unit 201 forms an optical image on an imaging surface of an imaging element included in the imaging section 202.

[0017] The imaging unit 202 has an imaging element such as a CMOS image sensor, and converts an optical image formed by the lens unit 201 into an analog signal group (analog image signal) using a plurality of photoelectric conversion elements. The imaging unit 202 also performs A / D conversion and noise reduction processing on the converted analog image signal, and outputs the signal to the control unit 104 as image data.

[0018] The tilt unit 102 has a drive mechanism that rotates the lens barrel 101 in the pitch direction of Fig. 1(b). The pan unit 103 has a drive mechanism that rotates the tilt unit 102 in the yaw direction of Fig. 1(b). The lens barrel 101 rotates according to a drive command output from a lens barrel driver 206.

[0019] The control unit 104 has an image processing unit 203 , a recording unit 204 , a lens driving unit 205 , a lens barrel driving unit 206 , a control unit 207 , a composition determination unit 208 , a face detection unit 209 , a communication unit 210 , a ROM 211 , and a system memory 212 . The image processing unit 203 performs image processing such as distortion correction, white balance adjustment, color interpolation processing, and encoding processing on the image data output from the imaging unit 202, and generates image data for recording and image data for display (live view image). The image data for display may be image data with a lower resolution than the image data for recording. The image processing unit 203 may also generate only image data for recording. The image data for recording is output to the recording unit 204.

[0020] The recording unit 204 is a recording medium such as a non-volatile memory that is detachable from the imaging device 100 or built into the imaging device 100. The recording unit 204 stores the image data output from the image processing unit 203 as a data file in a format conforming to specifications such as JPEG or MPEG. In addition, the image data that has been subjected to image processing by the image processing unit 203 is also output to the face detection unit 209 and the communication unit 210.

[0021] The face detection unit 209 performs a known face detection process on the image data output from the image processing unit 203 to detect an area that is likely to be a person's face (face area). The face detection unit 209 outputs the detection result (the number of face areas and position information) to the composition determination unit 208. Note that the face area is an example of a subject area that is the target of the tracking function and the function of automatically determining the composition of the image capture device 100. Therefore, the face detection unit 209 is an example of a configuration that detects a predetermined subject area. In addition to the detected face area and position information, the face detection unit 209 digitizes parameters related to facial expressions, such as the likelihood of a smile and the degree to which the eyes are open, using a known facial expression measurement technique and outputs the digitized parameters to the control unit 207.

[0022] The communication unit 210 is a communication interface for realizing communication between the smartphone 110 or other external devices and the imaging device 100. The communication unit 210 has a configuration compatible with one or more types of wired communication and wireless communication. Examples of communication standards compatible with the communication unit 210 include, but are not limited to, USB, Ethernet (registered trademark), HDMI (registered trademark), wireless LAN (IEEE802.11 series), Bluetooth (registered trademark), 3GPP 3G, 4G, and 5G.

[0023] The lens driving section 205 drives the zoom lens and the focus lens included in the lens unit 201 based on instructions (for example, a target position and a driving speed) output from the control section 207. The lens barrel driving unit 206 drives the tilt unit 102 and the pan unit 103 based on instructions (eg, the direction and amount of rotation) output from the control unit 207.

[0024] The control unit 207 is, for example, a microprocessor such as a CPU, and controls the operation of each unit of the imaging device 100 by loading a program recorded in the ROM 211 into the system memory 212 and executing it, thereby realizing the functions of the imaging device 100. The control unit 207 also generates instructions or commands (for example, a target position and a driving speed) for controlling the lens driving unit 205 and the lens barrel driving unit 206 based on the magnification information and position information output from the composition determination unit 208. Next, the control unit 207 outputs the generated instructions to the lens driving unit 205 and the lens barrel driving unit 206. The control unit 207 also determines the shooting conditions using the control information output to the lens barrel driving unit 206 and a score as evaluation information calculated regarding the facial expression included in the face area output from the face detection unit 209, and issues a shooting instruction to the lens barrel 101 if the shooting conditions are met. Furthermore, the control unit 207 performs processes such as receiving a communication command from the smartphone 110 via the communication unit 210 and periodically monitoring the remaining free recording capacity of the recording unit 204.

[0025] The composition determination unit 208 determines the composition based on the position information of the face area detected in the image by the face detection unit 209. For example, the composition determination unit 208 determines the magnification so that the size of the face area is equal to or larger than a predetermined size. Also, for example, the composition determination unit 208 determines the shooting direction so that the position of the face area is located at the center of the image. The composition determination unit 208 obtains the magnification and target position (pan angle and tilt angle) for realizing the determined magnification and shooting direction, and outputs them to the control unit 207. Note that the composition determination method is not limited to the above-mentioned method, and other methods may be used. Also, when the composition determination unit 208 receives a command instructing a pan, tilt, or zoom operation from the smartphone 110 via the communication unit 210, it determines the target position and target magnification based on the command and outputs them to the control unit 207 and the communication unit 210. Note that the operation of the composition determination unit 208 may be executed by the control unit 207.

[0026] The ROM 211 is a rewritable non-volatile memory that stores programs executed by the control unit 207, registered voice commands, and various setting values ​​of the imaging device 100. The system memory 212 is a memory used when the control unit 207 executes a program.

[0027] Next, the configuration of the smartphone 110 will be described. The smartphone 110 includes a communication unit 221 , a control unit 222 , a recording unit 223 , a system memory 224 , a display unit 225 , a power supply unit 226 , an operation unit 227 , an audio processing unit 228 , and a GPS receiver 229 . The communication unit 221 is a communication interface for realizing communication between the imaging device 100, other external devices, and the smartphone 110. The communication unit 221 has a basically similar configuration to the communication unit 210 of the imaging device 100. However, since the smartphone 110 has a call function, the communication unit 221 includes a function for communicating with a telephone communication network.

[0028] The control unit 222 is, for example, a microprocessor such as a CPU, and controls the operation of each unit of the smartphone 110 and realizes the functions of the smartphone 110 by loading a program recorded in the recording unit 223 into the system memory 224 and executing it. The recording unit 223 is a rewritable non-volatile memory, and records the program executed by the control unit 222, various setting values ​​of the smartphone 110, GUI data, etc. The recording unit 223 also records a remote photography application. The remote photography application is an application for transmitting various requests to the imaging device 100 and receiving images, image information, etc. from the imaging device 100. The system memory 224 is a memory used when the control unit 222 executes a program. A part of the system memory 224 is also used as a video memory for the display unit 225.

[0029] The power supply unit 226 supplies power to the components within the smartphone 110 . The display unit 225 is, for example, a touch display. The display unit 225 may have other functions such as a fingerprint sensor, a speaker, etc. The display unit 225 displays a UI (user interface) provided by the OS and applications of the smartphone 110, captured images, etc. The operation unit 227 is a general term for, for example, an input device for a user to give instructions to the smartphone 110. The operation unit 227 includes a volume control button, a power button, etc. Note that the touch panel provided on the display unit 225 is also included in the operation unit.

[0030] The voice processing unit 228 processes a voice signal obtained from, for example, a microphone built into the smartphone 110. The voice processing unit 228 may have a voice recognition function. In this case, the user can use voice to input commands and text. Note that the voice recognition function may be realized by using the function of an external device that can communicate through the communication unit 221.

[0031] The GPS (Global positioning system) receiver 229 acquires location information (longitude and latitude information) of the smartphone 110 by positioning processing based on signals received from GPS satellites. The smartphone 110 may acquire location information using other methods such as WPS (Wi-Fi Positioning System). The control unit 222 can use the fact that the current location information of the smartphone 110 is included in a preset geographical range or the detection of a predetermined change in the current location as event information for controlling the imaging device 100. The control unit 222 can use the event information as a trigger for starting or stopping image capture by the imaging device 100, for example.

[0032] The imaging device 100 and the smartphone 110 perform bidirectional communication through communication units 210 and 221. For example, the imaging device 100 transmits image signals output from the imaging unit 202, various information about the imaging device 100, audio signals, and the like to the smartphone 110, and receives various commands from the smartphone 110. In addition, the smartphone 110 transmits commands such as pan, tilt, zoom, and start and stop of shooting to the imaging device 100, and receives the execution results of the commands.

[0033] The communication units 210 and 221 can communicate simultaneously or selectively using multiple communication paths based on different communication standards. The communication units 210 and 221 can communicate, for example, using a first communication path 231 based on a first standard (e.g., wireless LAN standard) and a second communication path 232 based on a second standard (e.g., BLE standard). The communication units 210 and 221 can reduce power consumption and achieve efficient communication by performing communication based on multiple standards with appropriate power consumption, communicable distance, and communication speed according to the purpose of communication.

[0034] After the imaging device 100 is started, the control unit 207 of the imaging device 100 monitors the reception of a communication request through the communication unit 210. In this state, the control unit 207 may capture moving images or periodically capture still images, and record the captured images in the recording unit 204. When the remote photography application is executed on the smartphone 110, the control unit 222 of the smartphone 110 transmits a communication request to the imaging device 100. It is assumed that information necessary for communication with the imaging device 100 is set in the recording unit 223. When the control unit 207 of the imaging device 100 receives a communication request from the smartphone 110 via the communication unit 210, the control unit 207 transmits and receives information to and from the control unit 222 in a procedure defined by a communication standard to establish communication. When communication with the smartphone 110 is established, the control unit 207 transmits various information about the imaging device to the smartphone 110 via the communication unit 210. The various information about the imaging device includes information about the model of the imaging device and the size of the image sensor, information about the imaging optical system, and the like. The information about the imaging optical system includes a focal length equivalent to a zoom magnification of 1x, lens information (zoom magnification of the imaging optical system, tilt angle of the tilt unit, pan angle of the pan unit), and an adjustable range of the imaging optical system (for example, minimum and maximum values ​​of the magnification, tilt angle, and pan angle).

[0035] The control unit 207 of the imaging device 100 starts transmitting the captured image to the smartphone 110 via the communication unit 210. The image transmitted to the smartphone 110 may be image data for display output from the image processing unit 203. When the image processing unit 203 does not generate image data for display, the control unit 207 may generate image data for display from image data for recording. Note that, although the imaging device 100 is assumed here to capture a moving image having a predetermined frame rate, it may also capture a still image in response to an instruction from the smartphone 110.

[0036] When the control unit 222 of the smartphone 110 receives various pieces of information about the imaging device from the imaging device 100 with which communication has been established, the control unit 222 records the various pieces of information about the imaging device in the system memory 224. In addition, when the control unit 222 starts receiving images from the imaging device 100, the control unit 222 displays, on the display unit 225, a GUI screen generated by a remote photography application.

[0037] Next, a process of automatically deleting an image captured by the imaging device 100 will be described. Fig. 3 is a flowchart showing an example of control processing of the imaging device 100. The flowchart in Fig. 3 is realized by the control unit 207 reading a program recorded in the ROM 211 into the system memory 212 and executing it. The control unit 207 of the imaging device 100 repeatedly performs processing from S301 to S305, which will be described later, while the power is on.

[0038] In S301, the control unit 207 of the imaging device 100 executes automatic shooting processing. Details of the automatic shooting processing will be described later with reference to the flowchart of FIG. In S302, the control unit 207 executes a deletion candidate flagging process, the details of which will be described later with reference to the flowchart of FIG.

[0039] In S303, the control unit 207 determines whether or not the device is currently connected to the network via the communication unit 210. If the device is not currently connected to the network, the process proceeds to S304, and if the device is currently connected to the network, the process returns to S301 without executing the processes of S304 and S305. In S304, the control unit 207 determines whether the remaining free recording capacity available for recording in the recording unit 204 is less than a predetermined capacity. If the remaining free recording capacity is less than the predetermined capacity, the process proceeds to S305, and if the remaining free recording capacity is not less than the predetermined capacity, the process returns to S301 without executing the process of S305.

[0040] In S305, the control unit 207 deletes images that are candidates for deletion from among the images recorded in the recording unit 204. Specifically, the control unit 207 deletes a predetermined number of images whose deletion candidate flags are "-1" from the recording unit 204, which will be described later. The predetermined number is a number determined in advance, for example, five. Note that, if the number of images whose deletion candidate flags are "-1" recorded in the recording unit 204 does not reach the predetermined number, the control unit 207 deletes all images whose deletion candidate flags are "-1". For example, if only three images whose deletion candidate flags are "-1" are recorded in the recording unit 204, the control unit 207 deletes all three images. On the other hand, if six images whose deletion candidate flags are "-1" are recorded in the recording unit 204 (if the number is equal to or greater than the predetermined number), the control unit 207 deletes five images at once. Therefore, one image remains recorded in the recording unit 204 without being deleted. In this way, by deleting images that are candidates for deletion in a predetermined number at a time during the automatic shooting process rather than deleting them all at once, the load and time required for the deletion process can be reduced, and interference with automatic shooting can be prevented.

[0041] 3, the order of S303 and S304 may be interchanged, so that S303 is processed before S304. In this case, even if the remaining free recording capacity is less than a predetermined capacity, if the camera is connected to the network, the process returns to S301 without proceeding to S305, and images recorded in the recording unit 204 are not deleted. This makes it possible to prevent images from being automatically deleted while the camera is connected to the network.

[0042] Fig. 4 is a flowchart showing an example of the automatic shooting process of the imaging device 100. Fig. 4 shows detailed processing of S301 in Fig. 3 described above. In S401, the control unit 207 of the imaging device 100 determines whether or not a predetermined shooting condition is satisfied based on a live view image output from the image processing unit 203. Specifically, the face detection unit 209 detects a face area from the live view image, and calculates a score using information on the face and facial expression of a person included in the face area.

[0043] Here, the score is calculated from a basic score and a corrected score. The basic score is calculated by the following formula using the smile level, which increases the more the face in the face area is smiling, and the eye open level, which increases the more the eyes in the face area are open. Note that the smile level and eye open level are both values ​​between 0 and 100, and the basic score is also a value between 0 and 100. Base score = (smile level x 7 + eye opening level x 3) ÷ 10

[0044] The correction score is a score for making corrections to the basic score, and is, for example, the values ​​of the face size, face direction, and face position output from the face detection unit 209. The face size is any value between 0 and 100, and the face direction is any value indicating the front, 45° right, 90° right, 45° left, and 90° left. The face position is a value within a range of 640×480 dots that indicates where the center position of the main subject's face is located within the image.

[0045] The final score is calculated by adjusting the base score with the adjustment score as follows: How the final score is calculated Deductions due to face size: If the face size is less than 30, 10 points will be deducted from the base score. Face orientation bonus: If the face is facing forward, 10 points will be added to the base score. Face position deductions: If the face position meets any of the following four conditions, 50 points will be deducted from the base score. When adding half the face size to the horizontal position of the face and it exceeds 640 When the horizontal position of the face minus half the face size is less than 0 When adding half the face size to the vertical position of the face and it exceeds 480 When the vertical position of the face minus half the face size is less than 0 The final score is limited to a value between 0 and 100, with a score of 0 for anything less than 0 and 100 for anything greater than 100.

[0046] The control unit 207 records the calculated final score information as additional metadata of the image in the recording unit 204. If the final score is equal to or greater than the specified score, the control unit 207 determines that the shooting conditions are met, and if the final score is less than the specified score, the control unit 207 determines that the shooting conditions are not met. If the shooting conditions are met, the process proceeds to S402, and if the shooting conditions are not met, the automatic shooting process ends. The method of calculating the score and the method of determining whether the shooting conditions are satisfied are not limited to the above. For example, the angle of view, focus, and IS (Image Stabilization) state may be used to calculate the score. The specified score may be a fixed value or may be a value that varies with time or other conditions.

[0047] In S402, the control unit 207 issues a shooting instruction to the imaging unit 202, and the imaging unit 202 executes a shooting process of an image (a still image or a moving image) in response to the shooting instruction. In S403, the control unit 207 records the image output from the imaging unit 202 and processed by the image processing unit 203 in the recording unit 204. The control unit 207 also records the shooting date and time in the recording unit 204 in association with the image. In S404, the control unit 207 performs scene determination processing using the face area, position information, pan angle information, shooting date and time information, etc., and ends the automatic shooting processing. Details of the scene determination processing will be described later using the flowchart in FIG.

[0048] Fig. 5 is a flowchart showing an example of scene determination processing of the image capture device 100. Fig. 5 shows detailed processing of S404 in Fig. 4 described above. In S501, the control unit 207 judges whether the scene change information determined previously is recorded. Here, a scene change means that the scene of a captured image has changed. The scene change information includes various information when a scene change occurs, which will be described later. If the scene change information is recorded, the process proceeds to S502, and if not, the process proceeds to S507.

[0049] In S502, the control unit 207 compares the shooting date and time information of the image shot this time with the shooting date and time information included in the recorded previous scene change information to determine whether the time elapsed since the previous scene change is less than a predetermined period. The predetermined period is a period determined in advance, for example, 3 minutes. If the time elapsed is less than the predetermined period, the control unit 207 determines that the scene is the same as the previous one and proceeds to S503, and if the time elapsed is equal to or greater than the predetermined period, it determines that a scene change has occurred and proceeds to S507.

[0050] In S503, the control unit 207 compares the pan angle of the pan unit 103 when the current image was taken with the pan angle of the pan unit 103 when the previous scene was changed, and determines whether or not the change in the pan angle is less than a predetermined angle. The predetermined angle is a predetermined angle, for example, ±90°. If the change is less than the predetermined angle, the control unit 207 determines that the scene is the same as the previous scene and proceeds to S504, and if the change is equal to or greater than the predetermined angle, determines that a scene change has occurred and proceeds to S507. The control unit 207 may compare the pan angle of the pan unit 103 when the current image was taken with the pan angle of the pan unit 103 when the previous image was taken. In this case, the control unit 207 determines whether or not the change in the pan angle is less than a predetermined angle, and if the change is equal to or greater than the predetermined angle, determines that a scene change has occurred.

[0051] In S504, the control unit 207 compares the shooting date and time information of the image captured this time with the shooting date and time information of the image captured last time to determine whether the shooting time interval is less than a predetermined period. The predetermined period is a period determined in advance, for example, one minute. If it is less than the predetermined period, the control unit 207 determines that the scene is the same as the previous one and proceeds to S505, and if it is the predetermined period or more, determines that a scene change has occurred and proceeds to S507. In S505, the control unit 207 compares the installation state of the imaging device 100 when the current image was captured (whether it is placed or held, etc.) with the installation state of the imaging device 100 when the previous image was captured, and determines whether the installation state is the same. The control unit 207 can determine the installation state based on the state of the IS when the image was captured. If the installation state is the same, the control unit 207 determines that the scene is the same as the previous one and proceeds to S506, and if the installation state is different, it determines that a scene change has occurred and proceeds to S507.

[0052] In S506, the control unit 207 compares subject information such as a subject ID (IDentifier) ​​for identifying the type of subject or the number of subjects between images captured several times in the past and the image captured this time to determine whether they are the same. The face detection unit 209 detects a face area from the captured image, and the control unit 207 assigns a subject ID to each person included in the face area, and the subject ID is recorded in the recording unit 204 or the like together with the face image of the person. If the subject ID or the number of subjects is the same, the control unit 207 determines that the scene is the same as the previous time and proceeds to S509, and if they are different, determines that a scene change has occurred and proceeds to S507. As a specific determination method, it is preferable that the control unit 207 excludes a temporary change such as a subject momentarily going out of the angle of view as a scene change. For example, the control unit 207 determines that the scene is the same when the subject ID and the number of subjects are the same between the image captured this time and two of the three images captured in the past, and determines that the scene is a scene change when they are different.

[0053] In S507, the control unit 207 determines that the scene of the currently captured image is a new scene or that a scene change has occurred, and records scene information of the currently captured image as scene change information in the system memory 212. The scene information includes shooting date and time information, pan angle information, installation information of the imaging device 100, subject information, and information on the number of subjects, which are used to determine whether or not a scene change has occurred in the above-mentioned S501 to S506. In S508, the control unit 207 increments the current scene number.

[0054] In S509, the control unit 207 adds the current scene number to the scene information of the currently captured image. In S510, the control unit 207 records the scene information to which the scene number has been added in association with the currently captured image in the recording unit 204, and ends the scene determination process.

[0055] Fig. 6 is a flowchart showing an example of the deletion candidate flag setting process of the imaging device 100. Fig. 6 shows detailed processing of S302 in Fig. 3 described above. In S601, the control unit 207 analyzes the captured image and obtains the score calculated by the face detection unit 209. The score can be calculated in the same manner as the score calculation method described in S401 above. The control unit 207 records the calculated score (image score) and the face size used when calculating the score in the recording unit 204 in association with the image. In S602, the control unit 207 determines whether the calculated score is less than a predetermined value. The predetermined value may be a fixed value or may be a value that varies according to an instruction from a user, etc. If the score is less than the predetermined value, the process proceeds to S603, and if the score is not less than the predetermined value, the process proceeds to S604.

[0056] In S603, the control unit 207 sets the deletion candidate flag for the currently captured image to "-1", indicating that the image is a candidate for automatic deletion. In S604, the control unit 207 sets the deletion candidate flag for the currently captured image to "0" as an image that is not a candidate for automatic deletion, that is, an image to be recorded. In S605, the control unit 207 associates the set deletion candidate flag with the currently captured image, records it in the recording unit 204, and ends the deletion candidate flag assignment process.

[0057] Through this process, a deletion candidate flag of either "-1" or "0" is associated with all images recorded in the recording unit 204. When the remaining free recording capacity available for recording in the recording unit 204 becomes low, images with a deletion candidate flag of "-1" are automatically deleted in S305 in Fig. 3 described above, allowing the imaging device 100 to continue capturing images automatically.

[0058] Next, a process of the remote photography system for allowing the user of the smartphone 110 to recognize the recorded images will be described. Fig. 7(a) is a flowchart showing an example of processing of the imaging device 100, and Fig. 7(b) is a flowchart showing an example of processing of the smartphone 110. The flowchart of Fig. 7(a) is realized by the control unit 207 of the imaging device 100 reading a program recorded in the ROM 211 into the system memory 212 and executing it. On the other hand, the flowchart of Fig. 7(b) is realized by the control unit 222 executing the remote photography application when the user of the smartphone 110 starts the remote photography application. The flowchart of Fig. 7 is executed at any timing while the power supply of the imaging device 100 is on, specifically, while the control processing of the flowchart of Fig. 3 is being executed.

[0059] In S701, the control unit 207 of the imaging device 100 connects to the smartphone 110 via the communication unit 210 over a network. In S702, the control unit 207 receives a display request for a list of all images transmitted from the smartphone 110 via the communication unit 210. In S703, the control unit 207 transmits attribute information of images that are not candidates for automatic deletion among the images recorded in the recording unit 204, i.e., images to be recorded, to the smartphone 110. Specifically, the control unit 207 transmits attribute information (file name, shooting date and time, thumbnail image, etc.) of images whose deletion candidate flags are "0" among the images recorded in the recording unit 204 to the smartphone 110.

[0060] In S711, the control unit 222 of the smartphone 110 connects to the imaging device 100 via the communication unit 221 over the network. In S712, the control unit 222 transmits a display request for a list of all images to the imaging device 100 in response to an operation by the user. In S713, the control unit 222 receives the attribute information of the image to be recorded transmitted from the imaging device 100. In S714, the control unit 222 displays a list of all images recorded in the imaging device 100 on the display unit 225. Specifically, the control unit 222 displays on the display unit 225 at least thumbnail images among the attribute information of the images to be recorded received from the imaging device 100.

[0061] FIG. 8 is a diagram showing an example of images recorded in the recording unit 204 of the imaging device 100 and a list of all images displayed on the smartphone 110. As shown in FIG. Here, a plurality of images A to H are recorded in recording unit 204. Of images A to H, images A, C, G, and H indicated by dashed lines have their deletion candidate flags set to "-1" and are candidates for automatic deletion. On the other hand, of images A to H, images B, D, E, and F indicated by solid lines have their deletion candidate flags set to "0" and are images to be recorded that are not candidates for automatic deletion.

[0062] By receiving a display request for a list of all images from the smartphone 110, only attribute information of images B, D, E, and F among images A to H is transmitted from the imaging device 100 to the smartphone 110. Therefore, thumbnail images of images B, D, E, and F are displayed in a list on the screen of the display unit 225 of the smartphone 110. In this way, the attribute information of images that are recorded in the recording unit 204 when a display request is received from the smartphone 110 but are automatically deleted after a while is not displayed on the smartphone 110.

[0063] The smartphone 110 may allow the user to specify the type of images (still images, videos, recommended images, images containing a specific subject, etc.) to be displayed in the image list. When the user specifies the type of image, in the above-mentioned S712, the control unit 222 of the smartphone 110 adds type information of the specified image to the display request and transmits it to the imaging device 100. On the other hand, when the imaging device 100 receives a display request to which the image type information is added, in the above-mentioned S703, the control unit 207 of the imaging device 100 transmits only attribute information of images of the specified type among images whose deletion candidate flags are "0" to the smartphone 110.

[0064] Thus, according to the present embodiment, information on images that are not candidates for automatic deletion is transmitted from the imaging device 100 to the smartphone 110 via the communication unit 210 in order to display the information on the smartphone 110. Therefore, when a recorded image is automatically deleted, the user of the smartphone 110 can recognize the image to be recorded. In addition, since information on an image that is a candidate for automatic deletion is not transmitted, it is possible to suppress or prevent an image that has been confirmed by the user of the smartphone 110 once from being deleted over time. In particular, even when an image is automatically captured by the imaging device 100, the user can easily confirm what kind of image has been captured and recorded.

[0065] [Second embodiment] Next, a remote photography system according to a second embodiment will be described. The remote photography system according to this embodiment has the same configuration as that of the first embodiment. Below, differences from the first embodiment will be described in detail.

[0066] Fig. 9 is a flowchart showing an example of a control process of the imaging device 100. In the flowchart of Fig. 9, the same processes (S301, S303, S304) as those in Fig. 3 are given the same step numbers and descriptions thereof will be omitted as appropriate. In S902, the control unit 207 of the imaging device 100 executes a deletion candidate list creation process. The deletion candidate list creation process will be described in detail later with reference to the flowchart of FIG. In S905, the control unit 207 executes an image deletion process for deleting images based on the deletion candidate list from among the images recorded in the recording unit 204. Details of the image deletion process will be described later with reference to the flowchart in FIG.

[0067] Fig. 10 is a flowchart showing an example of a deletion candidate list creation process of the imaging device 100. Fig. 10 shows detailed processing of S902 in Fig. 9 described above. In S1001, the control unit 207 identifies the image with the oldest shooting date and time among the captured images, and acquires an image ID (IDentifier) ​​and a scene number associated with the image as information of the identified image. The image ID is information for identifying an image, and is assigned to an image each time it is captured. The control unit 207 assigns 001 as an image ID to the first captured image, and records it in the recording unit 204 together with the captured image. The control unit 207 also assigns 002, which is an image ID incremented by +1, to the next captured image, and records it in the recording unit 204 together with the captured image. Thereafter, the control unit 207 similarly assigns image IDs to the images while incrementing them in the order in which they were captured, and records them in the recording unit 204.

[0068] In S 1002 , the control unit 207 temporarily records the acquired scene number in the system memory 212 . In S1003, the control unit 207 creates a deletion candidate list, records it in the ROM 211, and initializes the image list number n of the image list that is divided by scene number in the deletion candidate list to n=0. In S1004, the control unit 207 records the acquired image ID in the image list [n].

[0069] Next, the control unit 207 of the imaging device 100 repeats the processes from S1005 to S1009 (described later) while image information can be obtained in order to sort the recorded images by scene number in order of deletion priority. In S1005, the control unit 207 identifies an image with the second oldest shooting date and time after the previously obtained image information, and obtains the image ID and the scene number associated with the image as information of the identified image. In S1006, the control unit 207 determines whether the acquired scene number is the same as the temporarily recorded scene number. If the scene numbers are different, the process proceeds to S1007, and if the scene numbers are the same, the process proceeds to S1009.

[0070] In S1007, the control unit 207 updates the temporarily recorded scene number to the acquired scene number and records it in the system memory 212. Specifically, the control unit 207 replaces the scene number that has been recorded up until now with the scene number acquired in S1005 and records it. In S1008, the control unit 207 increments the image list number n.

[0071] In S1009, the control unit 207 adds the acquired image ID to the image list [n] and records it. If an image ID has already been recorded in the image list [n], the control unit 207 sorts a plurality of images including the image of the added image ID in descending order of deletion priority based on a preset priority setting. Items that can be set in the priority setting include the shooting date and time, the image score, and the face size, and any one of them is set and recorded in the ROM 211. Also, each piece of information on the shooting date and time, the image score, and the face size is recorded in the recording unit 204 in association with each image. For example, when the shooting date and time is set in the priority setting, the older the shooting date and time, the higher the deletion priority, and the newer the shooting date and time, the lower the deletion priority. Also, when the image score is set in the priority setting, the lower the image score, the higher the deletion priority, and the higher the image score, the lower the deletion priority. Also, when the face size is set in the priority setting, the smaller the face size of the main subject (the person determined to be the main in the image), the higher the deletion priority, and the larger the face size of the main subject, the lower the deletion priority. In addition, if an image score is set in the priority setting and the image scores are the same, or if a face size is set in the priority setting and the face size of the main subject is the same, the older the image date and time, the higher the deletion priority.

[0072] Furthermore, the user can select the priority setting items from the smartphone 110. Specifically, the control unit 222 of the smartphone 110 executes a remote photography application to display the priority setting items selectably on the display unit 225. The control unit 222 transmits information on the priority setting items selected by the user to the imaging device 100 via the communication unit 221. The control unit 207 of the imaging device 100 records the information on the priority setting items received via the communication unit 210 in the ROM 211, whereby the priority setting is set.

[0073] In S1010, if there is no obtainable image information, control unit 207 records the maximum number N_MAX=n of image list numbers in system memory 212, and ends the deletion candidate list creation process. When the deletion candidate list creation process is completed, a deletion candidate list is created in which the image IDs for each scene are sorted in order of deletion priority.

[0074] FIG. 11 is a diagram showing an example of the deletion candidate list 1100. As shown in FIG. n indicates the image list number for each scene. Here, there are six image list numbers, [0] to [5]. The maximum number of image list numbers, N_MAX, is 5. The image ID indicates a number that identifies each image. Here, the image IDs are arranged from left to right for each image list number in order of decreasing deletion priority. For example, in image list number [0], the image IDs are arranged in the order 001, 002, 003, and 004. This indicates that in image list number [0], the image with image ID 001 has the highest deletion priority, and the image with image ID 004 has the lowest deletion priority.

[0075] 11 shows an example of a list of candidates for deletion 1100 when priority is set to the shooting date and time. As described above, image IDs are assigned in the order in which they were taken, and when priority is set to the shooting date and time, images with older shooting dates and times have a higher deletion priority, so the image IDs included in the image list number are arranged from the left in the order of the image ID numbers, starting from the smallest. On the other hand, when the priority setting is set to image score or face size, the order of image IDs is changed within each image list number. For example, when the priority setting is set to image score, the image scores of the images included in the image list number [0] are image ID 001 = 70 points, image ID 002 = 60 points, image ID 003 = 80 points, and image ID 004 = 40 points, respectively. In this case, in the image list number [0], the image IDs are arranged from the left in the order of lowest image score, 004, 002, 001, and 003.

[0076] Fig. 12 is a flowchart showing an example of image deletion processing of the imaging device 100. Fig. 12 shows detailed processing of S905 in Fig. 9 described above. In S1201, the control unit 207 determines whether the image list number N containing the next image to be deleted is greater than the maximum number N_MAX of image list numbers. The maximum number N_MAX of image list numbers is the value recorded in the system memory 212 in S1010 of Fig. 10. If the image list number N is greater than the maximum number N_MAX of image list numbers, the process proceeds to S1202, and if not, the process proceeds to S1203 without executing the process of S1202.

[0077] In S1202, the control unit 207 assigns 0 to the image list number N. In S1203, the control unit 207 refers to the deletion candidate list and determines whether or not there are two or more images that are candidates for deletion in the image list [N], specifically, whether or not there are two or more image IDs. If there are two or more image IDs, the process proceeds to S1205, and if there is only one, the process proceeds to S1204 without executing S1205. In this way, if there is only one image ID in the image list [N], no images are deleted in S1205, which will be described later, so that at least one image per scene can remain recorded in the recording unit 204 without being deleted.

[0078] In S1204, the control unit 207 increments the image list number N, and the process returns to S1201. In S1205, the control unit 207 deletes the image with the highest deletion priority in the image list [N]. In S1206, the control unit 207 increments the image list number N and ends the image deletion process.

[0079] When the remaining free recording capacity available for recording in the recording unit 204 becomes low as a result of such processing, images are automatically deleted in descending order of deletion priority in S1205 of Fig. 12 described above, so that the imaging device 100 can continue to perform automatic shooting. Note that in the flowchart of Fig. 12, the processing from S1201 to S1206 may be repeated until a predetermined number of images are deleted, as in the first embodiment, and the image deletion processing may end when the predetermined number of images are deleted. Also, in S1203, the processing proceeds to S1205 when there are two or more image IDs, but it is also possible to proceed to S1205 when there are a predetermined number or more (for example, three or more) image IDs, and to proceed to S1204 when there are not.

[0080] Next, a process of the remote photography system for making the user of the smartphone 110 aware of images that will be automatically deleted will be described. Fig. 13(a) is a flowchart showing an example of processing of the imaging device 100, and Fig. 13(b) is a flowchart showing an example of processing of the smartphone 110. The flowchart of Fig. 13 is executed while the imaging device 100 is powered on, specifically, at any timing while the control processing of the flowchart of Fig. 9 is being executed. Note that, in the flowchart of Fig. 13, the same steps (S701, S711) as those in Fig. 7 are denoted by the same step numbers, and descriptions thereof will be omitted as appropriate.

[0081] In S1302, the control unit 207 of the imaging device 100 receives a request to display the deletion candidate list transmitted from the smartphone 110 via the communication unit 210. In S1303, the control unit 207 transmits the currently recorded deletion candidate list, attribute information of the images included in the deletion candidate list, and information on items set as priority settings to the smartphone 110. The item set as priority settings is any one of the shooting date and time, image score, and face size recorded in the ROM 211 described in S1009. In S1304, the control unit 207 receives the edited deletion candidate list edited in response to a user operation and transmitted from the smartphone 110. The control unit 207 updates the deletion candidate list recorded in the ROM 211 to the received edited deletion candidate list and records the updated list.

[0082] In S1312, the control unit 222 of the smartphone 110 transmits a request to display the deletion candidate list to the imaging device 100 in response to an operation by the user. In S1313, the control unit 222 receives the deletion candidate list transmitted from the imaging device 100. In S1314, the control unit 222 displays on the display unit 225 a list of deletion candidates of images that are candidates for automatic deletion among the images recorded in the imaging device 100. Specifically, the control unit 222 displays on the display unit 225 thumbnail images and image IDs for each scene based on the deletion candidate list received from the imaging device 100. At this time, the control unit 222 displays the thumbnail images in descending order of deletion priority from the left, similar to the deletion candidate list. Note that a specific method of displaying thumbnail images will be described later with reference to FIG. 14.

[0083] In S1315, when the deletion priority of the image is changed by the user's operation, the control unit 222 edits the deletion candidate list in accordance with the changed deletion priority. A specific method of editing the deletion candidate list will be described later with reference to FIG. In S1316, the control unit 222 transmits the edited deletion candidate list to the imaging device 100. When the deletion priority of an image is changed by a user operation, the control unit 222 of the smartphone 110 may transmit information indicating the edited content to the imaging device 100. In this case, the control unit 207 of the imaging device 100 can edit, update, and record the deletion candidate list based on the information indicating the edited content.

[0084] Fig. 14(a) is a diagram showing an example of a deletion candidate list 1400 displayed on the smartphone 110. The deletion candidate list 1400 in Fig. 14(a) will be described assuming that the deletion candidate list received by the smartphone 110 is the deletion candidate list 1100 in Fig. 11. In the deletion candidate list 1400, a shooting date and time button 1401, a score button 1402, a face size button 1403, a thumbnail image display area 1404, a delete button 1405, and an exclude button 1406 are displayed.

[0085] The shooting date and time button 1401, score button 1402, and face size button 1403 are sorting selection items that can be selected by the user. The thumbnail images displayed in the thumbnail image display section 1404 are sorted and displayed in order of shooting date and time, score, or face size from the left in descending order of deletion priority according to the selected button. FIG. 14(a) shows a state in which the shooting date and time button 1401 is selected. Note that when the control unit 222 of the smartphone 110 receives the deletion candidate list from the imaging device 100 and initially displays the deletion candidate list, the button corresponding to the information of the item set as the priority setting received from the imaging device 100 is displayed in a selected state.

[0086] The thumbnail image display section 1404 is divided according to the image list number n of the deletion candidate list, with n=0 being scene 1, n=1 being scene 2, and n=2 being scene 3, and for each scene, a thumbnail image corresponding to the image ID included in each image list number of the deletion candidate list is displayed. The thumbnail images of each scene are displayed from the left in order of decreasing deletion priority. For ease of explanation, an image ID is displayed in the upper right corner of each thumbnail image, but is not displayed on the actual screen. In FIG. 14(a), because the shooting date and time button 1401 is selected, thumbnail images are displayed from the left in order of oldest shooting date and time (smallest image ID number) so that each scene has the highest deletion priority.

[0087] The delete button 1405 is a button for instructing the deletion of a selected image. The user can press the delete button 1405 in a state where a thumbnail image to be deleted is selected in the thumbnail image display portion 1404. In response to pressing the delete button 1405, the thumbnail image display portion 1404 displays the selected thumbnail image at the leftmost position or grayed out, for example, so that it is possible to identify that the image is to be deleted or has the highest deletion priority. In this case, the control unit 222 of the smartphone 110 edits the deletion candidate list by sorting the image IDs to the leftmost position within the image list number so that the selected image has the highest deletion priority.

[0088] The remove button 1406 is a button for instructing to record the selected image. The user can press the remove button 1406 in a state where a thumbnail image that the user does not want to delete is selected in the thumbnail image display portion 1404. In response to pressing the remove button 1406, the thumbnail image display portion 1404 displays the selected thumbnail image on the far right, or displays it in a hidden or highlighted state, for example, so that it is possible to identify that the image will not be deleted or that it has the lowest deletion priority. In this case, the control unit 222 of the smartphone 110 edits the deletion candidate list by sorting the image ID to the far right in the image list number or generating information indicating that the selected image will not be deleted, so that the selected image has the lowest deletion priority. Therefore, the user can use the delete button 1405 and the remove button 1406 to change the priority of images to be automatically deleted while checking images from the smartphone 110 in chronological order of their capture date and time.

[0089] Fig. 14(b) is a diagram showing an example of a deletion candidate list 1410 displayed on the smartphone 110. In Fig. 14(b), because the selection has been changed from the shooting date and time button 1401 to the face size button 1403, the thumbnail images are sorted and redisplayed in the thumbnail image display section 1414. Specifically, in the thumbnail image display section 1414, thumbnail images are displayed in ascending order of image ID numbers, followed by the smallest face size for each scene. Therefore, the user can use the smartphone 110 to check images in ascending order of face size, and use the delete button 1405 and the remove button 1406 to change the priority of images to be automatically deleted.

[0090] As described above, according to the present embodiment, information on images that are candidates for automatic deletion is transmitted from the imaging device 100 to the smartphone 110 via the communication unit 210 in order to display the information on the smartphone 110. Therefore, when a recorded image is automatically deleted, the user of the smartphone 110 can recognize the image to be deleted. In particular, when an image is automatically deleted by the imaging device 100, the user can know whether or not an image that the user wants to record will be deleted. Furthermore, according to this embodiment, the user of the smartphone 110 can select images that the user does not want to delete or images that the user wants to delete and edit the deletion priority. Therefore, even if recorded images are automatically deleted, the user can leave the images that the user desires recorded or prioritize deleting images that the user does not need.

[0091] [Other embodiments] The present invention can also be realized by supplying a program for implementing one or more of the functions of the above-described embodiments to a system or device via a network or a recording medium, and having one or more processors in the computer of the system or device read and execute the program. It can also be realized by a circuit (e.g., ASIC) that implements one or more of the functions.

[0092] Although the present invention has been described above in conjunction with various embodiments, the present invention is not limited to these embodiments, and modifications and the like are possible within the scope of the present invention, and the above-described embodiments and modified examples may be combined as appropriate.

[0093] In the above-described first embodiment, the imaging device 100 transmits information on an image that is not a candidate for automatic deletion to the smartphone 110. However, the present invention is not limited to this case, and information on an image that is a candidate for automatic deletion may also be transmitted. In this case, however, the imaging device 100 also transmits information on a deletion candidate flag to the smartphone 110. It is preferable that the smartphone 110 displays information on the deletion candidate flag received so that the user can identify whether the image is a candidate for automatic deletion or not a candidate for automatic deletion. Furthermore, the smartphone 110 may be able to edit information on the deletion candidate flag for each of an image that is a candidate for automatic deletion and an image that is not a candidate for automatic deletion in response to a user's operation from the smartphone 110. In this case, the smartphone 110 may transmit information on the edited deletion candidate flag to the imaging device 100, and the imaging device 100 may automatically delete the image based on the edited deletion candidate flag.

[0094] In the above embodiment, the case where the scene is determined according to the passage of time has been described, but the present invention is not limited to this case. For example, images showing the same subject may be determined as the same scene, or images taken at the same location may be determined as the same scene. In this case, the control unit 207 may coordinate the setting of the deletion priority for each scene. For example, when images showing the same subject are determined as the same scene, the control unit 207 may set the image scores of the subjects in ascending order, and when images taken at the same location are determined as the same scene, the control unit 207 may set the image scores of the subjects in descending order, or when images taken at the same location are determined as the same scene, the control unit 207 may set the image scores of the subjects in descending order.

[0095] In the above-described embodiment, the various controls described above as being performed by the control unit 207 of the imaging device 100 may be performed by a single piece of hardware, or the entire device may be controlled by multiple pieces of hardware (e.g., multiple processors or circuits) sharing the processing.

[0096] In the above embodiment, the imaging device is a digital camera, but the present invention is not limited to this, and can be applied to any electronic device that can capture an image of a subject. Such imaging devices include smartphones, tablet PCs, and other electronic devices. In the above embodiment, the electronic device that communicates with the imaging device is a smartphone, but the present invention is not limited to this, and can be applied to any electronic device that can communicate with the imaging device. Such electronic devices include computer devices (personal computers, tablet computers, media players, PDAs, etc.), mobile phones, game consoles, etc., and can also be applied to other electronic devices. [Explanation of symbols]

[0097] 100: Imaging device 110: Smartphone (external device) 202: Imaging section 204: Recording section 207: Control section 210: Communication section

Claims

1. An imaging means for photographing a subject; A recording means for controlling the captured image to be recorded in a recording unit; a deleting means for automatically deleting the images recorded in the recording unit; a control means for controlling information on images that are not candidates for automatic deletion by the deletion means, among images recorded in the recording unit including images before being automatically deleted by the deletion means, to be transmitted to the external device via a communication unit in order to display the information on the external device; having The imaging means is When certain shooting conditions are met, the camera automatically captures the subject. The deletion means includes: When the remaining free recording capacity available for recording in the recording unit becomes less than a predetermined capacity, images that are candidates for automatic deletion are deleted from among the images recorded in the recording unit; Even if the remaining free recording capacity available for recording in the recording unit becomes less than the predetermined capacity, when communication is being performed via the communication unit, images that are candidates for automatic deletion among the images recorded in the recording unit are not deleted.

1. An imaging device comprising:

2. The deletion means includes: The imaging device according to claim 1, characterized in that when the remaining free recording capacity available for recording in the recording unit becomes less than a predetermined capacity, if the number of images recorded in the recording unit that are candidates for automatic deletion is a predetermined number or more, a predetermined number of images recorded in the recording unit that are candidates for automatic deletion are deleted, and if the number of images recorded in the recording unit that are candidates for automatic deletion is less than the predetermined number, all images recorded in the recording unit that are candidates for automatic deletion are deleted.

3. A calculation means for calculating evaluation information for the captured image, The control means The imaging device according to claim 1 or 2, characterized in that the image recorded in the recording unit is controlled so as to be determined as a candidate image to be automatically deleted by the deletion means or as an image not to be automatically deleted by the deletion means based on the evaluation information.

4. The control means The imaging device according to claim 1 or 2, characterized in that when information about a plurality of images that are candidates for automatic deletion by the deletion means is sent to the external device, the imaging device is controlled so that information including the deletion priority is sent to the external device so that the images are displayed on the external device according to the deletion priority at which the images are deleted.

5. The control means 5. The imaging apparatus according to claim 4, wherein the deletion priority is controlled so as to be determined based on at least any one of information on a shooting date and time, evaluation information, and information on a size of a subject.

6. The deletion means includes:

6. The imaging device according to claim 4, wherein images recorded in the recording unit are automatically deleted based on information including a deletion priority level edited in response to a user's operation from the external device.

7. A discrimination means for discriminating a scene of the photographed image, The deletion means includes: The imaging device according to any one of claims 1 to 6, characterized in that, among the images recorded in the recording section, images that are candidates for automatic deletion are deleted for each scene determined by the determination means.

8. The deletion means includes:

8. The imaging apparatus according to claim 7, wherein images are deleted from the images recorded in the recording section so that at least one image remains for each scene determined by the determination means.

9. The discrimination means is 9. The imaging apparatus according to claim 7, wherein a scene is determined according to a time interval during which images are taken by said imaging means.

10. The discrimination means is 10. The imaging apparatus according to claim 7, wherein a scene is determined according to a type of the photographed subject or a number of the photographed subjects.

11. The discrimination means is 11. The imaging device according to claim 7, wherein the scene is determined according to an installation state of the imaging device.

12. A pan drive means for driving the optical axis of the imaging means in a pan direction, The discrimination means is 12. The imaging apparatus according to claim 7, wherein a scene is determined according to a pan angle driven by said pan driving means.

13. An imaging step of photographing a subject; a recording step of controlling the captured image to be recorded in a recording unit; a deleting step of automatically deleting the images recorded in the recording unit; a control step of controlling information of images that are not candidates for automatic deletion by the deletion step, among images recorded in the recording unit including images before being automatically deleted by the deletion step, to be transmitted to the external device via a communication unit in order to display the information on the external device; having In the imaging step, When certain shooting conditions are met, the camera automatically captures the subject. In the deletion step, When the remaining free recording capacity available for recording in the recording unit becomes less than a predetermined capacity, images that are candidates for automatic deletion are deleted from among the images recorded in the recording unit; Even if the remaining free recording capacity available for recording in the recording unit becomes less than the predetermined capacity, when communication is being performed via the communication unit, images that are candidates for automatic deletion among the images recorded in the recording unit are not deleted.

23. A method for controlling an imaging apparatus comprising the steps of:

14. A program for causing a computer to function as the means of the imaging device according to any one of claims 1 to 12.

15. 13. A computer-readable recording medium storing a program for causing a computer to function as the means of the imaging device according to any one of claims 1 to 12.

Citation Information

Patent Citations

  • Information recording apparatus and method

    JP2007036582A

  • Imaging device, image recording device, and its program

    JP2007295181A

  • Image photographing apparatus and image processing system

    JP2010035177A

  • Information processing apparatus and information processing method

    JP2015046845A

  • Imaging device, data management method and program

    JP2017059914A