Information processing device, information processing method, and information processing program

Abstract

Provided are an information processing device, an information processing method, and an information processing program which enable a setting change for an imaging device according to a state of a subject by generating a trigger according to the state of the subject.　The information processing device comprises: a state determination unit which determines the state of the subject; and a trigger processing unit which generates a trigger for a setting change of the imaging device when the state determination unit has determined the state of the subject to be a predetermined state.

Description

[Technical Field]

[0001] The present technology relates to an information processing device, an information processing method, and an information processing program. [Background technology]

[0002] When taking pictures with a camera, there is a demand to change the shooting method and camera settings appropriately depending on the subject's movements, state, etc. Therefore, a technology has been proposed that can realize continuous shooting linked to the movement of a target person (Patent Document 1). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2009-060355 Summary of the Invention [Problem to be solved by the invention]

[0004] However, the technology described in Patent Document 1 requires that the subject to be photographed be identified in advance using facial recognition, and the only camera setting that can be changed is whether or not to perform continuous shooting, so it cannot be applied to various photography purposes.

[0005] The present technology has been developed in consideration of these points, and aims to provide an information processing device, an information processing method, and an information processing program that enable settings of an imaging device to be changed in accordance with the state of the subject by generating a trigger in accordance with the state of the subject. [Means for solving the problem]

[0006] In order to solve the above-described problem, a first technique includes a state determination unit that determines whether a state of a subject has reached a predetermined pre-state, and a trigger processing unit that generates a trigger for changing settings of an imaging device when the state determination unit determines that the state of the subject has reached the pre-state; a setting change processing unit that performs processing to change the settings of the imaging device after a predetermined time has elapsed since the occurrence of the trigger;Equipped with The pre-state is the state of the subject before it reaches the state of the subject to be photographed using the imaging device, and the predetermined time is an adjustment time for adjusting the length of time until it reaches the state of the subject to be photographed after the setting change process of the imaging device is completed. It is an information processing device.

[0007] The second technique determines whether the state of the subject has reached a predetermined pre-state, and when it is determined that the state of the subject has reached the pre-state, generates a trigger for changing settings of the imaging device; An information processing method in which processing for changing settings of an imaging device is performed after a predetermined time has elapsed since the occurrence of a trigger, the pre-state being a state of a subject before the subject reaches a state to be photographed using the imaging device, and the predetermined time being an adjustment time for adjusting the length of time until the subject reaches the state to be photographed after the processing for changing settings of the imaging device is completed is.

[0008] Furthermore, a third technique determines whether or not the state of the subject has reached a predetermined pre-state, and when it is determined that the state of the subject has reached the pre-state, generates a trigger for changing settings of the imaging device; A process for changing the settings of the imaging device is performed after a predetermined time has elapsed since the occurrence of a trigger, and the pre-state is a state of the subject before it becomes a state to be photographed using the imaging device, and the predetermined time is an adjustment time for adjusting the length of time until it becomes a state to be photographed after the setting change process of the imaging device is completed. It is an information processing program that causes a computer to execute the information processing method. [Brief explanation of the drawings]

[0009] [Figure 1] FIG. 1 is a block diagram showing the configuration of an imaging device 100. [Figure 2] FIG. 2 is a block diagram showing the configuration of an information processing device 200. [Figure 3] FIG. 10 is a diagram showing an outline of processing by the information processing device 200 when a trigger is generated once. [Figure 4] 10 is a flowchart showing the process performed by the information processing device 200 when a trigger is generated once. [Figure 5] FIG. 10 is an explanatory diagram of state determination when a trigger is generated once. [Figure 6] FIG. 10 is an explanatory diagram of state determination when a trigger is generated once. [Figure 7] FIG. 10 is an explanatory diagram of the length of an adjustment time. [Figure 8] FIG. 10 is a diagram showing an outline of processing by the information processing device 200 when a trigger is generated multiple times. [Figure 9] FIG. 10 is an explanatory diagram of state determination when a trigger is generated multiple times. [Figure 10] 10 is a flowchart showing the process performed by the information processing device 200 when a trigger is generated multiple times. [Figure 11]10 is a flowchart showing the process performed by the information processing device 200 when a trigger is generated multiple times. [Figure 12] FIG. 10 is an explanatory diagram of an example in which the settings of the imaging device 100 are not changed when the assist mode is turned on. [Figure 13] FIG. 10 illustrates a first example of a notification in a user interface. [Figure 14] FIG. 10 illustrates a second example of a notification in a user interface. [Figure 15] FIG. 10 illustrates a third example of a notification in a user interface. [Figure 16] FIG. 10 is a diagram illustrating an example of a user interface for determining a pre-existing state and setting changes. [Figure 17] FIG. 10 is a diagram illustrating an example of a user interface for determining a pre-existing state and setting changes. DETAILED DESCRIPTION OF THE INVENTION

[0010] Hereinafter, embodiments of the present technology will be described with reference to the drawings. The description will be made in the following order. <1. Embodiment> 1-1. Configuration of the imaging device 100 [1-2. Configuration of information processing device 200] [1-3. Processing by Information Processing Device 200] [1-3-1. Example of generating a trigger once] [1-3-2. Example of multiple triggers] [1-3-3. User Interface] <2. Modifications>

[0011] <1. Embodiment> 1-1. Configuration of the imaging device 100 The configuration of the imaging device 100 will be described with reference to Fig. 1. The imaging device 100 is configured to include a lens block 110, an image sensor block 120, an image processing circuit 130, an image compression / decompression circuit 140, an image data bus 150, an image RAM (Random Access Memory) 160, a storage block 170, a display block 180, a control unit 190, a lens information determination circuit 191, an input unit 192, an interface 193, a speaker 194, a microphone 195, and an information processing device 200.

[0012] The lens block 110 is configured to include a lens 111 including an optical lens for collecting light from a subject onto an image sensor 121 and a focus lens for adjusting the focus, a lens driver 112 for moving the lens 111, a focus lens control circuit 113 for controlling the focus lens, an optical lens control circuit 114 for controlling the optical lens, and an optical lens storage device 115. The optical lens storage device 115 stores individual information about the lens, such as parameters relating to the relationship between the zoom position and the focal length, the relationship between the focus position and the shooting distance, etc. There may be multiple lens blocks 110 (compound lenses). An optical image of the subject obtained through the lens block 110 is formed on an image sensor 121 in the image sensor block 120.

[0013] The image sensor 121 included in the image sensor block 120 photoelectrically converts incident light from a subject obtained through the lens 111 into an electric charge and outputs an image signal. The image sensor 121 then outputs the pixel signal to the image processing circuit 130. The image sensor 121 may be a CCD (Charge Coupled Device), a CMOS (Complementary Metal Oxide Semiconductor), or the like. There may be multiple image sensors 121 (three-plate prism or compound eye). The image sensor block 120 may also include a photodiode for image plane phase difference AF (Auto Focus). The image sensor block 120 may also include an image sensor driver 122 that physically drives the image sensor 121 and also serves as an image stabilization unit, and an image sensor control circuit 123 that controls the image sensor 121.

[0014] The image processing circuit 130 performs processing on the image signal output from the image sensor 121 to convert it into digital data (RGB creation / bit conversion, etc.), various detection processing from the digitized image data, image quality correction processing on the image data (gain correction, white balance, etc.), aspect conversion processing, etc. The imaging device 100 may be provided with multiple image processing circuits 130 to improve processing speed.

[0015] The image compression / decompression circuit 140 receives image data output from the image processing circuit 130 via the image RAM 160, compresses and encodes the data, and then outputs the data to the storage unit 171 as a moving image or still image data file. MPEG (Moving Picture Experts Group), JPEG (Joint Photographic Experts Group), or the like may be used as the encoding method. This need not be used if the data is to be saved as uncompressed RAW. The imaging device 100 may be equipped with multiple image compression / decompression circuits 140 to improve processing speed.

[0016] The image data bus 150 is a bus for transmitting and receiving image data. The image RAM 160 is for supplying image data to the image processing circuit 130, the image compression / decompression circuit 140, and the information processing device 200, which are connected via the image data bus 150. A plurality of image RAMs 160 may be provided to improve processing speed.

[0017] The memory block 170 is composed of a memory unit 171 and a memory unit control circuit 172. The memory unit 171 stores the image data that has passed through each processing circuit and is finally generated, and the memory unit control circuit controls the saving and reading of the image data in the memory unit 171. The memory unit 171 is composed of a drive device for portable recording media such as magnetic tape and optical disks, a hard disk drive (HDD), a solid state drive (SSD), etc. The memory unit 171 may be built into the imaging device 100 or may be externally attached via a wired or wireless connection. The imaging device 100 may be equipped with multiple memory units 171 in order to store different formats for inline / offline processing or to improve processing speed and reliability.

[0018] The display block 180 is composed of a display unit 181 and a display unit control circuit 182. The display unit 181 displays the image data, through image, GUI (Graphical User Interface), etc. that are finally generated after passing through each processing circuit, and the display unit control circuit 182 controls the display. The display unit 181 is realized, for example, by a monitor display configured with an LCD (Liquid Crystal Display), PDP (Plasma Display Panel), or organic EL (Electro Luminescence) panel, or an EVF (Electronic View Finder). There may be multiple different settings so that a through image before aspect conversion and a completed image after aspect conversion processing can be simultaneously viewed. The display unit 181 may be an external device attached to the imaging device 100 via a wired or wireless connection.

[0019] The control unit 190 is composed of a CPU (Central Processing Unit), RAM (Random Access Memory), ROM (Read Only Memory), etc. The CPU executes various processes according to programs stored in the ROM and issues commands to control the entire imaging device 100 and each unit. The control unit 190 also performs autofocus and autoexposure processing correction control, calculates correction processing control values, etc. based on detection information.

[0020] The lens information determination circuit 191 is a circuit for identifying and determining the attached lens, assuming an interchangeable lens camera. The lens information determination circuit 191 is not an essential component.

[0021] The input unit 192 is used by the photographer (user) to input various instructions and the like to the imaging device 100. When the photographer makes an input to the input unit 192, a control signal corresponding to the input is generated and supplied to the control unit 190. The control unit 190 then performs various processes corresponding to the control signal. The input unit 192 may be a release button for issuing a release command, physical buttons for various operations, a touch panel, a touch screen configured integrally with the display unit 181, or the like.

[0022] The interface 193 is an interface between the image capturing device 100 and other devices, the Internet, and the like. The interface 193 may include a wired or wireless communication interface. More specifically, the wired or wireless communication interface may include cellular communication such as 3TTE, 4G (fourth generation mobile communication system), 5G (fifth generation mobile communication system), Wi-Fi, Bluetooth (registered trademark), NFC (Near Field Communication), Ethernet (registered trademark), HDMI (High-Definition Multimedia Interface), USB (Universal Serial Bus), and the like. When the image capturing device 100 and the information processing device 200 are connected via hardware, the interface 193 may include a connection terminal between the devices or a bus within the devices. When the image capturing device 100 and the information processing device 200 are realized as separate devices, the interface 193 may include different types of interfaces for each device. For example, the interface 193 may include both a communication interface and an interface within the devices.

[0023] The speaker 194 is an audio output device used to notify the photographer by voice.

[0024] The microphone 195 is a sound collecting device for recording sound during shooting.

[0025] The imaging device 100 is configured as described above. The imaging device 100 may be a digital camera, a single-lens reflex camera, a camcorder, a commercial camera, or professional-grade imaging equipment.

[0026] [1-2. Configuration of information processing device 200] Next, the configuration of the information processing device 200 will be described with reference to Fig. 2. The information processing device 200 is configured to include a state determination unit 201, a trigger processing unit 202, a setting change processing unit 203, and a notification processing unit 204.

[0027] The state determination unit 201 recognizes the current state of the subject, which is the subject of the image capture, from the image generated by the imaging device 100 and determines whether the state of the subject has reached the pre-state. The state determination unit 201 determines whether the current state of the subject has reached the pre-state based on whether a determination value indicating the degree of match between the current state of the subject and the pre-state exceeds a threshold. Details of the pre-state and state determination will be described later. Subject recognition techniques may include methods based on machine learning or deep learning, template matching, matching methods based on luminance distribution information of the subject, methods based on colors contained in images or human facial features, and methods using artificial intelligence. These methods may also be combined to improve recognition accuracy. The state determination unit 201 may be configured with a dedicated AI circuit for advanced image determination.

[0028] The trigger processing unit 202 generates a trigger that causes the setting change processing unit 203 to change the settings of the image capturing device 100 based on the determination result of the state determination unit 201 .

[0029] The setting change processing unit 203 performs processing to change the settings of the imaging device 100. The setting change processing unit 203 performs processing to change the settings of the imaging device 100 after a predetermined time (adjustment time) has elapsed from the occurrence of a trigger until processing to change the settings of the imaging device 100. The adjustment time will be described in detail later.

[0030] The setting change processing unit 203 performs the setting change processing by, for example, transmitting to the imaging device 100 a control signal instructing the setting change together with information indicating the type of parameter to be changed and the changed value of the parameter to be changed. Settings to be changed include, for example, the F-number, shutter speed, ISO, white balance, activation of continuous shooting mode, continuous shooting speed, AF frame position, and focus position, but may also be any other parameter that can be changed in the imaging device 100. The photographer needs to set in advance the settings of the imaging device 100 to be changed by the processing of the setting change processing unit 203 (which parameters to change to what values). The photographer may set the settings by inputting specific parameters and their values, or the information processing device 200 may automatically set the settings based on a predetermined template or algorithm corresponding to the subject or type of object to be photographed.

[0031] The notification processing unit 204 performs various notification processes regarding changes in the settings of the image capturing device 100 to the photographer using the display unit 181 provided in the image capturing device 100, etc.

[0032] The information processing device 200 is configured as described above. The information processing device 200 may be configured as a dedicated device using hardware having the functions. Furthermore, the information processing device 200 may not only be configured as a dedicated device, but may also be configured using a program, and execution of the program may provide the imaging device 100 with the functions of the information processing device 200. The program may be installed in the imaging device 100 in advance, or may be distributed by download or on a storage medium, and installed in the imaging device 100 by the photographer himself.

[0033] [1-3. Control by Information Processing Device 200] [1-3-1. Example of generating a trigger once] Next, a description will be given of processing by the information processing device 200. First, an outline of processing realized by the present technology will be described. In this embodiment, a person is the subject, and a description will be given of an example in which the person is photographed running a sprint in a track and field event.

[0034] As shown in Figure 3, for ease of explanation, the period during which the subject is sprinting is divided into time periods 0 to 6. In a sprint, the subject, who is a runner, first assumes a starting position with his or her hands on the ground at the starting position as shown at time 1. Then, as shown at time 2, the subject starts running and gradually stands up as shown at time 3. Then, as shown at time 4, the subject continues running in an upright position, reaches the finish line as shown at time 5, and the sprint ends at time 6. This period from time 0 to time 6 is the shooting period.

[0035] In the example of Fig. 3, the setting of the imaging device 100 is set to setting A from time 0 to time 3, and the state of the subject (photographing target state) at time 4 is photographed using setting B. To achieve this, the information processing device 200 changes the imaging device 100 to setting B before the subject enters the photographing target state at time 4. In this way, Fig. 3 shows an example in which a trigger is generated once within a photographing period to change the setting of the imaging device 100 once.

[0036] In order to capture the state of the subject at time 4 using setting B, it is necessary to change image capture device 100 from setting A to setting B before the subject enters the state of the subject at time 4. This is because if image capture device 100 were to be changed from setting A to setting B at the timing when the subject enters the state of the subject at time 4, it would be too late to capture the image, or even if it were possible to do so, it would be difficult to capture the image.

[0037] Therefore, state determination unit 201 determines whether the state of the subject has become a state (pre-state) before the subject became the shooting target state at time 4, and if the current state of the subject becomes the pre-state, trigger processing unit 202 generates a trigger that triggers a setting change. Then, after the adjustment time has elapsed since the trigger was generated and before the subject becomes the shooting target state at time 4, setting change processing unit 203 changes imaging device 100 from setting A to setting B. This allows the photographer to capture the shooting target state of the subject with setting B. For this reason, it is necessary to identify in advance which state of the subject is the pre-state.

[0038] The pre-state is the state of the subject before it reaches the capture target state, which is the state to be captured using the imaging device 100. The pre-state can be identified using specific images of the subject captured in the past. In the case of a sprint, for example, images of a pre-running practice or a sprint run by another runner other than the subject can be captured to obtain images to serve as the pre-state. Alternatively, the information processing device 200 may store multiple images or information representing pre-states as templates in advance, and the photographer may specify the type of subject or the type of scene to identify the pre-state from among those templates. Furthermore, if the pre-state is a numerical value such as the subject's moving speed, the photographer can identify the pre-state by inputting a specific numerical value.

[0039] The adjustment time is the time from when a trigger occurs until the processing to change the settings of the image capture device 100 is performed, and is set in advance. The adjustment time can be said to be the time for adjusting the length of time from when the settings of the image capture device 100 are changed until the shooting timing (when the subject becomes a state to be photographed). The adjustment time can be set to any length by the photographer, from 0 seconds onwards.

[0040] In this embodiment, a mode in which the information processing device 200 automatically changes the settings of the imaging device 100 to capture an image of a subject state is called an assist mode. In the example of Fig. 3, imaging is performed with setting A from time 0 until time 4, but this can be achieved by changing the setting of the imaging device 100 from setting X to setting A when the assist mode is turned on.

[0041] The processing by the information processing device 200 will be described with reference to the flowchart in Fig. 4. First, in step S101, the assist mode in which the information processing device 200 operates in response to input from the photographer is turned on. At the same time as turning on this assist mode, the imaging device 100 changes the setting to setting A.

[0042] Next, in step S102, the state determination unit 201 starts determining the state of the subject. The state determination unit 201 continues to perform the state determination while the assist mode is on.

[0043] 5 and 6, the state determination by state determination unit 201 will be described. In this description, the movement of the subject is considered to be the state of the subject. Setting change processing unit 203 needs to change the setting of imaging device 100 to setting B before the subject enters the shooting target state at time 4. To do this, it is necessary to define the state of the subject before entering the shooting target state at time 4 (the state at time 3 in this embodiment) as the previous state, and to determine whether the subject has entered the previous state.

[0044] Therefore, the state determination unit 201 recognizes the current state of the subject, which is the image capture target, from the image generated by the imaging device 100 and compares the current state of the subject with the prior state. Then, if a determination value indicating the degree of agreement between the current state of the subject and the prior state exceeds a threshold, it determines that the current state of the subject has become the prior state. Then, if it determines that the current state of the subject has become the prior state, the state determination unit 201 supplies the determination result to the trigger processing unit 202.

[0045] When the subject's movement is the subject's state, the comparison of the subject's current movement with the movement in the previous state can be made based on the subject's posture, movement speed, movement acceleration, movement trajectory, sound, vibration, etc.

[0046] When determining the state of a movement based on the posture of the subject, the determination value in the state determination indicates the degree of agreement between the current posture of the subject and the posture in the previous state. If the determination value exceeds a threshold, the current movement of the subject is determined to be the movement of the previous state, and the state determination unit 201 supplies the determination result to the trigger processing unit 202. The degree of agreement between the current posture of the subject and the posture in the previous state can be obtained, for example, by a known image comparison method using machine learning, deep learning, or the like, between an image capturing the current posture of the subject and an image showing the posture in the previous state.

[0047] Furthermore, when determining the state of a movement based on the speed of the subject, the determination value in the state determination indicates the degree of agreement between the current speed of the subject and the speed in the previous state. If the determination value exceeds a threshold, the current movement of the subject is determined to be the movement of the previous state, and the state determination unit 201 supplies the determination result to the trigger processing unit 202. The degree of agreement between the current speed of the subject and the speed in the previous state can be obtained, for example, by calculating the movement speed based on the shooting frame rate and the movement distance of the subject between multiple frames and comparing them.

[0048] Furthermore, when determining the state of a movement based on the trajectory of the movement of the subject, the determination value in the state determination indicates the degree of match between the trajectory of the current movement of the subject and the trajectory of the movement in the previous state. If the determination value exceeds a threshold, the state determination unit 201 determines that the trajectory of the current movement of the subject matches the trajectory of the movement in the previous state, and supplies the determination result to the trigger processing unit 202. The degree of match of the movement trajectories can be obtained, for example, by comparing or tracing line segments that indicate the trajectories of the movement of specific parts of the subject's body.

[0049] Furthermore, when determining the state of an action based on the sound emitted by the subject, the determination value in the state determination indicates the degree of agreement between the current sound of the subject and the sound in the previous state. The degree of agreement of the sound can be determined, for example, by comparing the frequency, the loudness (dB) of the sound, or the sound waveform. The sound during shooting can be acquired by microphone 195.

[0050] Furthermore, when determining the state of motion based on the vibrations emitted by the subject, the determination value indicates the degree of agreement between the current vibrations of the subject and the vibrations in the previous state. The degree of agreement can be determined by, for example, comparing the frequency, amplitude, and period of the vibrations.

[0051] The state may be determined by comparing the subject's movement with the previous state using a combination of the above-mentioned posture, speed, acceleration, trajectory, sound, and vibration.

[0052] The threshold value can be set arbitrarily. For example, the photographer may set the threshold value by inputting a specific value, or the photographer may input criteria such as high, middle, and low, and the information processing device 200 may automatically set the threshold value according to the input criteria. Alternatively, the information processing device 200 may set the threshold value based on an algorithm or the like. Furthermore, the threshold value may be set by inputting an image or video that corresponds to the threshold value, in addition to inputting a value or criteria.

[0053] 5, the subject takes the starting position for a sprint, starts running, and stands up, and as the subject's movement gradually approaches the movement of the pre-state at time 3, the judgment value increases. When the judgment value exceeds the threshold, it is determined that the subject's movement has become the movement of the pre-state at time 3, and the state judgment unit 201 supplies the judgment result to the trigger processing unit 202.

[0054] Note that the pre-state is not limited to the state immediately before the state to be photographed. As shown in FIG. 6, when time 4 is the state to be photographed, the state of time 1, which is before time 3, can also be the pre-state. By setting the state of time 1, which is before time 3, as the pre-state, the time from trigger occurrence to the state to be photographed becomes longer, so that, for example, a notice that "settings will be changed" can be given to the photographer during that time, and the photographer can calmly photograph knowing that the settings will be changed. Note that any state prior to the state to be photographed can be set as the pre-state, so the state of time 2 can also be set as the pre-state.

[0055] Note that "the state of the subject has become the pre-state" does not necessarily mean a perfect match, but may also mean a similar state including a deviation. The degree of deviation to be tolerated in the state determination can be adjusted by setting a threshold. If the threshold is set high, the current state of the subject is determined to have become the pre-state with less deviation than when the threshold is low. On the other hand, if the threshold is set low, the current state of the subject is determined to have become the pre-state with more deviation than when the threshold is high.

[0056] Returning to the description of the flowchart, if it is determined in step S103 that a certain period of time has not elapsed since the assist mode was turned on, the process proceeds to step S104 (No in step S103).

[0057] Next, in step S104, if the state determination unit 201 determines that the determination value is equal to or greater than the threshold value, the process proceeds to step S105 (Yes in step S104). Then, in step S105, the trigger processing unit 202 generates a trigger.

[0058] Next, in step S106, if the adjustment time has elapsed since the trigger was generated, the process proceeds to step S107 (Yes in step S106). Then, in step S107, the setting change processing unit 203 changes the setting of the imaging device 100 from setting A to setting B.

[0059] The adjustment time can be set to any length greater than or equal to 0 seconds. Generally, it is desirable to adjust the adjustment time according to the photographer's photography technique.

[0060] For example, a professional photographer with advanced photography skills can shorten the margin time, which is the time from when the settings of imaging device 100 are changed until the subject enters the subject state, by lengthening the adjustment time as shown in Fig. 7. This means that the settings are not changed until just before the subject enters the subject state, and photography can be carried out with setting A until just before the subject enters the subject state. Note that because the professional photographer has advanced photography skills, it is thought that photography can be carried out even if the settings of imaging device 100 are changed just before the subject enters the subject state.

[0061] On the other hand, for amateur photographers with low photography skills, shortening the adjustment time as shown in Fig. 7 can increase the time from when the settings of the imaging device 100 are changed until the subject is ready to be photographed. In other words, the settings of the imaging device 100 are changed earlier than when the adjustment time is long. This increases the time from when the settings of the imaging device 100 are changed until the subject is ready to be photographed, allowing the photographer to take photographs calmly and with more time to spare.

[0062] Furthermore, the length of the adjustment time may be determined depending on the type of setting before the change and the type of setting after the change. For example, assume that setting B is a mode that consumes more power than setting A because it continuously drives the image sensor 121, lens 111, etc. for autofocus. In this case, it is possible to reduce power consumption by lengthening the adjustment time and lengthening the time that the imaging device 100 is in the state of setting A (shortening the time that it is in setting B).

[0063] The adjustment time can also be set to 0 seconds. When the adjustment time is set to 0 seconds, the setting change processing unit 203 changes the setting of the imaging device 100 to setting B at the same time that the trigger processing unit 202 generates a trigger.

[0064] In this way, it is preferable to set the length of the adjustment time in accordance with the photographer's photography technique, the performance of the imaging device, etc. Therefore, the photographer needs to confirm and decide in advance what the optimal length of the adjustment time should be. In the case of shooting a sprint, the length of the adjustment time is determined in advance based on prior practice, past sprints, etc., and set in the information processing device 200.

[0065] Alternatively, a table in which multiple standards such as large, medium, and small correspond to multiple lengths of adjustment time may be stored in advance in the information processing device 200, and the standards may be presented to the photographer to select one, and the length of adjustment time may be determined based on the selected standard. This is effective mainly for amateur photographers who do not have high photography skills.

[0066] Returning to the description of the flowchart, next, in step S108, if a certain period of time has elapsed since the setting of the image capturing device 100 was changed (Yes in step S108), the process proceeds to step S109.

[0067] Next, in step S109, the settings of the imaging device 100 are returned to setting X, which is the setting before the change in assist mode. Note that the process of returning to the setting before the change in assist mode in step S109 is not essential, and the setting may or may not be returned. Then, in step S110, the assist mode is turned off and the process ends.

[0068] If a certain time has passed in step S103, the process proceeds to step S108, where the assist mode is turned off and the process ends. This is because if a certain time has passed after the start of state determination but before the determination value reaches the threshold, the state desired by the photographer has not been achieved, and the assist mode is ended.

[0069] In the above explanation, the movement of the subject is defined as the state of the subject, but other conditions such as the posture of the subject, the speed of the subject, the position of a specific part of the body, etc. can also be processed as the state of the subject. Furthermore, a combination of these conditions can also be processed as the state of the subject.

[0070] For example, by setting the posture of the subject to the posture of the subject, it is possible to generate a trigger at the timing when the subject assumes the posture of the pre-state before assuming the posture of the photographing target state, thereby changing the settings of the imaging device 100. This allows the photographer to photograph the state in which the subject assumes the posture of the photographing target state with specific settings of the imaging device 100.

[0071] When the posture of the subject is set to the state of the subject, the judgment value in the state judgment indicates the degree of agreement between the current posture of the subject and the posture in the previous state. If the judgment value exceeds a threshold, the current posture of the subject is determined to be the posture of the previous state, and the state judgment unit 201 supplies the judgment result to the trigger processing unit 202. The degree of agreement between the current posture of the subject and the posture in the previous state can be obtained by a known image comparison method using machine learning, deep learning, or the like.

[0072] Furthermore, by setting the speed of the subject to the subject state, it is possible to generate a trigger at the timing when the subject reaches the speed of the pre-state before it reaches the speed of the subject state, thereby changing the settings of the image capturing device 100. This allows the photographer to capture the state in which the subject has reached the speed of the subject state with specific settings of the image capturing device 100. The same applies to the acceleration of the subject.

[0073] When the speed of the subject is set to the state of the subject, the determination value in the state determination indicates the degree of agreement between the current speed of the subject and the speed in the previous state. If the determination value exceeds a threshold, the current speed of the subject is determined to be the speed in the previous state, and the state determination unit 201 supplies the determination result to the trigger processing unit 202. The degree of agreement between the current speed of the subject and the speed in the previous state can be obtained, for example, by calculating the speeds based on the frame rate of the shooting and the distance traveled by the subject between multiple frames, and comparing them.

[0074] Furthermore, by setting the position of the subject to the subject state, it is possible to change the settings of the imaging device 100 at the timing when the subject reaches the position of the previous state before reaching the position of the imaging target state. This allows the photographer to capture the state in which the subject has reached the position of the imaging target state with the settings of the imaging device 100 specified.

[0075] When the position of the subject is set to the subject's state, the determination value in the state determination indicates, for example, the degree of coincidence between the current position of the subject within the angle of view and the position in the previous state. If the determination value exceeds a threshold, the current position of the subject is deemed to have reached the position in the previous state, and the state determination unit 201 supplies the determination result to the trigger processing unit 202. The degree of coincidence between the current position of the subject and the position in the previous state can be obtained, for example, by comparing the current coordinates of the subject within the angle of view with the coordinates in the previous state.

[0076] Furthermore, by setting the position of a specific part of the subject's body to the subject's state, it is possible to change the settings of the imaging device 100 at the timing when the subject's body part reaches the position of the previous state before reaching the position of the imaging target state. This allows the photographer to capture the state in which the subject's body part has reached the position of the imaging target state with the specific settings of the imaging device 100.

[0077] For example, when the position of a specific part, such as the height of the subject's head from the ground, is set as the state of the subject, the determination value in the state determination indicates the degree of agreement between the current head height and the head height in the previous state. If the determination value exceeds a threshold, the current head height of the subject is determined to be the head height in the previous state, and the state determination unit 201 supplies the determination result to the trigger processing unit 202. The degree of agreement between the subject's head height and the head height in the previous state can be obtained, for example, by comparing the coordinates of the current head position within the angle of view with the coordinates of the head position in the previous state.

[0078] [1-3-2. Example of multiple triggers] Next, a description will be given of an example in which a trigger is generated multiple times within a shooting period to change multiple times the settings of the imaging device 100. In the example of Fig. 3 described above, a trigger is generated once within a shooting period to change the settings of the imaging device 100 once, but it is also possible to generate a trigger multiple times within a shooting period to change the settings of the imaging device 100 multiple times.

[0079] As shown in Figure 8, when photographing a sprint race in track and field, the settings of imaging device 100 are changed so that the subject's actions immediately after the start at time 2 are photographed with setting B as imaging subject state B, the subject's actions as they get up and run at time 4 are photographed with setting C as imaging subject state C, and the subject's actions after crossing the finish line at time 6 are photographed with setting D as imaging subject state D.

[0080] The trigger processing unit 202 generates trigger B when the state of the subject becomes pre-state B, in order to change the imaging device 100 to setting B for capturing image capture state B at time 2. Thereafter, the trigger processing unit 202 generates trigger C when the state of the subject becomes pre-state C, in order to change the imaging device 100 to setting C for capturing image capture state C at time 4. Further thereafter, the trigger processing unit 202 generates trigger D when the state of the subject becomes pre-state D, in order to change the imaging device 100 to setting D for capturing image capture state D at time 6. In Figure 8, the trigger is generated three times and then the settings of the imaging device 100 are changed three times, but this number of times is merely an example, and the number of triggers generated and the number of setting changes may be any number of times as long as they are one or more.

[0081] In order to generate each of these triggers, the state determination unit 201 determines whether the current state of the subject has become each of the pre-states using a determination value for each pre-state and a threshold value for each pre-state, as shown in Fig. 9. In order to change the settings of the image capture device 100 multiple times within a shooting period, it is necessary to identify multiple pre-states, and it is also necessary to identify the order in which the multiple pre-states are changed. The determination method by the state determination unit 201 is the same as that for changing the settings once described above.

[0082] A judgment value indicating the degree of match between the subject's current state and prior state B is defined as judgment value B, and a threshold value for determining that the subject's current state has become prior state B is defined as threshold B. A judgment value indicating the degree of match between the subject's current state and prior state C is defined as judgment value C, and a threshold value for determining that the subject's current state has become prior state C is defined as threshold C. A judgment value indicating the degree of match between the subject's current state and prior state D is defined as judgment value D, and a threshold value for determining that the subject's current state has become prior state D is defined as threshold D. The method for identifying the prior state is the same as the method described in the example of generating the trigger once above.

[0083] 10 and 11, a process of changing the settings of the imaging device 100 multiple times by generating a trigger multiple times by the information processing device 200 will be described.

[0084] First, in step S201, the assist mode in which the information processing device 200 operates in response to input from the photographer is turned on. At the same time as turning on this assist mode, the imaging device 100 changes the setting to setting A. Next, in step S202, the state determination unit 201 starts determining the state of the subject.

[0085] Next, in step S203, it is confirmed whether the most recent prior state is prior state B. If the most recent prior state is prior state B, the process proceeds to step S204 (Yes in step S203).

[0086] Next, in step S204, if a certain period of time has not elapsed since the assist mode was turned on, the process proceeds to step S205 (No in step S204).

[0087] If a certain period of time has elapsed in step S204, trigger B is not generated, and the setting of the imaging device 100 is changed to setting X, which is the previous setting, in step S210, and the assist mode is turned off in step S211, and the processing ends.

[0088] Next, in step S205, if the state determination unit 201 determines that the determination value is equal to or greater than threshold B, the process proceeds to step S206 (Yes in step S205).

[0089] Next, in step S207, if the adjustment time has elapsed after the occurrence of trigger B, the process proceeds to step S208 (Yes in step S207). Then, in step S208, the setting change processing unit 203 changes the setting of the imaging device 100 to setting B.

[0090] Next, in step S209, if all the setting changes have not been made yet, the process proceeds to step S203 (No in step S209).

[0091] Since the state of the subject has become pre-state B, trigger B has been generated and imaging device 100 has changed to setting B, the next pre-state is pre-state C. Therefore, the process proceeds from step S203 to step S213 (No in step S203).

[0092] Next, in step S213, it is confirmed whether the most recent prior state is prior state C. If the most recent prior state is prior state C, the process proceeds to step S214 (Yes in step S213).

[0093] Next, in step S214, if the certain time has not elapsed since the assist mode was turned on, the process proceeds to step S215 (No in step S214).

[0094] If a certain period of time has elapsed in step S214, trigger C is not generated, and in step S219 the setting of the imaging device 100 is changed to setting X, which is the previous setting, and in step S220 the assist mode is turned off, and the process ends.

[0095] Next, in step S215, if the state determination unit 201 determines that the determination value is equal to or greater than the threshold C, the process proceeds to step S216 (Yes in step S215).

[0096] Next, in step S217, if the adjustment time has elapsed since the occurrence of trigger B, the process proceeds to step S218 (Yes in step S207).

[0097] Next, in step S209, if all the setting changes have not been made yet, the process proceeds to step S203 (No in step S209).

[0098] Since trigger C has been generated and the setting of the imaging device 100 has been changed to setting C, the next trigger is trigger D. Therefore, the process proceeds from step S203 to step S213 (No in step S203), and from step S213 to step S221 (No in step S213).

[0099] Next, in step S221, if a certain period of time has not elapsed since the assist mode was turned on, the process proceeds to step S222 (No in step S221).

[0100] If a certain period of time has elapsed in step S221, trigger D is not generated, and in step S226 the setting of the imaging device 100 is changed to setting X, which is the previous setting, and in step S227 the assist mode is turned off, and the process ends.

[0101] Next, in step S222, if the state determination unit 201 determines that the determination value is equal to or greater than the threshold value D, the process proceeds to step S223 (Yes in step S222).

[0102] Next, in step S224, if the adjustment time has elapsed since the occurrence of trigger D, the process proceeds to step S225 (Yes in step S224).

[0103] Next, in step S209, if all the settings have been changed, the process proceeds to step S228 (Yes in step S209).

[0104] Thereafter, if it is determined in step S228 that a certain period of time has elapsed since the last setting change, the process proceeds to step S229 (Yes in step S228).

[0105] Next, in step S229, the setting before the change in assist mode is returned to setting X. Then, in step S230, the assist mode is turned off and the process ends.

[0106] It should be noted that the processes of steps S210, S219, S226 and S229 for returning to the settings before the change in the assist mode are not essential processes, and the settings may or may not be returned.

[0107] 3 and 8, the setting of the imaging device 100 is set to setting A when the assist mode is turned on, and after a trigger is generated, the setting of the imaging device 100 is changed from setting A to setting B. However, it is not essential to change the setting of the imaging device 100 when the assist mode is turned on, and as shown in FIG. 12, setting X, which is the setting before the assist mode was turned on, may be maintained as is, and after a trigger is generated, setting X may be changed to setting B.

[0108] In either case where a trigger is generated once or multiple times during the above-described shooting period, the release, which is an instruction to shoot, may be performed based on an input by the photographer to the input unit 192 of the imaging device 100, or may be performed automatically. For example, the release may be performed automatically based on the subject recognition result, or may be performed automatically when a predetermined time has elapsed after the trigger is generated or after a setting of the imaging device 100 is changed. Furthermore, the release may be remotely input from an external device rather than from the imaging device 100 itself. When shooting automatically, an automatic shooting function may be used if the imaging device 100 has one, or the information processing device 200 may perform automatic shooting processing in which a control signal instructing the imaging device 100 to shoot is transmitted from the information processing device 200 to the imaging device 100.

[0109] [1-3-3. User Interface] Next, a description will be given of a user interface for notifications by the notification processing unit 204. Notification contents include the type of setting of the imaging device 100, the current setting status of the imaging device 100, and a notice that the setting of the imaging device 100 will be changed.

[0110] One notification method is to superimpose a frame 301 on a through image displayed on the display unit 181 of the imaging device 100, as shown in Fig. 13. If the settings of the imaging device 100 are changed multiple times within a shooting period, it is advisable to use different colors for the frame 301 for each type of setting, as shown in Fig. 13A to 13D. In Fig. 13, by using different frame colors, Fig. 13A indicates setting A, Fig. 13A indicates setting B, Fig. 13A indicates setting C, and Fig. 13D indicates setting D.

[0111] Furthermore, by keeping the frame 301 lit, it is notified that the imaging device 100 is currently operating with the settings represented by the above-mentioned colors. This notification should be made from the time the settings of the imaging device 100 are changed, and should continue while the imaging device 100 is operating with the changed settings. Furthermore, by flashing the frame 301, advance notice is given that the settings of the imaging device 100 will be changed. This advance notice may be made at any timing between the occurrence of a trigger and the setting change process of the imaging device 100.

[0112] 14, there is also a notification method in which an icon 302 is superimposed on a through image displayed on the display unit 181 of the imaging device 100. In this case, the type of setting is notified using characters or symbols included in the icon 302, and by keeping the icon 302 lit, it is notified that the imaging device 100 is currently operating with the settings represented by the characters or symbols of the icon 302, and by flashing the icon 302, it is notified that a change in the settings of the imaging device 100 will be made.

[0113] The notification may be not only a display on the display unit 181, but also an audio notification using audio output from the speaker 194 of the imaging device 100. If the imaging device 100 has a vibration function, the notification may be a notification using vibration. Furthermore, if the imaging device 100 has a light-emitting body such as an LED, the notification may be a notification using light emitted from the LED. When changing the settings multiple times, it is preferable to use different types of audio, vibration, and light emission for each setting.

[0114] The photographer may also be notified of the timing to change the settings of the imaging device 100. After confirming this notification, the photographer changes the settings of the imaging device 100 by inputting an instruction to change the settings to the imaging device 100. This notification may be the same as or different from the advance notice that the settings of the imaging device 100 will be changed as described above.

[0115] 15, in a display on a device other than the imaging device 100, such as a personal computer or tablet terminal, which has a large display unit 400, the icon 302 may be displayed without being superimposed on the live view display 401 or the operation panel display 402. This prevents the icon 302 from obscuring part of the display.

[0116] 16 and 17 are examples of a user interface for specifying a pre-condition, which is displayed on the display unit 181. As shown in Fig. 16A, the user interface for specifying a pre-condition has a hierarchical structure made up of the type of subject to be photographed and the type of object.

[0117] For example, in the example of Figure 16, when a sport is selected as the subject of filming, pre-prepared candidate sport types such as soccer, baseball, and volleyball are presented. Therefore, if soccer is selected, pre-prepared soccer scene types such as shooting, passing, throwing, and catching / punching are presented. Therefore, if a shot is selected, pre-prepared scenes related to the shot such as take-back, impact, and follow-through are presented. Since a take-back is usually present before the impact of a soccer shot, when the state to be filmed is impact, the photographer selects take-back as the pre-state. This identifies the take-back motion as the pre-state.

[0118] Furthermore, the setting parameters of the imaging device 100 (shutter speed, ISO, F-number, focus position, white balance, etc. in FIG. 16A) to be changed when it is determined that the state of the subject has reached the pre-state are set based on input from the photographer, a predetermined template, algorithm, etc.

[0119] For professional photographers with advanced photography skills, for example, when the subject of photography is sports, the type of sport, the scene, and the settings of the imaging device 100 may be combined in advance as shown in Figure 16B, and this may be presented in a user interface for specifying a pre-condition, allowing the photographer to specify any pre-condition.

[0120] Furthermore, for amateur photographers who do not have high photography skills, for example, when the subject of photography is a sport, only the types of sports may be presented in the user interface as shown in FIG. 17A, and when the photographer selects one of them, the imaging device 100 and the information processing device 200 may recognize the characteristic state of the subject in that sport and identify the pre-condition.

[0121] Furthermore, for amateur photographers who do not have high photography skills, as shown in Figure 17B, only the types of subjects to be photographed may be presented in the user interface, and when the photographer selects one of them, the imaging device 100 and the information processing device 200 may recognize the state of the characteristic subject in the subject to be photographed and identify the pre-condition.

[0122] The processing of the present technology is performed as described above. According to the present technology, the imaging device can automatically change settings suitable for imaging before the subject becomes a state to be photographed, so that imaging can be performed with optimal settings regardless of the photographer's abilities such as dynamic visual acuity, athletic ability, and photography technique.

[0123] Since it is possible to suppress variations in the time required to change the settings of the imaging device 100 due to differences in the abilities of individual photographers, it is possible to provide the photographer with the effect of being able to take pictures with appropriate settings without missing a photo opportunity.

[0124] Furthermore, the settings of the imaging device 100 that can be changed are not limited to specific ones, so that the settings of the imaging device 100 can be changed widely to suit various shooting conditions such as the type of subject.

[0125] <2. Modifications> Although the embodiments of the present technology have been specifically described above, the present technology is not limited to the above-described embodiments, and various modifications based on the technical concept of the present technology are possible.

[0126] The information processing device 200 is not limited to the imaging device 100, but can be used in any device that has a camera function, such as a smartphone, a personal computer, a tablet terminal, a portable game console, or a wearable device.

[0127] The information processing device 200 may also operate on a server or in a cloud. In this case, the information processing device 200 determines the state of the image capture device 100 using a captured image received from the image capture device 100 via a network, and performs a setting change process by transmitting control information instructing a setting change to the image capture device 100 via the network.

[0128] The state determination unit 201 may perform state determination based on the state of the subject in a partial area within the angle of view of the imaging device 100. For example, if the subject changes its movement but remains positioned on the right side of the angle of view, the angle of view may be divided into left and right areas from the center, and state determination may be performed using only the captured image of the right area. This can reduce the processing load compared to performing state determination using captured images for the entire angle of view.

[0129] In the embodiment, the setting change processing unit 203 performs processing to change the settings of the imaging device 100 after a trigger occurs, but regardless of whether a trigger occurs or not, if the photographer inputs an instruction to change the settings, the setting change processing unit 203 may prioritize the instruction input from the photographer and change the settings of the imaging device 100.

[0130] Methods for inputting instructions from the photographer include input operations to the input unit 192 provided in the imaging device 100, such as a button, and voice input. If the settings are changed multiple times within the shooting period, it is advisable to assign each of the multiple settings to a different button on the imaging device 100. In addition, in the case of voice input, it is advisable to assign each of the multiple settings to a different voice. For example, setting A can be assigned to a voice that sounds "Ah," and setting B can be assigned to a voice that sounds "Bee."

[0131] Furthermore, the information processing device 200 may change the settings of the imaging device 100 according to the acceleration of the movement of the imaging device 100. For example, if the acceleration of the movement of the imaging device 100 is equal to or greater than a predetermined value, the settings of the imaging device 100 may be changed, or the assist mode may be turned off. Furthermore, when changing to multiple settings within a shooting period, it is preferable to assign different accelerations to the multiple settings. For example, if the acceleration of the imaging device 100 is equal to or greater than a predetermined acceleration A, the setting may be changed to setting A; if the acceleration of the imaging device 100 is equal to or less than a predetermined acceleration C, the setting may be changed to setting C; if the acceleration of the imaging device 100 is less than the predetermined acceleration A and exceeds acceleration C, the setting may be changed to setting B. In order to perform the setting change process according to the acceleration of the movement of the imaging device 100, the imaging device 100 needs to be equipped with an acceleration sensor and supply sensor information detected by the acceleration sensor to the information processing device 200.

[0132] Furthermore, the information processing device 200 may change the settings of the imaging device 100 in response to framing or a gesture. Examples of framing include changing the settings of the imaging device 100 or turning off the assist mode when it is detected that the lens of the imaging device 100 is facing the ground (downward). Whether the lens of the imaging device 100 is facing the ground can be detected by subject recognition in an image or by an attitude detection method using a gyro sensor or an acceleration sensor. In order to perform setting change processing in response to framing, the imaging device 100 needs to be equipped with a gyro sensor or an acceleration sensor and supply sensor information to the information processing device 200.

[0133] Examples of gestures include changing the settings of the imaging device 100 or turning off the assist mode when a predetermined gesture such as the photographer holding his / her hand in front of the lens is detected. The photographer's gesture can be detected by subject recognition in an image, or by providing the imaging device 100 with an infrared sensor or the like that detects contactless hand movements. In order to perform setting change processing in response to a gesture, the imaging device 100 needs to be equipped with a gyro sensor or acceleration sensor and supply sensor information to the information processing device 200.

[0134] The present technology can also be configured as follows. (1) a state determination unit that determines whether the state of the subject has reached a predetermined pre-state; a trigger processing unit that generates a trigger for changing settings of the imaging device when the state determination unit determines that the state of the subject has reached the pre-state; An information processing device comprising: (2) The information processing device according to (1), wherein the pre-state is a state of the subject before the subject becomes a state to be photographed using the imaging device. (3) A process for changing the settings of the imaging device is performed after a predetermined time has elapsed since the trigger was generated. The information processing device according to (2) includes a setting change processing unit. (4) The information processing device according to (3), wherein the predetermined time is an adjustment time for adjusting a length of time until the imaging device reaches the imaging subject state after completing a setting change process of the imaging device. (5) The information processing device according to (4), wherein the adjustment time is set by a user. (6) The information processing device according to (4) or (5), wherein the adjustment time can be set to any length equal to or greater than 0 seconds. (7) The information processing device according to any one of (1) to (6), wherein the state determination unit determines that the current state of the subject has become the pre-state when a determination value indicating the degree of coincidence between the current state of the subject in the image generated by the imaging device and the pre-state exceeds a threshold value. (8) The information processing device according to any one of (1) to (7), wherein the state of the subject is one of or a combination of the movement, posture, position, and speed of the subject. (9) The information processing device according to any one of (1) to (8), wherein the trigger processing unit generates a plurality of the triggers in accordance with a plurality of states of the subject. (10) The information processing device according to any one of (1) to (9), further comprising a notification processing unit that processes a notification to a photographer after the trigger occurs. (11) The information processing device according to (10), wherein the notification processing unit performs a process of notifying the photographer to change settings of the imaging device after the trigger occurs. (12) The information processing device according to (10) or (11), wherein the notification processing unit performs processing to notify the photographer of the current settings of the imaging device. (13) The information processing device according to any one of (10) to (12), wherein the notification processing unit performs a notification process to notify the photographer that it is time to change the settings of the imaging device after the trigger occurs. (14) The information processing device according to (3), wherein automatic photographing processing of the imaging device is performed after the setting change processing unit changes the setting of the imaging device. (15) The information processing device according to (3), wherein the setting change processing unit performs processing to change the setting of the imaging device in response to an input from a photographer, regardless of whether the trigger occurs or not. (16) determining whether the state of the subject has reached a predetermined pre-state; An information processing method for generating a trigger for changing settings of an imaging device when it is determined that the state of the subject has reached the pre-state. (17) determining whether the state of the subject has reached a predetermined pre-state; an information processing program that causes a computer to execute an information processing method for generating a trigger for changing settings of an imaging device when it is determined that the state of the subject has reached the pre-state; [Explanation of symbols]

[0135] 200 Information processing device 201 Status determination unit 202 Trigger processing unit 203 Setting change processing unit 204 Notification processing unit

Claims

1. a state determination unit that determines whether the state of the subject has reached a predetermined pre-state; a trigger processing unit that generates a trigger for changing a setting of the imaging device when the state determination unit determines that the state of the subject has reached the pre-state; a setting change processing unit that performs processing to change the setting of the imaging device after a predetermined time has elapsed since the occurrence of the trigger; Equipped with the pre-state is a state of the subject before the subject becomes a capture target state, which is a state that is a target of capture using the imaging device, The predetermined time is an adjustment time for adjusting the length of time until the image capture state is reached after the setting change process of the image capture device is completed. Information processing device.

2. The adjustment time is user configurable The information processing device according to claim 1 .

3. The adjustment time can be set to any length greater than or equal to 0 seconds. The information processing device according to claim 1 .

4. The state determination unit determines that the current state of the subject has become the prior state when a determination value indicating a degree of coincidence between the current state of the subject in the image generated by the imaging device and the prior state exceeds a threshold. The information processing device according to claim 1 .

5. The state of the subject is one of or a combination of the motion, posture, position, and speed of the subject. The information processing device according to claim 1 .

6. The trigger processing unit generates a plurality of triggers in accordance with a plurality of states of the subject. The information processing device according to claim 1 .

7. a notification processing unit that processes a notification to the photographer after the trigger is generated; The information processing device according to claim 1 .

8. The notification processing unit performs a process of notifying the photographer to change settings of the imaging device after the trigger occurs. The information processing device according to claim 7 .

9. The notification processing unit performs processing for notifying the photographer of the current settings of the imaging device. The information processing device according to claim 7 .

10. The notification processing unit performs a process of notifying the photographer that it is time to change the settings of the imaging device after the trigger occurs. The information processing device according to claim 7 .

11. After the setting change processing unit changes the setting of the imaging device, the imaging device performs automatic photography processing. The information processing device according to claim 1 .

12. The setting change processing unit performs processing to change the settings of the imaging device in response to an input from a photographer, regardless of whether the trigger has occurred. The information processing device according to claim 1 .

13. determining whether the state of the subject has reached a predetermined pre-state; When it is determined that the state of the subject has reached the pre-state, a trigger for changing the settings of the imaging device is generated; performing a process of changing the settings of the imaging device after a predetermined time has elapsed since the trigger was generated; the pre-state is a state of the subject before the subject becomes a capture target state, which is a state that is a target of capture using the imaging device, The predetermined time is an adjustment time for adjusting the length of time until the image capture state is reached after the setting change process of the image capture device is completed. Information processing methods.

14. determining whether the state of the subject has reached a predetermined pre-state; When it is determined that the state of the subject has reached the pre-state, a trigger for changing the settings of the imaging device is generated; performing a process of changing the settings of the imaging device after a predetermined time has elapsed since the trigger was generated; the pre-state is a state of the subject before the subject becomes a capture target state, which is a state that is a target of capture using the imaging device, The predetermined time is an adjustment time for adjusting the length of time until the image capture state is reached after the setting change process of the image capture device is completed. An information processing program that causes a computer to execute an information processing method.

Images