Imaging device, information processing device, information processing method, and program

Abstract

[Problem] To provide: an imaging device capable of more easily controlling a frame rate of an image; an information processing device; an information processing method; and a program. [Solution] To solve the problem, the imaging device according to an embodiment of the present technology comprises a recognition unit and a determination unit. The recognition unit recognizes a particular subject in an image. The determination unit determines whether the distance between the recognized particular subject and a frame rate region for setting a frame rate of the image is equal to or less than a threshold. Accordingly, it is possible to easily control the frame rate of the image when capturing, reproducing, and editing the image by an intuitive input compared to conventional technology.

Description

[Technical Field]

[0001] The present technology relates to an imaging device, an information processing device, an information processing method, and a program that can be applied to video editing and the like. [Background technology]

[0002] In the image playback device described in Patent Document 1, the playback speed of a moving image is controlled according to the distance between multiple specific objects in the moving image or the distance between a fixed position and an object of interest, thereby contributing to optimizing the playback speed for important scenes (see, for example, paragraphs

[0039] and

[0051] , Figure 3 of Patent Document 1). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2011-10276 A Summary of the Invention [Problem to be solved by the invention]

[0004] As in Patent Document 1, a technique of changing the frame rate of a moving image is sometimes used to emphasize a particular scene in a moving image. As such, there is a demand for a technology that makes it possible to easily control the frame rate of an image.

[0005] In view of the above circumstances, an object of the present technology is to provide an imaging device, an information processing device, an information processing method, and a program that are capable of more easily controlling the frame rate of an image. [Means for solving the problem]

[0006] In order to achieve the above object, an imaging device according to an embodiment of the present technology includes a recognition unit and a determination unit. The recognition unit recognizes a specific subject in an image. The determination unit determines whether or not a distance between the recognized specific subject and a frame rate area for setting a frame rate of an image is equal to or less than a threshold.

[0007] In this imaging device, a specific subject in an image is recognized, and it is determined whether the distance between the recognized specific subject and a frame rate region for setting the frame rate of the image is equal to or less than a threshold value, thereby making it possible to easily control the frame rate of the image.

[0008] The imaging device may further include a frame rate region setting unit that sets the frame rate region.

[0009] The imaging device may further include a frame rate setting unit that sets a frame rate of the image.

[0010] The imaging device may further include a shooting control unit that controls the image to be captured at the set frame rate when the determination unit determines that the distance between the specific subject and the set frame rate area is equal to or less than a threshold value.

[0011] The imaging device may further include a playback control unit that controls the image to be played back at the set frame rate when the determination unit determines that the distance between the specific subject and the set frame rate area is equal to or less than a threshold value.

[0012] The frame rate region setting unit may set the frame rate region as a point.

[0013] The frame rate region setting unit may set the frame rate region as a line.

[0014] The frame rate region setting unit may set the frame rate region as a region having a predetermined range.

[0015] The frame rate region setting unit may set a plurality of the frame rate regions. In this case, the shooting control unit may perform control to shoot the image at the set frame rate when the determination unit determines that the distance between the specific subject and each of the set frame rate regions is equal to or less than a threshold.

[0016] The frame rate region setting unit may set a plurality of the frame rate regions. In this case, the playback control unit may control playback of the image at the set frame rate when the determination unit determines that the distance between the specific subject and each of the set frame rate regions is equal to or less than a threshold.

[0017] The frame rate region setting unit may set the frame rate region as a region having a predetermined range. In this case, the shooting control unit may control the image to be shot at the set frame rate when the determination unit determines that the specific subject is within the set frame rate region.

[0018] The frame rate region setting unit may set the frame rate region as a region having a predetermined range. In this case, the playback control unit may control playback of the image at the set frame rate when the determination unit determines that the specific subject is within the set frame rate region.

[0019] The imaging device may further include an operation unit that accepts a user's operation. In this case, the frame rate region setting unit may set the frame rate region in response to a user's operation on the operation unit.

[0020] The imaging device may further include an operation unit that accepts user operations. In this case, the frame rate setting unit may set the frame rate of the image in response to the user's operation on the operation unit.

[0021] The frame rate setting section may set the frame rate so that the frame rate changes stepwise depending on the distance between the specific subject and the frame rate region.

[0022] The frame rate setting section may set the frame rate so that the frame rate changes continuously depending on the distance between the specific subject and the frame rate region.

[0023] An information processing device according to an embodiment of the present technology includes a recognition unit and a determination unit. The recognition unit recognizes a specific subject in an image. The determination unit determines whether or not a distance between the recognized specific subject and a frame rate area for setting a frame rate of an image is equal to or less than a threshold.

[0024] An information processing method according to one embodiment of the present technology is an information processing method executed by a computer system, and includes recognizing a specific subject in an image. It is determined whether the distance between the recognized specific subject and a frame rate area for setting the frame rate of the image is equal to or less than a threshold value.

[0025] A program according to one embodiment of the present technology causes a computer system to execute the following steps. Recognizing specific objects in the image. A step of determining whether or not the distance between the recognized specific subject and a frame rate area for setting the frame rate of an image is equal to or less than a threshold. [Brief explanation of the drawings]

[0026] [Figure 1] FIG. 1 is a schematic diagram for explaining an overview of an imaging device. [Figure 2] FIG. 2 is a block diagram illustrating an example of the functional configuration of the imaging device. [Figure 3] 10 is a flowchart illustrating an example of frame rate control. [Figure 4] FIG. 10 is a schematic diagram showing an example of a GUI that allows a specific subject to be selected. [Figure 5] FIG. 10 is a schematic diagram showing an example of setting a frame rate region and an image frame rate. [Figure 6] FIG. 10 is a schematic diagram showing an example of setting a frame rate area and an image frame rate when a rehearsal image is being acquired. [Figure 7] FIG. 10 is a schematic diagram showing an example of a control GUI 50 for controlling the frame rate. [Figure 8] FIG. 10 is a schematic diagram showing an example of the shape of a frame rate region. [Figure 9] 10A and 10B are schematic diagrams showing other examples of the shape of the frame rate region. [Figure 10] FIG. 10 is a schematic diagram showing an example of a frame rate control GUI in a frame rate area. [Figure 11] FIG. 10 is a schematic diagram illustrating an example of frame rate control. [Figure 12] FIG. 10 is a schematic diagram illustrating an example of frame rate control. [Figure 13] FIG. 10 is a schematic diagram illustrating an example of frame rate control. [Figure 14] FIG. 10 is a schematic diagram illustrating an example of frame rate control. [Figure 15] FIG. 2 is a block diagram illustrating an example of a functional configuration of an information processing device. [Figure 16] FIG. 2 is a block diagram illustrating an example of a hardware configuration of an information processing device. DETAILED DESCRIPTION OF THE INVENTION

[0027] Hereinafter, embodiments of the present technology will be described with reference to the drawings.

[0028] [Imaging device] FIG. 1 is a schematic diagram for explaining an overview of an imaging device according to the present technology.

[0029] The imaging device 10 has an imaging element 13 (image sensor), an optical system 11, an aperture, etc. (not shown), and is capable of capturing images within an angle of view. In this embodiment, the imaging device 10 captures an image of a person 3 shooting a basketball 1 toward a goal 2. The configuration of the imaging device is not limited. For example, the imaging element 13 may be an image sensor such as a complementary metal-oxide semiconductor (CMOS) sensor or a charge coupled device (CCD) sensor.

[0030] Furthermore, the imaging device 10 recognizes a specific subject in an image, and determines whether the distance between the specific subject and a frame rate region for setting the frame rate of the image is equal to or less than a threshold. For example, when the distance between a basketball 1 as a specific subject and a frame rate region including a goal 2 becomes equal to or less than a threshold, the frame rate of the image is controlled. That is, the frame rate of the image is controlled according to the distance between the specific subject and the frame rate region. The frame rate region includes a point, a line, and a region having a predetermined range, and is a region that is set in advance at a specific position within an image. The specific subject is a subject that is recognized by the recognition unit 17, which will be described later, from among the subjects included in the image. The image includes a captured image and a reproduced image.

[0031] The imaging device 10 also sets a frame rate region for the image. For example, the frame rate region may be specified as a region with a certain range, or as a line or a point, in response to a user's input. Using FIG. 1 as an example, the path (trajectory) of the basketball 1 until it enters the goal 2 may be set as the frame rate region. Alternatively, for example, a rectangular region centered on the goal 2 may be set as the frame rate region. Note that the shape and area of ​​the frame rate region are not limited.

[0032] The image capturing apparatus 10 also controls the frame rate of the image. In this embodiment, the image capturing apparatus 10 controls the frame rate of the image during shooting and playback. For example, when it is determined that the distance between a specific subject and the set frame rate region is equal to or less than a threshold, the imaging device 10 controls the imaging device 10 to capture or play back images at the set frame rate.

[0033] FIG. 2 is a block diagram showing an example of the functional configuration of the imaging device 10. As shown in FIG. As shown in Figure 2, the imaging device 10 has an optical system 11, a drive unit 12, an imaging element 13, a signal processing unit 14, a control unit 15, a recording unit 16, a recognition unit 17, a display unit 18, an output unit 19, and an operation unit 20.

[0034] The optical system 11 is composed of lenses, an aperture mechanism, a shutter, etc. For example, various lenses such as an incident end lens, a zoom lens, a focus lens, a condenser lens, etc. may be used for the optical system 11. Furthermore, for example, an aperture mechanism that controls exposure by adjusting the opening amount of a lens or an iris (aperture) so that sensing is performed in a state where the signal charge is not saturated but is within the dynamic range, or a shutter unit such as a focal plane shutter may be used.

[0035] The driving unit 12 drives the lenses and the like included in the optical system 11 .

[0036] The image sensor 13 performs exposure control for light from a subject that is incident via the optical system 11. The image sensor 13 also includes a processing unit that performs, for example, CDS processing, AGS processing, and A / D conversion processing on electrical signals photoelectrically converted by the pixels. In this embodiment, a captured image signal as digital data is output to the signal processing unit 14 and the control unit 15.

[0037] The signal processing unit 14 is composed of, for example, a microprocessor or microcomputer specialized for digital signal processing, such as a DSP (Digital Signal Processor). The signal processing unit 14 performs various signal processing on the digital signal (captured image signal) sent from the image sensor 13. Specifically, the signal processing unit 14 performs processing such as correction between R, G, and B color channels, white balance correction, aberration correction, and shading correction. The signal processing unit 14 also performs various processing such as YC generation processing to generate (separate) a luminance (Y) signal and a chrominance (C) signal from the R, G, and B image data, brightness and color adjustment processing, knee correction, and gamma correction. The signal processing unit 14 outputs the image signal that has undergone various signal processing to the recognition unit and the control unit. Furthermore, the signal processing unit 14 performs conversion to a final output format by performing resolution conversion processing and codec processing to encode the signal for recording or communication. The image signal converted to the final output format is recorded in the recording unit 17. The image signal is then displayed as an image on the display unit 18. Furthermore, by being output from an external output terminal, it is displayed on a device such as a monitor provided outside the imaging device 1. The captured image signal in this embodiment is an image signal output from the signal processing unit 14, and by displaying it on the display unit 18 as a captured image, the user can check the image being captured in real time. Also, the reproduced image signal in this embodiment is an image signal output from the recording unit 16, and by displaying it on the display unit 18 as a reproduced image, the user can check the recorded image.

[0038] The control unit 15 is configured by a microcomputer (arithmetic processing device) equipped with a CPU (Central Processing Unit), and performs overall control of the imaging device 10. For example, it issues instructions for various signal processes in the signal processing unit 14 in response to user operations, performs imaging operations, recording operations, and playback operations of recorded image files. The control unit 15 switches between various shooting modes. Examples of the various shooting modes include a still image shooting mode, a video shooting mode, and a continuous shooting mode in which still images are continuously captured. The control unit 15 includes a user interface control unit 21 (UI control unit 21) that enables the user to operate these functions. The UI control unit 21 performs processing to detect operations on each control provided on the imaging device 10, display processing and operation detection processing on the display unit 18, etc. The control unit 15 also controls various lenses provided in the optical system 11. For example, it performs processing to specify an aperture value to ensure the amount of light required for AF control, and instructs the operation of the aperture mechanism according to the aperture value. The ROM, flash memory, etc. store programs and the like used by the control unit 15. The ROM, flash memory, etc. store an OS (Operating System) and content files such as image files for the CPU to control each unit, as well as application programs and firmware for various operations. The control unit 15 controls the entire imaging device 10 by executing these programs. The RAM is used as a work area for the control unit 15 by temporarily storing data, programs, etc. used when the CPU of the control unit 15 executes various data processing. The control unit 15 also includes a UI control unit 21, a frame rate region setting unit 22, a frame rate setting unit 23, a determination unit 24, a shooting control unit 25, and a playback control unit .

[0039] The frame rate region setting unit 22 sets a frame rate region. For example, the frame rate region setting unit 22 sets a frame rate region within an image in response to a user operation.

[0040] The frame rate setting unit 23 sets the frame rate of the image, for example, when a specific subject approaches a set frame rate range by the user.

[0041] The determination unit 24 determines whether the distance between the specific subject and the frame rate region is equal to or less than a threshold value. The threshold value determined by the determination unit 24 may be set in advance or may be set by the user.

[0042] When the determination unit 24 determines that the distance between the specific subject and the frame rate region set by the frame rate region setting unit 22 is equal to or less than the threshold, the shooting control unit 25 controls the image capture to be performed at the frame rate set by the frame rate setting unit 23. For example, when the distance between the specific subject and the frame rate region is equal to or less than the threshold, the image capture control unit 25 controls the image capture to be performed at the frame rate set for the image sensor 13.

[0043] When the judgment unit 24 determines that the distance between a specific subject and the frame rate region set by the frame rate region setting unit 22 is equal to or less than a threshold, the playback control unit 26 controls the playback of the image at the frame rate set by the frame rate setting unit 23. For example, when controlling the frame rate during image playback, the image signal from the recording unit 16 is supplied to the playback control unit 26, and the image signal is subjected to frame rate thinning and addition processing by the control unit 15, and the playback control unit 26 controls the display unit 18 to display or play back the image on the display unit 18 at the set frame rate. The frame rate during playback may be controlled in the same manner as during shooting, by performing thinning or addition processing on images that have been shot in advance at a high or low frame rate.

[0044] The shooting control unit 25 and the playback control unit 26 can also process the frame rate of the image. For example, the shooting control unit 25 and the playback control unit 26 perform frame rate thinning and addition processing. For example, when the shooting control unit 25 controls the frame rate when an image is shot, an image signal from the signal processing unit 14 is supplied to the shooting control unit 25, and the frame rate of the image is controlled. The method for controlling the frame rate is not limited, and for example, the imaging control unit 25 may control the image sensor 13 to capture images at a set frame rate. Alternatively, for example, the image sensor 13 may capture all images at a high or low frame rate, and thinning or addition processing may be performed on the captured images. Processing related to the frame rate will be described later.

[0045] Furthermore, the shooting control unit 25 and the playback control unit 26 set the frame rate so that the frame rate changes stepwise or continuously depending on the distance between a specific subject and the frame rate region. For example, the shooting control unit 25 and the playback control unit 26 may set the frame rate based on a table in which the number of frame rates according to the distance between a specific subject and the frame rate area is recorded. Of course, the present invention is not limited to this, and the frame rate may be set by various methods.

[0046] The recording unit 16 is, for example, a nonvolatile memory, and stores image files (content files) such as still image data and video data, attribute information for the image files, thumbnail images, and the like. Image files are stored in formats such as JPEG (Joint Photographic Experts Group), TIFF (Tagged Image File Format), and GIF (Graphics Interchange Format). The actual form of the recording unit 16 can be various. For example, the recording unit 16 may be configured as a flash memory built into the imaging device, or may be configured as a memory card (e.g., a portable flash memory) that can be attached to or detached from the imaging device and an access unit that accesses the memory card for storage and reading. The recording unit 16 may also be realized as an HDD (Hard Disk Drive) built into the imaging device.

[0047] The recognition unit 17 recognizes a specific subject in an image from a captured image signal or a reproduced image signal. The recognition unit 17 may recognize a subject specified by a user's operation or the like as a specific subject, or may automatically recognize a specific subject such as a ball by machine learning as well as by a user's operation. For example, the recognition unit 17 recognizes a person in an image, or a human body part such as a person's arms, torso, or legs, or a ball, etc. The recognition method is not limited. Analysis may be performed using image recognition, threshold processing, segmentation, image signal analysis, or the like. The analysis method is not limited, and any method may be used. For example, image analysis may be performed using machine learning. For example, any machine learning algorithm using a DNN (Deep Neural Network) or the like may be used. For example, AI (artificial intelligence) that performs deep learning may be used. For example, a learning unit and a classification unit are constructed to perform image recognition. The learning unit performs machine learning based on input information (learning data) and outputs the learning results. The classification unit classifies (judges, predicts, etc.) the input information based on the input information and the learning results. The learning method used in the learning section is, for example, a neural network or deep learning. A neural network is a model that mimics the neural circuits of the human brain and consists of three types of layers: an input layer, an intermediate layer (hidden layer), and an output layer. Deep learning is a model that uses a multi-layered neural network, which repeats characteristic learning at each layer and is able to learn complex patterns hidden in large amounts of data. Deep learning is used, for example, to identify objects in video images, using a convolutional neural network (CNN) that is used for image and video recognition. Furthermore, as a hardware structure for realizing such machine learning, a neurochip / neuromorphic chip incorporating the concept of neural networks can be used. The recognition unit 17 also detects the position and frame rate of an object in the image. For example, the recognition unit 17 may detect coordinate values ​​(e.g., XYZ coordinate values) defined by the absolute coordinate system (world coordinate system) of the ball, or coordinate values ​​(e.g., XYZ coordinate values ​​or UVD coordinate values) defined by a relative coordinate system with a predetermined point as the reference (origin). When a relative coordinate system is used, the reference origin may be set arbitrarily.

[0048] The display unit 18 executes processing for providing various displays to the user. In this embodiment, images reproduced at the set frame rate are displayed on the display unit 18. The display unit 18 also performs processing to display image data converted to an appropriate resolution and input from the signal processing unit 14. This allows a live view image (also called a through image) that is an image captured during release standby to be displayed. Furthermore, the display unit 18 displays various operation menus, icons, messages, and the like as a GUI (Graphical User Interface) on the screen based on instructions from the control unit 15. The display unit 18 can also display playback images read from a recording medium in the recording unit 16. In this embodiment, the display unit 18 displays a GUI that allows the frame rate region to be set.

[0049] The output unit 19 performs data communication and network communication with external information processing devices via wired or wireless connections. For example, it transmits captured image data (still image files and video files) to external display devices, recording devices, playback devices, editing devices, etc. The output unit 19 may also function as a network communication unit. For example, it may perform communication via various networks such as the Internet, a home network, or a LAN (Local Area Network), and send and receive various data to and from servers, terminals, etc. on the network.

[0050] The operation unit 20 is used to perform various operations and settings, and includes, for example, a playback menu start button, a decision button, a cross key, a cancel button, a zoom key, a slide key, a shutter button, etc., as well as a monitor that employs a touch panel system, and outputs operation information to the control unit 15 in response to various operations such as tapping and swiping by the photographer. In this embodiment, a specific subject to be recognized by the recognition unit 17 may be selected by a user's operation via the operation unit 20. In this embodiment, the user can set the frame rate region by performing operations on the GUI displayed on the display unit 18 via the operation unit 20. For example, the position, size, and type of the frame rate region, such as a line, point, or region, are set. In this embodiment, the user can also set the frame rate of the image via the operation unit 20. For example, the user can input a numerical value for the frame rate, or can input the frame rate by tracing the predicted path along which a specific subject is expected to pass at a desired speed.

[0051] In this embodiment, the recognition unit 17 corresponds to a recognition unit that recognizes a specific subject in an image. In this embodiment, the determination unit 24 corresponds to a determination unit that determines whether or not the distance between the recognized specific subject and the frame rate area for setting the frame rate of the image is equal to or less than a threshold value. In this embodiment, the frame rate region setting unit 22 corresponds to a frame rate region setting unit that sets a frame rate region. In this embodiment, the frame rate setting unit 23 corresponds to a frame rate setting unit that sets the frame rate of an image. In this embodiment, the shooting control unit 25 corresponds to a shooting control unit that controls the shooting so that an image is shot at the set frame rate when the judgment unit determines that the distance between a specific subject and the set frame rate area is equal to or less than a threshold value. In this embodiment, the playback control unit 26 functions as a playback control unit that controls the playback of images at the set frame rate when the determination unit determines that the distance between a specific subject and the set frame rate area is equal to or less than a threshold value. In this embodiment, the operation unit 20 corresponds to an operation unit that accepts user operations.

[0052] FIG. 3 is a flowchart showing an example of frame rate control.

[0053] The recognition unit 17 recognizes a specific subject in an image (step 101).

[0054] FIG. 4 is a schematic diagram showing an example of a GUI that allows a specific subject to be selected.

[0055] The user can select any object in the image displayed on the GUI as a specific subject via the operation unit 20. In this embodiment, the user selects the specific subject by touching any object displayed on the GUI 30 shown in Fig. 4. In addition to this, a menu may be displayed that presents objects that can be selected as the specific subject, such as parts of the human body, such as hands, faces, and feet, or a ball or goal.

[0056] 4A, the user can select, as specific subjects, various parts of the human body, such as the hands 31, arms 32, head 33, torso 34, and feet 35, as well as the ball 36 and goal 37, via the GUI 30. For example, the recognition unit 17 may recognize the various parts of the human body, such as the hands 31, arms 32, head 33, torso 34, and feet 35, by semantic segmentation or the like. At this time, the boundaries of the regions of the various parts may be displayed. Furthermore, when recognizing objects, if there are multiple objects that are recognized as being of the same type, one object can be recognized by recognizing the characteristics of a particular subject, such as being larger or more in focus. Also, for example, when a rehearsal image has been acquired, an object to be focused on may be selected in a certain frame of the rehearsal image, and the selected object may be set as a specific subject. A rehearsal image is an image displayed on the display unit 18 when setting a frame rate region, etc. For example, an image similar to an image for which the user wants to control the frame rate is the rehearsal image. Specifically, in FIG. 4, a scene in which a basketball is shot into a goal is the rehearsal image. The method for acquiring the rehearsal image is not limited, and for example, when controlling the frame rate during playback, an image recorded in the recording unit 16 may be acquired as the rehearsal image. Furthermore, for example, when shooting, the user may select a scene such as a sporting event, and a rehearsal image appropriate for that scene (including footage that is not actually shot, for example, a sample image of a goal scene) may be displayed. In this case, the user may perform operations while viewing the sample image, or the image that is actually being shot may be displayed as the rehearsal image.

[0057] Also, as shown in Figure 4B, when the movement of a specific subject is large, such as a person 38 doing a somersault on a board 39, it is possible to track the specific subject by selecting the board 39 as the specific subject rather than the center of gravity of the person 38.

[0058] Of course, the specific subject may be automatically recognized by the recognition unit 17. In this case, the recognized specific subject may be displayed by the GUI 60 so that it can be identified by the user.

[0059] Returning to FIG. 3, the frame rate region setting unit 22 sets the frame rate region (step 102). The frame rate of the image is set by the frame rate setting unit 23 (step 103).

[0060] 5 is a schematic diagram showing an example of setting the frame rate region and the frame rate of an image. In FIG. 5, a control GUI 40 that allows control of the frame rate is displayed on the display unit 18. In this embodiment, the user can set the frame rate area and the frame rate of the image by touching the display unit 18 on which the control GUI 40 is displayed. As shown in Fig. 5, a basketball game is being photographed by the imaging device 10, and a goal 41 is displayed. Fig. 5 also shows the moment when the basketball passes through the goal.

[0061] The user sets the frame rate region by touching the display unit 18 with a finger 42. In this embodiment, the user can set the frame rate region by tracing with the finger 42 a predicted path 43 (a line from a start point 44 to an end point 45) along which the basketball is predicted to pass. The user can also set the frame rate of the image during playback by controlling the speed of the finger 42 when tracing the predicted path 43. In other words, the frame rate of the image is controlled based on the input speed of the finger 42. For example, the frame rate to be set during shooting or playback is calculated based on the tracing speed of the user's finger 42 (the speed input by the user) and the actual speed of a specific subject during shooting or playback. A specific calculation method is described below.

[0062] Here, a method for calculating the frame rate of the image to be controlled from the velocity of a specific object input by the user's finger will be described. The following parameters are used to determine the frame rate F of the image to be controlled: The actual velocity of a particular object is written as Vnow. The velocity of a specific object input by the user is written as Vexpected. The image frame rate set by the user is denoted as Fplay.

[0063] It should be noted that Vnow is acquired by the recognition unit 17. Vexpected is set by the frame rate setting unit 23. Furthermore, Fplay is a frame rate that is set in advance by a user input. Furthermore, Vexpected is the speed of the specific subject at each position on the expected path 43. In other words, the expected path 43 can also be said to be a set of points indicating each position of the specific subject. For example, the speed of the specific subject input by the user at the start point 44 can be expressed as Vexpected(1). Also, for example, the speed of the specific subject input by the user at the end point 45 can be expressed as Vexpected(n). The actual velocity of a specific object corresponding to Vexpected(1) can be expressed as Vnow(1). Similarly, the actual velocity of a specific object corresponding to Vexpected(n) can be expressed as Vnow(n).

[0064] Here, the formula for calculating the frame rate F of the image controlled by the control unit 15 is written as the following formula (1).

[0065]

number

[0066] The frame rate set at each position on the predicted path is controlled by performing the process of (Equation 1) for each frame. For example, if you want to slow down the image by 5 times at a specific position within the frame rate range, and the frame rate number during playback is set to 24, the frame rate number of the image at that specific position will be controlled to 120. During shooting, the above process is executed for each frame to control the frame rate.

[0067] FIG. 6 is a schematic diagram showing an example of the setting of the frame rate area and the frame rate of the image when the rehearsal image is being acquired. FIG. 6 shows an example of the control GUI 40 when a rehearsal image is being acquired.

[0068] If a rehearsal image is being acquired, a basketball 47 is ghosted based on the expected path and frame rate input by the user. Ghost display refers to the virtual display of a specific subject moving across multiple frames according to the predicted path in the frame area and the set frame rate. For example, overlapping ghosts indicate slow movement, while spacing ghosts indicate fast movement. For example, in FIG. 5, the ghost of a basketball 47 near the goal 48 is displayed in an overlapping manner, so the frame rate of the image is controlled to be slower when the basketball 47 is near the goal 48 .

[0069] The method of controlling the frame rate of the image when the rehearsal image of FIG. 6 has been acquired is also the same as the above (Equation 1).

[0070] FIG. 7 is a schematic diagram showing an example of a control GUI 50 for controlling the frame rate. 7, a graph showing the frame rate on the vertical axis and the length from the starting point on the horizontal axis is displayed on the control GUI 50. In this embodiment, the user can adjust the frame rate in the frame rate area via the control GUI 50. A solid line 53 connecting the start point 51 and the end point 52 indicates the frame rate of the predicted path 43 from the start point 44 to the end point 45 input via the control GUI 40 shown in FIG. A dotted line 54 connecting the start point 51 and the end point 52 indicates the range within which the frame rate within the image can be changed. In other words, the user can adjust the frame rate so as not to exceed the dotted line displayed on the control GUI 50.

[0071] The frame rate indicated by the dotted line 54 is calculated based on the actual speed of the specific subject recognized by the recognition unit 17. For example, it may be calculated based on the actual speed of the specific subject at the time of shooting. It may also be calculated based on the speed of the specific subject in the rehearsal image.

[0072] The frame rate indicated by the dotted line 54 can be calculated using the above equation (1). In this case, the speed of the specific subject detected in advance by the recognition unit 17 in the rehearsal image is used as a predicted value of Vnow, which is the actual speed of the specific subject. The dotted line 54 corresponding to the calculated frame rate is displayed on the control GUI 50.

[0073] Furthermore, if there is a rehearsal image, the control GUI 50 notifies the user of this when the solid line 53 exceeds the dotted line 54. For example, a sentence or voice may be presented to the user. Furthermore, a marker 55 indicating the position of a specific subject on the predicted route is displayed on the control GUI 50. That is, the user can adjust the frame rate of the specific subject at the current position of the marker 55.

[0074] As shown in FIG. 7, the control GUI 50 has an image display section 56 that displays a frame rate area and a specific subject.

[0075] The image display unit 56 displays the predicted route 43 set in the control GUI 40 and the positions (markers 55) of a specific subject passing through the predicted route. This allows the user to control the frame rate of the specific subject at each position on the predicted route while simultaneously viewing the markers 55 on the predicted route and the graph. A rehearsal image may also be displayed on the image display unit 56.

[0076] Returning to FIG. 3, the determination unit 24 determines whether the distance between the specific subject and the frame rate region is equal to or less than a threshold value (step 104). If the distance between the specific object and the frame rate region is not equal to or less than the threshold (NO in step 104), the frame rate of the image is not controlled until the distance between the specific object and the frame rate region becomes equal to or less than the threshold. When the distance between the specific subject and the frame rate region is equal to or less than the threshold value (YES in step 104), the shooting control unit 25 and the playback control unit 26 perform control to shoot or play back images at the set frame rate (step 105). In this embodiment, the recognition unit 17 recognizes the position of the specific subject and the frame rate at that position. For example, the control unit 15 controls the image sensor 13 to capture all images at a high frame rate. At this time, the image capture control unit 25 or the playback control unit 26 controls the frame rate of the images by performing a process of thinning frames using a conversion process or the like. Alternatively, when all images are captured at a low frame rate, the image capture control unit 25 or the playback control unit 26 may add frames using an addition process or the like to control the frame rate of the images. Alternatively, the image frame rate may be controlled by performing a process of combining images or the like. Specifically, when the frame rate of images is controlled in real time during shooting, the time intervals at which each image is shot for each frame are successively changed by the shooting control unit 25. In other words, images shot at different time intervals are played back at equal time intervals, so the user can see that the playback speed of the images is changing. Furthermore, for example, the control unit 15 can control the image sensor 13 to capture images at a set frame rate. Similarly, during playback, the playback control unit 26 executes thinning and addition processing, so that images are played back at the frame rate during playback set by the frame rate setting unit 23 .

[0077] [Frame rate area shape] FIG. 8 is a schematic diagram showing an example of the shape of the frame rate region.

[0078] As shown in Fig. 8, the user sets a circular frame rate region via a control GUI 70. In this embodiment, the user can set the frame rate region by touching any point and sliding a finger 71 (moving the finger while touching). For example, by touching a goal 72 and sliding the finger in a predetermined direction, a circular frame rate region 73 is set whose radius is the distance the finger is moved.

[0079] 9 is a schematic diagram showing another example of the shape of the frame rate region, in which the imaging device 10 captures an image of the entire stadium at a wide angle.

[0080] As shown in Fig. 9, the user sets a rectangular frame rate region via a control GUI 70. In this embodiment, the user can set the frame rate region by touching a predetermined position and sliding a finger 74. For example, in Fig. 9, the user touches a predetermined point and slides the finger in a predetermined direction to set a rectangular frame rate region 75 whose diagonal line corresponds to the distance the finger is moved. The user can also set the center coordinates of the set frame rate area 75. If the user does not set them, the center coordinates of the frame rate area 75 are set to the center of gravity of the frame rate area. In the case of a circular frame rate area 73, the center coordinates (any one point touched) are set to the center.

[0081] The method for setting the frame rate region is not limited. For example, in the case of a circular frame rate region, the coordinates and radius may be input as numerical values. Alternatively, for example, the shape (boundary) of the frame rate region may be set by the user tracing it with their finger.

[0082] [Frame rate control example] 10 is a schematic diagram showing an example of a control GUI for the frame rate in the frame rate region. In Fig. 10, a control GUI 80 displays a graph showing the control of the frame rate in the frame rate region and a predicted path 81 corresponding to the graph.

[0083] In this embodiment, the control unit 15 controls the frame rate of the image based on the position of the specific subject determined by the determination unit 24 and the position of the center coordinates 83 set within the frame rate area 82. Furthermore, the user can control the frame rate corresponding to the path from the boundary of the frame rate area 82 to the center coordinates 83 of the frame rate area via the control GUI 80.

[0084] 10, a graph showing the frame rate on the vertical axis and the distance from the starting point on the horizontal axis is displayed on the control GUI 80. In this embodiment, the frame rate of the image is controlled so that the frame rate increases as a specific subject approaches the center coordinates from the boundary of the frame rate area. Here, the normal frame rate is the normal frame rate at which images are played back. For example, if images are played back at a frame rate of 60, then the frame rate of 60 is the normal frame rate. For example, the user sets, via the control GUI 80, the magnitude of the frame rate near the boundary of the frame rate area 82, the ratio of the distance from the boundary to the center coordinate 83 and the increase (decrease) of the frame rate, and the magnitude of the frame rate at the center coordinate 83.

[0085] In this embodiment, the frame rates are set to be the same at positions 84 (85) where the ratio of the distance between the center coordinate 83 and the frame rate region 82 is the same, and so one graph is displayed for the frame rate region 82. In other words, if the frame rates set on the path 81 from the boundary of the frame rate region 82 to the center coordinate 83 and the path 87 from the center coordinate 83 to the boundary of the frame rate region 82 are different, two graphs are displayed.

[0086] The method for controlling the frame rate is not limited to a specific method, and may be, for example, the methods shown in Figures 11, 12, 13, and 14, which will be described later.

[0087] 11 to 14 are schematic diagrams showing an example of frame rate control.

[0088] In the graphs shown in FIGS. 11 to 14, the vertical axis indicates the frame rate and the horizontal axis indicates the distance from the starting point. In the control example shown in FIG. 11, when a specific subject exceeds the boundary of the frame rate region, the frame rate of the image is controlled to the frame rate set within the frame rate region. In this embodiment, the determination unit 24 determines whether or not a specific subject has crossed the boundary of the frame rate region. For example, the determination unit 24 determines whether or not the center of gravity of the specific subject has crossed the frame rate region. If the center of gravity of the specific subject has crossed the frame rate region, the control unit 15 changes the frame rate to that shown in FIG. 11.

[0089] In the control example shown in Fig. 12, when a specific subject crosses the boundary of the frame rate area, the frame rate of the image is set to be changed in stages as the specific subject approaches the center coordinates of the frame rate area. For example, the frame rate is set to be increased in stages as the specific subject approaches the center coordinates. Alternatively, for example, the frame rate may be set to be decreased in stages as the specific subject moves away from the center coordinates. For example, the user may be able to control, via a control GUI, how many steps the frame rate should approach the set value, or the control unit 15 may calculate the frame rate as appropriate. Alternatively, for example, the relationship between distance and frame rate as shown in Fig. 12 may be recorded in advance as a table in the recording unit 16, and the control unit 15 may control the frame rate of the image based on the table.

[0090] In the control examples shown in Figures 13 and 14, when a specific subject crosses the boundary of the frame rate region, the frame rate of the image is set to be continuously changed as the specific subject approaches the center coordinates of the frame rate region. For example, the frame rate is set so that the slope of the line becomes steeper as the specific subject approaches the center coordinates. Alternatively, for example, the frame rate is set so that the slope of the line becomes gentler as the specific subject moves away from the center coordinates. Furthermore, for example, the user can control, via the control GUI, so that the slope of the line and curve becomes steeper or shallower as the set frame rate value is approached. In other words, the coefficient of the line or curve is changed. Alternatively, the relationship between distance and frame rate as shown in FIG. 13 may be recorded in advance as a table in the recording unit 16, and the control unit 15 may control the frame rate of the image based on this table.

[0091] As described above, the imaging device 10 according to this embodiment recognizes a specific subject in an image. It is then determined whether the distance between the recognized specific subject and the frame rate region for setting the frame rate of the image is equal to or less than a threshold. This makes it possible to easily control the frame rate of the image.

[0092] Generally, techniques such as the RAMP effect, which gradually changes the frame rate of a video for scenes that you want to create an impact on, are used in visual expression. To achieve a smooth dramatic effect, it is necessary to dynamically change the frame rate during shooting. In this type of shooting, the scenes to be shot are decided in advance and rehearsed, and the target frame rate and the time required to reach that frame rate are set. In this case, it is difficult to accurately match the timing to the movement of objects and shoot the video as intended.

[0093] This technology allows users to input the frame rate of a specific subject by tracing the expected path, making it easier to capture, play back, and edit images with more intuitive input than ever before.

[0094] <Other embodiments> The present technology is not limited to the above-described embodiments, and various other embodiments can be realized.

[0095] In the above embodiment, the frame rate of the image during shooting and playback is controlled by the imaging device 10. However, the present invention is not limited to this, and the captured image may be transmitted to an external information processing device, and the frame rate of the image may be controlled by the external information processing device.

[0096] FIG. 15 is a block diagram illustrating an example of a functional configuration of an information processing device. As shown in FIG. 15, the information processing device 100 includes a control unit 15, a recording unit 16, a recognition unit 17, a display unit 18, an output unit 19, and an operation unit 20. The information processing device 100 includes an editing device such as a PC or a smartphone, and a playback device such as a monitor. For example, in the case of an editing device or a playback device, an image signal may be supplied from the imaging device 10, and the frame rate of the image signal may be controlled. Alternatively, for example, a signal indicating that the frame rate should be controlled to a set frame rate may be supplied to the playback device by the editing device, and the playback device may control the frame rate in accordance with the signal. Note that each block executes the same processing as the blocks installed in the imaging device 10, and therefore a description thereof will be omitted.

[0097] For example, the information processing device 100 is communicably connected to an imaging device 10 that captures images via an output unit 19, either wired or wirelessly. The connection form between the devices is not limited, and it is possible to use, for example, wireless LAN communication such as WiFi or short-range wireless communication such as Bluetooth (registered trademark). For example, a captured image signal or a reproduced image signal may be received from the imaging device 10, and the frame rate of the received image signal may be controlled by the information processing device 100. Alternatively, for example, a reproduced image signal recorded on a recording device such as an SD (Secure Digital) card may be read.

[0098] It is also possible to control the frame rate of the captured image signal or the playback image signal, for example. In this case, the control unit 15 performs frame rate thinning and addition processing on the recorded image, so that the image is played back at the set frame rate. Furthermore, for example, a captured image or a reproduced image whose frame rate has been controlled by the imaging device 10 or the information processing device 100 may be displayed on a display unit of an external device.

[0099] In the above embodiment, the frame rate is controlled according to the distance between the specific subject and the frame rate area. However, the present invention is not limited to this. Interpolation processing may be performed when the actual position of the specific subject during shooting deviates from the position of the frame rate area. In other words, interpolation processing may be performed when the actual movement (path) of the specific subject during shooting deviates from the path (expected path) of the set frame rate area. For example, when shooting or playing back at a set frame rate, if a specific subject is misaligned with the frame rate region, the control unit 15 may use nearest neighbor interpolation, quadratic interpolation, etc. to control the frame rate of the image.

[0100] In the above embodiment, the frame rate of the image is controlled based on the speed of the specific subject input by the user's finger. However, the present invention is not limited to this, and the user may input a numerical value for the frame rate of the image. Images were captured and played back according to the set frame rate of the image. However, this is not limiting, and if actual capture and playback cannot be performed according to the frame rate set by the user, the following calculation may be performed.

[0101] In the above embodiment, the frame rate is input in accordance with the speed at which the user moves their finger. However, this is not limiting, and a button or the like that allows the user to arbitrarily change the numerical value may be displayed on the control GUI.

[0102] In the above embodiment, only one frame rate region is set. However, this is not limiting, and multiple frame rate regions may be set. For example, a frame rate region including two basketball goals may be set. In this case, when a basketball, which is a specific subject, approaches each frame rate region, images may be captured and played back at the set frame rate. In this case, different frame rates may be set for each frame rate region including the basketball goals. For example, when multiple frame rate regions overlap, the control unit 15 may control the frame rate of the image based on the frame rate of the frame rate region in which the specific subject is closer to the center coordinates of the frame rate region. For example, the control unit 15 may also calculate a weighted average of the frame rates based on the distance between the center coordinates of the multiple frame rate regions and the specific subject.

[0103] In the above embodiment, the frame rate is controlled for sports such as basketball. However, the present invention is not limited to this and may be applied to any field. For example, a wedding cake may be included in the frame rate range, and the frame rate may be controlled to a set value when someone approaches to cut the cake.

[0104] FIG. 16 is a block diagram showing an example of the hardware configuration of the information processing device 100. As shown in FIG.

[0105] The information processing device 100 includes a CPU 101, a ROM 102, a RAM 103, an input / output interface 105, and a bus 104 that interconnects these components. The input / output interface 105 is connected to a display unit 106, an input unit 107, a storage unit 108, a communication unit 109, a drive unit 110, and the like.

[0106] The display unit 106 is a display device that uses, for example, a liquid crystal display, an electroluminescent display, etc. The input unit 107 is, for example, a keyboard, a pointing device, a touch panel, or other operating device. When the input unit 107 includes a touch panel, the touch panel can be integrated with the display unit 106.

[0107] The storage unit 108 is a non-volatile storage device, such as a HDD, flash memory, or other solid-state memory. The drive unit 110 is a device capable of driving a removable recording medium 111, such as an optical recording medium or magnetic recording tape.

[0108] The communication unit 109 is a modem, a router, or other communication equipment that can be connected to a LAN, a WAN, or the like and that communicates with other devices. The communication unit 109 may communicate using either a wired or wireless method. The communication unit 109 is often used separately from the information processing device 100.

[0109] Information processing by the information processing device 100 having the above-described hardware configuration is realized by cooperation between software stored in the storage unit 108, the ROM 102, or the like and the hardware resources of the information processing device 100. Specifically, the information processing method according to the present technology is realized by loading a program constituting the software stored in the ROM 102, or the like, into the RAM 103 and executing the program.

[0110] The program is installed in the information processing device 100 via, for example, the recording medium 111. Alternatively, the program may be installed in the information processing device 100 via a global network or the like. Alternatively, any computer-readable non-transitory storage medium may be used.

[0111] The imaging device, information processing device, information processing method, and program related to the present technology may be executed by linking a computer installed in a communication terminal with another computer that can communicate via a network, etc., thereby constructing an information processing device related to the present technology.

[0112] That is, the imaging device, information processing device, information processing method, and program according to the present technology can be executed not only in a computer system configured with a single computer, but also in a computer system in which multiple computers operate in conjunction with each other. In this disclosure, a system refers to a collection of multiple components (devices, modules (parts), etc.), regardless of whether all the components are in the same housing. Therefore, multiple devices housed in separate housings and connected via a network, and a single device in which multiple modules are housed in a single housing, are both systems.

[0113] The execution of the imaging device, information processing device, information processing method, and program according to the present technology by a computer system includes both cases where, for example, recognition of a specific subject, setting of a frame rate, control of a frame rate, etc. are executed by a single computer, and cases where each process is executed by a different computer. Furthermore, the execution of each process by a specific computer includes having another computer execute part or all of the process and obtaining the results.

[0114] In other words, the imaging device, information processing device, information processing method, and program according to the present technology can also be applied to a cloud computing configuration in which a single function is shared and processed jointly by multiple devices via a network.

[0115] The configurations of the frame rate region setting unit 22, the determination unit 24, the frame rate setting unit 23, and the like, as well as the control flow of the communication system, which have been described with reference to the drawings, are merely one embodiment and can be modified as desired without departing from the spirit of the present technology. In other words, any other configurations, algorithms, and the like for implementing the present technology may be adopted.

[0116] It should be noted that the effects described in this disclosure are merely examples and are not limiting, and other effects may also be present. The description of multiple effects above does not necessarily mean that these effects are exhibited simultaneously. It means that at least one of the effects described above can be obtained depending on the conditions, etc., and of course, effects not described in this disclosure may also be exhibited.

[0117] It is also possible to combine at least two of the features of each embodiment described above. In other words, the various features described in each embodiment may be combined in any way without distinguishing between the embodiments.

[0118] The present technology can also be configured as follows. (1) a recognition unit that recognizes a specific subject in an image; a determination unit that determines whether or not a distance between the recognized specific subject and a frame rate area for setting a frame rate of an image is equal to or less than a threshold; An imaging device comprising: (2) The imaging device according to (1), further comprising: A frame rate region setting unit that sets the frame rate region is provided. Imaging device. (3) The imaging device according to (1) or (2), further comprising: A frame rate setting unit is provided to set the frame rate of the image. Imaging device. (4) The imaging device according to (2), further comprising: and a photographing control unit that controls the image to be photographed at the set frame rate when the determination unit determines that the distance between the specific subject and the set frame rate region is equal to or less than a threshold. Imaging device. (5) The imaging device according to (2), further comprising: and a playback control unit that controls playback of the image at the set frame rate when the determination unit determines that the distance between the specific subject and the set frame rate region is equal to or less than a threshold. Imaging device. (6) The imaging device according to (2), The frame rate region setting unit sets the frame rate region as a point. Imaging device. (7) The imaging device according to (2), The frame rate region setting unit sets the frame rate region as a line. Imaging device. (8) The imaging device according to (2), The frame rate region setting unit sets the frame rate region as a region having a predetermined range. Imaging device. (9) The imaging device according to (4), the frame rate region setting unit sets a plurality of the frame rate regions, The photographing control unit controls the photographing to be performed at the set frame rate when the determination unit determines that the distance between the specific subject and each of the set frame rate regions is equal to or less than a threshold. Imaging device. (10) The imaging device according to (5), the frame rate region setting unit sets a plurality of the frame rate regions, The reproduction control unit controls reproduction of the image at the set frame rate when the determination unit determines that the distance between the specific subject and each of the set frame rate regions is equal to or less than a threshold. Imaging device. (11) The imaging device according to (4), the frame rate region setting unit sets the frame rate region as a region having a predetermined range, The photographing control unit controls the photographing of the image at the set frame rate when the determination unit determines that the specific subject is within the range of the set frame rate region. Imaging device. (12) The imaging device according to (5), the frame rate region setting unit sets the frame rate region as a region having a predetermined range, The reproduction control unit controls reproduction of the image at the set frame rate when the determination unit determines that the specific subject is within the set frame rate range. Imaging device. (13) The imaging device according to (2), further comprising: An operation unit that accepts user operations is provided, The frame rate region setting unit sets the frame rate region in response to a user's operation on the operation unit. Imaging device. (14) The imaging device according to (3), further comprising: An operation unit that accepts user operations is provided, The frame rate setting unit sets the frame rate of the image in response to a user's operation on the operation unit. Imaging device. (15) The imaging device according to (3), The frame rate setting unit sets the frame rate so that the frame rate changes stepwise depending on the distance between the specific subject and the frame rate region. Imaging device. (16) The imaging device according to (3), The frame rate setting unit sets the frame rate so that the frame rate changes continuously depending on the distance between the specific subject and the frame rate region. Imaging device. (17) a recognition unit that recognizes a specific subject in an image; a determination unit that determines whether or not a distance between the recognized specific subject and a frame rate area for setting a frame rate of an image is equal to or less than a threshold; An information processing device comprising: (18) Recognize specific subjects in an image; It is determined whether the distance between the recognized specific subject and a frame rate area for setting the frame rate of the image is equal to or less than a threshold. An information processing method implemented by a computer system. (19) recognizing a specific object in the image; determining whether or not a distance between the recognized specific subject and a frame rate region for setting a frame rate of an image is equal to or less than a threshold; A program that causes a computer system to execute the following. [Explanation of symbols]

[0119] 10...imaging device 20...Operation unit 22...Frame rate area setting section 23...Frame rate setting section 24…Judgment section 25...Shooting control unit 26...Playback control unit 40...Control GUI 100...Information processing device

Claims

1. a recognition unit that recognizes a specific subject in an image; a determination unit that determines whether a distance between the recognized specific subject and a frame rate area for setting a frame rate of an image is equal to or less than a threshold; a frame rate region setting unit that sets the frame rate region as a line; An imaging device comprising:

2. 2. The imaging device according to claim 1, further comprising: A frame rate setting unit is provided to set the frame rate of the image. Imaging device.

3. 2. The imaging device according to claim 1, further comprising: and a photographing control unit that controls the image to be photographed at the set frame rate when the determination unit determines that the distance between the specific subject and the set frame rate region is equal to or less than a threshold. Imaging device.

4. 2. The imaging device according to claim 1, further comprising: and a playback control unit that controls playback of the image at the set frame rate when the determination unit determines that the distance between the specific subject and the set frame rate region is equal to or less than a threshold. Imaging device.

5. 2. The imaging device according to claim 1, The frame rate region setting unit sets the frame rate region as a point. Imaging device.

6. 2. The imaging device according to claim 1, The frame rate region setting unit sets the frame rate region as a region having a predetermined range. Imaging device.

7. 4. The imaging device according to claim 3, the frame rate region setting unit sets a plurality of the frame rate regions, The photographing control unit controls the photographing to be performed at the set frame rate when the determination unit determines that the distance between the specific subject and each of the set frame rate regions is equal to or less than a threshold. Imaging device.

8. 5. The imaging device according to claim 4, the frame rate region setting unit sets a plurality of the frame rate regions, The reproduction control unit controls reproduction of the image at the set frame rate when the determination unit determines that the distance between the specific subject and each of the set frame rate regions is equal to or less than a threshold. Imaging device.

9. 4. The imaging device according to claim 3, the frame rate region setting unit sets the frame rate region as a region having a predetermined range, The photographing control unit controls the photographing of the image at the set frame rate when the determination unit determines that the specific subject is within the range of the set frame rate region. Imaging device.

10. 5. The imaging device according to claim 4, the frame rate region setting unit sets the frame rate region as a region having a predetermined range, The reproduction control unit controls reproduction of the image at the set frame rate when the determination unit determines that the specific subject is within the set frame rate range. Imaging device.

11. 2. The imaging device according to claim 1, further comprising: An operation unit that accepts user operations is provided, The frame rate region setting unit sets the frame rate region in response to a user's operation on the operation unit. Imaging device.

12. 3. The imaging device according to claim 2, further comprising: An operation unit that accepts user operations is provided, The frame rate setting unit sets the frame rate of the image in response to a user's operation on the operation unit. Imaging device.

13. 3. The imaging device according to claim 2, The frame rate setting unit sets the frame rate so that the frame rate changes stepwise depending on the distance between the specific subject and the frame rate region. Imaging device.

14. 3. The imaging device according to claim 2, The frame rate setting unit sets the frame rate so that the frame rate changes continuously depending on the distance between the specific subject and the frame rate region. Imaging device.

15. a recognition unit that recognizes a specific subject in an image; a determination unit that determines whether or not a distance between the recognized specific subject and a frame rate area for setting a frame rate of an image is equal to or less than a threshold; a frame rate region setting unit that sets the frame rate region as a line; An information processing device comprising:

16. Recognizes specific subjects in the image, determining whether or not a distance between the recognized specific subject and a frame rate region for setting a frame rate of an image is equal to or less than a threshold; Set the frame rate region as a line An information processing method implemented by a computer system.

17. Recognizing a particular object in an image; determining whether a distance between the recognized specific subject and a frame rate region for setting a frame rate of an image is equal to or less than a threshold; setting the frame rate region as a line; A program that causes a computer system to execute the following.

Images