Imaging apparatus, information processing apparatus, information processing method and program

Abstract

[Objective] To provide an imaging apparatus, information processing apparatus, information processing method, and program that enables easier control of the frame rate of an image. [Solution] To achieve the above objective, an imaging apparatus according to an embodiment of the present technology includes an identification unit and a determination unit. The identification unit identifies a specific subject in an image. The determination unit determines whether the distance between the identified specific subject and a frame rate region used to set the frame rate of the image is equal to or less than a threshold. Therefore, compared with the prior art, the frame rate of an image can be easily controlled with more intuitive input during image capture, reproduction, and editing.

Description

Technical Field

[0001] This technology relates to imaging devices, information processing devices, information processing methods, and programs that can be applied to motion image editing, etc. Background Technology

[0002] In the image reproduction apparatus described in Patent Document 1, the reproduction speed of the moving image is controlled according to the distance between multiple specific objects in the moving image or the distance between a fixed position and an object of interest. Therefore, this helps to optimize the reproduction speed of important scenes (paragraphs

[0039] and

[0051] of Patent Document 1). Figure 3 wait).

[0003] Citation List

[0004] Patent documents

[0005] Patent Document 1: Japanese Patent Application Publication No. 2011-10276 Summary of the Invention

[0006] Technical issues

[0007] As shown in Patent Document 1, in order to make a particular scene in a moving image impressive, a method of changing the frame rate of the moving image is sometimes used. Thus, it is desirable to provide a technique that makes it easy to control the frame rate of the image.

[0008] In view of the above, the purpose of this technology is to provide an imaging device, information processing device, information processing method and program that can more easily control the frame rate of an image.

[0009] Solution to the problem

[0010] To achieve the above objectives, the imaging apparatus according to embodiments of the present technology includes an identification unit and a determination unit.

[0011] The recognition unit identifies a specific subject in the image.

[0012] The determination unit determines whether the distance between the identified specific subject and the frame rate region used to set the frame rate of the image is equal to or less than a threshold.

[0013] In this imaging device, a specific subject in the image is identified. It is then determined whether the distance between the identified subject and a frame rate region used to set the image frame rate is equal to or less than a threshold. Therefore, the image frame rate can be easily controlled.

[0014] The imaging device may further include a frame rate region setting unit for setting the frame rate region.

[0015] The imaging device may further include a frame rate setting unit for setting the frame rate of the image.

[0016] The imaging device may further include a shooting control unit that controls the shooting of images at a set frame rate when the determination unit determines that the distance between the specific subject and the set frame rate region is equal to or less than a threshold.

[0017] The imaging device may further include a reproduction control unit that controls the reproduction of the image at a set frame rate when the determination unit determines that the distance between the specific subject and the set frame rate region is equal to or less than a threshold.

[0018] The frame rate region setting unit can set the frame rate region as a point.

[0019] The frame rate region setting unit can set the frame rate region as a line.

[0020] The frame rate region setting unit can set the frame rate region to a region with a predetermined range.

[0021] The frame rate region setting unit can set multiple frame rate regions, each of which is a frame rate region. In this case, when the determination unit determines that the distance between the specific subject and each of the multiple set frame rate regions is equal to or less than a threshold, the shooting control unit can control the shooting to capture images at the set frame rate.

[0022] The frame rate region setting unit can set multiple frame rate regions. In this case, when the determination unit determines that the distance between the specific subject and each of the multiple set frame rate regions is equal to or less than a threshold, the reproduction control unit can control the reproduction of the image at the set frame rate.

[0023] The frame rate region setting unit can set the frame rate region to a region with a predetermined range. In this case, the shooting control unit can control the shooting of images at the set frame rate when the determination unit determines that the specific subject is within the range of the set frame rate region.

[0024] The frame rate region setting unit can set the frame rate region to a region with a predetermined range. In this case, the reproduction control unit can control the reproduction of the image at the set frame rate if the determination unit determines that the specific subject is within the range of the set frame rate region.

[0025] The imaging device may further include an operation unit that receives user operations. In this case, the frame rate region setting unit can set the frame rate region according to the user's operation on the operation unit.

[0026] The imaging device may further include an operation unit that receives user input. In this case, the frame rate setting unit sets the frame rate of the image according to the user's input to the operation unit.

[0027] The frame rate setting unit can set the frame rate according to the distance between the specific subject and the frame rate region, so that the frame rate changes in a stepwise manner.

[0028] The frame rate setting unit can set the frame rate according to the distance between the specific subject and the frame rate region, so that the frame rate changes continuously.

[0029] The information processing apparatus according to embodiments of the present technology includes an identification unit and a determination unit.

[0030] The recognition unit identifies a specific subject in the image.

[0031] The determination unit determines whether the distance between the identified specific subject and the frame rate region used to set the frame rate of the image is equal to or less than a threshold.

[0032] The information processing method according to embodiments of the present technology is an information processing method executed by a computer system and includes identifying a specific subject in an image.

[0033] Determine whether the distance between the identified specific subject and the frame rate region used to set the image frame rate is equal to or less than a threshold.

[0034] The procedure according to embodiments of this technology causes a computer system to perform the following steps.

[0035] The steps to identify a specific subject in an image.

[0036] The step of determining whether the distance between a specific subject being identified and the frame rate region used to set the frame rate of the image is equal to or less than a threshold. Attached Figure Description

[0037] Figure 1 This is a schematic diagram describing the outline of the imaging device.

[0038] Figure 2 This is a block diagram illustrating an example of the functional configuration of an imaging device.

[0039] Figure 3 This is a flowchart illustrating an example of frame rate control.

[0040] Figure 4 This is a schematic diagram illustrating an example of a GUI that enables the selection of a specific subject.

[0041] Figure 5This is a schematic diagram illustrating an example of setting the frame rate range and the frame rate of an image.

[0042] Figure 6 This is a schematic diagram illustrating an example of setting the frame rate region and the frame rate of an image when a preview image has been acquired.

[0043] Figure 7 This is a schematic diagram illustrating an example of a control GUI 50 used to control the frame rate.

[0044] Figure 8 This is a schematic diagram illustrating an example of the shape of a frame rate region.

[0045] Figure 9 This is a schematic diagram of another example representing the shape of the frame rate region.

[0046] Figure 10 This is a schematic diagram illustrating an example of a GUI for controlling the frame rate in a frame rate region.

[0047] Figure 11 This is a schematic diagram illustrating an example of frame rate control.

[0048] Figure 12 This is a schematic diagram illustrating an example of frame rate control.

[0049] Figure 13 This is a schematic diagram illustrating an example of frame rate control.

[0050] Figure 14 This is a schematic diagram illustrating an example of frame rate control.

[0051] Figure 15 This is a block diagram illustrating an example of the functional configuration of an information processing device.

[0052] Figure 16 This is a block diagram illustrating an example of the hardware configuration of an information processing device. Detailed Implementation

[0053] The following will describe embodiments according to the present technology with reference to the accompanying drawings.

[0054] [Imaging device]

[0055] Figure 1 This is a schematic diagram illustrating the general structure of an imaging apparatus according to the present technology.

[0056] The imaging device 10 includes an imaging element 13 (image sensor), an optical system 11, an aperture, etc. (not shown), and is capable of capturing a field of view. In this embodiment, the imaging device 10 captures an image of a person 3 throwing a basketball 1 towards a hoop 2.

[0057] It should be noted that the configuration of the imaging device is not limited. For example, image sensors such as complementary metal-oxide-semiconductor (CMOS) sensors and charge-coupled devices (CCDs) can be used as imaging elements 13.

[0058] In addition, the imaging device 10 identifies a specific subject in the image and determines whether the distance between the specific subject and the frame rate region used to set the frame rate of the image is equal to or less than a threshold.

[0059] For example, the frame rate of the image is controlled when the distance between the basketball 1 (a specific subject) and the frame rate region including the hoop 2 is equal to or less than a threshold. That is, the frame rate of the image is controlled according to the distance between the specific subject and the frame rate region.

[0060] The frame rate region includes points, lines, and areas with a predetermined range, and is a region pre-defined at a specific location in the image.

[0061] The specific subject is the subject identified by the recognition unit 17 described later among the subjects included in the image.

[0062] It should be noted that images include captured images and reproduced images.

[0063] Furthermore, the imaging device 10 sets a frame rate region for the image area. For example, based on user input, a region with a certain range can be designated as the frame rate region, or the frame rate region can be designated as a line or a point. Figure 1 For example, the path (trajectory) of the basketball 1 entering the basket 2 can be set as the frame rate region. Alternatively, a rectangular area centered on the basket 2 can be set as the frame rate region. It should be noted that the shape and area of ​​the frame rate region are not limited.

[0064] Furthermore, the imaging device 10 controls the frame rate of the image. In this embodiment, the imaging device 10 controls the frame rate of the image during capture and playback.

[0065] For example, if it is determined that the distance between a specific subject and a set frame rate area is equal to or less than a threshold, the imaging device 10 controls the image to be captured or reproduced at the set frame rate.

[0066] Figure 2 This is a block diagram illustrating an example of the functional configuration of the imaging device 10.

[0067] like Figure 2 As shown, the imaging device 10 includes an optical system 11, a driving unit 12, an imaging element 13, a signal processing unit 14, a control unit 15, a recording unit 16, a recognition unit 17, a display unit 18, an output unit 19, and an operation unit 20.

[0068] The optical system 11 includes lenses, an aperture mechanism, a shutter, etc. For example, various lenses such as an incident end lens, a zoom lens, a focusing lens, and a condenser lens can be used in the optical system 11. For example, a shutter unit can also be used, such as an aperture mechanism and a focal plane shutter, to control exposure by adjusting the aperture using a lens or iris (aperture) to sense within a dynamic range, thereby preventing signal charge saturation.

[0069] The drive unit 12 drives lenses and the like included in the optical system 11.

[0070] Imaging element 13 controls the exposure of incident light from the subject via optical system 11. Furthermore, imaging element 13 includes, for example, a processor that performs CDS processing, AGS processing, and A / D conversion processing on electrical signals obtained through pixel-by-pixel photoelectric conversion.

[0071] In this embodiment, the captured image signal, which is digital data, is output to the signal processing unit 14 and the control unit 15.

[0072] The signal processing unit 14 includes, for example, a microprocessor or microcomputer specifically designed for digital signal processing, such as a digital signal processor (DSP). The signal processing unit 14 performs various signal processing operations on the digital signal (captured image signal) transmitted from the imaging element 13. Specifically, the signal processing unit 14 performs processes such as correction processing between R, G, and B color channels, white balance correction, aberration correction, and shading correction. Furthermore, the signal processing unit 14 performs various processing operations such as YC generation processing (separating) luminance (Y) and chrominance (C) signals from R, G, and B image data, brightness and color adjustment processing, inflection point correction, and gamma correction. The signal processing unit 14 outputs the image signal after various signal processing operations to the recognition unit and the control unit. Additionally, the signal processing unit 14 performs resolution conversion processing, codec processing for encoding and communication, etc., thereby converting the signal into a final output format. The image signal converted to the final output format is recorded in the recording unit 17. Furthermore, the image signal is displayed as an image on the display unit 18. Additionally, image signals are output from external output terminals so that they are displayed on a device such as a monitor located outside the imaging device 1. In this example, the captured image signal refers to the image signal output from the signal processing unit 14. By displaying the captured image signal as a captured image on the display unit 18, the user can review the captured image in real time. Furthermore, in this example, the reproduced image signal refers to the image signal output from the recording unit 16. By displaying the reproduced image signal as a reproduced image on the display unit 18, the user can review the recorded image.

[0073] The control unit 15 includes a microcomputer (arithmetic processing unit) with a central processing unit (CPU) that comprehensively controls the imaging device 10. For example, the control unit 15 performs instructions regarding various signal processing operations in the signal processing unit 14 corresponding to user operations, imaging operations, recording operations, and playback operations of recorded image files. The control unit 15 also performs switching between various shooting modes. These shooting modes include, for example, still image shooting mode, movie shooting mode, and continuous shooting mode for acquiring still images. The control unit 15 includes a user interface control unit 21 (UI control unit 21) that enables the user to operate these functions.

[0074] The UI control unit 21 performs operations such as detecting and processing the operation of each operating element provided in the imaging device 10, display processing on the display unit 18, and operation detection processing. Furthermore, the control unit 15 controls the various lenses of the optical system 11. For example, the UI control unit 21 processes the specification of the F-value to ensure the amount of light required for AF control, and provides operation instructions for the aperture mechanism corresponding to the F-value.

[0075] The ROM, flash memory, and other storage devices store the programs used by the control unit 15. The ROM, flash memory, and other storage devices store applications, firmware, etc., used for various operations, as well as the operating system (OS) used by the CPU to control the various units and content files such as image files. The control unit 15 executes the programs, thereby controlling the entire imaging device 10. RAM temporarily stores data, programs, etc., used in various data processing performed by the CPU of the control unit 15, so that it can be used as a working area for the control unit 15.

[0076] In addition, the control unit 15 includes a UI control unit 21, a frame rate area setting unit 22, a frame rate setting unit 23, a determination unit 24, a shooting control unit 25, and a playback control unit 26.

[0077] The frame rate region setting unit 22 sets the frame rate region. For example, the frame rate region setting unit 22 sets the frame rate region in the image according to the user's operation.

[0078] The frame rate setting unit 23 sets the frame rate of the image. For example, the user sets the frame rate of the image when a specific subject is close to a set frame rate area.

[0079] The determination unit 24 determines whether the distance between a specific subject and the frame rate region is equal to or less than a threshold. It should be noted that the threshold determined by the determination unit 24 can be preset or set by the user.

[0080] If the determination unit 24 determines that the distance between a specific subject and the frame rate region set by the frame rate region setting unit 22 is equal to or less than a threshold, the shooting control unit 25 controls the image to be captured at the frame rate set by the frame rate setting unit 23. For example, if the distance between a specific subject and the frame rate region is equal to or less than the threshold, the imaging element 13 is controlled to capture an image at the set frame rate.

[0081] If the determination unit 24 determines that the distance between a specific subject and the frame rate region set by the frame rate region setting unit 22 is equal to or less than a threshold, the reproduction control unit 26 controls the reproduction of the image at the frame rate set by the frame rate setting unit 23.

[0082] For example, when the frame rate is controlled during image reproduction, the image signal from the recording unit 16 is provided to the reproduction control unit 26. The control unit 15 performs frame rate decimation or addition processing on the image signal, and the reproduction control unit 26 controls the display unit 18 to display the image signal on the display unit 18 at the set frame rate of the image, or reproduces the image signal at the set frame rate of the image.

[0083] In addition, to control the frame rate during playback, just like during shooting, images captured in advance at high or low frames per second can be extracted or added together.

[0084] Furthermore, the capture control unit 25 and the playback control unit 26 are capable of performing frame rate-related processing. For example, the capture control unit 25 and the playback control unit 26 perform frame rate extraction or addition processing. For example, when the capture control unit 25 controls the frame rate during image capture, the image signal from the signal processing unit 14 is provided to the capture control unit 25, which controls the frame rate of the image.

[0085] The frame rate control method is unrestricted. For example, the capture control unit 25 can control the imaging element 13 to capture images at a set number of frames per second. Furthermore, for example, the imaging element 13 can capture all images at a high or low frame rate per second, and the captured images can be extracted or summed. Frame rate-related processing will be described later.

[0086] In addition, the shooting control unit 25 and the playback control unit 26 set the frame rate according to the distance between a specific subject and the frame rate area so that the frame rate changes in a stepwise or continuous manner.

[0087] For example, the shooting control unit 25 and the playback control unit 26 can set the frame rate based on a table storing the number of frames per second corresponding to the distance between a specific subject and a frame rate zone. Of course, this technology is not limited to this, and the frame rate can be set by various methods.

[0088] Recording unit 16 may include, for example, non-volatile memory that stores image files (content files) such as still image data or moving image data, attribute information of the image files, thumbnail images, etc. Image files may be stored in formats such as Joint Photographic Experts Group (JPEG), Tagged Image File Format (TIFF), and Graphics Interchange Format (GIF). Various practical forms are possible for recording unit 16. For example, recording unit 16 may be configured as flash memory built into the imaging device, or may include a memory card (e.g., portable flash memory) removably mounted on the imaging device and an access unit for storing or reading from the memory card. Furthermore, recording unit 16 may be implemented as a hard disk drive (HDD) built into the imaging device.

[0089] The recognition unit 17 identifies a specific subject in an image from the captured image signal or the reproduced image signal. The recognition unit 17 can identify a subject specified by user operation, or it can automatically identify a specific subject, such as a ball, not only through user operation but also through machine learning. For example, the recognition unit 17 identifies people in the image, human body parts such as arms, torso, and legs, balls, etc.

[0090] It should be noted that the recognition method is unrestricted. Analysis can be performed through image recognition, thresholding, segmentation, image signal analysis, etc. The analysis method is not limited; any method can be used. For example, machine learning can be used for image analysis.

[0091] For example, any machine learning algorithm that utilizes deep neural networks (DNNs) can be used. For example, artificial intelligence (AI) that performs deep learning can be used.

[0092] For example, to perform image recognition, a learning unit and a recognition unit are constructed. The learning unit performs machine learning based on the input information (learning data) and outputs the learning results. Furthermore, the recognition unit performs recognition (e.g., judgment, prediction) of the input information based on the input information and the learning results.

[0093] For example, learning techniques used in learning units include neural networks and deep learning. A neural network is a model that mimics the neural networks of the human brain. A neural network consists of three types of layers: input layers, intermediate layers (hidden layers), and output layers.

[0094] Deep learning is a model that uses neural networks with multi-layered structures. Deep learning can repeatedly learn features in each layer and learn complex patterns hidden in large amounts of data.

[0095] For example, deep learning is used to identify objects in moving images. This includes, for instance, convolutional neural networks (CNNs) used for the recognition of images or moving images.

[0096] Furthermore, neural chips / neuromorphic chips, in which the concept of neural networks has been incorporated, can be used as the hardware structure for implementing this type of machine learning.

[0097] Furthermore, the recognition unit 17 detects the position and frame rate of objects in the image. For example, the recognition unit 17 can detect coordinate values ​​defined by the absolute coordinate system (world coordinate system) of the sphere (e.g., XYZ coordinate values), or coordinate values ​​defined by a relative coordinate system using a predetermined point as a reference (origin) (e.g., XYZ coordinate values ​​or UUVD coordinate values). It should be noted that when using a relative coordinate system, the origin as the reference can be arbitrarily set.

[0098] The display unit 18 performs processing for various displays to the user. In this embodiment, an image reproduced at a set frame rate is displayed on the display unit 18.

[0099] Furthermore, the display unit 18 processes the image data input from the signal processing unit 14, converting it to an appropriate resolution. Therefore, it displays a live view image (also called a pass-through image), which is the captured image that is waiting to be released. Additionally, based on instructions from the control unit 15, the display unit 18 displays a graphical user interface (GUI) on the screen, such as various operation menus, icons, and messages. Furthermore, the display unit 18 is capable of displaying the reproduced image read from the recording medium in the recording unit 16.

[0100] Furthermore, in this embodiment, a GUI that allows setting a frame rate region is displayed on the display unit 18.

[0101] The output unit 19 performs wired or wireless data and network communication with external information processing devices. For example, captured image data (still image files or moving image files) is sent to external display devices, recording devices, playback devices, editing devices, etc. Furthermore, the output unit 19 can function as a network communication unit. For example, it can communicate using various networks such as the Internet, home networks, and local area networks (LANs), and can send and receive various data to and from servers, terminals, etc., within the network.

[0102] The operation unit 20 is used to perform various operations and settings. For example, the operation unit 20 includes a playback menu start button, an OK button, directional keys, a cancel button, a zoom button, a slide key, a shutter button, etc., and also includes a monitor using a touch panel system. The operation unit 20 outputs operation information to the control unit 15 corresponding to various operations such as the photographer's tapping and sliding operations.

[0103] In this embodiment, the specific subject identified by the identification unit 17 can be selected by the user through the operation unit 20.

[0104] Furthermore, in this embodiment, the user can operate the GUI displayed on the display unit 18 via the operation unit 20 and set the frame rate area. For example, the user can set the position and size of the frame rate area, as well as the types of dots, lines, regions, etc.

[0105] Furthermore, in this embodiment, the user can set the frame rate of the image via the operation unit 20. For example, the user can input a frame rate value, or input the expected path, for example, by moving along a expected path that a particular subject is expected to traverse at a desired speed.

[0106] It should be noted that in this embodiment, the identification unit 17 corresponds to the identification unit for a specific subject in the image.

[0107] It should be noted that in this embodiment, the determination unit 24 corresponds to the determination unit that determines whether the distance between the specific subject being identified and the frame rate region used to set the frame rate of the image is equal to or less than a threshold.

[0108] It should be noted that in this embodiment, the frame rate region setting unit 22 corresponds to the frame rate region setting unit for setting the frame rate region.

[0109] It should be noted that in this embodiment, the frame rate setting unit 23 corresponds to the frame rate setting unit for setting the frame rate of the image.

[0110] It should be noted that in this embodiment, when the determination unit determines that the distance between a specific subject and the set frame rate area is equal to or less than a threshold, the shooting control unit 25 corresponds to the shooting control unit that controls the shooting of images at the set frame rate.

[0111] It should be noted that in this embodiment, when the determination unit determines that the distance between a specific subject and the set frame rate area is equal to or less than a threshold, the reproduction control unit 26 functions as a reproduction control unit that controls the reproduction of the image at the set frame rate.

[0112] It should be noted that in this embodiment, the operation unit 20 corresponds to the operation unit that receives user operations.

[0113] Figure 3 This is a flowchart illustrating an example of frame rate control.

[0114] The recognition unit 17 identifies a specific subject in the image (step 101).

[0115] Figure 4This is a schematic diagram illustrating an example of a GUI that enables the selection of a specific subject.

[0116] Users can select any object in the image displayed in the GUI as a specific subject through the operation unit 20. In this embodiment, the user selects the object by touching the GUI. Figure 4 The GUI 30 shown can be used to select a specific subject by displaying any object. Additionally, a menu can be displayed to present objects that can be selected as specific subjects, such as human body parts including hands, faces, and legs, balls, and basketball hoops.

[0117] In this embodiment, Figure 4 In A, the user can select human body parts such as hand 31, arm 32, head 33, torso 34, and leg 35, a ball 36, or a basketball hoop 37 as specific subjects via GUI 30. For example, the recognition unit 17 can recognize human body parts such as hand 31, arm 32, head 33, torso 34, and leg 35 through semantic segmentation, etc. In addition, the boundaries of the regions of each part can be displayed at this time.

[0118] Furthermore, during object recognition, in cases where multiple objects are identified as objects of the same kind, for example, an object may be identified by recognizing features such as a specific subject holding the object, the object being larger, or the object being better focused.

[0119] Furthermore, for example, if a preview image has already been acquired, an object that you wish to focus on can be selected in a frame of the preview image, and the selected object can be set as a specific subject.

[0120] A preview image is an image displayed on display unit 18 when a frame rate range is set, etc. For example, an image similar to the image from which the user wants to control the frame rate is a preview image. Specifically, in Figure 4 In the image, the scene of the basketball being thrown towards the hoop is a preview.

[0121] It should be noted that the method of acquiring preview images is not limited. For example, while controlling the frame rate during playback, images recorded in the recording unit 16 can be acquired as preview images. Furthermore, for example, during shooting, the user can select a scene such as motion, and preview images suitable for that scene can be displayed (including images that are not actually captured video, such as sample images of a goal scene). In this case, the user can operate while viewing the sample images, or the captured image, which is currently being actually shot, can be displayed as a preview image.

[0122] In addition, such as Figure 4As shown in B, when a specific subject makes a large movement, such as when person 38 performs a 360° flip on board 39, the specific subject can be tracked by selecting board 39 as the specific subject instead of the center of gravity of person 38.

[0123] Of course, the recognition unit 17 can automatically identify a specific subject. In this case, the GUI 60 can display the identified specific subject so that the user can recognize it.

[0124] Return to Figure 3 The frame rate region setting unit 22 sets the frame rate region (step 102).

[0125] The frame rate setting unit 23 sets the frame rate of the image (step 103).

[0126] Figure 5 This is a schematic diagram illustrating an example of frame rate settings for a frame rate region and an image frame rate. Figure 5 In the middle, a control GUI 40 that can control the frame rate is displayed on the display unit 18.

[0127] In this embodiment, the user can set the frame rate range and the frame rate of the image by touching the display unit 18, which displays the control GUI 40.

[0128] like Figure 5 As shown, a basketball game is captured by imaging device 10, and the basketball hoop 41 is displayed. Furthermore, Figure 5 It shows the moment the basketball passes through the hoop.

[0129] The user touches the display unit 18 with finger 42 and sets the frame rate area. In this embodiment, the user can set the frame rate area by tracing the expected path 43 (a line from the starting point 44 to the ending point 45) through which the basketball is expected to travel with finger 42.

[0130] Furthermore, the user can set the frame rate of the image during playback by controlling the speed of the finger 42 as it traverses the expected path 43. That is, the frame rate of the image is controlled based on the speed of the input finger 42.

[0131] For example, the frame rate set during shooting or playback is calculated based on the speed at which the user's finger 42 swipes (the speed of user input) and the speed of a specific subject during the actual shooting or playback. The specific calculation method is explained below.

[0132] Here, a method for calculating the frame rate of the controlled image based on the speed of a specific subject input by the user's finger will be explained.

[0133] To determine the controlled frame rate F for an image, the following parameters are used.

[0134] The actual velocity of a specific subject is represented by Vnow.

[0135] The velocity of a specific subject, as input by the user, is represented by Vexpected.

[0136] The frame rate of the image set by the user is represented by Fplay.

[0137] It should be noted that Vnow is obtained by the recognition unit 17. Vexpected is set by the frame rate setting unit 23. In addition, Fplay represents the frame rate preset by the user's input.

[0138] Furthermore, Vexpected represents the velocity of a specific subject at each position along the expected path 43. That is, the expected path 43 can also be described as a set of points indicating the positions of a specific subject. For example, the velocity of a specific subject input by the user at the starting point 44 can be represented by Vexpected(1). Furthermore, for example, the velocity of a specific subject input by the user at the ending point 45 can be represented by Vexpected(n).

[0139] Furthermore, the actual velocity of a specific subject corresponding to Vexpected(1) can be represented by Vnow(1). Similarly, the actual velocity of a specific subject corresponding to Vexpected(n) can be represented by Vnow(n).

[0140] Here, the expression used to determine the frame rate F of the image controlled by the control unit 15 is expressed as the following expression 1.

[0141] [Expression 1]

[0142] F = Fplay × (Vnow / Vexpected)

[0143] Regarding the frame rate set for each location along the expected path, the process (Expression 1) is performed for each frame to control the frame rate. For example, to reduce the speed of the image at a predetermined location in the frame rate region to 1 / 5, assuming the number of frames per second during playback is 24, the number of frames per second for the image at that predetermined location is controlled to 120.

[0144] In addition, this processing is performed frame by frame during shooting to control the frame rate.

[0145] Figure 6 This is a schematic diagram illustrating an example of setting the frame rate region and the frame rate of an image when a preview image has been acquired.

[0146] Figure 6 The example shown is the control GUI 40 with a pre-visualized image already acquired.

[0147] With the preview images already acquired, basketball 47 is displayed in a ghosting manner based on the user's expected path and frame rate.

[0148] Ghosting refers to the virtual display of how a specific subject moves across multiple frames, following a predetermined path defined as a frame area and a set frame rate. For example, when ghosts overlap, it indicates slow motion, while when they are separated, it indicates fast motion.

[0149] For example, in Figure 5 In the image, because the ghost images of basketballs 47 near the basket 48 are displayed overlapping each other, the frame rate of the image is controlled to be low when basketballs 47 are near the basket 48.

[0150] For in Figure 6 The frame rate control method for images in the case of pre-rehearsed images is also processed in a similar way to (Expression 1) above.

[0151] Figure 7 This is a schematic diagram illustrating an example of a control GUI 50 used to control the frame rate.

[0152] like Figure 7 As shown, the control GUI 50 displays a graph with the frame rate indicated on the vertical axis and the distance from the starting point indicated on the horizontal axis. In this embodiment, the user can adjust the frame rate in the frame rate region via the control GUI 50.

[0153] The solid line 53 connecting the starting point 51 to the ending point 52 indicates the route via Figure 5 The frame rate of the expected path 43 from the starting point 44 to the ending point 45 is shown as input to the control GUI 40.

[0154] The dashed line 54, connecting the starting point 51 to the ending point 52, indicates the range of adjustable frame rates in the image. That is, the user can adjust the frame rate so that it does not exceed the dashed line displayed in the control GUI 50.

[0155] The frame rate shown by dashed line 54 is calculated based on the actual speed of a specific subject identified by recognition unit 17. For example, the frame rate can be calculated based on the actual speed of a specific subject during shooting. Alternatively, for example, the frame rate can be calculated based on the speed of a specific subject in a preview image.

[0156] The frame rate shown by dashed line 54 can be determined using the above (Expression 1). In this case, the speed of a specific subject pre-detected by recognition unit 17 in the preview image is used as the predicted value of Vnow, where Vnow is the actual speed of the specific subject. Therefore, dashed line 54 corresponding to the determined frame rate is displayed in the control GUI 50.

[0157] Furthermore, if a preview image exists and the solid line 53 extends beyond the dashed line 54, the GUI 50 is controlled to present this situation to the user. For example, text can be presented to the user, or it can be presented in the form of sound.

[0158] In addition, the control GUI 50 displays a marker 55 indicating the position of a specific subject on the expected path. That is, the user can adjust the frame rate of a specific subject at the current position of marker 55.

[0159] like Figure 7 As shown, the control GUI 50 has an image display unit 56 that displays the frame rate area and the specific subject.

[0160] The image display unit 56 displays the expected path 43 set by the control GUI 40 and the positions (markers 55) along which a specific subject passes on the expected path. Therefore, the user can control the frame rate of a specific subject at various positions on the expected path while simultaneously viewing the marks 55 and the graphics on the expected path. Furthermore, the image display unit 56 can display preview images.

[0161] Return to Figure 3 The determination unit 24 determines whether the distance between a specific subject and the frame rate area is equal to or less than a threshold (step 104).

[0162] If the distance between a specific subject and the frame rate region is not equal to or less than the threshold (No in step 104), the frame rate of the image is not controlled until the distance between the specific subject and the frame rate region becomes equal to or less than the threshold.

[0163] If the distance between a specific subject and the frame rate region becomes equal to or less than a threshold ("Yes" in step 104), control is performed to capture or reproduce an image at the frame rate set by the capture control unit 25 and the reproduction control unit 26 (step 105). In this embodiment, the identification unit 17 identifies the position of the specific subject and the frame rate at that position.

[0164] For example, the control unit 15 controls the imaging element 13 to capture all images at a high frame rate per second. In this case, the frame rate is controlled by the capture control unit 25 or the reproduction control unit 26 through frame extraction processing, such as conversion processing. Alternatively, when capturing all images at a low frame rate per second, the frame rate can be controlled by the capture control unit 25 or the reproduction control unit 26 through adding frames, such as summation processing. Alternatively, the frame rate can be controlled by performing image compositing processing, etc.

[0165] Specifically, while controlling the frame rate of the image in real time during shooting, the shooting control unit 25 successively changes the time interval between each frame of the image being captured. That is, images captured at different time intervals are reproduced at equal time intervals during playback, so the user can see the image changing at the playback speed.

[0166] Furthermore, for example, the control unit 15 can control the shooting to be performed at a frame rate set for the imaging element 13.

[0167] Furthermore, during playback, the playback control unit 26 also performs extraction or addition processing to reproduce the image at the frame rate set by the frame rate setting unit 23 during playback.

[0168] [Shape of the frame rate region]

[0169] Figure 8 This is a schematic diagram illustrating an example of the shape of a frame rate region.

[0170] like Figure 8 As shown, the user sets a circular frame rate region by controlling the GUI 70. In this embodiment, the user can set the frame rate region by touching any point and sliding their finger 71 (an operation of moving the finger in touch mode). For example, by touching the basketball hoop 72 and sliding the finger in a predetermined direction, a circular frame rate region 73 with the distance the user moves their finger as the radius is set.

[0171] Figure 9 This is a schematic diagram of another example representing the shape of the frame rate region. Figure 9 In the image, imaging device 10 is taking wide-angle pictures of the entire stadium.

[0172] like Figure 9 As shown, the user sets a rectangular frame rate region by controlling the GUI 70. In this embodiment, the user can set the frame rate region by touching a predetermined location and sliding their finger 74. For example, in Figure 9 In the process, a rectangular frame rate region 75 is set whose diagonal corresponds to the distance the user moves their finger, by having the user touch a predetermined point and slide their finger in a predetermined direction.

[0173] In addition, the user can set the center coordinates of the frame rate region 75. If the user does not set them, the center coordinates of the frame rate region 75 are set at the centroid of the frame rate region. Furthermore, for the circular frame rate region 73, the center coordinates (any point touched) are set to the center.

[0174] It should be noted that there are no restrictions on the method for setting the frame rate region. For example, for a circular frame rate region, the coordinates and radius can be input numerically. Alternatively, the frame rate region can be set by having the user trace the shape (boundary) of the region with their finger.

[0175] [Example of frame rate control]

[0176] Figure 10 This is a schematic diagram illustrating an example of a GUI for controlling the frame rate within a frame rate region. Figure 10 In the control GUI80, a graphic indicating the frame rate control in the frame rate area and the expected path 81 corresponding to the graphic are displayed.

[0177] In this embodiment, the control unit 15 controls the frame rate of the image based on the position of a specific subject determined by the determination unit 24 and the position of the center coordinates 83 set within the frame rate region 82. Furthermore, the user can control the frame rate corresponding to the path from the boundary of the frame rate region 82 to the center coordinates 83 of the frame rate region via the control GUI 80.

[0178] like Figure 10 As shown, the control GUI 80 displays a graph with the frame rate indicated on the vertical axis and the distance from the starting point indicated on the horizontal axis. Furthermore, in this embodiment, the frame rate of the image is controlled such that it increases as a specific subject approaches the center coordinates from the boundary of the frame rate region.

[0179] Here, the normal frame rate is the usual frame rate when reproducing an image. For example, in the case of reproducing an image at a rate of 60 frames per second, 60 frames per second is the normal frame rate.

[0180] For example, the user can set the frame rate value near the boundary of the frame rate region 82, the distance between the boundary and the center coordinate 83, the rate of increase (decrease) of the frame rate, and the frame rate value at the center coordinate 83 by controlling GUI 80.

[0181] Furthermore, in this embodiment, since the frame rate is set to be the same at positions 84 (85) where the distance between the center coordinate 83 and the frame rate region 82 is the same, one graphic is displayed for the frame rate region 82. Therefore, if the frame rate is set differently between the path 81 from the boundary of the frame rate region 82 to the center coordinate 83 and the path 87 from the center coordinate 83 to the boundary of the frame rate region 82, two graphics are displayed.

[0182] It should be noted that there are no restrictions on the methods used to control the frame rate. For example, methods as described later can be used. Figure 11 , 12 The methods shown in 13 and 14.

[0183] Figures 11-14 This is a schematic diagram illustrating an example of frame rate control.

[0184] Figures 11-14 The graph shown is plotted with frame rate on the vertical axis and distance from the starting point on the horizontal axis.

[0185] exist Figure 11 In the control example shown, when a specific subject exceeds the boundary of the frame rate region, the frame rate of the image is controlled to a set frame rate within the frame rate region.

[0186] In this embodiment, the determination unit 24 determines whether a specific subject exceeds the boundary of the frame rate region. For example, the determination unit 24 determines whether the center of gravity of the specific subject exceeds the frame rate region. If the center of gravity of the specific subject has exceeded the frame rate region, the control unit 15 changes the frame rate of the image to [a different value]. Figure 11 The frame rate shown.

[0187] exist Figure 12 In the control example shown, when a subject crosses the boundary of the frame rate region, the frame rate of the image is set to change in a stepwise manner as the subject approaches the center coordinates of the frame rate region. For example, the frame rate is set to gradually increase as the subject approaches the center coordinates. Alternatively, the frame rate can be set to gradually decrease as the subject moves further away from the center coordinates.

[0188] For example, a user might be able to control how many steps the frame rate should take to approach a set value via a GUI, or the control unit 15 could calculate the frame rate as needed. Furthermore, for example, such as... Figure 12 The relationship between distance and frame rate shown is pre-recorded in the recording unit 16 as a table, and the control unit 15 can control the frame rate of the image based on the table.

[0189] exist Figure 13 and Figure 14 In the control example shown, when a specific subject has crossed the boundary of the frame rate region, the frame rate of the image is set to change continuously as the specific subject approaches the center coordinates of the frame rate region. For example, the frame rate is set such that the slope of a straight line becomes steeper as the specific subject approaches the center coordinates. Furthermore, for example, the frame rate is set such that the slope of a straight line becomes gentler as the specific subject moves further away from the center coordinates. Additionally, for example, the user can control the slope of the straight line and curve as they approach the set frame rate value by increasing or decreasing the slope. That is, the coefficients of the straight line or curve are changed.

[0190] In addition, such as Figure 13 The relationship between distance and frame rate shown can be pre-recorded in the recording unit 16 as a table, and the control unit 15 can control the frame rate of the image based on the table.

[0191] Above, in the imaging apparatus 10 according to this embodiment, a specific subject in the image is identified. It is determined whether the distance between the identified specific subject and the frame rate region used to set the frame rate of the image is equal to or less than a threshold. Therefore, the frame rate of the image can be easily controlled.

[0192] Generally, for scenes that are intended to be presented impressively in video, methods such as the RAMP effect, which gradually changes the frame rate of moving images, are sometimes used. To achieve a smooth presentation, the frame rate during imaging needs to be dynamically changed. For such shooting, the scene to be filmed is decided in advance, a rehearsal is performed, and a target frame rate and the time to reach that frame rate are set. In this case, the timing must be correctly adjusted for the movement of objects, making it difficult to capture the desired moving images.

[0193] Therefore, in this technology, users can input the frame rate of a specific subject by traversing a desired path. Consequently, compared to existing technologies, images can be captured, reproduced, and edited more easily through more intuitive input.

[0194] <Other Embodiments>

[0195] This technology is not limited to the above embodiments and can be implemented in various other ways.

[0196] In the above embodiment, the imaging device 10 controls the frame rate of the image during capture and playback. This technology is not limited to this. The captured image can be sent to an external information processing device, which can then control the image frame rate.

[0197] Figure 15 This is a block diagram illustrating an example of the functional configuration of an information processing device.

[0198] like Figure 15 As shown, the information processing device 100 includes a control unit 15, a recording unit 16, an identification unit 17, a display unit 18, an output unit 19, and an operation unit 20.

[0199] The information processing apparatus 100 includes editing devices such as PCs and smartphones, and playback devices such as monitors. For example, in the case of an editing device or a playback device, the imaging device 10 can provide an image signal and can control the frame rate relative to the image signal. Furthermore, for example, a signal instructing the playback device to be controlled to have a frame rate set by the editing device can be provided, and the playback device can control the frame rate according to that signal.

[0200] It should be noted that since each block undergoes similar processing as the blocks mounted on the imaging device 10, the description will be omitted.

[0201] For example, the information processing device 100 is connected to communicate with the imaging device 10, which captures images, via the output unit 19, either wired or wirelessly. The connection method between the devices is not limited; for example, wireless LAN communication such as Wi-Fi or near-field communication such as Bluetooth (registered trademark) can be used.

[0202] For example, captured image signals or reproduced image signals can be received from the imaging device 10, and the frame rate of the image signals received by the information processing device 100 can be controlled. Furthermore, for example, reproduced image signals recorded in a recording device such as a secure digital (SD) card can be read.

[0203] Furthermore, for example, the frame rate of the captured image signal or the reproduced image signal can be controlled. In this case, the control unit 15 performs frame rate extraction or summation processing on the recorded image and reproduces the image at the set frame rate.

[0204] Furthermore, for example, captured or reproduced images whose frame rate has been controlled by the imaging device 10 or the information processing device 100 can be displayed on the display unit of an external device.

[0205] In the above embodiments, the frame rate is controlled according to the distance between a specific subject and the frame rate region. This technology is not limited to this. Interpolation can be performed when the actual position of a specific subject deviates from the position of the frame rate region during shooting. In other words, interpolation can be performed when the actual movement (path) of a specific subject during shooting deviates from the set path (expected path) of the frame rate region.

[0206] For example, when shooting or reproducing at a set frame rate, if a specific subject deviates from the frame rate range, the control unit 15 can control the frame rate of the image through nearest neighbor interpolation, quadratic interpolation, etc.

[0207] In the above embodiments, the frame rate of the image is controlled based on the speed of a specific subject input by the user's finger. This technology is not limited to this; the user can input a numerical value for the image's frame rate.

[0208] The images described above are captured and reproduced at a set frame rate. This technology is not limited to this. If the user cannot actually capture and reproduce images at the set frame rate, the following calculations can be performed.

[0209] In the above embodiment, the frame rate is input according to the speed of the user's finger movement. This technology is not limited to this; buttons with arbitrarily changeable values ​​can be displayed in the control GUI.

[0210] In the above embodiment, only one frame rate region is set. This technology is not limited to this; multiple frame rate regions can be set. For example, two frame rate regions including the basketball hoop can be set. In this case, when the basketball, as a specific subject, approaches each frame rate region, an image can be captured and reproduced at the set frame rate. Furthermore, in this case, different frame rates can be set for the frame rate regions including the basketball hoop.

[0211] Furthermore, for example, when multiple frame rate regions overlap, the control unit 15 can control the image frame rate based on the frame rate of the frame rate region where a specific subject is closer to the center coordinates of the frame rate region. Additionally, for example, the control unit 15 can take a weighted arithmetic mean of the frame rates based on the distances between the center coordinates of the multiple frame rate regions and the specific subject.

[0212] In the above embodiment, the frame rate is controlled for sports such as basketball. This technology is not limited to this and can be used in any field. For example, the frame rate zone could include a wedding cake, and the frame rate could be controlled to a set frame rate as people approach to cut the cake.

[0213] Figure 16 This is a block diagram illustrating an example of the hardware configuration of the information processing device 100.

[0214] The information processing device 100 includes a CPU 101, a ROM 102, a RAM 103, an input / output interface 105, and a bus 104 interconnecting them. A display unit 106, an input unit 107, a storage unit 108, a communication unit 109, a drive unit 110, etc., are connected to the input / output interface 105.

[0215] Display unit 106 may be a display device using liquid crystal, EL, or the like. Input unit 107 may include, for example, a keyboard, an indicator device, a touch panel, and other operating devices. When input unit 107 includes a touch panel, the touch panel may be integrated with display unit 106.

[0216] Storage unit 108 is a non-volatile storage device, such as an HDD, flash memory, and other solid-state storage devices. Drive unit 110 is, for example, a device capable of driving removable recording media 111 such as optical recording media and magnetic recording tape.

[0217] The communication unit 109 includes modems, routers, and other communication devices for communicating with other devices that can be connected to a LAN, WAN, etc. The communication unit 109 can perform wired communication or wireless communication. The communication unit 109 is typically used separately from the information processing device 100.

[0218] The software stored in the storage unit 108, ROM 102, etc., cooperates with the hardware resources of the information processing device 100 to realize information processing by the information processing device 100 having the above-described hardware configuration. Specifically, the information processing method according to this technology is realized by loading the program constituting the software stored in the ROM 102, etc., into the RAM 103 and executing the program.

[0219] The program may be installed in the information processing device 100, for example, via recording medium 111. Alternatively, the program may be installed in the information processing device 100 via a global network or the like. Furthermore, any computer-readable non-transitory storage medium may be used.

[0220] By collaborating with a computer mounted on a communication terminal and other computers that can communicate with it via a network, an imaging apparatus, an information processing apparatus, an information processing method and program according to the present technology can be performed, and an information processing system according to the present technology can be constructed.

[0221] That is, the imaging apparatus, information processing apparatus, information processing method, and program according to this technology can be performed not only in a computer system consisting of a single computer, but also in a computer system in which multiple computers operate collaboratively. It should be noted that in this disclosure, a system means a group of multiple components (devices, modules (parts), etc.), and it is not important whether all components are housed in the same housing. Thus, multiple devices housed in separate housings and interconnected via a network, as well as a single device having multiple modules housed in one housing, are both systems.

[0222] Imaging devices, information processing devices, information processing methods, and programs according to this technology are performed via computer systems. Examples include cases where a single computer performs specific subject identification, frame rate setting, and frame rate control, and cases where different computers perform various processes. Furthermore, performing various processes by a predetermined computer includes having other computers perform some or all of these processes and obtaining the results.

[0223] That is, the imaging device, information processing device, information processing method and program according to this technology can also be applied to a cloud computing configuration in which multiple devices share and collaboratively process a function via a network.

[0224] The various components, such as the frame rate region setting unit 22, the determination unit 24, and the frame rate setting unit 23, as well as the control flow of the communication system, described with reference to the accompanying drawings are merely embodiments and can be modified arbitrarily without departing from the essence of this technology. That is, any other components, algorithms, etc., used to implement this technology can be employed.

[0225] It should be noted that the effects described in this disclosure are merely exemplary and not limiting, and other effects may be provided. The above description of multiple effects does not necessarily mean that all of these effects are provided simultaneously. This means that, depending on conditions, at least one of the above effects will be obtained, and of course, effects not described in this disclosure may also be provided.

[0226] At least two features from the above embodiments can be combined. That is, the various features described in the various embodiments can be arbitrarily combined across the various embodiments.

[0227] It should be noted that this technology can also be configured as follows.

[0228] (1) An imaging device, comprising:

[0229] A recognition unit that identifies a specific subject in an image; and

[0230] The determination unit determines whether the distance between the identified specific subject and the frame rate region used to set the frame rate of the image is equal to or less than a threshold.

[0231] (2) The imaging device according to (1) further includes

[0232] A frame rate region setting unit that sets the frame rate region.

[0233] (3) The imaging apparatus according to (1) or (2) further includes

[0234] A frame rate setting unit that sets the frame rate of the image.

[0235] (4) The imaging device according to (2) further includes

[0236] The shooting control unit controls the shooting to capture an image at a set frame rate when the determination unit determines that the distance between the specific subject and the set frame rate area is equal to or less than a threshold.

[0237] (5) The imaging device according to (2) further includes

[0238] A reproduction control unit, which controls the reproduction of an image at a set frame rate when the determination unit determines that the distance between the specific subject and the set frame rate region is equal to or less than a threshold.

[0239] (6) The imaging apparatus according to (2), wherein

[0240] The frame rate region setting unit sets the frame rate region as a point.

[0241] (7) The imaging apparatus according to (2), wherein

[0242] The frame rate region setting unit sets the frame rate region to a line.

[0243] (8) The imaging apparatus according to (2), wherein

[0244] The frame rate region setting unit sets the frame rate region to a region with a predetermined range.

[0245] (9) The imaging apparatus according to (4), wherein

[0246] The frame rate region setting unit sets multiple frame rate regions, each designated as a frame rate region, and

[0247] If the determination unit determines that the distance between the specific subject and each of the set plurality of frame rate regions is equal to or less than a threshold, the shooting control unit performs control to shoot an image at a set frame rate.

[0248] (10) The imaging apparatus according to (5), wherein

[0249] The frame rate region setting unit sets multiple frame rate regions, and

[0250] When the determination unit determines that the distance between the specific subject and each of the set plurality of frame rate regions is equal to or less than a threshold, the reproduction control unit performs control to reproduce the image at the set frame rate.

[0251] (11) The imaging apparatus according to (4), wherein

[0252] The frame rate region setting unit sets the frame rate region to a region with a predetermined range, and

[0253] When the determination unit determines that the specific subject is within the set frame rate range, the shooting control unit performs control to capture an image at the set frame rate.

[0254] (12) The imaging apparatus according to (5), wherein

[0255] The frame rate region setting unit sets the frame rate region to a region with a predetermined range, and

[0256] When the determination unit determines that the specific subject is within the range of the set frame rate region, the reproduction control unit performs control to reproduce the image at the set frame rate.

[0257] (13) The imaging apparatus according to (2) further includes:

[0258] The operation unit that receives user operations, wherein

[0259] The frame rate region setting unit sets the frame rate region according to the user's operation on the operation unit.

[0260] (14) The imaging apparatus according to (3) further includes

[0261] The operation unit that receives user operations, wherein

[0262] The frame rate setting unit sets the frame rate of the image according to the user's operation on the operation unit.

[0263] (15) The imaging apparatus according to (3), wherein

[0264] The frame rate setting unit sets the frame rate according to the distance between the specific subject and the frame rate region, so that the frame rate changes in a stepwise manner.

[0265] (16) The imaging apparatus according to (3), wherein

[0266] The frame rate setting unit sets the frame rate according to the distance between the specific subject and the frame rate region, so that the frame rate changes continuously.

[0267] (17) An information processing apparatus, comprising:

[0268] A recognition unit that identifies a specific subject in an image; and

[0269] The determination unit determines whether the distance between the identified specific subject and the frame rate region used to set the frame rate of the image is equal to or less than a threshold.

[0270] (18) An information processing method, comprising:

[0271] Through computer system

[0272] Identify specific subjects in an image; and

[0273] Determine whether the distance between the identified specific subject and the frame rate region used to set the image frame rate is equal to or less than a threshold.

[0274] (19) A program that causes a computer system to perform:

[0275] The steps to identify a specific subject in an image; and

[0276] The step of determining whether the distance between a specific subject being identified and the frame rate region used to set the frame rate of the image is equal to or less than a threshold.

[0277] List of reference numerals

[0278] 10 Imaging Devices

[0279] 20 operating units

[0280] 22 Frame Rate Region Setting Unit

[0281] 23 Frame Rate Setting Unit

[0282] 24 Decision Units

[0283] 25. Camera Control Unit

[0284] 26 Reproduction Control Unit

[0285] 40 Controlling the GUI

[0286] 100 Information Processing

Claims

1. An imaging device, comprising: A frame rate region setting unit, configured to set a frame rate region for setting the frame rate of an image; A recognition unit is configured to recognize a specific subject in the image; as well as The determination unit is configured to determine whether the distance between the identified specific subject and a set frame rate region is equal to or less than a threshold. The frame rate region setting unit sets the frame rate region based on user operations within the user interface. The user's actions include drawing a line. When the distance between the specific subject and the set frame rate region is equal to or less than the threshold, the frame rate of the image is set according to the position of the specific subject and the position of the center coordinates set within the set frame rate region.

2. The imaging device according to claim 1, further comprising: A frame rate setting unit configured to set the frame rate of the image.

3. The imaging apparatus according to claim 2, wherein the frame rate setting unit sets the frame rate of the image based on the speed at which the user draws the line.

4. The imaging apparatus according to claim 1, further comprising: A shooting control unit is configured to control the shooting to capture an image at a set frame rate when the determination unit determines that the distance between the specific subject and the set frame rate region is equal to or less than a threshold.

5. The imaging apparatus according to claim 1, further comprising: A reproduction control unit is configured to control the reproduction of an image at a set frame rate when the determination unit determines that the distance between the specific subject and the set frame rate region is equal to or less than a threshold.

6. The imaging apparatus according to claim 1, wherein The frame rate region setting unit sets the frame rate region based on the start and end points of the line.

7. The imaging apparatus according to claim 1, wherein The frame rate region setting unit sets the frame rate region to a region with a predetermined range indicated by the drawn line.

8. The imaging apparatus according to claim 4, wherein The frame rate region setting unit sets multiple frame rate regions, each designated as a frame rate region, and If the determination unit determines that the distance between the specific subject and each of the set plurality of frame rate regions is equal to or less than a threshold, the shooting control unit performs control to shoot an image at a set frame rate.

9. The imaging apparatus according to claim 5, wherein The frame rate region setting unit sets multiple frame rate regions, and When the determination unit determines that the distance between the specific subject and each of the set plurality of frame rate regions is equal to or less than a threshold, the reproduction control unit performs control to reproduce the image at the set frame rate.

10. The imaging apparatus according to claim 4, wherein The frame rate region setting unit sets the frame rate region to a region with a predetermined range, and When the determination unit determines that the specific subject is within the set frame rate range, the shooting control unit performs control to capture an image at the set frame rate.

11. The imaging apparatus according to claim 5, wherein The frame rate region setting unit sets the frame rate region to a region with a predetermined range, and When the determination unit determines that the specific subject is within the range of the set frame rate region, the reproduction control unit performs control to reproduce the image at the set frame rate.

12. The imaging apparatus according to claim 1 or 2, further comprising: An operation unit configured to receive the user's operation.

13. The imaging apparatus according to claim 2, wherein The frame rate setting unit sets the frame rate according to the distance between the position of the specific subject and the center coordinates set in the frame rate area, so that the frame rate changes in a stepwise manner.

14. The imaging apparatus according to claim 2, wherein The frame rate setting unit sets the frame rate according to the distance between the specific subject and the frame rate region, so that the frame rate changes continuously.

15. An information processing apparatus, comprising: A frame rate region setting unit, configured to set a frame rate region for setting the frame rate of an image; A recognition unit is configured to recognize a specific subject in the image; as well as The determination unit is configured to determine whether the distance between the identified specific subject and a set frame rate region is equal to or less than a threshold. The frame rate region setting unit sets the frame rate region based on user operations within the user interface. The user's actions include drawing a line. When the distance between the identified subject and the set frame rate region is equal to or less than the threshold, the frame rate of the image is set according to the position of the identified subject and the position of the center coordinates of the line that sets the frame rate region.

16. An information processing method executed by a computer system, the method comprising: Set the frame rate range used to set the frame rate of the image; Identify a specific subject in the image; as well as Determine whether the distance between the identified specific subject and the set frame rate area is equal to or less than a threshold; The frame rate range is set based on the user's actions within the user interface. The user's actions include drawing a line, and When the distance between the identified subject and the set frame rate region is equal to or less than the threshold, the frame rate of the image is set according to the position of the identified subject and the position of the center coordinates set within the set frame rate region.

17. A computer program product comprising a program that causes a computer system to perform a method, the method comprising: Set the frame rate range used to set the frame rate of the image; Identify a specific subject in the image; as well as Determine whether the distance between the identified specific subject and the set frame rate area is equal to or less than a threshold; The frame rate range is set based on the user's actions within the user interface. The user's actions include drawing a line. When the distance between the identified subject and the set frame rate region is equal to or less than the threshold, the frame rate of the image is set according to the position of the identified subject and the position of the center coordinates set within the set frame rate region.

Images