Information processing device, information processing method, and program

Abstract

To simplify control of an imaging range in which a subject is positioned at a place desired by a user in the imaging range.SOLUTION: An information processing device includes: acquisition means for acquiring an image imaged by the imaging means, display control means for displaying the image acquired by the acquisition means on the display means; and control means for controlling an imaging range of the imaging means. The display control means displays information on a first arrangement candidate in which a subject in the imaging range is arranged at a first position and the information on a second arrangement candidate in which the subject in the imaging range is arranged in a second position different from the first position on the display means. The control means controls the imaging range based on the information on the arrangement candidate chosen by the user out of the first arrangement candidate and the second arrangement candidate.SELECTED DRAWING: Figure 6

Description

[Technical field]

[0001] The present invention relates to an information processing method. [Background technology]

[0002] Currently, in the video production market, systems that remotely control imaging devices connected to a network are on the rise. In such systems, there are applications that can change the imaging range (hereinafter referred to as the imaging range) of an imaging device by controlling the PTZ (pan-tilt-zoom) of the imaging device while displaying images captured by the imaging device. Users of the application can change the imaging range using a device such as a joystick.

[0003] As a method for controlling the imaging range of an imaging device, there is a method for controlling PTZ based on the position and size of a subject. Patent Document 1 discloses that in order to capture an image of a subject in a desired imaging range, the ratio between the entire area of ​​the subject and a partial area of ​​the subject (such as the head) is calculated, and the zoom magnification is controlled so that the calculated ratio remains constant according to the zoom operation. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2011-209620 A Summary of the Invention [Problem to be solved by the invention]

[0005] In video production, there are cases where a cameraman wants to control the imaging range so that the subject is positioned at a desired location within the imaging range while being conscious of the composition within the angle of view. In this case, it is cumbersome for the user to use a joystick to control the PTZ while controlling the imaging range so that the subject is positioned at a desired location within the imaging range.

[0006] Therefore, an object of the present invention is to simplify control of the imaging range so that the subject is positioned in a location desired by the user within the imaging range. [Means for solving the problem]

[0007] In order to solve the above problems, for example, an information processing device of the present invention has the following configuration: That is, the device has an acquisition means for acquiring an image captured by an imaging means, a display control means for displaying the image acquired by the acquisition means on a display means, and a control means for controlling an imaging range of the imaging means, the display control means displays on the display means information on a first arrangement candidate in which a subject in the imaging range is arranged at a first position and information on a second arrangement candidate in which the subject in the imaging range is arranged at a second position different from the first position, and the control means controls the imaging range based on information on an arrangement candidate selected by a user from the first arrangement candidate and the second arrangement candidate. Effect of the Invention

[0008] According to the present invention, it is possible to easily control the imaging range so that the subject is positioned in the imaging range at a location desired by the user. [Brief description of the drawings]

[0009] [Figure 1] FIG. 1 illustrates an example of a system. [Diagram 2] FIG. 1 is a diagram illustrating an example of the appearance of an imaging device. [Diagram 3] FIG. 2 is a diagram illustrating functional blocks of the imaging apparatus. [Figure 4] FIG. 2 is a diagram illustrating functional blocks of the information processing device. [Diagram 5] 13 is a flowchart showing a process for displaying arrangement candidates. [Figure 6] FIG. 13 is a diagram showing an example of an image and arrangement candidates displayed on a display. [Figure 7] FIG. 13 is a diagram for explaining displayed arrangement candidates. [Figure 8] 10 is a flowchart showing a flow of a process for controlling an imaging range. [Figure 9] FIG. 13 is a diagram showing an example of an image and arrangement candidates displayed on a display. [Figure 10] FIG. 2 is a diagram illustrating a hardware configuration of each device. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0010] Hereinafter, an embodiment of the present invention will be described with reference to the accompanying drawings. Note that the configurations shown in the following embodiments are merely examples and are not limited to the configurations shown in the drawings.

[0011] (Embodiment 1) 1 is a diagram showing the system configuration of this embodiment. The system of this embodiment includes an image capturing device 100, an information processing device 200, a display 400, and a network 300.

[0012] The imaging device 100 and the information processing device 200 are connected to each other via a network 300. The network 300 is realized by a plurality of routers, switches, cables, etc., that comply with a communication standard such as ETHERNET (registered trademark).

[0013] The network 300 may be realized by the Internet, a wired LAN (Local Area Network), a wireless LAN (Wireless LAN), a WAN (Wide Area Network), or the like.

[0014] The imaging device 100 is a device that captures an image, and functions as an imaging unit capable of controlling the imaging range. The imaging device 100 transmits image data of the captured image, information on the imaging date and time when the image was captured, identification information for identifying the imaging device 100, and information on the imaging range of the imaging device 110 to an external device such as an information processing device 200 via a network 300. The information processing device 200 is, for example, a client device such as a personal computer in which a program for realizing the function of the processing described later is installed. Note that in the system according to the present embodiment, the imaging device 100 is one, but may be multiple. That is, multiple imaging devices 100 may be connected to the information processing device 200 via the network 300. In this case, the information processing device 200 determines which of the multiple imaging devices 100 captured the transmitted image, for example, by using identification information associated with the transmitted image.

[0015] The display 400 is configured with an LCD (Liquid Crystal Display) or the like, and displays images captured by the imaging device 100. The display 400 is connected to the information processing device 200 via a display cable that complies with a communication standard such as HDMI (High Definition Multimedia Interface) (registered trademark). The display 400 and the information processing device 200 may be provided in a single housing.

[0016] Next, the imaging device 100 according to this embodiment will be described with reference to Fig. 2 and Fig. 3. Fig. 2 is an example of an external view of the imaging device 100 according to this embodiment. Fig. 3 is an example of functional blocks of the imaging device 100 and the information processing device 200 according to this embodiment. Among the functional blocks of the imaging device 100 shown in Fig. 3, the functions of the image processing unit 112, the system control unit 113, the pan-tilt-zoom control unit 114, the storage unit 115, the communication unit 116, etc. are realized as follows. That is, they are realized by a CPU (Central Processing Unit) 1000 of the imaging device 100 executing a computer program stored in a ROM (Read Only Memory) 1020 of the imaging device 100, which will be described later with reference to Fig. 10.

[0017] The direction in which the optical axis of the lens 101 faces is the imaging direction of the imaging device 100, and a light beam that passes through the lens 101 forms an image on an imaging element of an imaging section 111 of the imaging device 100. In addition, the lens driving section 102 is configured with a drive system that drives the lens 101, and changes the focal length of the lens 101. The lens driving section 102 is controlled by a pan-tilt-zoom control section 114.

[0018] The pan driving unit 103 is composed of a mechanical driving system that performs panning and a motor that is a driving source, and drives to perform control to perform rotational driving for rotating the imaging direction of the imaging device 100 in a pan direction 105. The pan driving unit 103 is also controlled by a pan-tilt-zoom control unit 114.

[0019] The tilt driving unit 104 is composed of a mechanism driving the tilt operation and a motor of a driving source, and drives to control rotation driving for rotating the imaging direction of the imaging device 100 in a tilt direction 106. The tilt driving unit 104 is controlled by a pan-tilt-zoom control unit 114.

[0020] The imaging unit 111 is composed of an imaging element (not shown) such as a CCD (charge coupled device) sensor or a CMOS (complementary metal oxide semiconductor) sensor. The imaging unit 111 photoelectrically converts the subject image formed through the lens 101 to generate an electric signal. The image processing unit 112 performs image processing such as a process of converting the electric signal photoelectrically converted in the imaging unit 111 into a digital signal and a compression encoding process to generate image data.

[0021] The pan-tilt-zoom control unit 114 controls the pan driving unit 103, the tilt driving unit 104, and the lens driving unit 102 based on instructions transmitted from the system control unit 113, thereby controlling the pan, tilt, and zoom of the imaging device 100.

[0022] The storage unit 115 stores (holds) information indicating, for example, an imaging range. The communication unit 116 communicates with the information processing device 200 via an I / F 1040, which will be described later with reference to FIG. 10. For example, the communication unit 116 transmits image data of an image captured by the imaging device 100 to the information processing device 200 via the network 300. The communication unit 116 also transmits information indicating the imaging range of the imaging device 100. The communication unit 116 also receives a control command, which is a command for controlling the imaging device 100 transmitted from the information processing device 200, and transmits the control command to the system control unit 113.

[0023] The system control unit 113 controls the entire imaging device 100 in accordance with processing executed by the CPU 1000, which will be described later with reference to Fig. 10, and performs, for example, the following processing. That is, the system control unit 113 analyzes a control command for controlling the imaging device 100 transmitted from the information processing device 200, and performs processing according to the control command. The system control unit 113 also instructs the pan-tilt-zoom control unit 114 to perform a pan-tilt-zoom operation. When transmitting image data generated by the image processing unit 112 to the information processing device 200, the system control unit 113 also adds information about the imaging time when the image data was captured to the image data.

[0024] The imaging range in this embodiment is determined by the pan value, tilt value, and zoom value of the imaging device 100. The pan value is the angle of the imaging direction (optical axis) in the pan direction 105 of the imaging device 100 when one of the drive ends of the pan drive unit 103 is set to 0°. The tilt value is the angle of the imaging direction (optical axis) in the tilt direction 106 of the imaging device 100 when one of the drive ends of the tilt drive unit 104 is set to 0°. The zoom value of the imaging device 100 when an image is captured by the imaging device 100 is calculated from the focal length of the lens 101.

[0025] Here, the information processing of the information processing device 200 according to this embodiment will be described with reference to the functional blocks of the information processing device 200 shown in Fig. 4. Note that each function of the information processing device 200 is realized as follows using a ROM 1020 and a CPU 1000, which will be described later with reference to Fig. 10. That is, each function shown in Fig. 4 is realized by the CPU 1000 of the information processing device 200 executing a computer program stored in the ROM 1020 of the information processing device 200.

[0026] The communication unit 201 acquires image data transmitted from the imaging device 100 via an I / F 1040, which will be described later with reference to Fig. 10. The recording unit 201 can be realized by a random access memory (RAM) 1010, a hard disk drive (HDD) 1030, etc., which will be described later with reference to Fig. 10, and records information and data related to information processing by the information processing device 200. For example, the recording unit 201 records information related to the position of a subject detected from an image. The recording unit 201 also records controllability information, which is information indicating which of a pan value, a tilt value, and a zoom value the imaging device 100 can control.

[0027] The detection unit 203 executes a detection process to detect a subject in an image acquired by the communication unit 201. The detection unit 202 in this embodiment detects a person as a subject included in an image by performing a process such as pattern matching using a matching pattern (dictionary). Note that when detecting a person from an image, a person may be detected from the image using multiple matching patterns, such as a matching pattern when the person is facing forward and a matching pattern when the person is facing sideways. In this way, by executing a detection process using multiple matching patterns, it is expected that the detection accuracy will be improved.

[0028] It is also possible to prepare a matching pattern when viewing a person from other angles, such as from an oblique direction or from above. When detecting a person from an image, it is not always necessary to prepare a matching pattern (dictionary) showing the characteristics of the entire body, and matching patterns may be prepared for parts of a person, such as the upper body, lower body, head, face, and legs.

[0029] In this embodiment, a person is detected as a subject detected from an image, but the subject is not limited to a person and may be other objects such as a car. In addition, the detection unit 203 in this embodiment uses a pattern matching process as a method for detecting a specific object from an image, but a specific object may be detected from an image using other conventional techniques.

[0030] The identification unit 204 identifies a subject included in an image as a criterion for controlling the imaging range of the imaging device 100. The imaging range of the imaging device 100 is controlled based on the subject (person) in the image identified by the identification unit 204. A detailed description of the process of identifying a subject included in an image by the identification unit 204 as a criterion for controlling the imaging range will be given later.

[0031] The operation receiving unit 205 receives operations performed by the user via an input device (not shown) such as a keyboard or a mouse. The display control unit 206 causes the image acquired by the communication unit 201 to be displayed on the display 400. Furthermore, the display control unit 206 in this embodiment causes the display 400 to display a plurality of arrangement candidates indicating candidates for arranging the subject in the imaging range. The arrangement candidates displayed by the display control unit 206 will be described in detail later.

[0032] The range control unit 207 executes a process of controlling the imaging range of the imaging device 100. Specifically, the range control unit 207 generates a control command for changing at least one of the pan value, tilt value, and zoom value of the imaging device 100, and transmits the control command to the imaging device 100 via the communication unit 201. The imaging device 100 controls the imaging range according to the transmitted control command. For example, when the operation reception unit 205 receives a user instruction to change the pan value of the imaging device 100 by a predetermined value in the pan direction 105, the range control unit 207 executes the following process. That is, the range control unit 207 generates a control command for changing the pan value by a predetermined value in the pan direction 105, and transmits the control command to the imaging device 100 via the communication unit 201. The imaging device 100 changes the pan angle by a predetermined angle in the pan direction 105 by controlling the pan driving unit 103 according to the acquired control command.

[0033] 5 to 8, a process of generating a plurality of arrangement candidates and displaying them on the display 400 will be described. Fig. 5 is a flowchart showing the flow of a process of generating a plurality of arrangement candidates and displaying them on the display 400.

[0034] In step S501, the display control unit 206 determines whether or not there is a subject identified by the identification unit 204 as a reference for controlling the imaging range. If it is determined that there is a person identified by the identification unit 204 (Yes in S501), the process proceeds to S502, and if it is determined that there is no person identified (No in S501), the process of S501 is repeated. Here, a process of identifying a subject (hereinafter, a reference subject) as a reference for controlling the imaging range by the identification unit 204 will be described. For example, the detection unit 203 executes a detection process for detecting a subject in an image, and the display control unit 206 causes a frame indicating the position of the detected subject to be superimposed on the image and displayed on the display 400. Then, when the operation reception unit 205 receives a user operation for selecting at least one of the frames displayed superimposed on the image, the identification unit 204 identifies the subject corresponding to the frame selected according to the user operation as the reference subject. For example, when four people are detected as subjects from a captured image by the detection unit 203, the display control unit 206 superimposes circumscribing rectangular frames for each of the detected four people on the image and displays them on the display 400. Then, when a user operation is received to select a frame corresponding to a certain person from among the frames superimposed on each of the four people, the identification unit 204 identifies the certain person corresponding to the selected frame as the reference subject.

[0035] Next, in S502, the display control unit 206 judges whether the number of reference subjects specified in S501 is 1. If it is judged that the number of the reference subjects specified is 1 (Yes in S502), the process proceeds to S503, and if it is judged that the number of the reference subjects specified is not 1 (No in S502), the process proceeds to S504. In S503, the display control unit 206 displays information on arrangement candidates for one person on the display 400. The information on the arrangement candidates will be described later with reference to FIG. 6. In S504, the display control unit 206 judges whether the number of the reference subjects specified is two people. If it is judged that the number of the reference subjects specified is two people (Yes in S504), the process proceeds to S505, and if it is judged that the number of the reference subjects specified is not two people (No in S504), the process proceeds to S506. In S505, the display control unit 206 displays information on arrangement candidates for two people on the display 400. In S506, the display control unit 206 causes the display 400 to display layout candidates in which all the people fit within the angle of view.

[0036] Here, with reference to Figs. 6(a)-(b), the information on the arrangement candidates displayed by the display control unit 206 on the display 400 will be described. The display control unit 206 in this embodiment causes the display 400 to display a display window 601 including an image display area 602 in which an image captured by the imaging device 100 is displayed, and a candidate display area 605 in which a plurality of arrangement candidates are displayed. Note that the display control unit 206 may cause the image display area 602 and the candidate display area 605 to be displayed separately in different windows on the display 400. Also, as shown in Fig. 6(a), an image including a person 604 identified by the identification unit 204 as a reference subject is displayed in the image display area 206. At this time, the display control unit 206 causes a frame 603 to be displayed by superimposing it on the image in accordance with the position of the person 604. Also, a candidate display area 605 is displayed, which includes at least information on a first arrangement candidate 606 in which the subject is arranged at a first position in the imaging range of the imaging device 100, and information on a second arrangement candidate 608 in which the subject is arranged at a second position different from the first position in the imaging range. As shown in FIG. 6(a), the first arrangement candidate 606 is displayed in the candidate display area 605 as a figure in which an icon 607 indicating the subject is arranged on the left side in a rectangular area indicating the imaging range. Also, the second arrangement candidate 608 is displayed in the candidate display area 605 as a figure in which an icon 609 indicating the subject is arranged in the center in a rectangular area indicating the imaging range. Also, the third arrangement candidate 610 is displayed in the candidate display area 605 as a figure in which an icon 611 indicating the subject is arranged on the right side in a rectangular area indicating the imaging range. Note that, although three different arrangement candidates are displayed in the example shown in FIG. 6(a), the present invention is not limited to this, and other numbers of arrangement candidates may be displayed.

[0037] Here, a case where the first arrangement candidate 606 is selected from among the multiple arrangement candidates in FIG. 6(a) will be described. When the first arrangement candidate 606 is selected by a user operation, the range control unit 207 executes the following process. That is, the range control unit 207 executes a process of controlling the imaging range of the imaging device 100 so that the positional relationship of the subject with respect to the imaging range indicated by the first arrangement candidate 606 is the same as the positional relationship of the person 604, who is the reference subject, with respect to the imaging range of the current imaging device 100. Specifically, the range control unit 207 specifies the center of gravity of the icon 607, which indicates the subject, with respect to the rectangular area indicating the imaging range in the first arrangement candidate 606. Furthermore, the range control unit 207 specifies the center of gravity of the person 604, who is the reference subject, with respect to the imaging range of the current imaging device 100. Then, the range control unit 207 generates a control command for controlling the imaging range so that the relative positional relationship of the center of gravity of the icon 607 with respect to the rectangular area of ​​the first arrangement candidate 606 is the same as the relative positional relationship of the center of gravity of the person 604 with respect to the current imaging range. The generated control command is transmitted to the imaging device 100 via the communication unit 201, and the imaging device 100 controls the imaging range by controlling at least one of the pan value, tilt value, and zoom value based on the transmitted control command. The image captured after the imaging range of the imaging device 100 is controlled in this way is transmitted from the imaging device 100 to the information processing device 200. FIG. 6(b) shows an example in which the image captured and transmitted after the imaging range of the imaging device 100 is controlled according to the selection of the arrangement candidate is displayed in the image display area 602 by the display control unit 206. At this time, as shown in FIG. 6(b), an image is obtained in which the positional relationship of the subject with respect to the imaging range shown in the first arrangement candidate 606 is similar to the positional relationship of the subject (person 604) with respect to the actual imaging range. Also, as shown in FIG. 6(b), the display control unit 206 makes the display mode of the first arrangement candidate 606 different from the display mode of the second arrangement candidate 608 and the third arrangement candidate 610 according to the selection of the first arrangement candidate 606. In this way, it is possible to present to the user that the first arrangement candidate 606 has been selected.

[0038] In the example shown in FIG. 6, the case of the arrangement candidate for one person has been described, but here, the case of the arrangement candidate for other people will be described with reference to FIG. 7. FIG. 7(a) shows an example of a plurality of arrangement candidates for one person, and the arrangement candidates 701 to 703 are similar to the arrangement candidates 606, 608, and 610 shown in FIG. 6, respectively, and therefore the description will be omitted. FIG. 7(b) shows an example of a plurality of arrangement candidates for two people. The arrangement candidates 704 to 706 shown in FIG. 7(b) are information displayed in the candidate display area in the process of S505. In the arrangement candidate 704, an icon 707 corresponding to a first person identified in an image is arranged on the left side of the imaging range, and an icon 708 corresponding to a second person identified in the image is arranged on the right side of the imaging range. In addition, in the arrangement candidate 705, the icon 707 corresponding to the first person is arranged so as to be zoomed up on the left side. In addition, in the arrangement candidate 706, the icon 708 corresponding to the second person is arranged so as to be zoomed up on the right side. 7(c) is an arrangement candidate displayed in the candidate display area by the display control unit 206 in S506 when it is determined in S504 of FIG. 5 that the reference subjects are not two people. At this time, it is an arrangement candidate in which N people (N is an integer) identified by the identification unit 207 fit within the angle of view. In this embodiment, when the arrangement candidate 709 is selected, the range control unit 207 generates a control command for controlling the imaging range of the imaging device 100 so that the identified N people fit within the angle of view, and transmits the control command to the imaging device 100. Note that the arrangement candidates to be displayed are not limited to those in FIGS. 7(a) to 7(c), and other arrangement candidates may be added.

[0039] Here, a process of controlling the imaging range associated with a user selection of an arrangement candidate will be described with reference to the flow shown in Fig. 8. The process of the flow shown in Fig. 8 is started or ended, for example, in accordance with an instruction from a user. The process of the flowchart shown in Fig. 10 is executed by the functional blocks of the information processing device 200 shown in Fig. 4, which are realized by the CPU 1000 of the information processing device 200 executing a computer program stored in the ROM 1020 of the information processing device 200.

[0040] First, in S801, the range control unit 207 judges whether any of the arrangement candidates displayed in the candidate display area 605 has been selected. If it is judged that an arrangement candidate has been selected (Yes in S801), the process proceeds to S802, and if it is judged that no arrangement candidate has been selected (No in S801), the process returns to the process of S801. In S802, the range control unit 207 determines the amount of control of the pan value and the tilt value in controlling the imaging range based on the information on the position of the subject with respect to the imaging range indicated by the selected arrangement candidate. Here, a case where the first arrangement candidate 606 is selected in the example shown in FIG. 6(a) will be described. At this time, in S802, the range control unit 207 executes the following process. That is, the pan value and the tilt value for controlling the imaging range are determined so that the relative positional relationship of the center of gravity of the icon 607 with respect to the rectangular area of ​​the first arrangement candidate 606 and the relative positional relationship of the center of gravity of the person 604 with respect to the actual imaging range are the same. Next, in S803, the range control unit 207 determines a zoom value for controlling the imaging range based on information on the size of the subject relative to the imaging range indicated by the selected arrangement candidate. Here, it is assumed that the first arrangement candidate 606 is selected. At this time, the range control unit 207 determines a zoom value of the imaging device 100 such that the relative size of the icon 606 relative to the rectangular area of ​​the first arrangement candidate 606 is the same as the relative size of the person 604 relative to the actual imaging range. In S804, the range control unit 207 generates a control command for controlling the imaging device 100 so that the pan value, tilt value, and zoom value are the values ​​determined in S802 to S803. In S805, the communication unit 201 transmits the control command generated in S804 to the imaging device 100. At this time, the imaging device 100 analyzes the transmitted control command, and controls at least one of the pan driving unit 103, the tilt driving unit 104, and the lens driving unit 102 based on the analysis result, thereby controlling the range of the imaging device 100.

[0041] As described above, the information processing device 200 in this embodiment controls the imaging range of the imaging device 100 according to an arrangement candidate selected from a plurality of different displayed arrangement candidates so that a composition of a subject similar to the arrangement candidate is captured. In this way, it is possible to easily control the imaging range so that the subject is positioned at a location desired by the user in the imaging range.

[0042] (Embodiment 2) A second embodiment of the present invention will be described. In the second embodiment, a case will be described in which the display mode of an icon displayed in a placement candidate in a candidate display area is associated with the display mode of a frame showing a reference subject corresponding to the icon in an image display area. Note that the following mainly describes the parts that are different from the first embodiment, and the same or equivalent components and processes as those in the first embodiment are given the same reference numerals, and duplicated descriptions will be omitted.

[0043] With reference to Figs. 9(a)-(b), information that the display control unit 206 in this embodiment causes the display 400 to display will be described. The display control unit 206 causes the display 400 to display a display window 901 including an image display area 902 in which an image captured by the imaging device 100 is displayed, and a candidate display area 907 in which a plurality of arrangement candidates are displayed. The display control unit 206 may cause the image display area 902 and the candidate display area 905 to be displayed separately in different windows on the display 400. Also, as shown in Fig. 9(a), an image including person 904 and person 906 identified by the identification unit 204 as reference subjects is displayed in the image display area 206. At this time, the display control unit 206 causes a frame 903 corresponding to the position of person 904 and a frame 905 corresponding to the position of person 906 to be displayed by superimposing them on the image. The display control unit 206 also displays a candidate display area 907 including a layout candidate 908, a layout candidate 911, and a layout candidate 913 as layout candidates for two people. In the example shown in FIG. 9(a), the layout candidate 908 is a layout candidate in which an icon 909a corresponding to a person 904 specified in an image is placed on the left side of an imaging range, and an icon 910 corresponding to a person 906 specified in the image is placed on the right side of the imaging range. The layout candidate 911 is a layout candidate in which the icon 909a corresponding to the person 904 is placed so as to be zoomed up on the left side. The layout candidate 913 is a layout candidate in which the icon 914a corresponding to the person 906 is placed so as to be zoomed up on the right side. Note that, as shown in FIG. 9(a), the display control unit 206 in this embodiment displays a frame indicating a person specified as a reference subject and an icon corresponding to the person in the layout candidate using a display mode in which the association between the frame and the icon corresponding to the person in the layout candidate is clearly indicated to the user. Specifically, in the example shown in Fig. 9(a), a frame 903 indicating a person 904 and the outer edges of icons 909a and 912a corresponding to the person 904 are each indicated by a solid line. Also, in the example shown in Fig. 9(a), a frame 905 indicating a person 906 and the outer edges of icons 910a and 914a corresponding to the person 906 are each indicated by a dotted line.The method of clearly indicating the association between the frame showing a person and the icon corresponding to the person is not limited to the method of presenting it by a solid line or a dotted line. For example, the display control unit 206 may perform the following display. That is, the display control unit 206 displays the frame 903 showing the person 904 and the icons 909a and 912a corresponding to the person 904 in a first color. Furthermore, the display control unit 206 displays the frame 905 showing the person 906 and the icons 910a and 914a corresponding to the person 906 in a second color different from the first color. In addition, the display control unit 206 may use a cut-out image of the person as a method of clearly indicating the association with the icon corresponding to the person. Specifically, as shown in FIG. 9(b), the display control unit 206 may use cut-out images 909b and 912b, which are images cut out of the person 904, instead of the icons 909a and 912a. At this time, the display control unit 206 may use cut-out images 910b and 914b, which are cut-out images of the person 906, instead of the icon 910a and the icon 914a.

[0044] As described above, the information processing device 200 in this embodiment performs display such that the association between the figure superimposed on the image corresponding to the person specified from the image and the figure displayed in the arrangement candidate corresponding to the person is clearly indicated. In this way, it is possible to easily control the imaging range so that the subject is positioned at a location desired by the user in the imaging range.

[0045] (Other embodiments) Next, a hardware configuration of the information processing device 200 for realizing each function of each embodiment will be described with reference to Fig. 10. In the following description, the hardware configuration of the information processing device 200 will be described, but the imaging device 100 will also be realized by a similar hardware configuration.

[0046] The information processing device 200 in this embodiment includes a CPU 1000, a RAM 1010, a ROM 1020, a HDD 1030, and an I / F 1040.

[0047] The CPU 1500 is a central processing unit that controls the information processing device 200. The RAM 1010 temporarily stores computer programs executed by the CPU 1000. The RAM 1010 also provides a work area used when the CPU 1000 executes processing. The RAM 1010 also functions as, for example, a frame memory or a buffer memory.

[0048] The ROM 1020 stores programs and the like for the CPU 1500 to control the information processing device 200. The HDD 1030 is a storage device for recording image data and the like.

[0049] The I / F 1010 communicates with external devices via a network 140 in accordance with TCP / IP, HTTP, or the like.

[0050] In the above-described embodiments, an example is described in which the CPU 1000 executes the processing, but at least a part of the processing of the CPU 1000 may be executed by dedicated hardware. For example, the processing of displaying a GUI (GRAPHICAL USER INTERFACE) or image data on the display 400 may be executed by a GPU (GRAPHICS PROCESSING UNIT). Furthermore, the processing of reading program code from the ROM 1020 and loading it in the RAM 1010 may be executed by a DMA (DIRECT MEMORY ACCESS) functioning as a transfer device.

[0051] The present invention can also be realized by a process in which one or more processors read and execute a program that realizes one or more functions of the above-mentioned embodiments. The program may be supplied to a system or device having a processor via a network or a storage medium. The present invention can also be realized by a circuit (e.g., ASIC) that realizes one or more functions of the above-mentioned embodiments. Each unit of the information processing device 200 may be realized by hardware shown in FIG. 10, or by software.

[0052] Note that one or more functions of the information processing device 200 according to each of the above-described embodiments may be included in another device. For example, the information processing device 200 may have one or more functions of the information processing device 200 according to each of the embodiments. Note that the above-described embodiments may be combined, for example, the above-described embodiments may be combined in any desired manner.

[0053] Although the present invention has been described above with reference to the embodiments, the above embodiments are merely examples of the embodiment of the present invention, and the technical scope of the present invention should not be interpreted as being limited by these. In other words, the present invention can be embodied in various forms without departing from the technical concept or main features of the present invention. For example, combinations of the respective embodiments are also included in the disclosure of this specification. [Explanation of symbols]

[0054] 100 Imaging device 200 Information processing device 201 Communications Department 202 Storage section 203 Detection unit 204 Specific section 205 Operation reception section 206 Display control unit 207 Range Control Section

Claims

[Claim 1] An acquisition means for acquiring an image captured by the imaging means; a display control means for displaying the image acquired by the acquisition means on a display means; a control means for controlling an imaging range of the imaging means, the display control means causes the display means to display information about a first arrangement option in which the subject in the image capture range is arranged at a first position and information about a second arrangement option in which the subject in the image capture range is arranged at a second position different from the first position; The information processing apparatus is characterized in that the control means controls the imaging range based on information on an arrangement candidate selected by a user from the first arrangement candidate and the second arrangement candidate.

Images