Information processor, information processing method, and program product

Abstract

An information processor according to the present technology includes a presentation unit that performs processing for presenting to a user a list of objects identified as a result of performing object recognition processing on a captured image; and a tracking unit that sets a tracking range of a subject corresponding to an object selected by the user from the list presented by the presentation unit and tracks the subject based on the set tracking range.

Description

Technical Field

[0001] The present technology relates to an information processor, an information processing method, and a program, and more particularly, to a technical field related to setting a tracking range of a subject. Background Art

[0002] An example of a known imager is a type of imager generally referred to as a PTZ camera. A PTZ camera is a camera equipped with a zoom function for changing the imaging angle of view by using a zoom lens and a pan-tilt function for changing the imaging direction in pan and tilt directions.

[0003] A PTZ camera can capture a specific subject at a specific size within the view frame by using the zoom function, and can further perform imaging so as to perform so-called subject tracking, i.e., keep the specific subject at a specific position, such as a middle position within the view frame, by using the pan-tilt function.

[0004] It should be noted that examples of related conventional technology may include PTL 1 described below. PTL 1 discloses a technology of setting a preset imaging position of a monitoring camera at a position corresponding to an area where the detection frequency of a monitoring target is high.

[0005] [Citation List]

[0006] [Patent Document]

[0007] [PTL 1]

[0008] Japanese Patent Publication No. 2016-100696 Summary of the Invention

[0009] [Technical Issues]

[0010] Here, the range in which a subject can be tracked is determined by the pan / tilt movable range and the focal length of the lens. However, subject tracking is not always performed across the entire trackable range. In some cases, for example, when an undesirable object is included within the trackable range, the range in which tracking is performed (hereinafter referred to as the "tracking range") is set to exclude the area where the object is located, and subject tracking is performed only within the set tracking range.

[0011] Conventionally, the tracking range is usually set by manual operation of the user. Specifically, when tracking a subject with a PTZ camera, the user sets the tracking range by performing pan-tilt adjustment operations while viewing a captured image and specifying the pan angle and tilt angle corresponding to each of the upper left corner, upper right corner, lower left corner, and lower right corner of the search range, which places a heavy burden on the user.

[0012] The present technology is provided in view of the above circumstances, and an object thereof is to reduce the user's operational burden related to setting of a tracking range of a subject.

[0013] [Solution to the problem]

[0014] An information processor according to the present technology includes a presentation processing section configured to perform processing for presenting a list of objects recognized in object recognition processing of a captured image to a user, and a tracking processing section configured to set a tracking range of a subject corresponding to an object selected by the user from the list presented by the presentation processing section, and perform tracking processing of the subject based on the set tracking range.

[0015] Therefore, the operation required to set the tracking range of the subject is only sufficient to select an object from the list.

[0016] In the above-mentioned information processor according to the present technology, the presentation processing part can be configured to perform processing to present a candidate list for tracking range and a candidate list for tracking start range of the subject as a list of objects, and the tracking processing part can be configured so that: when an object is selected from the candidate list for tracking start range, the tracking start range corresponds to the selected object.

[0017] By setting the tracking start range, the tracking process of the subject can be started from the range where the subject may exist when imaging starts.

[0018] In the above-mentioned information processor according to the present technology, the presentation processing part can be configured to perform processing to present a candidate list for tracking range and a candidate list of search range as a list of objects, wherein in a case where the subject is lost, the subject is to be searched, and the tracking processing part can be configured to, in a case where an object is selected from the candidate list of search range, set the search range corresponding to the selected object.

[0019] By setting the search range, in the case where the subject being tracked is lost, the search for the subject can be performed while setting as a target the range in which the subject is most likely to exist.

[0020] In the above-mentioned information processor according to the present technology, the presentation processing part can be configured to perform processing to present a candidate list for tracking range and a candidate list for search exclusion range as a list of objects, the search exclusion range is a range excluded from the target of the search subject, and the tracking processing part can be configured to, when an object is selected from the candidate list for search exclusion range, set the search exclusion range corresponding to the selected object.

[0021] By setting the search exclusion range, it is possible to exclude an undesirable range to be included in the subject search range (eg, a range where a subject not being the tracking target is assumed to exist) in order to appropriately perform tracking of the target subject to perform search for the subject.

[0022] In the above-mentioned information processor according to the present technology, the presentation processing part can be configured to perform processing to present a candidate list for tracking range and a candidate list for different ranges which are ranges related to tracking processing that are different from the tracking range as a list of objects, and perform processing to present a list in which the objects listed thereon are at least partially different as a candidate list for tracking range and a candidate list for different ranges.

[0023] This enables presentation of objects suitable as candidates for each tracking range and different ranges.

[0024] In the above-mentioned information processor according to the present technology, the presentation processing part can be configured to perform processing for presenting the candidate list for the tracking range and the candidate list for the different range based on the correspondence information indicating the correspondence relationship of the objects to be listed for each tracking range and the different range.

[0025] This makes it possible to present only objects suitable as candidates for each range through a simple process of generating a candidate list with reference to the correspondence information.

[0026] In the above-mentioned information processor according to the present technology, the presentation processing part can be configured to perform processing to present a candidate list for tracking range and a candidate list for different range (the different range is a range related to tracking processing and different from the tracking range) as a list of objects, and perform processing to present a candidate list for tracking range and a candidate list for different ranges based on the history of selecting objects from each candidate list.

[0027] This makes it possible to present only objects that fit in each scope as candidates based on the selection history of the object.

[0028] In the above-mentioned information processor according to the present technology, the presentation processing section may be configured to perform processing to present a list in which objects selected based on selection frequencies according to selection history are listed as a candidate list for the tracking range and a candidate list for a different range.

[0029] This enables only objects that are assumed to fit within each range to be presented as candidates based on the high frequency of previous selections.

[0030] In the above-mentioned information processor according to the present technology, the presentation processing section may be configured to perform processing to present information indicating a range corresponding to the selected object on the captured image in a case where the object is selected from the list.

[0031] This enables the user to see the extent of his / her selected object on the captured image.

[0032] In the above-mentioned information processor according to the present technology, the presentation processing section may be configured to perform a process of changing the size or shape of the range in response to an operation applied to the information indicating the range presented on the captured image.

[0033] Therefore, when information indicating a corresponding range is presented in response to an object selected from the list, the user can apply an operation to the information indicating the range, thereby issuing an instruction to change the size or shape of the range.

[0034] In the above-mentioned information processor according to the present technology, the presentation processing section may be configured to, in a case where a plurality of objects are selected from the list, perform a process of presenting information indicating a range including the selected objects on the captured image.

[0035] Therefore, in the case where the user wants to set a tracking range covering multiple objects, the user only needs to perform at least one operation to select these objects from the list.

[0036] In the above-mentioned information processor according to the present technology, the presentation processing part can be configured to perform processing for presenting a candidate list for tracking range and a candidate list for searching exclusion range, so that an object selected from any one of the candidate lists will not be presented in an optional state in another candidate list.

[0037] This makes it possible to prevent inconsistent selection from being performed, which includes selecting an object selected for the tracking range also as an object of the search exclusion range, and reversely selecting an object selected for the search exclusion range also as an object within the tracking range.

[0038] In the above-mentioned information processor according to the present technology, the presentation processing section may be configured to perform processing for presenting error information when an object selected from either the candidate list for the tracking range and the candidate list for the search exclusion range is selected from the other candidate list.

[0039] This enables an error notification to be provided to the user in response to an inconsistent selection being made.

[0040] In the above-mentioned information processor according to the present technology, the presentation processing section may be configured to generate and present to the user a list including, as an option, information indicating a position history dependent range set based on history information on the subject position.

[0041] This enables a range considered suitable for performing tracking (eg, a range through which the subject frequently passes) to be presented as a candidate for the tracking range based on the position history of the subject.

[0042] In the above-mentioned information processor according to the present technology, the subject may include a teacher, and the presentation processing part may be configured to set the position history dependence range based on historical information about the teacher as the tracking target among historical information about positions stored on a teacher-by-teacher basis.

[0043] Different teachers may have different movement characteristics in class. For example, one teacher moves around frequently during class, while another teacher does not move around often during class.

[0044] In the above-mentioned information processor according to the present technology, in the object recognition processing, the recognition processing of at least one object among the podium, teacher's desk and the blackboard writing body can be performed, and the presentation processing part can be configured to perform the processing of presenting a list to the user, and the list includes at least one of the podium, teacher's desk and the blackboard writing body identified in the object recognition processing.

[0045] This enables setting of the tracking range based on the objects arranged in the teacher when giving a lecture.

[0046] In addition, the information processing method according to the present technology is an information processing method, in which an information processor is configured to perform processing to present a list of objects recognized in object recognition processing of a captured image to a user, set a tracking range of a subject corresponding to an object selected by the user from the presented list, and perform tracking processing of the subject based on the set tracking range.

[0047] This information processing method can also provide operations and effects similar to those of the above-mentioned information processor according to the present technology.

[0048] A program according to the present technology is a program configured to cause an information processor to implement a function to perform processing of presenting a list of objects recognized in object recognition processing of a captured image to a user, setting a tracking range of a subject corresponding to an object selected by the user from the presented list, and performing tracking processing of the subject based on the set tracking range.

[0049] With the help of such a program, the above-mentioned information processor according to the present technology is realized. BRIEF DESCRIPTION OF THE DRAWINGS

[0050] Figure 1 : is a block diagram showing a configuration example of a tracking imaging system including an information processor as an embodiment of the present technology.

[0051] Figure 2is a block diagram showing a hardware configuration example of an information processor as an embodiment.

[0052] Figure 3 This is a flowchart for explaining the process for setting various ranges related to tracking of a subject.

[0053] Figure 4 is a functional block diagram showing various functions of the information processor as an embodiment in a block form.

[0054] Figure 5 is a diagram to help explain an example of object recognition technology (general object recognition technology).

[0055] Figure 6 is a diagram that helps explain an example of object recognition technology (semantic segmentation).

[0056] Figure 7 are diagrams for explaining examples of various objects that may be targets of object recognition in the embodiment.

[0057] Figure 8 Also shown are diagrams for explaining examples of various objects that may be targets of object recognition in the embodiment.

[0058] Figure 9 Depicted are diagrams each for explaining a presentation example of a list of objects.

[0059] Figure 10 is a diagram for explaining an example of correspondence relationship information according to an embodiment.

[0060] Figure 11 : is a diagram showing a presentation example of frame information according to the embodiment.

[0061] Figure 12 is a diagram illustrating another presentation example of frame information according to the embodiment.

[0062] Figure 13 is a diagram to help explain an operation for changing a range corresponding to a selected object.

[0063] Figure 14 is a flowchart showing the processing performed before the selection screen is presented.

[0064] Figure 15 This is a flowchart corresponding to the process from object selection to range fixing.

[0065] Figure 16 This is a flowchart of the process related to the setting of various ranges.

[0066] Figure 17is a diagram illustrating an example of a selection screen where a plurality of objects can be selected from a list.

[0067] Figure 18 is a diagram illustrating a presentation example of frame information presented in a case where a plurality of objects are selected from a list.

[0068] Figure 19 2 is a diagram for explaining a first example of the presentation process according to the third modification.

[0069] Figure 20 It is also a diagram for explaining a first example of the presentation process according to the third modification.

[0070] Figure 21 2 is a diagram for explaining a second example of the presentation process according to the third modification.

[0071] Figure 22 It is also a diagram for explaining a second example of the presentation process according to the third modification.

[0072] Figure 23 2 is a diagram illustrating a presentation example according to a fourth modification. DETAILED DESCRIPTION

[0073] The embodiments will be described in the following order.

[0074] <1. Tracking Imaging System>

[0075] [1-1. System Configuration]

[0076] [1-2. About Tracking Imaging]

[0077] <2. Range Setting Technology as an Example>

[0078] <3. Processing steps>

[0079] <4. Various Modifications>

[0080] [4-1. First Modification Example]

[0081] [4-2. Second Modification Example]

[0082] [4-3. Third Modification Example]

[0083] [4-4. Fourth Amendment]

[0084] <5. Other Changes>

[0085] <6. Overview of Examples>

[0086] <7. This technology>

[0087] <1. Tracking Imaging System>

[0088] [1-1. System Configuration]

[0089] Figure 1 1 is a block diagram showing a configuration example of a tracking imaging system 100 including the information processor 1 as an embodiment of the present technology.

[0090] As shown in the figure, the tracking imaging system 100 includes at least an information processor 1 , an imager 2 , and a recorder 3 .

[0091] The imager 2 is in the form of a PTZ camera having mechanical pan and tilt functions and capable of adjusting the focal length (i.e., the angle of view) by using a zoom lens. The imager 2 adjusts the focal length and the imaging direction by panning and tilting based on a control signal output from the information processor 1.

[0092] The imager 2 includes an imaging element in the form of an imaging sensor such as a CMOS (Complementary Metal Oxide Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and is capable of generating captured image data in the form of a moving image. The captured image data acquired by the imager 2 is output to the information processor 1 and the recorder 3.

[0093] In addition, the imager 2 outputs camera information such as information on angles in the pan direction and the tilt direction and information on the focal length to the information processor 1 .

[0094] The information processor 1 , which takes the form of, for example, a computer device, has an image analysis function of performing image analysis on a captured image input from the imager 2 and a function of controlling the movement of the imager 2 based on the above-mentioned control signal (pan-tilt-zoom control function).

[0095] Specifically, the information processor 1 of this example includes a subject detection function as one of its image analysis functions for detecting a specific subject. Then, in response to the subject detection function detecting the specific subject, the information processor 1 performs tracking processing for the subject. Here, subject tracking processing refers to processing that causes the subject or object to remain at a specific position within the output image frame of the captured image. In this example, subject tracking can be achieved through pan-tilt control of the imaging direction. That is, as tracking processing in this case, the information processor 1 performs pan-tilt control of the imager 2 based on the aforementioned control signal to cause the subject to remain at a specific position within the output image frame.

[0096] In addition, the information processor 1 of this example also performs setting processing of various ranges related to the tracking processing of the subject, including the tracking range, that is, the range in which the subject is to be tracked. It should be noted that this setting processing of various ranges will be described again later.

[0097] The recorder 3 has a function of recording captured image data input from the imager 2 .

[0098] Figure 2 is a block diagram showing a hardware configuration example of the information processor 1 .

[0099] As shown in the figure, the information processor 1 includes a CPU (central processing unit) 11, a ROM (read-only memory) 12, a RAM (random access memory) 13, a bus 14, an input / output interface 15, an input part 16, a display part 17, an audio output part 18, a storage part 19, a communication part 20 and a drive 22.

[0100] The CPU 11 executes various processes according to a program stored in the ROM 12 or a program loaded from the storage section 19 into the RAM 13. Data and the like necessary for the CPU 11 to execute various processes are also stored in the RAM 13 as appropriate.

[0101] The CPU 11, the ROM 12, and the RAM 13 are connected to one another via a bus 14. To the bus 14, an input / output interface 15 is also connected.

[0102] An input section 16 including an operating section or an operating device is connected to the input / output interface 15 .

[0103] For example, the input section 16 is assumed to be any one of various operating sections or operating devices such as a keyboard, a mouse, a key, a dial, a touch panel, a touch pad, and a remote controller.

[0104] A user operation is detected by the input section 16 , and a signal corresponding to the input operation is interpreted by the CPU 11 .

[0105] In addition, a display section 17 in the form of an LCD (Liquid Crystal Display) or an organic EL (Electro Luminescence) panel or the like and an audio output section 18 in the form of a speaker or the like are connected to the input / output interface 15 integrally or as separate components.

[0106] The display section 17 is a display section that performs various types of display, and includes, for example, a display device mounted on a housing of the information processor 1 or a separate display device connected to the information processor 1 or the like.

[0107] The display section 17 displays various types of information on a display screen based on instructions from the CPU 11. For example, the display section 17 displays various operation menus, icons, messages, and the like as what is generally called a GUI (Graphical User Interface) based on instructions from the CPU 11. In addition, the display section 17 can display a captured image input from the imager 2.

[0108] The input / output interface 15 is connected to a storage section 19 including a hard disk, a solid-state memory, or the like, and a communication section 20 including a modem or the like.

[0109] The communication section 20 performs communication processing through a transmission line such as the Internet, and communicates with various devices through wired / wireless communication or bus communication, etc. In this example, communication between the imager 2 and the information processor 1 is performed via the communication section 20 .

[0110] In addition, the input / output interface 15 is connected to a drive 22 as necessary, and has a removable recording medium 21 such as a magnetic disk, an optical disk, a magneto-optical disk, or a semiconductor memory attached thereto as appropriate.

[0111] The drive 22 enables data files such as image files, various computer programs, and the like to be read from the removable recording medium 21. The read data files are stored in the storage section 19, or images or audio contained in the data files are output by the display section 17 or the audio output section 18. In addition, the computer programs and the like read from the removable recording medium 21 are installed in the storage section 19 as necessary.

[0112] [1-2. About Tracking Imaging]

[0113] The following description uses an example of using tracking imaging system 100 to capture a lecture. Specifically, imager 2 is positioned to capture an image of the interior of a classroom, etc., where a lecture is being given, and obtains a captured image showing the lecturer. In this case, the tracking target is the lecturer, and tracking processing for the lecturer begins upon detecting the subject (i.e., the lecturer) within the captured image.

[0114] In order to appropriately perform such tracking imaging for a specific subject, the following various ranges related to tracking are set in the tracking imaging system 100 before starting imaging.

[0115] - Tracking start range (home position)

[0116] This is the range at which tracking is to be started, and in response to the target subject appearing within the tracking start range, tracking is started.

[0117] - Tracking range

[0118] This is the range within which the target subject is tracked. For example, it is defined by the angular range in the pan direction and the angular range in the tilt direction. In other words, when the movable range in the pan and tilt directions reaches the maximum range, the tracking range is defined as a range equal to or less than the maximum range.

[0119] - Search range (restore location)

[0120] It is the range to search for the subject in the event that the tracking target subject is lost. It should generally be set to a range that includes the area where the tracking target subject often passes.

[0121] - Search exclusion range (mask area)

[0122] This is a range in which a search for a subject is not performed for tracking purposes. For example, a range in which a subject that is not a tracking target exists (such as a place where an audience exists) is set, thereby preventing a subject that is not a tracking target from being erroneously tracked.

[0123] refer to Figure 3 The process for setting these different ranges is described in the flowchart in .

[0124] First, as shown in step S1 in the figure, it is determined whether various ranges have been set. If not, the process proceeds to step S3 to execute a process for setting various ranges. In other words, a process for setting various ranges (i.e., the aforementioned tracking start range, tracking range, search range, and search exclusion range) is executed.

[0125] Then, in response to the setting processing of the various ranges performed in step S3, tracking imaging is started in step S4. For the tracking imaging, tracking processing based on the information on the various ranges set in step S3 is performed.

[0126] Conversely, if it is determined in step S1 that various ranges have been set, a determination is made in step S2 as to whether the settings need to be changed. Specifically, a determination is made as to whether information regarding the already set various ranges needs to be changed. For example, even in the same classroom, when different lectures are given, the positions of objects that are not intended to appear in the captured image (tracked captured image) may differ, and therefore, it may be desirable to change the tracking range or search range, for example. In step S2, for example, in view of such circumstances, a determination is made as to whether the already set various ranges need to be changed.

[0127] If it is determined in step S2 that the setting needs to be changed, the setting process in step S3 is performed, and then tracking imaging is started in step S4. Conversely, if it is not determined in step S2 that the setting needs to be changed, the setting process in step S3 is skipped, and tracking imaging is started in step S4.

[0128] Here, conventionally, the process of setting various ranges to be executed in step S3 is performed as a process of setting various ranges based on user operations. Specifically, the user needs to perform a pan-tilt adjustment operation while viewing the captured image for each of the various ranges (i.e., the above-mentioned tracking start range, tracking range, search range, and search exclusion range) and specify the pan and tilt angles for defining the ranges.

[0129] Therefore, users are conventionally forced to bear a heavy operational burden.

[0130] Therefore, the present embodiment aims to reduce the operational burden on the user when setting various ranges related to subject tracking.

[0131] <2. Range Setting Technology as an Example>

[0132] Figure 4 1 is a functional block diagram showing various functions of the CPU 11 of the information processor 1 in block form. It should be noted that among the various functions of the CPU 11, Figure 4 Only some functions related to tracking imaging are shown.

[0133] As shown in the figure, the CPU 11 has functions as an object recognition section F1 , a rendering processing section F2 , and a tracking processing section F3 .

[0134] The object recognition section F1 applies object recognition processing to the captured image from the imager 2. Specifically, this is a process for identifying objects appearing in the image. Object recognition processing can also be referred to as a process for analyzing the structure of the real space appearing in the captured image. The specific object recognition technology is not limited to a specific technology. For example, conventional technologies such as AI (artificial intelligence) image recognition technology can be used.

[0135] For example, Figure 5 As shown, the position of the object and / or the name (category) of the object appearing in the image is identified by a typical object recognition technology. Figure 6 As shown, the location and / or name of an object can be identified through semantic segmentation.

[0136] Figure 7 and Figure 8 : are diagrams for explaining examples of various objects to be targets for object recognition in the present embodiment.

[0137] Since the environment as an imaging target in the present embodiment is a classroom where a lecture is to be given as described above, target objects for recognition in the object recognition process are various objects placed in the classroom.

[0138] Figure 7 The following illustrates an example of a classroom in which a teacher's desk o1, ​​a blackboard o2, a lectern o3, a display o4, and seating o5 are located. Here, the blackboard o2 refers to a medium on which the teacher writes, such as a blackboard or a whiteboard. The display o4 is a display device that displays and outputs images presented during a lecture, for example. The seating o5 refers to a portion of a seat and / or table where attendees, such as students, are seated.

[0139] Figure 8The classrooms shown correspond to Figure 7 In the classroom, the podium o3 is omitted.

[0140] exist Figure 4 In the process, the object recognition section F1 outputs, for each recognized object, information indicating the range of the object (eg, the coordinates and size of the circumscribed frame of the object) and information indicating the name thereof as information on the result of the object recognition processing.

[0141] The presentation processing section F2 performs processing for presenting a list of objects recognized in the above-mentioned object recognition processing to the user. The list of objects is presented by Figure 2 A display portion 17 is shown presented to the user.

[0142] The tracking processing section F3 sets a tracking range of a subject corresponding to one of the objects selected by the user from the list presented by the presentation processing section F2 and performs tracking processing of the subject based on the selected tracking range.

[0143] As described below, in this example, the presentation processing section F2 presents a list of objects not only for the tracking range but also for other ranges (i.e., the aforementioned tracking start range, search range, and search exclusion range). Therefore, the tracking processing section F3 individually sets the tracking start range, tracking range, search range, and search exclusion range based on the results of the user selecting an object from these range lists. Then, subject tracking processing is performed based on the information regarding each of the set ranges.

[0144] Figure 9 Depicted are diagrams each used to explain a presentation example of a list of objects.

[0145] Figure 9 A shows an example of an image (GUI) for operating reception, which is caused to be displayed on the display section 17 by the presentation processing section F2 when various ranges are set.

[0146] In the image for operation reception, a pull-down button Bp is displayed for each of the various ranges (i.e., tracking start range, tracking range, search range, and search exclusion range). Here, as shown in the figure, in order to distinguish the pull-down buttons Bp, the pull-down buttons Bp for the tracking start range, tracking range, search range, and search exclusion range are referred to by using reference numerals "Bp1," "Bp2," "Bp3," and "Bp4," respectively.

[0147] As from Figure 9 An example showing migration of A, Figure 9 B shows a transition example when the pull-down button Bp1 (track start range) and the pull-down button Bp4 (search exclusion range) are operated.

[0148] In response to the drop-down button Bp being operated, a list of objects corresponding to the range of the operated drop-down button Bp is displayed in a pull-down manner. In the illustrated example, in response to the drop-down button Bp1 being operated, a list including "lectern," "blackboard writing," and "teacher's desk" is displayed as a list of objects corresponding to the tracking start range, while in response to the drop-down button Bp4 being operated, a list including "seating section" and "display" is displayed as a list of objects corresponding to the search exclusion range.

[0149] For example, when "teacher's desk" is selected from the list of tracking start ranges, the tracking processing section F3 sets the range corresponding to the position of the teacher's desk o1 as the tracking start range. Here, the operation for selecting the object may be an operation such as a click operation or a tap operation.

[0150] Furthermore, if "seat section" is selected from the list of search exclusion ranges, the tracking processing section F3 sets the range corresponding to the position of the seat section o5 as the search exclusion range. This applies similarly to the tracking range and search range. If objects are selected from the list displayed in a pull-down manner in response to the pull-down buttons Bp2 and Bp3 being operated, the tracking processing section F3 sets the range corresponding to the position of each selected object as the tracking range and search range.

[0151] This eliminates the need for the user to perform pan-tilt operations to specify the respective ranges when setting various ranges related to tracking of the subject. This makes it possible to reduce the operational burden on the user when setting various ranges related to tracking of the subject.

[0152] It should be noted that in the illustrated example, the list of objects each includes an item "Specify Coordinates." Although not illustrated, by selecting the "Specify Coordinates" item, the user can specify coordinates for specifying a range via the captured image displayed on the display portion 17. That is, any range can be set regardless of the range of the recognized object.

[0153] Here, regarding the respective lists of objects presented for various ranges, which object is to be listed on each list can be determined as desired.

[0154] In this example, objects that differ are listed between at least some of the scopes.

[0155] To generate a list of objects for each of the various scopes, the rendering process F2 of this example uses Figure 10 The correspondence information I1 is shown.

[0156] like Figure 10As shown, the correspondence information I1 is information about identification information (e.g., name information) of possible objects to be listed on the list for each of the various ranges (i.e., the tracking start range, the tracking range, the search range, and the search exclusion range). Specifically, in the correspondence information I1 of this example, "teacher's desk," "lectern," and "blackboard writing" are defined as possible objects to be listed on the list of the target tracking start range, and "teacher's desk," "lectern," "blackboard writing," and "display" are defined as possible objects to be listed on the list of the tracking range. In addition, "teacher's desk," "lectern," and "blackboard writing" are defined as possible objects to be listed on the list of the search range, and "seat section" and "display" are defined as possible objects to be listed on the list of the search exclusion range.

[0157] The presentation processing section F2 generates a list of each range based on the correspondence information I1 in response to the object recognition result obtained from the object recognition section F1. Specifically, the list is generated, including all objects actually recognized for each of the various ranges (i.e., the tracking start range, the tracking range, the search range, and the search exclusion range) among the objects defined in the correspondence information I1.

[0158] By generating a list of ranges based on the correspondence information I1 as described above, objects suitable as candidates for each range can be presented to the user, and unnecessary candidates can be prevented from being listed, which reduces the burden on the user when selecting an object from the list.

[0159] Here, as reference Figure 10 As can be understood from the correspondence information I1 in the tracking range, in this example, at least partially different lists of listed objects are presented between the tracking range and the search exclusion range. Specifically, "seat section" is listed in the search exclusion range list, while "seat section" is not listed in the tracking range list.

[0160] If the seat o5, where a subject not being tracked exists, is included in the tracking range, it will be difficult to stably track the subject. Therefore, in this example, "seat part" is listed in the search exclusion range list, while "seat part" is not listed in the tracking range list.

[0161] For the tracking start range and the search range, this applies to the "seat section" similarly to the tracking range. Therefore, in this example, the "seat section" is not listed on the list of the tracking start range nor on the list of the search range.

[0162] Here, “display” in which an image of a person appears in some cases, which may become a cause of erroneous tracking, is included as a candidate to be listed on the list of the search exclusion range in this example.

[0163] It should be noted that the above example shows that the objects listed on the list are different between the search exclusion range and other ranges. However, for example, the objects listed on the list may be different between any other combination of ranges (such as between the tracking start range and the tracking range or between the tracking range and the search range). For example, in Figure 10 In the example in , the objects listed on the list differ between the tracking start range and the tracking range (presence / absence of "display"). Figure 10 In the example in , the objects listed on the list also differ between the tracking range and the search range (similarly, the presence / absence of a “display”).

[0164] As described above, the presentation processing section F2 of this example results in the display of the image in response to the pull-down button Bp being operated (see Figure 9 ) displays a list generated for each of the various ranges as described above, allowing the user to select an object from the displayed list as needed to specify a range corresponding to the selected object for each of the tracking start range, tracking range, search range, and search exclusion range.

[0165] In this case, if Figure 11 or Figure 12 As illustrated, the presentation processing section F2 of the present example causes, in response to an object being selected from a list, presentation of information indicating a range corresponding to the selected object on a captured image.

[0166] like Figure 11 or Figure 12 As shown, the presentation processing section F2 of this example causes the display section 17 to display a screen on which captured images acquired from the imager 2 are arranged, along with pull-down buttons Bp (Bp1 to Bp4) for the various ranges described above, as the object selection screen Gs. In this example, a captured image determined as a target of the object recognition processing by the object recognition section F1 is used as the captured image.

[0167] Figure 11 An example of the range information presentation provided when "Teacher's Desk" listed on the list is selected is shown. In this example, a rectangular range is set as the range corresponding to the selected object, and as the range information corresponding thereto, frame information W indicating the outline of the range corresponding to the selected object is presented.

[0168] Figure 12 A presentation example of the frame information W provided in the case where “podium” is selected is shown.

[0169] Here, the operation for selecting an object that triggers the presentation of the frame information W may be a mouse hovering operation, rather than a click or tap operation. That is, in response to an object on the list being hovered over by the mouse, information indicating the range corresponding to the hovered object can be presented on the captured image.

[0170] It should be noted that although illustration is omitted, when presenting the frame information W, display control such as reducing the brightness of the image area outside the range indicated by the frame information W can be performed to enhance the range corresponding to the selected object in the captured image.

[0171] In addition, in this example, Figure 13 As illustrated, the size or shape of the range can be changed by applying an operation to the presented frame information W.

[0172] In this example, the shape or size of the frame is changed in response to a drag operation applied to the frame presented as the frame information W. That is, the range corresponding to the selected object is changed (adjusted). It should be noted that the shape herein refers only to shapes belonging to the rectangular category and does not include changes to shapes other than rectangles.

[0173] For each of the various ranges, the tracking processing section F3 waits for an operation to fix the range after selecting an object from the list. In this example, the operation to fix the range is, for example, re-operating the pull-down button Bp of the target range (i.e., an operation to close the list displayed in a pull-down manner).

[0174] In the case where an operation for fixing a range is performed, the tracking processing section F3 stores information indicating the range.

[0175] The tracking processing section F3 then waits for a selection completion operation, i.e., an operation indicating completion of selection of all the various ranges, and in the event of the selection completion operation, executes a process for setting the various ranges. Specifically, the tracking processing section F3 executes a process for setting each of the various ranges to be used during tracking imaging based on the information on the ranges stored in response to the above-described operation for fixing the ranges, for the various ranges (i.e., the tracking start range, the tracking range, the search range, and the search exclusion range).

[0176] In this case, the set range information includes at least information about coordinates in the captured image.

[0177] In this example, wide-angle imaging is performed with the zoom lens set to the widest angle (i.e., set to the wide end) to capture images for object recognition, while imaging is performed with a narrower angle of view than during wide-angle imaging during subject tracking. Therefore, as range information regarding various ranges in this example, in addition to the aforementioned information regarding coordinates, information regarding the focal length during wide-angle imaging is also set.

[0178] Note that the above example illustrates an operation applied to a frame to change the range. However, the operation may be any other operation, such as dragging a portion of the range's periphery relative to the frame. It is sufficient if the operation applied to information indicating the range is applied.

[0179] <3. Processing steps>

[0180] Will refer to Figures 14 to 16 , specific steps of the processing to be performed to realize the range setting technology as the above-mentioned embodiment are described.

[0181] It should be noted that description is made here by way of example of a case where the processing for realizing the range setting technique as the embodiment is to be realized by software processing of the CPU 11. However, the processing described below may be executed by hardware.

[0182] Figure 14 : is a flowchart showing the processing performed before the selection screen Gs is presented.

[0183] First, the CPU 11 executes wide-angle imaging processing in step S101. That is, the imager 2 is controlled so as to cause the above-described wide-angle imaging to be performed.

[0184] In step S102 following step S101, the CPU 11 acquires a captured image. That is, the image captured by the wide-angle imaging performed in step S101 is acquired from the imager 2.

[0185] Then, in step S103, the CPU 11 applies object recognition processing to the captured image. That is, by means of the above-mentioned processing as the object recognition part F1, the recognition processing of predetermined objects such as the teacher's desk o1, ​​the blackboard o2, the podium o3, the display o4 and the seating part o5 is performed.

[0186] In response to the object recognition processing in step S103 being executed, the CPU 11 performs a candidate list generation process based on the object recognition result in step S104. This means that, in this example, based on Figure 10 The correspondence information I1 shown generates a candidate list based on the object recognition results for each of the various ranges (i.e., tracking start range, tracking range, search range, and search exclusion range). Specifically, a list of all actually recognized objects, including those defined in the correspondence information I1, is generated for each of these various ranges.

[0187] In step S105 following step S104, as a presentation process of the selection screen Gs, the CPU 11 executes a process resulting in Figure 11 The selection screen Gs shown is displayed on the display section 17, and the process is terminated. Figure 14 A series of processing shown.

[0188] In this example, as described above, the captured image obtained by wide-angle imaging is displayed on the selection screen Gs. In addition, in response to the pull-down button Bp being operated, the list corresponding to the range of the operated pull-down button Bp among the lists generated in step S104 is displayed in a pull-down manner on the selection screen Gs.

[0189] Figure 15 This is a flowchart corresponding to the process from selecting an object to fixing a range.

[0190] It should be noted that the list of objects presented starts in response to the pull-down button Bp in the selection screen Gs being operated. Figure 15 The CPU 11 responds to the user's operation and Figure 15 The illustrated processing is applied to each of the various ranges (ie, the tracking start range, the tracking range, the search range, and the search exclusion range).

[0191] First, in step S201, the CPU 11 waits until an object is selected from the list, and in response to the object being selected from the list, proceeds to step S202 to obtain range information corresponding to the selected object. Specifically, information regarding the selected object, i.e., information indicating the range of the object identified in the object recognition process, is obtained, and based on this information, the range corresponding to the object is calculated and obtained. In this example, the range corresponding to the object is a range that extends beyond the range of the recognized object (at least in the vertical direction). For this reason, a range that extends beyond the recognition range is calculated and obtained in step S202.

[0192] In step S203 following step S202, the CPU 11 executes processing for presenting a frame based on the acquired range information on the captured image in the selection screen Gs. That is, the CPU 11 controls the display section 17 so as to display the above-mentioned frame information W or the frame information W indicating the range acquired in step S202 on the captured image in the selection screen Gs.

[0193] In step S204 following step S203, the CPU 11 determines whether any operation has been applied to the frame. If the CPU 11 determines that no operation has been applied to the frame, it determines whether a range fixing operation (in this example, a re-operation of the pull-down button Bp as described above) has been performed in step S205. If the CPU 11 determines that no range fixing operation has been performed, the CPU 11 returns to step S204. The processing in steps S204 and S205 provides a loop process to wait for an operation or range fixing operation to be applied to the frame.

[0194] In a case where the CPU 11 determines in step S204 that an operation is applied to the frame, the CPU 11 proceeds to step S206 to execute a process of changing the size or shape of the frame according to the operation, and returns to step S204.

[0195] On the contrary, in the case where the CPU 11 determines in step S205 that the range fixing operation is performed, the CPU 11 proceeds to step S207 to perform the range storing process, and terminates the process. Figure 15 In the storage process of step S207, when no operation is applied to the frame, the process of storing the information about the range acquired in step S202 is performed, and when an operation is applied to the frame to change at least the size or shape, information indicating the range of the frame when the range fixing operation is performed is stored.

[0196] Figure 16 This is a flowchart of the process related to the setting of various ranges.

[0197] First, in step S301, the CPU 11 waits until an operation to complete the selection of various ranges is performed. In this example, the operation to complete the selection of various ranges is, for example, an operation to select a completion button (not shown) provided in the selection screen Gs. Therefore, in the processing of step S301, the operation to select the completion button is waited for.

[0198] In the case where the operation of completing the selection of the various ranges is performed, the CPU 11 acquires information on the coordinates of each of the various ranges on the wide-angle captured image in step S302, and performs a process of storing the information on the coordinates of each of the various ranges and the information on the focal length of the wide-angle imaging in the subsequent step S303, and then terminates. Figure 16 A series of processing shown.

[0199] Here, information on the focal length during wide-angle imaging may be acquired from the imager 2 , or information on the designated focal length of the imager 2 during the previous wide-angle imaging process in step S101 may be used.

[0200] In addition, when the focal length during tracking imaging is fixed in advance at a predetermined focal length, information about coordinates during wide-angle imaging can be converted into information about pan and tilt angles at the predetermined focal length as information about the range and can be set.

[0201] <4. Various Modifications>

[0202] [4-1. First Modification Example]

[0203] Here, an example is given above in which the objects to be listed on the list are predefined in the correspondence information I1. However, the use of the correspondence information I1 is not essential.

[0204] For example, it is also possible to adopt a technique of listing all objects recognized in the object recognition process on a list of all tracking start ranges, tracking ranges, search ranges, and search exclusion ranges.

[0205] Alternatively, although all recognized objects are initially listed on the lists of all ranges as described above, objects to be listed may be selected for each range later based on the history of selecting objects from the lists for each range. For example, a technique may be employed in which, for each range, objects frequently selected from the list in the first rank to a predetermined higher rank are listed on the list of that range.

[0206] In this case, in response to an object being selected from the list, the CPU 11 sequentially stores information indicating which object was selected for each range as a selection history. Then, when presenting the selection screen Gs, for example, after performing tracking imaging a predetermined number of times or more (i.e., after collecting a predetermined number of history samples), the CPU 11 refers to the corresponding selection history for each of the various ranges and selects frequently selected objects from the first rank to a predetermined higher rank as candidate objects to be listed on the list. Then, when presenting the list, the CPU 11 executes a presentation process for listing the candidate objects.

[0207] With the help of the selection history-based list presented as described above, only objects suitable for each range can be presented as candidates without using the correspondence relationship information I1.

[0208] This eliminates the need to manually create the correspondence relationship information I1 in advance in order to reduce the burden on the user when selecting an object from the candidate list, which enables reduction of the operational burden associated with the development of the information processor 1 .

[0209] [4-2. Second Modification Example]

[0210] In the above explanation, an example is given in which only a single object is selected from the list to set the range. However, a plurality of objects may also be selected.

[0211] Figure 17 An example of a selection screen GsA in which a plurality of objects can be selected from a list is shown.

[0212] As shown in the figure, in the selection screen GsA, a check box Cb is set for each object in the object list of the target range among the tracking start range, tracking range, search range, and search exclusion range (in the accompanying figure, the tracking range is shown by example), thereby allowing the object to be selected by checking the check box Cb.

[0213] Here, in this example, in the case of selecting multiple objects from a list, as Figure 18 As illustrated, a process is performed to present frame information W indicating a range including the selected object on the captured image. The drawing illustrates frame information W corresponding to a case where two of the objects ("teacher's desk" and "lectern") are selected from the list. Therefore, in this case, information indicating a range including range H1 (which corresponds to the "teacher's desk" shown in the drawing) and range H2 (which corresponds to the "lectern") is presented as frame information W.

[0214] The CPU 11 in this case sets the range indicated by the frame information W as a target range (in the example in the drawing, a tracking range) while performing the operation of fixing the range indicated by the presented frame information W as described above.

[0215] With the processing as the second modification example described above, when the user wants to set a range covering a plurality of objects, the user only needs to perform at least an operation of selecting these objects from a list.

[0216] Therefore, it is possible to reduce the user's operational burden associated with setting a tracking range covering a plurality of objects.

[0217] It should be noted that although the tracking range is used as an example above, this is similarly applicable to any of other ranges such as the tracking start range and the search range. When multiple objects are selected from the list, frame information W indicating the range including the selected objects can be presented on the captured image.

[0218] [4-3. Third Modification Example]

[0219] Here, the tracking start range can also be referred to as the range in which the search for the tracking target subject is performed at the start of tracking imaging. Furthermore, the tracking range can also be referred to as the range in which the search for the tracking target subject is performed during tracking imaging. The search range is the range in which the search for the subject is performed if the tracking target subject is lost as described above. In light of these points, the tracking start range, tracking range, and search range can also each be referred to as the range in which the search for the subject is performed.

[0220] In contrast, the search exclusion range is a range in which the search for a subject is not performed in order to prevent subjects that are not the tracking target from being mistakenly tracked, as described above. Therefore, if the object selected for the search exclusion range is also selected for any of the tracking start range, tracking range, and search range outside the search exclusion range, an inconsistency in the range settings will occur.

[0221] To prevent such inconsistency, this example proposes the following technology: This technology aims to prevent an object selected from a candidate list for a range other than the search exclusion range or a candidate list for the search exclusion range from being presented as selectable in another candidate list.

[0222] Figure 19 and Figure 20 A specific example is shown.

[0223] Figure 19 An example is shown in which the objects “teacher's desk”, “lectern”, and “display” are selected from the candidate list for the tracking range.

[0224] The CPU 11 in this case, after performing the object selection on the tracking range as described above, performs a list presentation process when presenting a candidate list for searching the exclusion range so that the "display" that has been selected on the tracking range side is not displayed in a state for selection by the user. For example, Figure 20 As shown, Display is grayed out.

[0225] It should be noted that, as far as the corresponding object is not in a state for user selection, it may be hidden rather than displayed in a grayed-out manner.

[0226] Note that to prevent inconsistencies in range settings, an error message indicating the occurrence of inconsistencies may be provided to the user. That is, if an object selected from either the candidate list for the range outside the search exclusion range or the candidate list for the search exclusion range is also selected from the other candidate list, a process of presenting an error message may be performed.

[0227] Figure 21 and Figure 22 is a diagram that helps explain a specific example. Figure 21 As shown, when the objects "teacher's desk", "lectern" and "display" are selected from the candidate list for tracking range and then "display" is selected from the candidate list for searching exclusion range, processing is performed to present an error message indicating that "display" cannot be selected.

[0228] Therefore, in response to an inconsistent selection being made, an error notification is provided to the user, which makes it possible to prevent the occurrence of inconsistency in scoping.

[0229] [4-4. Fourth Amendment]

[0230] As an alternative to the range corresponding to the object, a range set based on history information about the position of the subject (hereinafter referred to as a “position history-dependent range”) may be presented as a candidate for each of various ranges related to tracking imaging.

[0231] An example of a position history dependent range may be a range that a subject as a tracking target often passes through (a frequently passed range). A range that a subject often passes through may also be referred to as a range where the subject is detected with high frequency, and thus may be obtained based on historical information about the subject's position.

[0232] Specifically, the CPU 11 in this case generates information about the position of the subject detected per unit time (e.g., every few seconds, etc.) during the previous tracking imaging of the subject, as historical information about the position. Then, based on the generated historical information, the CPU 11 sets a range where the detection frequency of the subject reaches a certain level or higher as a "frequently passed range."

[0233] The CPU 11 in this case generates a list including information indicating the "frequently passed range" set as described above as an option. The generation of this list is performed on at least the tracking range among the tracking start range, tracking range, search range, and search exclusion range.

[0234] Then, the CPU 11 executes processing for presenting the generated list to the user.

[0235] Figure 23 is a diagram for explaining a presentation example of a list.

[0236] As shown in the figure, in this case, the list includes the item "Frequently Passed Range" along with information indicating the name of the object recognized from the captured image. In this example, when an operation is performed to select "Frequently Passed Range," frame information W indicating the range is similarly presented on the captured image.

[0237] It should be noted that Figure 23 An example is given in which a “range that is frequently passed” is listed on the list of the tracking range. However, a “range that is frequently passed” may be listed similarly for the search range and the tracking start range.

[0238] Here, the position history-dependent range is not limited to the "frequently passed range". For example, it is preferable to include places where the subject often stops (places where he often stays) in the search range. Therefore, the range corresponding to the location where the subject often stops can be listed as the position history-dependent range. Alternatively, since the location where the subject is detected less frequently should be excluded from the search range, for example, the range corresponding to the location where the subject is detected less frequently can be listed as the position history-dependent range on the list of search exclusion ranges.

[0239] In addition, a different position history-dependent range may be set for each subject that is a tracking target (ie, for each teacher in this example).

[0240] In this case, the CPU 11 pre-generates and stores historical information based on each teacher as the historical information of the location. Then, the CPU 11 sets the location history dependency range based on the historical information about the teacher as the tracking target among the historical information stored on a teacher-by-teacher basis. At this time, the user can select which teacher is the teacher as the tracking target. Alternatively, the CPU 11 can select which teacher is the teacher as the tracking target based on the schedule information about the lectures to be given in the classroom (including at least information indicating the start time and the teacher in charge of each lecture).

[0241] Note that the above example presents a location history-dependent range as a single coordinate on a list. However, the location history-dependent range can also be used as information for adjusting the range corresponding to a recognized object. For example, considering a "frequently passed range," the range corresponding to "teacher's desk" or "lectern" can be adjusted to be wider or narrower.

[0242] <5. Other Changes>

[0243] The present embodiment is not limited to the specific examples described above, and various modifications are possible.

[0244] For example, when setting or adjusting various ranges related to tracking, information on the written area on the plate writing body o2, that is, the area where writing is performed, may also be referred to.

[0245] For example, in a case where the writing on the blackboard is relatively elongated and the teacher writes only in a partial area of ​​the writing on the blackboard (such as a corner), when tracking of the subject is performed in a manner that a range corresponding to the "writing on the blackboard" is set as the tracking range, adjustments can be performed to cause the tracking range to be narrowed from a range corresponding to the entire writing on the blackboard to a partial range including the writing area.

[0246] Alternatively, in a case where a range including the "teacher's desk" and the "writing on the blackboard" is designated as the tracking range, although at the start of the lecture (at the start of tracking imaging) only the range corresponding to the "teacher's desk" is set as the tracking range for tracking the subject, the tracking range can be expanded to the range including the "teacher's desk" and the "writing on the blackboard" in response to detecting writing relative to the writing on the blackboard to perform tracking.

[0247] It should be noted that writing can be detected by a character recognition technology based on OCR (Optical Character Recognition / Reader) or the like.

[0248] In addition, in the above description, regarding various ranges (i.e., tracking start range, tracking range, search range, and search exclusion range), it is assumed that object selection from the list is performed for basically all ranges. However, it is not necessary to select all of the various ranges, and items that are not selected may be subject to tracking-related control according to predetermined settings (initial settings).

[0249] For example, if the tracking range is not selected, the pan-tilt range can be set as the tracking range. Alternatively, if the tracking start range or search range is not selected, tracking can be started from the center of the captured image. Furthermore, if the search exclusion range is not selected, the entire range can be searched for the subject.

[0250] In the above description, an example of imaging for object recognition is provided using wide-angle imaging with a zoom function. However, imaging for object recognition can also be performed using panoramic imaging. Specifically, the CPU 11 in this case causes the imager 2 to perform imaging multiple times while panning and / or tilting, thereby obtaining multiple captured images. These captured images are then panoramically combined to generate a panoramic image, and object recognition processing is performed on the panoramic image.

[0251] This enables various ranges related to tracking to be appropriately set even in the case of using the imager 2 that is not equipped with a zoom function.

[0252] Here, in the above explanation, an example of applying the present technology is given in the case of performing tracking imaging by using a mechanical pan-tilt function. However, the present technology is also advantageously applicable to the case of performing subject tracking by controlling the trimming position (cropping position) from the captured image.

[0253] In the case where a tracking image of a subject is obtained by such control of the cropping position, tracking processing of the subject can be defined as processing of controlling the cropping position so that the subject remains at a specific position within the output frame of the captured image.

[0254] In addition, the aforementioned Figure 1 The example in which the information processor 1 and the imager 2 are independent components is shown. However, the information processor 1 may be provided as a device integrated with the imager 2. In addition, the information processor 1 may also be a device integrated with the recorder 3.

[0255] The above explanation illustrates an example of applying this technology to tracking imaging of a teacher giving a lecture in a classroom. However, examples of tracking targets in this technology are not limited to this. For example, this technology is also advantageously applicable to tracking targets such as instructors in in-house training or singers or performers at a live music performance.

[0256] <6. Overview of Examples>

[0257] As described above, the information processor (corresponding to F1) as an embodiment includes a presentation processing part (corresponding to F2) configured to perform a process of presenting a list of objects recognized in an object recognition process of a captured image to a user, and a tracking processing part (corresponding to F3) configured to set a tracking range of a subject corresponding to an object selected by the user from the list presented by the presentation processing part and to perform tracking processing of the subject based on the set tracking range.

[0258] Therefore, the operation required to set the tracking range of the subject is only sufficient to select an object from the list.

[0259] Therefore, it is possible to reduce the operational burden on the user associated with setting the tracking range of the subject.

[0260] In addition, in the information processor as an embodiment, the presentation processing part is configured to perform processing of presenting a candidate list for tracking ranges and a candidate list for tracking start ranges for subjects as a list of objects, and the tracking processing part is configured to set the tracking start range corresponding to the selected object when an object is selected from the candidate list for tracking start ranges.

[0261] By setting the tracking start range, the tracking process of the subject can be started from a range where the subject is likely to exist at the start of imaging.

[0262] Therefore, tracking of the subject can be started smoothly.

[0263] Furthermore, in an information processor as an embodiment, the presentation processing part is configured to perform processing of presenting a candidate list for tracking ranges and a candidate list for search ranges as a search range to be searched for a subject in a case where the subject is lost as a list of objects, and the tracking processing part is configured to set a search range corresponding to the selected object in a case where an object is selected from the candidate list for the search range.

[0264] By setting the search range, in the case where the subject being tracked is lost, the search for the subject can be performed with the range where the subject is highly likely to exist being set as a target.

[0265] Therefore, tracking can be smoothly resumed after the subject is lost.

[0266] Furthermore, in an information processor as an embodiment, the presentation processing part is configured to perform processing of presenting a candidate list for tracking ranges and a candidate list for search exclusion ranges as ranges excluded from the target of searching for a subject as a list of objects, and the tracking processing part is configured to set the search exclusion range corresponding to the selected object when an object is selected from the candidate list for search exclusion ranges.

[0267] By setting the search exclusion range, a range that is undesirable to be included in the subject search range in terms of appropriately performing tracking of the target subject (such as a range where a subject not being the tracking target is assumed to exist) can be excluded to perform search for the subject.

[0268] Therefore, the subject tracking performance can be improved.

[0269] In addition, in the information processor as an embodiment, the presentation processing part is configured to perform processing of presenting a candidate list for the tracking range and a candidate list for different ranges that are ranges different from the tracking range and related to the tracking processing as a list of objects, and to perform processing of presenting a list on which the objects listed thereon are at least partially different as the candidate list for the tracking range and the candidate list for the different ranges.

[0270] This enables presentation of objects suitable as candidates for each of the tracking range and the different ranges.

[0271] Therefore, it is possible to prevent unnecessary candidates from being listed and reduce the burden on the user when selecting an object from the candidate list.

[0272] In addition, in the information processor as an embodiment, the presentation processing section is configured to perform processing of presenting a candidate list for the tracking range and a candidate list for the different range based on correspondence information indicating a correspondence relationship between objects listed for the tracking range and each of the different ranges.

[0273] This enables presenting only objects suitable as candidates for each range through a simple process of generating a candidate list with reference to the correspondence relationship information.

[0274] Therefore, the burden on the user when selecting an object from the candidate list can be reduced through simple processing.

[0275] In addition, in the information processor as an embodiment, the presentation processing part is configured to perform processing of presenting a candidate list for the tracking range and a candidate list for different ranges which are ranges different from the tracking range and related to the tracking processing as lists of objects, and to perform processing of presenting the candidate list for the tracking range and the candidate list for the different ranges based on a history of selecting objects from respective candidate lists of the candidate list for the tracking range and the candidate list for the different ranges.

[0276] This enables presenting only objects suitable for each range as candidates based on the selection history of the objects.

[0277] Therefore, the burden on the user when selecting an object from the candidate list can be reduced. In addition, there is no need to manually create correspondence information indicating the correspondence between each range and the object to achieve such burden reduction, thereby reducing the operational burden associated with the development of the information processor.

[0278] In addition, in the information processor as the embodiment, the presentation processing section is configured to perform processing of presenting a list listing objects selected based on selection frequencies according to selection history as the candidate list for the tracking range and the candidate list for the different range.

[0279] This enables presenting as candidates only objects that are assumed to fit within each range according to the previously selected high frequency.

[0280] Therefore, it is possible to reduce the burden on the user when selecting an object from the candidate list.

[0281] In addition, in the information processor as the embodiment, the presentation processing section is configured to, in a case where an object is selected from the list, perform a process of presenting information indicating a range corresponding to the selected object on the captured image.

[0282] This enables the user to see the extent of his / her selected object on the captured image.

[0283] Therefore, the user is allowed to intuitively understand which object range is selected.

[0284] Additionally, in addition to text information indicating the range of the object, the range can also be seen on the captured image, which makes incorrect selection of the range less likely to occur.

[0285] Also, in the information processor as the embodiment, the presentation processing section is configured to execute a process of changing the size or shape of the range in response to an operation applied to the information indicating the range presented on the captured image.

[0286] Therefore, when information indicating the corresponding range is presented in response to selection of an object from the list, the user can apply an operation to the information indicating the range, thereby issuing an instruction to change the size or shape of the range.

[0287] Therefore, it is possible to both reduce the operational burden associated with range setting and improve the flexibility of range setting.

[0288] In addition, in the information processor as the embodiment, the presentation processing section is configured to, in a case where a plurality of objects are selected from the list, perform a process of presenting information indicating a range including the selected objects on the captured image.

[0289] Therefore, in a case where the user wants to set a tracking range covering a plurality of objects, the user only needs to perform at least an operation of selecting these objects from a list.

[0290] Therefore, it is possible to reduce the operational burden on the user associated with setting a tracking range covering a plurality of objects.

[0291] Furthermore, in the information processor as an embodiment, the presentation processing part is configured to: perform processing of presenting a candidate list for tracking range and a candidate list for searching exclusion range, so that an object selected from any one of the candidate lists is not presented in an optional state in another candidate list.

[0292] This makes it possible to prevent inconsistent selection from being performed, which conversely includes selecting an object selected for the tracking range also as an object for the search exclusion range and selecting an object selected for the search exclusion range also as an object for the tracking range.

[0293] Therefore, appropriate range setting without inconsistency between the tracking range and the search exclusion range can be achieved.

[0294] Furthermore, in the information processor as an embodiment, the presentation processing section is configured to perform processing for presenting error information when an object selected from either the candidate list for the tracking range or the candidate list for the search exclusion range is selected from the other candidate list.

[0295] This enables error notification to be provided to the user in response to making an inconsistent selection.

[0296] Therefore, it is possible to prevent the occurrence of setting inconsistency between the tracking range and the search exclusion range.

[0297] In addition, in the information processor as the embodiment, the presentation processing section is configured to generate and present to a user a list including, as options, information indicating a position history dependent range that is a range set based on history information on positions of the subject.

[0298] This enables presentation of a range assumed to be suitable for performing tracking according to the position history of the subject, such as a range through which an object frequently passes, as a candidate for the tracking range.

[0299] Therefore, an appropriate list considering the position history of the subject can be presented as a candidate list for selection for the tracking range.

[0300] Also, in the information processor as an embodiment, the subject includes a teacher, and the presentation processing section is configured to set the position history dependent range based on historical information about the teacher as the tracking target among historical information about positions stored on a teacher-by-teacher basis.

[0301] Different teachers may have different movement characteristics during their lectures. For example, one teacher may move frequently during a lecture, while another teacher may not move frequently during a lecture.

[0302] With the ranges of candidates for the tracking range set based on the position history information on the targeted teacher as described above, it is possible to present an appropriate candidate list that takes into account the movement characteristics of the targeted teacher during a lecture.

[0303] Furthermore, in the information processor as an embodiment, in the object recognition processing, recognition processing of at least one object among the podium, teacher's desk and the blackboard writing body is performed, and the presentation processing part is configured to perform processing of presenting a list to the user, which list includes at least one of the podium, teacher's desk and the blackboard writing body identified in the object recognition processing.

[0304] This enables setting of the tracking range based on objects arranged in a classroom where a lecture is being given.

[0305] Therefore, it is possible to set an appropriate range as the tracking range for performing tracking on the teacher giving a lecture.

[0306] In addition, an information processing method as an embodiment is an information processing method in which an information processor is configured to perform processing of presenting a list of objects identified in object recognition processing of a captured image to a user, setting a tracking range of a subject corresponding to an object selected by the user from the presented list, and performing tracking processing of the subject based on the set tracking range.

[0307] This information processing method as an embodiment can also provide similar actions and effects to those of the information processor as the above-described embodiment.

[0308] As an embodiment, the program is a program configured to cause an information processor to implement functions of presenting a list of objects identified in object recognition processing of a captured image to a user, setting a tracking range of a subject corresponding to an object selected by the user from the presented list, and performing tracking processing of the subject based on the set tracking range.

[0309] That is, the program as an embodiment is to cause the information processor to execute reference Figures 14 to 16 The processing procedures described in [ 15 ] .

[0310] Such a program makes it easy to realize the information processor as an embodiment.

[0311] Furthermore, such a program may be pre-stored in a recording medium built into a device such as a computer device or a ROM in a microcomputer equipped with a CPU. Alternatively, it may be temporarily or permanently saved (stored) in a removable recording medium such as a semiconductor memory, a memory card, an optical disc, a magneto-optical disc, or a magnetic disk. In addition, such a removable recording medium may be provided as what is generally called packaged software.

[0312] In addition, besides being installed on a personal computer or the like from a removable recording medium, such a program can also be downloaded from a download site via a network such as a LAN (Local Area Network) or the Internet.

[0313] It should be noted that the effects described herein are merely examples, and any other effects are also possible.

[0314] <7. This technology>

[0315] It should be noted that the present technology can also have the following configurations.

[0316] (1) An information processor comprising:

[0317] a presentation processing section configured to perform a process of presenting a list of objects recognized in the object recognition process of the captured image to a user; and

[0318] The tracking processing section is configured to set a tracking range of a subject corresponding to an object selected by a user from the list presented by the presentation processing section and to perform tracking processing of the subject based on the set tracking range.

[0319] (2) The information processor according to (1), wherein

[0320] The presentation processing section is configured to perform a process of presenting a candidate list for the tracking range and a candidate list for the tracking start range of the subject as lists of objects, and

[0321] The tracking processing section is configured to, in a case where an object is selected from the candidate list for the tracking start range, set a tracking start range corresponding to the selected object.

[0322] (3) The information processor according to (1) or (2), wherein

[0323] The presentation processing section is configured to perform processing of presenting a candidate list for the tracking range and a candidate list for the search range as a search range to be searched for a subject in a case where the subject is lost as a list of objects, and

[0324] The tracking processing section is configured to, in a case where an object is selected from the candidate list for the search range, set a search range corresponding to the selected object.

[0325] (4) The information processor according to any one of (1) to (3), wherein

[0326] The presentation processing section is configured to perform processing of presenting a candidate list for the tracking range and a candidate list for the search exclusion range as a range excluded from the target of searching for the subject as a list of objects, and

[0327] The tracking processing section is configured to, in a case where an object is selected from the candidate list for the search exclusion range, set a search exclusion range corresponding to the selected object.

[0328] (5) The information processor according to any one of (1) to (4), wherein

[0329] The rendering process is configured as follows:

[0330] A process of presenting a candidate list for the tracking range and a candidate list for a different range that is a range different from the tracking range and related to the tracking process as lists of objects is performed, and

[0331] A process of presenting lists on which objects listed thereon are at least partially different as a candidate list for a tracking range and a candidate list for the different range is performed.

[0332] (6) The information processor according to (5), wherein

[0333] The presentation processing section is configured to perform a process of presenting a candidate list for the tracking range and a candidate list for the different range based on correspondence relationship information indicating a correspondence relationship for the tracking range and each of the listed objects of the different ranges.

[0334] (7) The information processor according to any one of (1) to (6), wherein

[0335] The rendering process is configured as follows:

[0336] A process of presenting a candidate list for the tracking range and a candidate list for a different range that is a range different from the tracking range and related to the tracking process as lists of objects is performed, and

[0337] A process of presenting a candidate list for the tracking range and a candidate list for the different range based on a history of selecting an object from each of the candidate list for the tracking range and the candidate list for the different range is performed.

[0338] (8) The information processor according to (7), wherein

[0339] The presentation processing section is configured to perform a process of presenting a list listing objects selected based on a selection frequency according to a selection history as a candidate list for the tracking range and a candidate list for the different range.

[0340] (9) The information processor according to any one of (1) to (8), wherein

[0341] The presentation processing section is configured to, in a case where an object is selected from the list, perform a process of presenting information indicating a range corresponding to the selected object on the captured image.

[0342] (10) The information processor according to (9), wherein

[0343] The presentation processing section is configured to perform a process of changing a size or a shape of the range in response to an operation applied to information indicating a range presented on the captured image.

[0344] (11) The information processor according to (9) or (10), wherein

[0345] The presentation processing section is configured to, in a case where a plurality of objects are selected from the list, perform a process of presenting information indicating a range including the selected objects on the captured image.

[0346] (12) The information processor according to any one of (4) to (11), wherein

[0347] The presentation processing section is configured to perform processing of presenting a candidate list for the tracking range and a candidate list for the search exclusion range so that an object selected from either one of the candidate lists is not presented in a selectable state in the other one of the candidate lists.

[0348] (13) The information processor according to any one of (4) to (11), wherein

[0349] The presentation processing section is configured to perform a process of presenting error information in a case where an object selected from either one of the candidate list for the tracking range and the candidate list for the search exclusion range is selected from the other candidate list.

[0350] (14) The information processor according to any one of (1) to (13), wherein

[0351] The presentation processing section is configured to generate and present to a user a list including, as options, information indicating a position history dependent range that is a range set based on history information on the position of the subject.

[0352] (15) The information processor according to (14), wherein

[0353] The subjects include teachers, and

[0354] The presentation processing section is configured to set the position history dependency range based on history information on a teacher as a tracking target among history information on positions stored on a teacher-by-teacher basis.

[0355] (16) The information processor according to any one of (1) to (15), wherein

[0356] In the object recognition process, recognition processing of at least one object among the podium, the teacher's desk, and the blackboard writing is performed, and

[0357] The presentation processing section is configured to perform a process of presenting a list to a user, the list including at least one of the podium, the teacher's desk, and the blackboard writing body recognized in the object recognition process.

[0358] (17) An information processing method comprising:

[0359] Through the information processor,

[0360] A process of presenting a list of objects recognized in object recognition processing of a captured image to a user, setting a tracking range of a subject corresponding to an object selected by the user from the presented list, and performing tracking processing of the subject based on the set tracking range is performed.

[0361] (18) A program that causes an information processor to:

[0362] A process of presenting a list of objects recognized in object recognition processing of a captured image to a user, setting a tracking range of a subject corresponding to an object selected by the user from the presented list, and performing tracking processing of the subject based on the set tracking range is performed.

[0363] [Reference Signs List]

[0364] 100: Tracking Imaging System

[0365] 1: Information Processor

[0366] 2: Imager

[0367] 11: CPU

[0368] 16: Input part

[0369] 17: Display part

[0370] F1: Object recognition part

[0371] F2: Presentation processing part

[0372] F3: Tracking processing part

[0373] o1: Teacher's desk

[0374] o2: The style of the board

[0375] o3: Podium

[0376] o4: Display

[0377] o5: Seat part

[0378] Bp1, Bp2, Bp3, Bp4: Drop-down button

[0379] Gs, GsA: Selection screen

[0380] W: Frame information

[0381] Cb: Checkbox

Claims

1. An information processor for a PTZ camera, comprising: a presentation processing section configured to perform a process of presenting a list of objects recognized in the object recognition process of the captured image to a user; and a tracking processing section configured to set a tracking range of a subject corresponding to an object selected by a user from the list presented by the presentation processing section and to perform tracking processing of the subject based on the set tracking range, wherein the presentation processing section performs processing of presenting at least one of a candidate list for the tracking range or a candidate list for the tracking start range of the subject as a list of objects, and wherein each of the rendering processing portion and the tracking processing portion is implemented via at least one processor, and The presentation processing part performs processing for presenting a candidate list for tracking ranges and a candidate list for search ranges in which a subject is to be searched for in a case where the subject is lost as a list of objects, and the tracking processing part is also configured to set a search range corresponding to a selected object when an object is selected from the candidate list for search ranges.

2. The information processor according to claim 1, wherein The presentation processing section performs processing of presenting a candidate list for the tracking range and a candidate list for the tracking start range of the subject as lists of objects, and The tracking processing section sets a tracking start range corresponding to the selected object if the object is selected from the candidate list for the tracking start range.

3. The information processor according to claim 1, wherein The presentation processing section performs processing of presenting a candidate list for the tracking range and a candidate list for the search exclusion range as a range excluded from the target of searching for the subject as a list of objects, and The tracking processing section is further configured to, in a case where an object is selected from the candidate list for the search exclusion range, set a search exclusion range corresponding to the selected object.

4. The information processor according to claim 1, wherein Rendering processing part: A process of presenting a candidate list for the tracking range and a candidate list for a different range that is a range different from the tracking range and related to the tracking process as lists of objects is performed, and A process of presenting lists on which objects listed thereon are at least partially different as a candidate list for a tracking range and a candidate list for the different range is performed.

5. The information processor according to claim 4, wherein The presentation processing section performs a process of presenting a candidate list for the tracking range and a candidate list for the different range based on correspondence relationship information indicating a correspondence relationship for the tracking range and each of the listed objects of the different ranges. The information processor according to claim 1 , wherein: Rendering processing part: A process of presenting a candidate list for the tracking range and a candidate list for a different range that is a range different from the tracking range and related to the tracking process as lists of objects is performed, and A process of presenting a candidate list for the tracking range and a candidate list for the different range based on a history of selecting an object from each of the candidate list for the tracking range and the candidate list for the different range is performed.

7. The information processor according to claim 6, wherein The presentation processing section performs processing of presenting a list listing objects selected based on the selection frequency according to the selection history as a candidate list for the tracking range and a candidate list for the different range.

8. The information processor according to claim 1, wherein The presentation processing section is further configured to, in a case where an object is selected from the list, perform a process of presenting information indicating a range corresponding to the selected object on the captured image.

9. The information processor according to claim 8, wherein The presentation processing section is further configured to perform a process of changing the size or shape of the range in response to an operation applied to the information indicating the range presented on the captured image.

10. The information processor according to claim 8, wherein The presentation processing section is further configured to, in a case where a plurality of objects are selected from the list, perform a process of presenting information indicating a range including the selected objects on the captured image.

11. The information processor according to claim 3, wherein The presentation processing section performs processing of presenting a candidate list for the tracking range and a candidate list for the search exclusion range so that an object selected from either one of the candidate lists is not presented in a selectable state in the other one of the candidate lists.

12. The information processor according to claim 3, wherein The presentation processing section is further configured to perform a process of presenting error information in a case where the object selected from either one of the candidate list for the tracking range and the candidate list for the search exclusion range is selected from the other candidate list.

13. The information processor according to claim 1, wherein The presentation processing section is further configured to generate and present to a user a list including, as options, information indicating a position history dependent range that is a range set based on the history information on the position of the subject.

14. The information processor according to claim 13, wherein The subjects include teachers, and The presentation processing section is further configured to set the position history dependency range based on history information on the teacher as the tracking target among the history information on positions stored on a teacher-by-teacher basis.

15. The information processor according to claim 1, wherein In the object recognition process, recognition processing of at least one of a podium, a teacher's desk, or a blackboard is performed, and The presentation processing section performs a process of presenting a list to a user, the list including at least one of the podium, the teacher's desk, or the blackboard writing body recognized in the object recognition process.

16. An information processing method for a PTZ camera, comprising: Through the information processor, performing a process of presenting a list of objects recognized in the object recognition process of the captured image to a user, setting a tracking range of a subject corresponding to the object selected by the user from the presented list, and performing tracking processing of the subject based on the set tracking range, wherein the list of objects includes at least one of a candidate list for a tracking range or a candidate list for a tracking start range of a subject, and It also uses the information processor: Processing is performed to present a candidate list for tracking ranges and a candidate list for search ranges in which a subject is to be searched for in a case where the subject is lost as lists of objects, and to set a search range corresponding to a selected object when the object is selected from the candidate list for the search ranges.

17. A program product comprising instructions which, when executed, cause a processor to perform an information processing method for a PTZ camera, the information processing method comprising: performing a process of presenting a list of objects recognized in the object recognition process of the captured image to a user, setting a tracking range of a subject corresponding to the object selected by the user from the presented list, and performing tracking processing of the subject based on the set tracking range, wherein the list of objects includes at least one of a candidate list for a tracking range or a candidate list for a tracking start range of a subject, and Processing is performed to present a candidate list for tracking ranges and a candidate list for search ranges in which a subject is to be searched for in a case where the subject is lost as lists of objects, and to set a search range corresponding to a selected object when the object is selected from the candidate list for the search ranges.

Images