Information processing apparatus

Abstract

To efficiently classify whether a person who appears in a video is to be pixelated or not even with a video in which many persons appear.SOLUTION: An information processing apparatus according to the present invention comprises: acquisition means for acquiring a video; detection means for detecting persons in the video; calculation means for calculating a score on the basis of an appearance frequency in the video for each of the detected persons; and classification means for classifying whether the person is to be subjected to processing or not depending on a result of comparison between the score and a predetermined value for each of the detected persons.SELECTED DRAWING: Figure 4

Description

[Technical field]

[0001] The present invention relates to an information processing device. [Background technology]

[0002] From the viewpoint of privacy consideration, there is a technology that processes images so that people in the images cannot be identified. Patent Document 1 describes a surveillance camera that can perform face masking on all people photographed so that they cannot be identified by their faces at all times. Furthermore, Patent Document 2 describes an image processing device that, when all people in an image are masked and an event such as an abandoned bag is detected, only the person (object to be monitored) related to the detected event is displayed without being masked. This image processing device enables the object to be monitored to be identified at the client. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2020-174336 A [Patent Document 2] JP 2011-91705 A Summary of the Invention [Problem to be solved by the invention]

[0004] As described above, in Patent Document 2, when an event such as leaving a bag behind is detected, the state of a specific person is changed from being masked to being unmasked. This event includes not only leaving an object behind, but also taking it away, appearing, disappearing, etc. Unless such an event is detected, the masking of the specific person is not released.

[0005] For example, in a video of a child performing at a kindergarten play, where the above-mentioned phenomenon is difficult to detect, it is not possible to remove the masking of only one's child, even if one wishes to do so. In that case, one must edit the video to remove the masking of only one's child.

[0006] However, in cases where many people appear, such as at a play, if all the children are masked, it is necessary to remove the masks one by one to check whether they are your children or not, and then it is necessary to change only your children to an unmasked state, which is time-consuming.

[0007] Therefore, an object of the information processing device of the present invention is to efficiently classify people appearing in a video as to whether or not they should be subject to mosaicking, even in a video with many characters. [Means for solving the problem]

[0008] In order to achieve the above-mentioned object, the information processing device of the present invention is characterized by comprising an acquisition means for acquiring a video, a detection means for detecting a person from the video, a calculation means for calculating a score for each detected person based on the frequency of appearance in the video, and a classification means for classifying each detected person as to whether or not it is to be subjected to processing depending on the result of comparing the score for each detected person with a predetermined value. Effect of the Invention

[0009] According to the present invention, even in a video with many characters, the people appearing in the video can be efficiently classified as to whether or not they should be pixelated. [Brief description of the drawings]

[0010] [Figure 1] FIG. 1 is a diagram illustrating the overall configuration of a system according to an embodiment of the present invention. [Diagram 2] FIG. 1 is a block diagram illustrating a configuration of an electronic device 102 or an information processing device 103 according to the present embodiment. [Diagram 3] FIG. 1 is a block diagram showing a configuration of an imaging device 101 according to the present embodiment. [Figure 4] 11 is a flowchart illustrating processing performed by the information processing device 103 according to the first embodiment to classify people appearing in a moving image as to whether or not they are to be pixelated. [Diagram 5] 13 is an example of a person shooting information management table in which people are linked to the appearance dates and times of each person. [Figure 6] 13 is an example of a person score information management table in which people, the scores of each person, and information on whether each person is a mosaic target are linked together. [Figure 7] 2 is an example of a configuration of a video file. [Figure 8] 13 is an example of a UI displayed on the display means of the electronic device 102 when changing a person to be pixelated. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0011] Hereinafter, preferred embodiments of the present disclosure will be described in detail with reference to the accompanying drawings. In this specification and the drawings, components having substantially the same functional configurations are denoted by the same reference numerals, and redundant description will be omitted.

[0012] This embodiment is intended for a case where a moving image file captured by an imaging device 101 is uploaded to an information processing device 103, and data processing is performed by the information processing device 103 equipped with the system of the present invention. Furthermore, a user refers to anyone who uses the system of the present invention.

[0013] 1 is a diagram illustrating the overall configuration of a system according to this embodiment. The system according to this embodiment includes an imaging device 101, an electronic device 102, and an information processing device 103.

[0014] The imaging device 101 is used to generate a moving image file to be processed by an information processing device 103 described later. The moving image file used in this embodiment is not limited to a specific format, codec, or the like.

[0015] The electronic device 102 is a terminal device of a user who uses the system of the present invention, and is also used as a medium for acquiring information notified from an information processing device 103 described later.

[0016] The information processing device 103 performs data processing on the video file generated by the imaging device 101 and uploaded to classify whether or not people appearing in the video, as described below, are to be blurred, and notifies information as to whether or not the people are to be blurred.

[0017] A moving image file generated by the imaging device 101 is uploaded from a user's local environment to the information processing device 103 via a network 104. The network 104 may be wireless or wired, depending on its form.

[0018] In addition, in the system of the present invention, the means for transmitting the moving image file to the information processing device is not limited to a specific form, and other means than communication via a network may be used. In this embodiment, the moving image file may be uploaded directly from the imaging device 101 to the information processing device 103, or may be uploaded from the imaging device 101 to the information processing device 103 via the electronic device 102.

[0019] The information processing device described here may take the form of a server, may be a device having the same functions as the respective servers, or may be a server that aggregates the functions of the respective servers.

[0020] In this embodiment, the electronic device 102 is described as an example of a data output destination from the information processing device 103, but this is not limited to this depending on the format of the output data. When a server or the like of another system is connected as the output destination of the information processing device 103, it is not necessary to output data in text file format or displayed on a UI, and data may be output in a format such as a database.

[0021] In this embodiment, a moving image file is uploaded from the imaging device 101 to the information processing device 103, and processing is carried out in the information processing device 103 equipped with the system of the present invention. However, the present embodiment is not limited to this, and a form in which the system of the present invention is equipped in the electronic device 102 is also conceivable.

[0022] 2 is a block diagram for explaining an example of the configuration of each of the electronic device 102 and the information processing device 103 according to this embodiment. The electronic device 102 and the information processing device 103 according to this embodiment may each be realized by a single computer device, or may be realized by distributing each function to multiple computers as necessary. When configured by multiple computers, they are connected by a Local Area Network (LAN) or the like so as to be able to communicate with each other.

[0023] 2, the electronic device 102 and the information processing device 103 have a common configuration.

[0024] The electronic device 102 and the information processing device 103 also include input devices such as a keyboard 204 and a PD (pointing device) 205 , and a CPU (Central Processing Unit) 206 .

[0025] The electronic device 102 and the information processing device 103 each include a read only memory (ROM) 207, a random access memory (RAM) 208, and a hard disk drive (HDD) 209.

[0026] Furthermore, the electronic device 102 and the information processing device 103 each include a recording media drive 210 , a network I / F (NET I / F) 211 , and a bus 212 .

[0027] The display 201 displays, for example, icons, messages, menus, and other user interface information for managing the electronic device 102. The display 201 can also function as a keyboard 204 and a PD 205.

[0028] An image to be displayed on the display 201 is drawn in the VRAM 202. The image data generated in the VRAM 202 is transferred to the display 201 in accordance with a predetermined rule, and the image is displayed on the display 201.

[0029] The BMU 203 controls, for example, data transfer between memories (eg, between the VRAM 202 and other memories) and data transfer between memories and each I / O device (eg, the NET I / F 211).

[0030] The keyboard 204 has various keys for inputting characters and the like. The keyboard 204 includes a software keyboard that is displayed on the display 201. The PD 205 is used, for example, to point to icons, menus, and other content displayed on the display 201 or to drag and drop objects. The PD 205 includes operations on the display 201 using a finger or a touch pen.

[0031] The CPU 206 controls each device based on a control program such as an OS or application software stored in the ROM 207 , the HDD 209 , or the recording media drive 210 .

[0032] The ROM 207 stores various control programs and data. The RAM 208 has a work area for the CPU 206, an area for saving data during error processing, an area for loading control programs, and the like.

[0033] The HDD 209 stores various control programs executed in the electronic device 102 and data such as temporarily stored data.

[0034] The NET I / F 211 communicates with other electronic devices 102, printers, etc. via a network.

[0035] The bus 212 includes an address bus, a data bus, and a control bus.

[0036] The control program can be provided to the CPU 206 from the ROM 207, the HDD 209, or the recording media drive 210, or can be provided from another server or the like via the NET I / F 211 over the network.

[0037] 3 is a block diagram showing the configuration of an image capturing device 101 according to this embodiment. The image capturing device 101 is, for example, a terminal such as a digital camera 300 having an image capturing function.

[0038] The photographing lens 301 includes a zoom lens and a focus lens. The shutter 302 has an aperture function.

[0039] The imaging unit 303 is composed of a CCD (Charge Coupled Device) or a CMOS (Complementary Metal Oxide Semiconductor) element that converts an optical image into an electrical signal.

[0040] The A / D converter 304 converts the analog image data input from the imaging unit 303 into digital image data. The barrier 305 covers the photographing lens 301 and the like to prevent the imaging system, including the photographing lens 301, the shutter 302, and the imaging unit 303, from becoming dirty or being damaged.

[0041] The image processing unit 306 performs predetermined pixel interpolation, resizing such as reduction, and color conversion processing on the image data from the A / D converter 304 or the image data from the memory control unit 307. The image processing unit 306 also performs predetermined calculation processing using the captured image data, and the system control unit 308 performs exposure control and distance measurement control based on the calculation results. The image data output from the A / D converter 304 is written into the memory 309 via the image processing unit 306 and the memory control unit 307, or via the memory control unit 307 only.

[0042] The system control unit 308 controls the entire image capturing apparatus 101. The system control unit 308 executes a program stored in a non-volatile memory 312 to realize processing of the image capturing apparatus 101.

[0043] The memory 309 temporarily records image data output from the A / D converter 304 and image data to be displayed on the display unit 310. The memory 309 has a storage capacity sufficient to store a predetermined number of still images, a predetermined length of moving images, and audio. The memory 309 also serves as a memory for displaying images (video memory).

[0044] D / A converter 311 converts image data for image display stored in memory 309 into an analog signal and supplies it to display unit 310. In this way, the image data for display temporarily stored in memory 309 is displayed by display unit 310 via D / A converter 311. Display unit 310 performs display according to the analog signal from D / A converter 311 on a display device such as an LCD (Liquid Crystal Display).

[0045] The non-volatile memory 312 is an electrically erasable and recordable memory, such as an EEPROM (Electrically Erasable Programmable Read-Only Memory), etc. The non-volatile memory 312 stores constants for the operation of the system control unit 308, control programs such as a program for performing cooperation, which will be described later, and the like.

[0046] The system memory 313 is, for example, a RAM, and develops constants and variables for the operation of the system control unit 308, programs read from the non-volatile memory 312, and the like.

[0047] A mode changeover switch 314, a first shutter switch 315, a second shutter switch 316, and an operation unit 317 are operation means for inputting various operation instructions to the system control unit 308. The mode changeover switch 314 switches the operation mode of the system control unit 308 to one of a still image recording mode, a moving image recording mode, a playback mode, etc.

[0048] A first shutter switch 315 is turned on when a shutter button provided on the image capture device 101 is pressed halfway (instruction to prepare for shooting) during operation, and generates a first shutter switch signal SW1.

[0049] The second shutter switch 316 is turned on when the shutter button is fully pressed (photographing instruction) and generates a second shutter switch signal SW2. The system control unit 308 starts a series of photographing processing operations from reading a signal from the imaging unit 303 to writing image data to the recording medium 325 in response to the second shutter switch signal SW2.

[0050] Each operating member of the operating unit 317 acts as various function buttons with appropriate functions assigned for each scene, for example, by selecting and operating various function icons displayed on the display unit 310. Examples of the function buttons include a confirmation button, an end button, a back button, an image forward button, a jump button, a filter button, and an attribute change button. For example, when the menu button is pressed, a menu screen in which various settings can be made is displayed on the display unit 310. The user can intuitively make various settings using the menu screen displayed on the display unit 310, the four-way button, and the SET button.

[0051] A controller wheel 318 is a rotatable operating member included in the operating unit 317, and is used together with the direction buttons to specify a selection item, etc. A system control unit 308 controls each component of the imaging device 101 based on a pulse signal.

[0052] Furthermore, the system control unit 308 can determine the angle at which the controller wheel 318 has been rotated, the number of rotations, etc., based on the pulse signal. Note that the controller wheel 318 may be any operating member that can detect a rotation operation.

[0053] The controller ring 319 is a rotary operation member included in the operation unit 317, and can be operated to rotate around the optical axis around the lens barrel. For example, by operating the controller ring 319, an electrical pulse signal corresponding to the amount of rotation (amount of operation) is generated. The system control unit 308 controls each component of the imaging device 101 based on the pulse signal. In addition, when a function switching button of the controller ring 319 included in the operation unit 317 is pressed, a menu screen that allows the function assigned to the controller ring 319 to be changed is displayed on the display unit 310. The controller ring 319 and the controller wheel 318 are normally used to select a mode item or change a value.

[0054] The power switch 320 switches the power on and off.

[0055] The power supply control unit 321 is composed of a battery detection circuit, a DC-DC converter, a switch circuit for switching between blocks to be energized, etc. The power supply control unit 321 detects whether a battery is installed, the type of battery, and the remaining battery level. The power supply control unit 321 also controls the DC-DC converter based on the detection results and instructions from the system control unit 308, and supplies the required voltage for the required period to each component, including the recording medium 325.

[0056] The power supply unit 322 is composed of a primary battery such as an alkaline battery or a lithium battery, a secondary battery such as a NiCd battery, a NiMH battery, or a Li battery, an AC adapter, or the like.

[0057] The communication unit 323 transmits the images stored in the recording medium 325 to an external device.

[0058] The I / F 324 is an interface with a recording medium 325, and the recording medium 325 is configured with a semiconductor memory, a magnetic disk, or the like.

[0059] The NET I / F 326 is a network I / F that performs communication via a network under the control of the system control unit 308. Communication with the electronic device 102 can be performed via this network.

[0060] 3 is an example of a general imaging device, and the imaging device 101 does not necessarily require the shutter 302, the mode change switch 314, the display unit 310, and the like.

[0061] (First embodiment) FIG. 4 is a flowchart illustrating processing performed by the information processing device 103 according to the first embodiment to classify people appearing in a moving image as to whether or not they are to be pixelated.

[0062] In S401, the information processing device 103 receives a moving image file transmitted from the imaging device 101 or the electronic device 102. As described above, the means for transmitting the moving image file to the information processing device 103 is not limited to a specific form.

[0063] In S402, the information processing device 103 assigns the total number of received video files to a variable N as an initial value, and assigns "0" to a variable i.

[0064] In S403, the information processing device 103 acquires the i-th video file and stores it internally.

[0065] In S404, the information processing device 103 analyzes the video data in the i-th video file and acquires information on people appearing in the video.

[0066] In S405, the information processing device 103 acquires the appearance date and time of a person appearing in the video from the shooting information in the video file. Fig. 7 shows an example of the configuration of a video file. One video file 700 includes shooting information 702 and video data 703.

[0067] Shooting information 702 is shooting information related to video data managed by imaging device 100, and specifically, information such as the shooting date and time of the video and the appearance date and time of people appearing in the video is stored. If shooting information is not included in the video file, the date and time of receiving the video file from electronic device 102 may be registered as the shooting date and time of the video. In that case, the date and time of each person's appearance will also be the date and time of receiving the video file, but if a person appears repeatedly in the video, that person will appear multiple times at the same shooting date and time.

[0068] Therefore, since there may be a bias in the score for that person, which will be described later, the person is registered as appearing once for that shooting date and time. In this embodiment, information on the appearance date and time of the person appearing in the video acquired in S405 is acquired from the shooting information 702 of the video file.

[0069] In S406, the information processing device 103 stores information linking people appearing in the video with the appearance dates and times of the people as a person shooting information management table. Fig. 5 is an example of a person shooting information management table linking people with the appearance dates and times of each person.

[0070] 5, there are person shooting information management tables such as person shooting information table 1 for the i-th video file and person shooting information table 2 for video files older than the i-th video file. Each table includes information on person 501 or 503 and appearance date and time 502 or 504 of each person. Person 501 or 503 indicates the person acquired by analyzing the video data in S404 with a classification code of person A, B, C, or D. This classification code is a value, character, etc. that is automatically set to be unique for each person acquired by analyzing the video data.

[0071] In S407, the value of score 1 of a person appearing in a video is calculated based on person shooting information table 1 of the i-th video file. For example, in one video file, person B appears more frequently than persons A, C, and D (FIG. 5). Therefore, the value of score 1 of person B is set higher than those of persons A, C, and D.

[0072] In S408, the information processing device 103 determines whether or not a person appearing in the i-th video appeared in one or more video files saved in the past. The information processing device 103 makes this determination by referring to person shooting information table 1 related to the i-th video file and person shooting information table 2 related to a video file saved before the i-th video file. For example, person C in person shooting information table 2 of FIG. 5 is also in person shooting information table 1. If the information processing device 103 determines that a person appearing in the i-th video appeared in one or more video files saved in the past, the process proceeds to S409, and if not, the process proceeds to S413.

[0073] In S409, the information processing device 103 calculates the value of score 2 based on the difference between the appearance date and time of the person in the i-th video and the appearance date and time in the previously stored video.

[0074] In S410, the information processing device 103 adds the value of score 1 calculated in S407 and the value of score 2 calculated in S409, and sets the sum as the score of the person.

[0075] If a person appearing in the i-th video appears multiple times in a previous video, or if that person appears in multiple previous videos, the calculated value of score 2 will be higher, and as a result, the person's score will also be higher.

[0076] If the information processing device 103 determines that a person appearing in the i-th video does not appear in one or more previously saved video files, in S411, the information processing device 103 sets the value of score 1 calculated in S407 as the score for that person.

[0077] As a method of calculating the value of Score 1, in addition to the frequency of appearance, the following conditions may be used to calculate a higher score. The calculation method is not limited. If a particular person speaks frequently in a video or if the proportion of the time that a particular person speaks in a video is large compared to the total time of the video, the score of that person may be calculated to be higher than that of other people. Furthermore, if a particular person continues to occupy a certain amount or more of the screen area in one frame of the video, the score of that person may be calculated to be higher than that of other people.

[0078] In S412, the information processing device 103 increments i by i+1 and proceeds to S413.

[0079] In S413, the information processing device 103 determines whether or not i > N. If the information processing device 103 determines that i > N, the process proceeds to S414, and if it determines that i > N is not true, the process returns to S403.

[0080] In S414, the information processing device 103 stores information linking information about people appearing in the video with scores as a person score information management table. Fig. 6 is an example of a person score information management table linking person information 601, a score 602 for each person, and information 603 on whether each person is a mosaic target. In the person shooting information table of Fig. 5, the people appearing in descending order of frequency are Person D, Person C, Person B, and Person A, while in the person score information management table of Fig. 6, the people appearing in descending order of score 602 are Person D, Person C, Person B, and Person A. In this way, the higher the appearance frequency, the higher the score.

[0081] In S415, the information processing device 103 transmits only the video file to the electronic device 102.

[0082] In S416, the information processing device 103 automatically sets an initial value of the score boundary value based on the score of each person in the person score information management table. For example, the average value of the scores is set as the initial value of the boundary value. Alternatively, the initial value of the boundary value may be set so that the number of people who are not to be pixelated is a predetermined number. The predetermined number may be set manually by the user, or the information processing device 103 may set the predetermined number in advance.

[0083] In S417, the information processing device 103 refers to the person shooting information management table for each person appearing in the video, and compares the score with the boundary value. As a result of the comparison, a person whose score is equal to or greater than the boundary value is automatically classified as a person who is not to be mosaiced, and a person whose score is less than the boundary value is automatically classified as a person to be mosaiced. In other words, the higher the score of a character, the less likely it is to be a mosaiced subject, and the lower the score, the more likely it is to be a mosaiced subject.

[0084] In S418, the information processing device 103 notifies the electronic device 102 of the classification result. Specifically, the information processing device 103 extracts people from the video data, applies mosaic processing to the areas of the people classified as subjects to be mosaiced, generates processed video data, and transmits it to the electronic device 102. The electronic device 102 receives the processed video data and displays and plays it on a display means, allowing the user to confirm people who are not subjects to be mosaiced.

[0085] Then, the information processing device 103 transmits the UI together with the processed video data to the electronic device 102. The electronic device 102 displays the UI on the screen while displaying and playing back the processed video data. If the user does not want to pixelate a person or if the person to pixelate is not as intended, the user can change it using the UI.

[0086] 8 is an example of a UI displayed on the display means of the electronic device 102. A minimum score value 801 and a maximum score value 802 are displayed on the display means of the electronic device 102. The minimum score value 801 and the maximum score value 802 are automatically set to be within a range that includes all of the scores of each person.

[0087] A slider 805 indicating the current boundary value is further displayed on the display means of the electronic device 102. A person having a score higher than the boundary value is determined to be a person 804 who is not a target of mosaic, and a person having a score lower than the boundary value is determined to be a person 803 who is a target of mosaic.

[0088] If the person to be pixelated or the person not to be pixelated does not match the user's intention, the user operates the electronic device 102 to move the slider 805 to instruct the score boundary value to be changed. This makes it possible to change the people to be pixelated and the people not to be pixelated all at once. In this way, the user can reduce the effort of removing the pixelation from each person and checking them or setting to apply the pixelation, and can efficiently apply the pixelation to the other people without pixelating the desired person.

[0089] In S419, the information processing device 103 judges whether or not there is an instruction to change the score boundary value from the electronic device 102. If it is judged that there is an instruction to change the score boundary value from the electronic device 102, the process returns to S417, and the person is classified into a person to be a mosaic target and a person to be a non-mosaic target again based on the new boundary value. If it is judged that there is no instruction to change the score boundary value from the electronic device 102, the process proceeds to S420.

[0090] In S420, the information processing device 103 confirms the classification result, performs mosaic processing on the area in which the person to be mosaicked is detected, generates a video file including the video data to which the mosaic processing has been applied, and transmits the file to the electronic device 102.

[0091] In addition, a specific person may be individually set as to whether or not to be pixelated, regardless of the score.

[0092] In the information processing device 103 that is the destination of the moving image file and the information about the person not to be pixelized, the face may be hidden with an icon, an image, blacked out, or the like instead of pixelizing.

[0093] (Other embodiments) The present invention can also be realized by a process in which a program for implementing one or more of the functions of the above-described embodiments is supplied to a system or device via a network or a storage medium, and one or more processors in a computer of the system or device read and execute the program. The present invention can also be realized by a circuit (e.g., ASIC) that implements one or more of the functions.

[0094] The disclosure of this embodiment includes the following configurations and methods.

[0095] (Configuration 1) An information processing device, An acquisition means for acquiring a video; A detection means for detecting a person from a video; A calculation means for calculating a score for each of the detected persons based on the frequency of appearance of the person in the video; A classification means for classifying whether or not a processing process is to be performed on each of the detected persons according to a result of comparing the score of each of the detected persons with a predetermined value; An information processing device comprising:

[0096] (Configuration 2) 2. The information processing device according to configuration 1, wherein the appearance frequency is a value based on an appearance interval and an appearance count of the detected person in the video.

[0097] (Configuration 3) the acquiring means acquires, as the moving images, a first moving image and a second moving image in order from the oldest captured moving image to the newest captured moving image, When the detection means detects the person from the second video, 3. The information processing device according to configuration 1 or 2, wherein the calculation means calculates a score for each of the detected persons based on the appearance frequency in the first video and the second video.

[0098] (Configuration 4) The information processing device further includes: a setting means for setting the predetermined value based on the score for each of the detected persons, The information processing device according to any one of configurations 1 to 3, wherein the classification means classifies whether or not the detected person is to be subjected to the processing depending on a result of a comparison between the score of each detected person and the predetermined value set by the setting means.

[0099] (Configuration 5) the classification means classifies a person having a score equal to or greater than the predetermined value for each of the detected persons as a person to be subjected to the processing; 5. The information processing device according to any one of configurations 1 to 4, wherein a person whose score for each detected person is less than the predetermined value is classified as not to be subjected to the processing.

[0100] (Configuration 6) The information processing device further includes: A notification means for notifying an electronic device of a result of classification by the classification means. 6. The information processing device according to any one of configurations 1 to 5, comprising:

[0101] (Configuration 7) The information processing device further includes: a receiving means for receiving an instruction to change the predetermined value from the electronic device; When the receiving means receives an instruction to change the predetermined value from the electronic device, The setting means changes the predetermined value based on an instruction from the electronic device, The information processing device according to any one of configurations 1 to 6, wherein the classification means classifies whether or not the detected person is to be subjected to the processing depending on a result of a comparison between the score of each detected person and the predetermined value changed by the setting means.

[0102] (Configuration 8) The information processing device further includes: The information processing device according to any one of configurations 1 to 7, further comprising a processing means for executing the processing on an area of ​​the video in which a person classified as a subject to be subjected to the processing is detected.

[0103] (Configuration 9) An acquisition step of acquiring a video; A detection step of detecting a person from a video; A calculation step of calculating a score for each of the detected persons based on the frequency of appearance of the person in the video; a classification step of classifying whether or not a processing process is to be performed on each of the detected persons according to a result of comparing the score of each of the detected persons with a predetermined value; 13. A method for controlling an information processing device, comprising:

[0104] (Configuration 10) A program for causing a computer to execute the control method for an information processing device according to configuration 9.

[0105] (Configuration 11) A computer-readable recording medium having recorded thereon a program for causing a computer to execute the method for controlling an information processing device according to configuration 9.

Claims

1. An information processing device, An acquisition means for acquiring a video; A detection means for detecting a person from a video; A calculation means for calculating a score for each of the detected persons based on the frequency of appearance of the person in the video; A classification means for classifying whether or not a processing process is to be performed on each of the detected persons according to a result of comparing the score of each of the detected persons with a predetermined value; An information processing device comprising:

2. The information processing apparatus according to claim 1 , wherein the appearance frequency is a value based on an appearance interval and an appearance count of the detected person in the video.

3. the acquiring means acquires, as the moving images, a first moving image and a second moving image in order from the oldest captured moving image to the newest captured moving image, When the detection means detects the person from the second video, The information processing apparatus according to claim 1 , wherein the calculation means calculates a score for each of the detected persons based on the appearance frequency in the first video and the second video.

4. The information processing device further includes: a setting means for setting the predetermined value based on the score for each of the detected persons, The information processing device according to claim 1 , wherein the classification means classifies whether or not the detected person is to be subjected to the processing depending on a result of a comparison between the score of each detected person and the predetermined value set by the setting means.

5. The information processing device according to claim 1, characterized in that the classification means classifies each of the detected persons whose score is equal to or greater than the predetermined value as a target for performing the processing, and classifies each of the detected persons whose score is less than the predetermined value as a not target for performing the processing.

6. The information processing device further includes: A notification means for notifying an electronic device of a result of classification by the classification means.

2. The information processing apparatus according to claim 1, further comprising:

7. The information processing device further includes: a receiving means for receiving an instruction to change the predetermined value from the electronic device; When the receiving means receives an instruction to change the predetermined value from the electronic device, The setting means changes the predetermined value based on an instruction from the electronic device, The information processing device according to claim 4 or 6, characterized in that the classification means classifies whether or not to perform the processing on each of the detected persons depending on a result of comparing the score of each of the detected persons with the predetermined value changed by the setting means.

8. The information processing device further includes: 2 . The information processing apparatus according to claim 1 , further comprising: a processing unit for executing the processing on an area in the moving image in which a person classified as a subject to be subjected to the processing is detected.

9. An acquisition step of acquiring a video; A detection step of detecting a person from a video; A calculation step of calculating a score for each of the detected persons based on the frequency of appearance of the person in the video; a classification step of classifying whether or not a processing process is to be performed on each of the detected persons according to a result of comparing the score of each of the detected persons with a predetermined value; 13. A method for controlling an information processing device, comprising:

10. A program for causing a computer to execute the method for controlling an information processing device according to claim 9.

11. 10. A computer-readable recording medium having recorded thereon a program for causing a computer to execute the method for controlling an information processing device according to claim 9.

Images