Learning video data editing program, learning video data editing method, and information processing apparatus

Abstract

To allow a worker to easily confirm information about unnecessary data.SOLUTION: An information processing device extracts a first feature amount and a second feature amount from a plurality of time-series image frames included in video data. The information processing device performs, on each of the plurality of image frames, processing of arranging a point corresponding to the image frame in a two-dimensional plan on a visible first display screen on the basis of the first feature amount and the second feature amount corresponding to the image frame. When receiving designation of a region on the two-dimensional plan, the information processing device gives information to a first image frame corresponding to a point included in the region and a second image frame not included in the region. The information processing device gives information on the first image frame and information on the second image frame onto a seek bar that is set on a visible second display screen and displays the plurality of image frames in a time series manner.SELECTED DRAWING: Figure 1

Description

Technical Field

[0001] The present invention relates to a learning video data editing program and the like.

Background Art

[0002] In recent years, when performing image recognition, a learning model such as an NN (Neural Network) is used. When performing image recognition using a learning model, as a preparation step, supervised machine learning using learning data is executed. In the following description, supervised machine learning is simply referred to as machine learning.

[0003] For example, in the learning data, a pair of image data and a correct label indicating the classification result of this image data is registered. In machine learning, a process of adjusting the parameters in the learning model is performed so that the output when the image data is input to the learning model approaches the correct label.

[0004] Generally, since the accuracy of the learning model can be improved by using more learning data, it is preferable to prepare a large amount of learning data. The work of preparing learning data is that while an operator checks the image data available as learning data, the operator sets the correct label corresponding to the image data. There is also a conventional technique in which image data considered unnecessary is deleted based on the feature amounts of a plurality of image data, and the image data to be used as learning data is narrowed down.

Prior Art Documents

Patent Documents

[0005]

Patent Document 1

Patent Document 2

Summary of the Invention

Problems to be Solved by the Invention

[0006] In the above-described prior art, image data is deleted based on feature amounts. However, it is difficult to accurately identify whether image data is unnecessary as learning data based only on feature amounts. For this reason, an operator has to make a final determination as to whether the image data is unnecessary data, and the burden on the operator is great.

[0007] For this reason, it is required to enable an operator to easily check information regarding unnecessary data.

[0008] In one aspect, an object of the present invention is to provide a learning video data editing program, a learning video data editing method, and an information processing apparatus that can enable an operator to easily check information regarding unnecessary data.

Means for Solving the Problem

[0009] In a first aspect, a computer is caused to execute the following processing. The computer extracts a first feature amount and a second feature amount respectively from a plurality of image frames in a time series included in video data. The computer executes, for each of the plurality of image frames, a process of arranging points corresponding to the image frames on a two-dimensional plane on a visually observable first display screen based on the first feature amount and the second feature amount corresponding to the image frames. When the computer receives a designation of a region of the two-dimensional plane, the computer assigns information to a first image frame corresponding to a point included in the region and a second image frame not included in the region. The computer assigns the information of the first image frame and the information of the second image frame on a seek bar that is set on a visually observable second display screen and that displays the plurality of image frames in a time series.

Effect of the Invention

[0010] Information regarding unnecessary data can be made easily checkable by an operator.

Brief Description of the Drawings

[0011]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

MODE FOR CARRYING OUT THE INVENTION

[0012] Hereinafter, embodiments of the learning video data editing program, the learning video data editing method, and the information processing apparatus disclosed in the present application will be described in detail with reference to the drawings. Note that the present invention is not limited by this embodiment.

EXAMPLE

[0013] FIG. 1 is a diagram for explaining the processing of the information processing apparatus according to the present embodiment. When the information processing apparatus according to the present embodiment receives an analysis instruction for video data, it analyzes the time-series image frames included in the video data, and extracts a first feature amount and a second feature amount from each image frame, respectively. It is assumed that each image frame is assigned a frame number in time series.

[0014] The information processing apparatus displays the screen information 10 having the two-dimensional plane 10a on a screen visible to the user. For example, the vertical axis of the two-dimensional plane 10a corresponds to the first feature amount, and the horizontal axis corresponds to the second feature amount. The information processing apparatus plots dots corresponding to each image frame on the two-dimensional plane 10a based on the first feature amount and the second feature amount extracted from each image frame. In the example shown in FIG. 1, the dots are indicated by black circles.

[0015] The information processing apparatus sets the threshold Th1 on the vertical axis and the threshold Th2 on the horizontal axis. The thresholds Th1 and Th2 are pre-specified values. The information processing apparatus identifies a region 11 in the entire region of the two-dimensional plane 10a where the first feature amount is less than the threshold Th1 and the second feature amount is less than the threshold Th2.

[0016] The information processing apparatus sets a flag not to be a deletion target for each image frame corresponding to the dots included in the region 11 among the dots included in the entire region of the two-dimensional plane 10a. In the following description, the image frame with the flag not to be a deletion target set is appropriately referred to as the "first image frame". In the example shown in FIG. 1, the image frame corresponding to the black circle is the first image frame.

[0017] The information processing apparatus sets a flag to be a deletion target for each image frame corresponding to the dots not included in the region 11 among the dots included in the entire region of the two-dimensional plane 10a. In the following description, the image frame with the flag to be a deletion target set is appropriately referred to as the "second image frame". In the example shown in FIG. 1, the image frame corresponding to the white circle is the second image frame. The information processing apparatus causes the frame number corresponding to the second image frame to be displayed in the region 10b of the screen information 10.

[0018] When the application button B1 included in the screen information 10 is pressed by the user, the information processing apparatus causes the screen information 20 to be displayed on a screen visible to the user.

[0019] The screen information 20 includes a seek bar 21 and a display area 22. In the seek bar 21, the position on the seek bar 21 is associated with each frame number of a plurality of image data in time series. The left end of the seek bar 21 corresponds to the frame number of the first image data of the video data, and the frame number becomes a larger number as the position on the seek bar 21 moves to the right. The right end of the seek bar 21 corresponds to the frame number of the last image data of the video data.

[0020] In the seek bar 21, an area corresponding to the frame number of the second image frame is visibly displayed within the range on the seek bar 21. In the following description, the area corresponding to the frame number of the second image frame within the range on the seek bar 21 is denoted as the "area to be excluded". In the example shown in FIG. 1, areas to be excluded L1 to L10 are set on the seek bar 21. The positions of the areas to be excluded on the seek bar 21 correspond to the positions of the second image data in the video data. The information processing apparatus displays, in the area 23, the start frame number and the end frame number among the consecutive frame numbers included in each area to be excluded for each area to be excluded. Note that, on the seek bar 21, areas other than the areas to be excluded L1 to L10 are areas corresponding to the frame numbers of the first image frames.

[0021] The user can move the pointer 21A on the seek bar 21. The image data of the frame number corresponding to the position of the pointer 21A specified by the user is displayed in the display area 22. For example, the user can confirm the second image frame to be deleted by moving the pointer 21A to a position corresponding to the area to be excluded.

[0022] As described above, the information processing apparatus according to the present embodiment extracts the second image data to be deleted based on the feature amounts of a plurality of image data included in the video data, and displays the extracted second image data to be deleted on the seek bar 21 where the position within the video data can be grasped. Thereby, the user can easily confirm the information regarding the second image data to be deleted.

[0023] Further, the information processing apparatus generates screen information 10 in which dots corresponding to each image frame are plotted on the two-dimensional plane 10a based on the first feature amount and the second feature amount extracted from each image frame, and displays it visibly. Thereby, the user can easily grasp the relationship between the feature amount of the second image frame to be deleted and the threshold value.

[0024] Next, an example of the configuration of the information processing apparatus that executes the processing shown in FIG. 1 will be described. FIG. 2 is a functional block diagram showing the configuration of the information processing apparatus according to the present embodiment. As shown in FIG. 2, this information processing apparatus 100 includes a communication unit 110, an input unit 120, a display unit 130, a storage unit 140, and a control unit 150.

[0025] The communication unit 110 is connected to an external device or the like by wire or wirelessly, and transmits and receives information to and from the external device or the like. For example, the communication unit 110 is realized by a NIC (Network Interface Card) or the like. The communication unit 110 may be connected to a network (not shown). The communication unit 110 may acquire the video DB 141 from an external device via the network.

[0026] The input unit 120 is an input device that inputs various types of information into the information processing apparatus 100. The input unit 120 corresponds to a keyboard, a mouse, a touch panel, or the like. For example, the user may operate the input unit 120 to input an instruction to analyze video data.

[0027] The display unit 130 is a display device that displays information output from the control unit 150. The display unit 130 corresponds to a liquid crystal display, an organic EL (Electro Luminescence) display, a touch panel, or the like. For example, the display unit 130 displays the screen information 10 and 20 described in FIG. 1.

[0028] The storage unit 140 has a video DB (Data Base) 141 and an image frame management table 142. The storage unit 140 is realized by, for example, a semiconductor memory element such as a RAM (Random Access Memory) or a flash memory, or a storage device such as a hard disk or an optical disk.

[0029] The video database 141 is a database that holds video data. For example, the video data has a plurality of image frames in time series, and each image frame is assigned a frame number. FIG. 3 is a diagram showing an example of the data structure of the video database. As shown in FIG. 3, this video database 141 associates the frame number with the image frame.

[0030] The image frame management table 142 holds various information regarding the image frame. FIG. 4 is a diagram showing an example of the data structure of the image frame management table. As shown in FIG. 4, this image frame management table 142 associates the frame number with the first feature amount, the second feature amount, and the flag.

[0031] The frame number is the number set for the image frame and is the number that identifies each image frame. The first feature amount and the second feature amount are feature amounts extracted by analyzing the image frame. For example, the first feature amount corresponds to the average luminance. The second feature amount corresponds to the variance of the luminance. The first feature amount and the second feature amount may be other feature amounts of the image.

[0032] The flag is information indicating whether the corresponding image frame is the second image frame to be deleted. For example, when the flag is "off", it indicates that the corresponding image frame is the first image frame that is not a deletion target. When the flag is "on", it indicates that the corresponding image frame is the second image frame to be deleted. The initial value of the flag is set to "off".

[0033] Returning to the description of FIG. 2. The control unit 150 includes an extraction unit 151 and a screen information generation unit 152. The control unit 150 is realized, for example, by a CPU (Central Processing Unit) or an MPU (Micro Processing Unit). Also, the control unit 150 may be executed by an integrated circuit such as an ASIC (Application Specific Integrated Circuit) or an FPGA (Field Programmable Gate Array).

[0034] When the extraction unit 151 receives an analysis instruction from the input unit 120, it extracts the first feature amount and the second feature amount from each image frame registered in the video DB 141. The extraction unit 151 associates the frame number of the image frame, the first feature amount, and the second feature amount, and registers them in the image frame management table 142. The extraction unit 151 sets the flag to the initial value "off".

[0035] The screen information generation unit 152 generates the screen information 10, 20 described in FIG. 1, and outputs the screen information 10, 20 to the display unit 130 for display. Hereinafter, an example of the process of the screen information generation unit 152 will be described.

[0036] Based on the image frame management table 142, the screen information generation unit 152 identifies the first feature amount and the second feature amount corresponding to each image frame, and plots the dots corresponding to each image frame on the two-dimensional plane 10a.

[0037] The screen information generation unit 152 sets the threshold Th1 on the vertical axis and the threshold Th2 on the horizontal axis on the two-dimensional plane 10a. The threshold Th1 and the threshold Th2 may use preset values or may be received from the input unit 120 operated by the user. The screen information generation unit 152 identifies a region 11 in the entire region of the two-dimensional plane 10a where the first feature amount is less than the threshold Th1 and the second feature amount is less than the threshold Th2.

[0038] The screen information generation unit 152 identifies each image frame (frame number of the image frame) corresponding to the dots not included in the region 11 among the dots included in the entire region of the two-dimensional plane 10a. The screen information generation unit 152 sets the flag of the frame number corresponding to the dots not included in the region 11 to "on" in the image frame management table 142.

[0039] The screen information generation unit 152 may set the colors of the dots included in the region 11 and the dots not included in the region 11 among the dots shown in the two-dimensional plane 10a of the screen information 10 to different colors. The screen information generation unit 152 sets a list of frame numbers for which the flag is "on" in the image frame management table 142 in the region 10b of the screen information 10. The screen information generation unit 152 generates the screen information 10 by the above processing, outputs it to the display unit 130, and causes it to be displayed.

[0040] The user refers to the screen information 10 displayed on the display unit 130. The user may operate the input unit 120 to change the threshold Th1 and the threshold Th2. When the screen information generation unit 152 receives the change of the threshold Th1 and the threshold Th2, it updates the region 11 of the two-dimensional plane 10a, and updates the flag of the image frame management table 142 based on whether dots are included in the region 11. As a result, the colors and the like of the dots shown in the two-dimensional plane 10a of the screen information 10 are updated.

[0041] When the screen information generation unit 152 detects that the application button B1 of the screen information 10 has been pressed by the user operating the input unit 120, it outputs the screen information 20 to the display unit 130 and causes it to be displayed.

[0042] The screen information generation unit 152 refers to the image frame management table 142, identifies the frame numbers for which the flag is set to "on", and identifies the start frame number and the end frame number of the exclusion target region. The screen information generation unit 152 sets the exclusion target region on the seek bar 21 based on the start frame number and the end frame number of the exclusion target region. In the example shown in FIG. 1, the screen information generation unit 152 sets the exclusion target regions L1 to L10 on the seek bar 21. Further, the screen information generation unit 152 sets the start frame number and the end frame number among the consecutive frame numbers included in the exclusion target region in the region 23 of the screen information 20.

[0043] The user refers to the screen information 20 displayed on the display unit 130. The user operates the input unit 120 to move the pointer 21A on the seek bar 21 to a desired position. When the screen information generation unit 152 detects the movement of the pointer 21A, it identifies the frame number corresponding to the position of the pointer 21A, acquires the image frame corresponding to the identified frame number from the video DB 141, and displays it in the display area 22.

[0044] When the screen information generation unit 152 detects that the playback button has been pressed by the user operating the input unit 120, it moves the pointer 21A on the seek bar 21 from the left end to the right end, and sequentially displays the image frames of the frame numbers corresponding to the positions of the pointer 21A in the display area 22.

[0045] Next, an example of the processing procedure of the information processing apparatus according to this embodiment will be described. FIG. 5 is a flowchart showing the processing procedure of the information processing apparatus according to this embodiment. As shown in FIG. 5, the extraction unit 151 of the information processing apparatus 100 receives an analysis instruction from the input unit 120 (step S101).

[0046] The extraction unit 151 analyzes all the image frames of the video data, extracts the first feature amount and the second feature amount, and registers them in the image frame management table 142 (step S102).

[0047] The screen information generation unit 152 of the information processing apparatus 100 plots the dots corresponding to each image frame on a two-dimensional plane based on the first feature amount and the second feature amount (step S103). The screen information generation unit 152 identifies the image frames to be deleted according to whether dots are included in the area specified based on the threshold values Th1 and Th2 (step S104).

[0048] The screen information generation unit 152 updates the flag in the image frame management table 142 (step S105). The screen information generation unit 152 displays the screen information 10 on the display unit 130 (step S106).

[0049] The screen information generation unit 152 accepts the pressing of the application button B1 (step S107). Based on the image frame management table 142, the screen information generation unit 152 sets an exclusion target area on the seek bar 21 (step S108).

[0050] The screen information generation unit 152 causes the display unit 130 to display the screen information 20 (step S109). The screen information generation unit 152 causes an image frame with a frame number corresponding to the pointer position on the seek bar 21 to be displayed in the display area 22 (step S110).

[0051] Next, the effects of the information processing apparatus 100 according to the present embodiment will be described. The information processing apparatus 100 extracts second image data to be deleted based on the feature amounts of a plurality of image data included in the video data, and displays the extracted second image data to be deleted on the seek bar 21 where the position within the video data can be grasped. As a result, the user can easily confirm information regarding the second image data to be deleted.

[0052] The user can move the pointer 21A on the seek bar 21. The information processing apparatus 100 causes the image data with the frame number corresponding to the position of the pointer 21A specified by the user to be displayed in the display area 22. For example, the user can confirm the second image frame to be deleted by moving the pointer 21A to a position corresponding to the exclusion target area.

[0053] The information processing apparatus 100 generates screen information 10 in which dots corresponding to each image frame are plotted on the two-dimensional plane 10a based on the first feature amount and the second feature amount extracted from each image frame, and visually displays it. As a result, the user can easily grasp the relationship between the feature amount of the second image frame to be deleted and the threshold value.

[0054] Note that the information processing apparatus 100 may generate learning data obtained by deleting the second image frame from the video DB 141 and use it for machine learning of the learning model.

[0055] Next, an example of the hardware configuration of a computer that realizes the same functions as the information processing apparatus 100 shown in the above embodiment will be described. FIG. 6 is a diagram showing an example of the hardware configuration of a computer that realizes the same functions as the information processing apparatus of the embodiment.

[0056] As shown in FIG. 6, the computer 200 includes a CPU 201 that executes various arithmetic processes, an input device 202 that receives input of data from a user, and a display 203. Further, the computer 200 includes a communication device 204 that exchanges data with an external device or the like via a wired or wireless network, and an interface device 205. Further, the computer 200 includes a RAM 206 that temporarily stores various information, and a hard disk device 207. And each device 201-207 is connected to a bus 208.

[0057] The hard disk device 207 has an extraction program 207a and a screen information generation program 207b. Further, the CPU 201 reads out each program 207a, 207b and expands it in the RAM 206.

[0058] The extraction program 207a functions as an extraction process 206a. The screen information generation program 207b functions as a screen information generation process 206b.

[0059] The process of the extraction process 206a corresponds to the process of the extraction unit 151. The process of the screen information generation process 206b corresponds to the process of the screen information generation unit 152.

[0060] Note that each program 207a, 207b does not necessarily have to be stored in the hard disk device 207 from the beginning. For example, each program is stored in a "portable physical medium" such as a flexible disk (FD), a CD-ROM, a DVD, a magneto-optical disk, or an IC card inserted into the computer 200. And the computer 200 may read out and execute each program 207a, 207b.

[0061] Regarding the embodiments including the above embodiments, the following appendices are further disclosed.

[0062] (Appendix 1) Extract the first feature amount and the second feature amount respectively from a plurality of time-series image frames included in video data, Based on the first feature amount and the second feature amount corresponding to the image frame, perform a process of arranging points corresponding to the image frame on a two-dimensional plane on a visually visible first display screen for each of the plurality of image frames, When receiving a designation of a region of the two-dimensional plane, assign information to a first image frame corresponding to a point included in the region and a second image frame not included in the region, A seek bar set on a visually visible second display screen, and assign information of the first image frame and information of the second image frame on the seek bar that displays the plurality of image frames in time series A learning video data editing program characterized by causing a computer to execute the process.

[0063] (Appendix 2) The process of assigning the information is to assign information indicating that the first image frame is not a deletion target and assign information indicating that the second image frame is a deletion target to the learning video data editing program according to Appendix 1.

[0064] (Appendix 3) When displaying the first display screen, further execute a process of displaying dots corresponding to the first image frame and dots corresponding to the second image frame in different colors. The learning video data editing program according to Appendix 1 is characterized by this.

[0065] (Appendix 4) In the second display screen, further execute a process of displaying an image frame corresponding to a position selected on the seek bar. The learning video data editing program according to Appendix 1 is characterized by this.

[0066] (Appendix 5) Extract the first feature amount and the second feature amount respectively from a plurality of time-series image frames included in the video data, Based on the first feature amount and the second feature amount corresponding to the image frame, perform a process of arranging points corresponding to the image frame on a two-dimensional plane on a visually visible first display screen for each of the plurality of image frames, When receiving a designation of a region of the two-dimensional plane, assign information to a first image frame corresponding to a point included in the region and a second image frame not included in the region, A seek bar set on a visually visible second display screen, and assign the information of the first image frame and the information of the second image frame on the seek bar that displays the plurality of image frames in time series, A learning video data editing method characterized in that a computer executes a process.

[0067] (Appendix 6) The process of assigning the information is to assign information indicating that the first image frame is not a deletion target and assign information indicating that the second image frame is a deletion target, and the learning video data editing method according to Appendix 5.

[0068] (Appendix 7) When displaying the first display screen, further execute a process of displaying the color of the dot corresponding to the first image frame and the color of the dot corresponding to the second image frame in different colors, and the learning video data editing method according to Appendix 5.

[0069] (Appendix 8) In the second display screen, further execute a process of displaying an image frame corresponding to a position selected on the seek bar, and the learning video data editing method according to Appendix 5.

[0070] (Appendix 9) An extraction unit that extracts the first feature amount and the second feature amount respectively from a plurality of time-series image frames included in the video data, Based on the first feature amount and the second feature amount corresponding to the image frame, a process of arranging points corresponding to the image frame on a two-dimensional plane of a visible first display screen is executed for each of the plurality of image frames. When receiving a designation of a region of the two-dimensional plane, information is given to a first image frame corresponding to a point included in the region and a second image frame not included in the region. A screen information generation unit that gives information of the first image frame and information of the second image frame on a seek bar set on a visible second display screen and that displays the plurality of image frames in time series An information processing apparatus characterized by having the above.

[0071] (Appendix 10) The information processing apparatus according to Appendix 9, wherein the screen information generation unit gives information indicating that the first image frame is not a deletion target and gives information indicating that the second image frame is a deletion target.

[0072] (Appendix 11) The information processing apparatus according to Appendix 9, wherein when displaying the first display screen, the screen information generation unit further executes a process of displaying dots corresponding to the first image frame and dots corresponding to the second image frame in different colors.

[0073] (Appendix 12) The information processing apparatus according to Appendix 9, wherein the screen information generation unit further executes a process of displaying an image frame corresponding to a position selected on the seek bar on the second display screen.

Explanation of Reference Numerals

[0074] 100 Information processing apparatus 110 Communication unit 120 Input unit 130 Display unit 140 Storage unit 141 Video DB 142 Image frame management table 150 Control unit 151 Extraction unit 152 Screen information generation unit

Claims

1. Extract a first feature amount and a second feature amount respectively from a plurality of image frames in time series included in video data, Based on the first feature amount and the second feature amount corresponding to the image frame, execute, for each of the plurality of image frames, a process of arranging a point corresponding to the image frame on a two-dimensional plane on a visually observable first display screen, Set a first threshold value on a first axis of the two-dimensional plane, set a second threshold value on a second axis of the two-dimensional plane, and display, in a visually observable state, a region that is less than the first threshold value and less than the second threshold value on the two-dimensional plane, When receiving a designation of a region on the two-dimensional plane, attach information to a first image frame corresponding to a point included in the region and a second image frame not included in the region, A seek bar set on a visually observable second display screen, and attach the information of the first image frame and the information of the second image frame on the seek bar that displays the plurality of image frames in time series A learning video data editing program characterized by causing a computer to execute a process.

2. The process of attaching the information attaches information indicating that the first image frame is not a deletion target, and attaches information indicating that the second image frame is a deletion target. The learning video data editing program according to Claim 1.

3. When displaying the first display screen, further execute a process of displaying dots corresponding to the first image frame and dots corresponding to the second image frame in different colors. The learning video data editing program according to Claim 1.

4. In the second display screen, further execute a process of displaying an image frame corresponding to a position selected on the seek bar. The learning video data editing program according to Claim 1.

5. Extract a first feature amount and a second feature amount respectively from a plurality of image frames in time series included in video data, Based on the first feature amount and the second feature amount corresponding to the image frame, execute, for each of the plurality of image frames, a process of arranging a point corresponding to the image frame on a two-dimensional plane on a visually observable first display screen, Set a first threshold on the first axis of the two-dimensional plane, set a second threshold on the second axis of the two-dimensional plane, and display in a visible state the region that is less than the first threshold and less than the second threshold in the two-dimensional plane. When receiving a designation of a region in the two-dimensional plane, attach information to a first image frame corresponding to points included in the region and a second image frame not included in the region. A seek bar set on a visible second display screen, and attach the information of the first image frame and the information of the second image frame on the seek bar that displays the plurality of image frames in time series. A method for editing learning video data, characterized in that a computer executes the processing.

6. An extraction unit that extracts a first feature amount and a second feature amount respectively from a plurality of time-series image frames included in video data. Based on the first feature amount and the second feature amount corresponding to the image frame, perform a process of arranging points corresponding to the image frame on a two-dimensional plane on a visible first display screen for each of the plurality of image frames. Set a first threshold on the first axis of the two-dimensional plane, set a second threshold on the second axis of the two-dimensional plane, display in a visible state the region that is less than the first threshold and less than the second threshold in the two-dimensional plane. When receiving a designation of a region in the two-dimensional plane, attach information to a first image frame corresponding to points included in the region and a second image frame not included in the region. A seek bar set on a visible second display screen, and attach the information of the first image frame and the information of the second image frame on the seek bar that displays the plurality of image frames in time series. A screen information generation unit. An information processing apparatus, characterized by comprising the above.

Images