Information processing device, information processing method, and program

Abstract

To display a time when an event occurs.SOLUTION: An information processing method includes: acquisition means of acquiring a measurement result as the number of the occurrence of the change of a luminance on the basis of an address event signal indicating an address of a pixel, in which the change of the luminance occurs and a time; and control means of displaying a relation between the time and the measurement result. The control means makes it the measurement result in accordance with a direction of the change of the luminance.SELECTED DRAWING: Figure 4

Description

[Technical field]

[0001] The present invention relates to event-based sensors. [Background technology]

[0002] An event-based sensor is known that outputs a change in luminance of each pixel as an address event signal in real time (see Patent Document 1). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2019-134271 A Summary of the Invention [Problem to be solved by the invention]

[0004] The problem that the present invention aims to solve is to display the time when an event occurs. [Means for solving the problem]

[0005] The information processing device of the present invention, which solves the above problem, comprises an acquisition means for acquiring a measurement result, which is the number of luminance changes that have occurred, based on an address event signal indicating the address and time of a pixel where a luminance change has occurred, and a control means for displaying the relationship between time and the measurement result, wherein the control means displays the measurement result according to the direction of the luminance change. Effect of the Invention

[0006] You can view the time when an event occurred. [Brief description of the drawings]

[0007] [Figure 1] FIG. 1 is a block diagram showing an example of a hardware configuration of an information processing device. [Diagram 2]FIG. 1 is a block diagram showing an example of a functional configuration of an information processing device including an event-based sensor; [Diagram 3] A diagram showing an example of the configuration of an event-based sensor [Figure 4] Schematic diagram of the output of an event-based sensor [Diagram 5] FIG. 13 is a diagram showing an example of a display. [Figure 6] FIG. 13 is a diagram showing an example of a display. [Figure 7] FIG. 13 is a diagram showing an example of a display. [Figure 8] Schematic diagram of the output of an event-based sensor [Figure 9] FIG. 13 is a diagram showing an example of a display. [Figure 10] A flowchart for explaining a process executed by an information processing device. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0008] Hereinafter, an information processing device according to an embodiment of the present invention will be described with reference to the drawings. In this regard, components having the same functions in all the drawings will be given the same numbers, and repeated description will be omitted.

[0009] <Embodiment 1> <Information processing device: Figure 1> FIG. 1 shows a block diagram illustrating an example of a hardware configuration of an information processing device. In FIG. 1, the information processing device 100 includes an event-based sensor 101 including an imaging optical system 1010 and a photoelectric conversion element 1011, a CPU 102, and a memory 103. The event-based sensor 101 outputs an address event signal according to the received incident light. The imaging optical system 1010 is specifically a light receiving lens that receives incident light and forms an image on the photoelectric conversion element 1011. The photoelectric conversion element 1011 is specifically a SPAD sensor or a CMOS sensor that outputs an address event signal according to the received incident light. The CPU 102 reads out and executes an OS and other programs stored in the memory 103, controls each connected component, and performs calculations and logical judgments for various processes. The processes executed by the CPU 102 include information processing according to this embodiment. The CPU 102 also controls the driving of the focus and aperture of the imaging optical system 1010, the driving of the photoelectric conversion element 1011, and the like. The memory 103 is, for example, a hard disk drive or an external storage device, and stores programs and various data related to the information processing of the embodiment.

[0010] Next, an example of the functional configuration of the information processing device according to the present embodiment will be described with reference to FIG. 2. The information processing device 100 includes an event-based sensor 101, a measurement unit 201, a display control unit 202, a determination unit 203, a display unit 104, and an operation unit 105. The event-based sensor 101 outputs an address event signal according to the received incident light. More specifically, the event-based sensor 101 outputs an address event signal indicating the address and time of a pixel where a change in luminance has occurred. The measurement unit 201 acquires a measurement result of measuring the number of occurrences of luminance changes from the address event signal output by the event-based sensor. The display control unit 202 causes the display unit 104 to display a graph showing the time on the horizontal axis and the number of occurrences of luminance changes on the vertical axis based on the address event signal. Here, the measurement results are displayed separately according to the direction of the luminance change. Specifically, the measurement results are shown in which the number of pixels where the luminance has changed in the positive direction is counted in the quadrant where Y>0 based on the horizontal axis (X=0). Also, the measurement results are shown in which the number of pixels where the luminance has changed in the negative direction is counted in the quadrant where Y<0. The determination unit 203 determines whether a predetermined condition is satisfied based on the measurement result in which a change in luminance occurs at a certain time. For example, a threshold is set in advance, and whether a change in luminance in a predetermined direction occurs equal to or exceeds the threshold is determined. The display unit 104 displays a graph showing time on the horizontal axis and the number of pixels in which a change in luminance occurs on the vertical axis. For example, the display unit 104 may be a device outside the information processing device, such as a display device or a projection device such as a projector. The output of the address event signal may be something other than a display, such as a configuration that outputs sound. In that case, a speaker may be built into or connected to the information processing device. The operation unit 106 accepts various instructions such as imaging and display input by a user. The display unit 104 and the operation unit 105 may be configured by an external device different from the information processing device. The functional configuration of the information processing device may also include configurations other than those listed here.

[0011] <Event-based sensor: Figure 3> An example of an event-based sensor according to the present embodiment will be described. The event-based sensor counts the number of incident photons and determines the timing when the number of counted photons exceeds a predetermined threshold. The event-based sensor also measures the time (clock count) required for the number of photons to reach or exceed a first threshold, and detects a change in luminance by comparing the required times. Specifically, when the previously measured required time is T0 and the latest required time is T, if the difference T-T0 is equal to or greater than a second threshold, a change in luminance in the negative direction is detected. If the difference T0-T is equal to or greater than the second threshold, a change in luminance in the positive direction is detected. If the difference between T and T0 is less than the second threshold, no change in luminance is detected. The second threshold is a value equal to or greater than zero, and a value set in advance or according to other parameters is used.

[0012] 3a is a diagram showing an example of the configuration of a photoelectric conversion element 1011. The photoelectric conversion element 1011 is made up of a pixel section 110 and a peripheral circuit 120. The peripheral circuit 120 includes a vertical arbitration circuit 121 and a horizontal readout circuit 122.

[0013] FIG. 3b is a diagram showing an example of the configuration of each pixel unit constituting the event-based sensor. The pixel unit 110 includes a photoelectric conversion unit 111, a pixel counter 112, a time counter 113, a first judgment circuit 114, a memory 115, a comparator 116, a second judgment circuit 117, a response circuit 118, and a selection circuit 119. The photoelectric conversion unit 111 includes an avalanche photodiode (SPAD) that operates in Geiger mode, and is configured to count the number of photons incident on the photoelectric conversion unit 111 with the pixel counter 112. The time counter 113 counts the time during which the photon is incident on the photoelectric conversion unit 111. By configuring the event-based sensor using the SPAD, it is possible to detect a luminance change at the level of one photon. By detecting a luminance change at the level of one photon, it is possible to acquire an address event signal even in a dark vision state such as at night.

[0014] When the number of photons counted by pixel counter 112 reaches a first threshold, first decision circuit 114 stops counting time by time counter 113. Past count values ​​of time counter 113 are stored in memory 115, and a comparator 116 is used to find the difference between the current count value of time counter 113 and the past count value of time counter 113.

[0015] If the difference count value is equal to or greater than the second threshold, the second determination circuit 117 sends a request signal to the vertical arbitration circuit 121 via the response circuit 118. The response circuit 118 receives a response from the vertical arbitration circuit 121 indicating whether output of the address event data is permitted or not. If the difference count value is less than the second threshold, the response circuit 118 does not send a request signal.

[0016] When the response circuit 118 receives a response indicating permission to output, the selection circuit 119 outputs the count value of the time counter circuit 113 to the horizontal output circuit 122. The horizontal output circuit 122 outputs the received count value as an output signal from the photoelectric conversion element 1011 to the detection unit 103.

[0017] Since the count value of the difference calculated by the comparator 116 corresponds to the inverse of the incidence frequency of photons, the photoelectric conversion element 1011 according to this embodiment has a function of measuring "changes in the incidence frequency of photons", that is, changes in luminance. In addition, the second judgment circuit 117 is used to output an address event only when the difference in the interval of time at which the number of incident photons reaches the first threshold is equal to or greater than the second threshold. That is, the photoelectric conversion element outputs the incidence frequency when the difference in incidence frequency is equal to or greater than the second threshold, and does not output the incidence frequency when the difference is less than the threshold. With the above configuration, an asynchronous photoelectric conversion element that detects changes in luminance as address events in real time for each pixel address can be realized.

[0018] <Variations of photoelectric conversion elements> In the above, a case has been shown in which a photoelectric conversion element is used that detects changes in the frequency of photon incidence by using a SPAD in the photoelectric conversion section and measuring the time at which a photon is incident. However, as long as the photoelectric conversion element detects changes in luminance as address events in real time, the configuration does not have to be as shown in FIG. 2. For example, as described in Patent Document 1, a photoelectric conversion element that detects changes in luminance as voltage changes may be used.

[0019] <Measurement Section 201> The measurement unit 201 measures the number of pixels in which a luminance change occurs at a certain time from the address event signal output by the event-based sensor. Specifically, the measurement unit 201 obtains measurement results by independently measuring the total number of pixels in which the luminance changes in the positive direction and the total number of pixels in which the luminance changes in the negative direction within a specific time range.

[0020] The specific time range is a preset parameter, and may be a minimum time width determined by the time resolution of the vertical arbitration circuit 121 of the photoelectric conversion element 1011, or a longer time range may be specified by the user. A shorter time width enables faster detection of an abnormal phenomenon, but a longer time width can reduce the influence of errors due to random noise and the like, improving the accuracy of distinguishing whether or not an abnormal phenomenon is occurring.

[0021] <Display control unit: 202> The display control unit 202 causes the display unit 104 to display a graph, which is generated based on the address event signal and shows the time on the horizontal axis and the number of pixels where a luminance change occurred on the vertical axis. At this time, the information processing device 100 according to this embodiment separately displays the number of occurrences of luminance changes in the positive direction y1 and the number of occurrences of luminance changes in the negative direction y2. This makes it easier for the user to grasp the time when the abnormality occurred.

[0022] FIG. 4 is a schematic diagram of an output in a frame image format when an object brighter than the background moving along the +X axis direction is captured by an information processing device using an event-based sensor. In FIG. 4, white indicates pixels whose luminance has changed to a positive value by more than a threshold, black indicates pixels whose luminance has changed to a negative value by more than a threshold, and gray indicates pixels whose luminance change is less than the threshold. As can be seen from FIG. 3, the luminance of the boundary between the object and the background changes as the object moves. In the pixels in front of the object (+X side), the luminance value of the boundary pixel changes to a positive value because the object, which is brighter than the background, moves. On the other hand, in the pixels behind the object (-X side), the luminance value of the boundary pixel changes to a negative value because the background darker than the object is captured as the object moves. That is, when the object moves, in an ideal environment ignoring photon shot noise, the number of pixels in which luminance changes in both the positive and negative directions are detected to be equal. In addition, when the brightness of the entire screen being captured changes, more luminance changes are detected in the direction in which the luminance changed. On the other hand, if the horizontal axis is simply time and the vertical axis is an integral value of the brightness change of the entire screen, it is difficult for the user to distinguish between the detection of a moving object and a change in brightness of the entire screen.

[0023] FIG. 5 is a diagram for explaining the display unit 104 of the information processing apparatus 100 of the present invention. On the horizontal axis is time, and on the vertical axis, the number of occurrences y1 (dotted line) of luminance changes in the positive direction and the number of occurrences y2 (broken line) of luminance changes in the negative direction are separately displayed. The output of the event-based sensor does not generate changes in either the positive or negative direction when there is no movement of the subject, but when there is movement of the subject, changes in both the positive and negative directions occur simultaneously. Therefore, as shown in FIG. 5, by separately displaying the number of occurrences y1 of luminance changes in the positive direction and the number of occurrences y2 of luminance changes in the negative direction, it becomes easier for the user to grasp the presence or absence of movement of the subject. For example, when using an event-based sensor for stationary monitoring, it becomes easier to specify the time when a moving object is detected due to intrusion or theft. In FIG. 5, time is displayed on the horizontal axis and the number of occurrences of luminance changes is displayed on the vertical axis, but the vertical and horizontal axes may be interchanged. Also, an oblique coordinate system may be used instead of a rectangular coordinate system. That is, it is sufficient that the relationship between the time and the number of occurrences of luminance changes is displayed on the display unit.

[0024] <Display only the luminance change of the ROI> As the number of occurrences y1 of luminance changes in the positive direction and the number of occurrences y2 of luminance changes in the negative direction, it is possible to count and display all the luminance changes of the pixels on the entire screen, or only the luminance changes of some pixels. When used for intrusion detection or theft detection, there may be cases where it is desired to identify the presence or absence of an abnormal phenomenon by focusing only on the luminance changes in a specific area such as an intrusion route. In such use cases, it is preferable to count only the luminance changes within the area specified by the user in advance and display them on the display unit. Thereby, it is possible to efficiently grasp only the abnormalities that have occurred in the area of interest. When specifying the area of interest, the information processing apparatus 100 only needs to be provided with a user interface for the user to specify the area of interest.

[0025] <Random noise removal> In addition, in order to distinguish between luminance changes caused by photon shot noise and luminance changes caused by the movement of a subject, it is preferable to detect only luminance changes of pixels that are relatively grouped together and not detect luminance changes of isolated pixels. That is, the measurement unit measures the occurrence of luminance changes in an area larger than a predetermined size based on the address event signal. Since luminance changes caused by photon shot noise occur randomly, it is possible to distinguish between luminance changes caused by the movement of a subject and luminance changes caused by noise by not detecting luminance changes of isolated pixels.

[0026] Whether the luminance change is of an isolated pixel or a group of pixels can be determined by the number of connections. The address of the pixel where the luminance change occurred can be identified from the address event signal. For example, if a luminance change occurs at the pixel of interest, and there are two or more pixels within four neighboring pixels where a luminance change occurs in the same direction, those two pixels are determined to be connected. Then, if the group of pixels that are connected to each other contains a predetermined number of pixels (for example, 25 pixels) or more, it is determined that a luminance change has occurred in a group of pixels.

[0027] (Variation 1) One possible use case is to use an information processing device using an event-based sensor for intrusion detection, theft detection, etc. When an event-based sensor is used, most pixels do not change in luminance when there is no intrusion or theft, and a change in luminance occurs only when an abnormality such as intrusion or theft occurs, so the sensor can be used as a low-power consumption surveillance system for intrusion and theft detection. In such a use case, when a change in luminance occurs, it means that a moving object has been detected, so it can be inferred that an abnormality has occurred.

[0028] <Embodiment 2> The information processing device 100 according to the second embodiment differs from that according to the first embodiment in the information on luminance changes displayed on the display unit, which makes it easier to know the time when an event occurred.

[0029] <Only brightness changes above the threshold are displayed; Fig. 6> Fig. 6 is an example of a display on the display unit 104. Fig. 6 displays the number of occurrences of luminance changes at the time when an event occurs in which the absolute value of the number of occurrences of luminance changes in the positive direction y1 is equal to or greater than the first threshold value and the absolute value of the number of occurrences of luminance changes in the negative direction y2 is equal to or greater than the first threshold value. This is preferable because it makes it easier to grasp the time when an event occurred, since it is possible to exclude luminance changes caused by random noise and the like and to grasp only the time when the subject made a large movement.

[0030] Only luminance changes that satisfy at least one of the following conditions may be displayed: the absolute value of the number of occurrences of luminance changes in the positive direction y1 is equal to or greater than a third threshold value, and the absolute value of the number of occurrences of luminance changes in the negative direction y2 is equal to or greater than a third threshold value. However, it is preferable to make a determination based on both the absolute value of the number of occurrences of luminance changes in the positive direction y1 and the absolute value of the number of occurrences of luminance changes in the negative direction y2, because this makes it easier to grasp the time when an event occurred.

[0031] <Plus and minus differences are also shown; Figure 7> FIG. 7 is an example of a display on the display unit 104. FIG. 7 shows an example of displaying the difference Δy between the number of occurrences y1 of brightness changes in the positive direction and the number of occurrences y2 of brightness changes in the negative direction. In addition to the number of occurrences y1 of brightness changes in the positive direction and the number of occurrences y2 of brightness changes in the negative direction, the difference between the number of occurrences y1 of brightness changes in the positive direction and the number of occurrences y2 of brightness changes in the negative direction is further displayed. This makes it possible to easily distinguish between brightness changes caused by the movement of the subject and brightness changes in the imaging range caused by changes in the illuminance of the environmental light (such as the transition between day and night outdoors, or turning on and off the lights indoors). As a result, it is preferable because the user can easily grasp the time when the movement of the subject occurred. The following description will be given.

[0032] Fig. 8 is a schematic diagram of the output in the frame image format in the same way as Fig. 4, when the subject does not move and the illuminance of the ambient light changes gradually. As can be seen from Fig. 7, excluding noise components, when the illuminance of the ambient light becomes brighter, the luminance values ​​of all pixels change to a positive value, and when the illuminance of the ambient light becomes darker, the luminance values ​​of all pixels change to a negative value. Therefore, when the illuminance of the ambient light changes, the difference between the number of occurrences of luminance changes in the positive direction y1 and the number of occurrences of luminance changes in the negative direction y2 changes significantly.

[0033] On the other hand, as shown in FIG. 4, when the subject moves, the difference between the number of occurrences of positive luminance changes y1 and the number of occurrences of negative luminance changes y2 across the entire screen can approximate zero, excluding noise components.

[0034] In this way, there is a commonality between a case where the illuminance of the ambient light changes and a case where the subject moves in that the number of occurrences of luminance changes in the positive direction y1 and the number of occurrences of luminance changes in the negative direction y2 are both large, but the difference between the number of occurrences of luminance changes in the positive direction y1 and the number of occurrences of luminance changes in the negative direction y2 is large. Therefore, by displaying the difference between the number of occurrences of luminance changes in the positive direction y1 and the number of occurrences of luminance changes in the negative direction y2, the user can distinguish between the luminance changes caused by the movement of the subject and the luminance changes caused by the change in illuminance of the ambient light, which is preferable.

[0035] <Threshold value based on positive and negative difference; Figure 9> In use cases such as intrusion detection and theft detection, there are cases where luminance changes caused by changes in the illuminance of the ambient light are not detected, and outputs caused by the movement of a subject are detected as specific events. Therefore, as shown in FIG. 9, only luminance changes are displayed where the difference between the number of occurrences of luminance changes in the positive direction y1 and the number of occurrences of luminance changes in the negative direction y2 is less than the second threshold, and the absolute values ​​of the number of occurrences of luminance changes in the positive direction y1 and the number of occurrences of luminance changes in the negative direction y2 are equal to or greater than the first threshold. This is preferable because it is possible to detect luminance changes caused by the movement of a subject as an abnormal phenomenon without detecting luminance changes caused by changes in the illuminance of the ambient light.

[0036] <Time periods when no luminance change occurs are omitted> When the luminance changes to be displayed are limited by a threshold value as in Figs. 6 and 9, the user will only pay attention to the time periods in which luminance changes are displayed. Therefore, it is preferable to display the time scale of the time periods in which no luminance changes occur in a compressed manner, rather than the time scale of the time periods in which luminance changes occur. In other words, when the number of occurrences of luminance changes is smaller than a predetermined value, the intervals of the scale on the time axis are displayed larger. Also, time periods in which the number of occurrences of luminance changes is smaller than a predetermined value may be omitted. This makes it easier for the user to grasp the time when a luminance change occurs and an abnormal phenomenon may occur.

[0037] <Mountain type and gelatin type> Also, the display method may be changed by focusing on the rate of brightness change. As can be seen from FIG. 4, when an object passes through the screen at a constant speed, the number of occurrences of both positive and negative brightness changes occurs over time. On the other hand, when the speed of the object is not constant, the number of occurrences of positive and negative brightness changes changes over time. Therefore, by simultaneously displaying the rate of brightness change in the positive direction and the rate of brightness change in the negative direction, it is possible to further facilitate identification of the type of abnormality that has occurred.

[0038] <Flowchart> The process executed by the information processing device 100 to display the address event signal described above will be described. FIG. 10 is a flowchart for describing the process executed by the information processing device 100. The process shown in the flowchart of FIG. 10 is executed by a computer, CPU 102, in accordance with a computer program stored in memory 103. In the following description, each process (step) is represented by adding an S to the beginning, and the representation of the process (step) will be omitted. However, the information processing device 100 does not necessarily have to perform all the steps described in this flowchart.

[0039] In S1001, the information processing device 100 initializes various settings. For example, a time range for measuring the number of occurrences of luminance changes is set. Also, a first threshold is set according to photon count noise. For example, a result of measuring luminance changes in a state where there is no moving object in a monitoring area is obtained, and a value at which an address event signal is observed is obtained. Since the address event signal observed at this time is likely to be noise, the number of occurrences of the noise is set as the first threshold. The method of setting the first threshold may be other than the above. An arbitrary value may be set by the user. Next, in S1002, the measurement unit 201 acquires an address event signal output by the event-based sensor. This address event signal includes the address of a pixel where a luminance change has occurred, the direction of the luminance change, and time information that can identify the time when the luminance change occurred. In S1003, the number of occurrences of luminance changes in the positive direction (first measurement value) y1 and the number of occurrences of luminance changes in the negative direction (second measurement value) y2 are measured based on the address event signal. In S1004, the determination unit 203 compares the measurement result with a preset first threshold value to determine whether the number of occurrences of luminance changes in the positive direction (first measurement value) y1 and the number of occurrences of luminance changes in the negative direction (second measurement value) y2 are greater than the first threshold value. For example, if either the number of occurrences of luminance changes in the positive direction (first measurement value) y1 or the number of occurrences of luminance changes in the negative direction (second measurement value) y2 is greater than the threshold value, the process proceeds to S1005 as Yes. If both the number of occurrences of luminance changes in the positive direction (first measurement value) y1 and the number of occurrences of luminance changes in the negative direction (second measurement value) y2 are equal to or less than the threshold value, the process proceeds to S1006 as No. At this time, it is considered that no luminance changes other than noise have occurred, so the display of the time when there is no number of occurrences of luminance changes may be skipped and the measurement result of the next time may be acquired. In this case, the process returns to S1002. Next, in S1005, the display control unit 102 plots the number of occurrences of luminance changes in the plus direction (first measurement value) y1 and the number of occurrences of luminance changes in the minus direction (second measurement value) y2 on a graph in association with the time of measurement. By displaying the direction of the luminance change separately, the occurrence of an event can be easily seen.In S1006, the information processing device 100 judges whether or not to end the process. The information processing device 100 may judge whether or not to end the process based on a user's instruction to end the process, or may judge whether or not all of the processing targets set in advance have been processed. If the information processing device 100 does not end the process, the information processing device 100 returns to S1002.

[0040] <Other embodiments> The present invention can also be realized by executing the following process. That is, software (programs) that realize the functions of the above-described embodiments are supplied to a system or device via a data communication network or various storage media. Then, a computer (or a CPU, MPU, etc.) of the system or device reads and executes the program. The program may also be provided by recording it on a computer-readable recording medium. [Explanation of symbols]

[0041] 100 Information processing device 101 Event-Based Sensors 201 Measurement Division 202 Display control unit 203 Judgment section 104 Display section 105 Operation section

Claims

1. an acquisition means for acquiring a measurement result, which is the number of occurrences of a luminance change, based on an address event signal indicating the address and time of the pixel where the luminance change occurred; and a control means for displaying the relationship between time and the measurement result, The information processing apparatus, wherein the control means displays the measurement result according to a direction of change in luminance.

2. the measurement result includes a first measurement value in which a luminance change occurs in a positive direction and a second measurement value in which a luminance change occurs in a negative direction; 2. The information processing apparatus according to claim 1, wherein the control means causes the first measurement value and the second measurement value to be displayed separately.

3. The control means is a graph showing time on the horizontal axis and the measurement result on the vertical axis, 3. The information processing apparatus according to claim 2, wherein the first measurement value is displayed in the positive direction of the vertical axis, and the second measurement value is displayed in the negative direction of the vertical axis.

4. 4. The information processing apparatus according to claim 2, wherein the control means displays a difference between the first measurement value and the second measurement value.

5. 5. The information processing apparatus according to claim 2, wherein the control means displays the measurement result when the first measurement value or the second measurement value is equal to or greater than a first threshold value.

6. 6. The information processing apparatus according to claim 2, wherein the control means displays the measurement result when a difference between the first measurement value and the second measurement value is less than a second threshold value.

7. The method further includes a receiving means for receiving a region of interest designated by a user, 7. The information processing apparatus according to claim 1, wherein the acquisition means acquires the measurement result from an address event signal that corresponds to a pixel included in the region of interest, among the address event signals.

8. 8. The information processing device according to claim 1, wherein the measurement result is a number of pixels whose luminance has changed in a positive direction and a number of pixels whose luminance has changed in a negative direction, measured for each pixel based on the address event signal.

9. 9. The information processing apparatus according to claim 1, wherein the measurement result is a number of occurrences of a luminance change in an area larger than a predetermined size based on the address event signal.

10. 10. The information processing apparatus according to claim 1, wherein the control means changes and displays the time scale in accordance with the measurement result.

11. 11. The information processing apparatus according to claim 10, wherein said control means displays said time scale with larger intervals when said measurement result is smaller than a predetermined value.

12. 11. The information processing apparatus according to claim 10, wherein the control means displays the measurement result without indicating the time when the measurement result is less than a third threshold value.

13. 13. The information processing apparatus according to claim 1, wherein the acquisition means acquires the measurement result by measuring the number of occurrences of a luminance change within a preset time range.

14. 14. The information processing apparatus according to claim 1, wherein the acquiring means acquires the address event signal based on an event-based sensor that outputs a signal in accordance with the number of incident photons.

15. A program for causing a computer to function as each of the means included in the information processing device according to any one of claims 1 to 14.

16. an acquisition step of acquiring a measurement result, which is the number of occurrences of a luminance change, based on an address event signal indicating an address and a time of the pixel where a luminance change has occurred; and a control step of displaying a relationship between time and the measurement result, The information processing method, wherein the control step displays the measurement result according to a direction of change in luminance.

Images