A device, computer program and method

Abstract

A device comprising processing circuitry configured to: receive a stream of event state data from an Event-based Vision Sensor, the field of view of the Event-based Vision sensor being a sporting event including an object and a net; analyse the event state data and determine contact between the net and object based upon the proximity of the net and the object and the movement of the net and / or object determined from the analysed event state data; and in the event of contact, the processing circuitry being further configured to: output a notification.

Description

[0001] EU-IPD: SYP357211WO01

[0002] DYC Ref: P131383PCT

[0003] A DEVICE, COMPUTER PROGRAM AND METHOD

[0004] BACKGROUND

[0005] Field of the Disclosure

[0006] The present technique relates to a device, computer program and method.

[0007] Description of the Related Art

[0008] The “background” description provided herein is for the purpose of generally presenting the context of the disclosure. Work of the presently named inventors, to the extent it is described in the background section, as well as aspects of the description which may not otherwise qualify as prior art at the time of filing, are neither expressly or impliedly admitted as prior art against the present technique.

[0009] In many sports, a projectile such as a ball or shuttlecock is hit over a net to an opponent. In some instances, a foul is caused when the projectile or a player makes contact with the net. It is therefore necessary to detect when an object hits the net.

[0010] In many of these sports, such as tennis, a sensor is used which is attached to the top of the net. The sensor is bulky and difficult to attach to the net. Additionally, the sensor sometimes moves in the wind which can provide an erroneous indication that an object has hit the net.

[0011] It is an aim of the disclosure to address this issue.

[0012] SUMMARY

[0013] According to embodiments of the present disclosure, there is provided a device comprising processing circuitry configured to: receive a stream of event state data from an Event-based Vision Sensor, the field of view of the Event-based Vision sensor being a sporting event including an object and a net; analyse the event state data and determine contact between the net and object based upon the proximity of the net and the object and the movement of the net and / or object determined from the analysed event state data; and in the event of contact, the processing circuitry being further configured to: output a notification.

[0014] The foregoing paragraphs have been provided by way of general introduction, and are not intended to limit the scope of the following claims. The described embodiments, together with further advantages, will be best understood by reference to the following detailed description taken in conjunction with the accompanying drawings.EU-IPD: SYP357211WO01

[0015] DYC Ref: P131383PCT

[0016] BRIEF DESCRIPTION OF THE DRAWINGS

[0017] A more complete appreciation of the disclosure and many of the attendant advantages thereof will be readily obtained as the same becomes better understood by reference to the following detailed description when considered in connection with the accompanying drawings, wherein: Figure 1 shows a device 100 according to embodiments of the present disclosure;

[0018] Figure 2 shows a system 200 into which the device 100 is included, in embodiments;

[0019] Figures 3A to 3C show a real-world view 300 of the field of view captured by the EVS camera 202 over a period of time;

[0020] Figures 4A to 4C show a series of images output by the EVS camera 202 for the real-world view 300 of Figure 3A to 3C over a particular time period; and

[0021] Figure 5 shows a process carried out by the processing circuitry 102.

[0022] DESCRIPTION OF THE EMBODIMENTS

[0023] Referring now to the drawings, wherein like reference numerals designate identical or corresponding parts throughout the several views.

[0024] Numerous modifications and variations of the present disclosure are possible in light of the above teachings. It is therefore to be understood that within the scope of the appended claims, the disclosure may be practiced otherwise than as specifically described herein.

[0025] Figure 1 shows a device 100 according to embodiments of the present disclosure. The device 100 comprises a communication interface 101 for sending electronic information to and / or receiving electronic information from one or more of the other devices, a processor 102 for processing electronic instructions, a memory 103 for storing the electronic instructions to be processed and input and output data associated with the electronic instructions and a storage medium 104 (e.g. in the form of a hard disk drive, solid state drive, tape drive or the like) for long term storage of electronic information. Each of the communication interface 101, processor 102 and memory 103 are implemented using appropriate circuitry, for example. The circuitry may be embodied as solid state circuitry which may be controlled by software or may be an Application Specific Integrated Circuit. The software comprises computer readable instructions, which when loaded onto a computer or circuitry, configures the computer (or circuitry) to perform a method according to embodiments. The software is stored on the storage medium 104. The processor 102 controls the operation of each of the communication interface 101, memory 103 and storage medium 104.EU-IPD: SYP357211WO01

[0026] DYC Ref: P131383PCT

[0027] As will be explained, the purpose of the device 100 is to detect contact between an object such as a sporting projectile (for example a ball such as a tennis ball) and a net in a sporting event (for example a net across a court of play such as a tennis court).

[0028] In the example of tennis, if the ball hits the net and continues over the net and into the service area after a serve, a net fault occurs.

[0029] In embodiments, such as in tennis, and as will become apparent, the device 100 detects the contact between the object and the net more accurately. Further, in embodiments, one or more match officials may be notified accordingly. In embodiments, the device 100 is further configured to detect whether the ball subsequently lands in the service area and so will detect a net fault and notify the umpire and / or the audience. In embodiments, the notification to the umpire may be provided using an audible and / or video system or haptic system. In embodiments, the notification to the audience may be provided by an audible and / or video system.

[0030] Figure 2 shows a system 200 into which the device 100 is included, in embodiments.

[0031] The system 200 includes an Event-based Vision Sensor (EVS) camera 202. The EVS camera 202 is known and is a camera that includes an Event-based Vision Sensor. The EVS camera 202 outputs a stream of events based upon a change in brightness at a particular pixel. This is termed Event State data below. This provides a very high temporal fidelity (much higher than an RGB camera) at very low latency. Moreover, other advantages associated with using an EVS camera 202 in detecting the contact between an object and the net includes i) the ability to perceive very subtle changes in brightness which improves the accuracy of detecting contact between the net and an object; ii) the ability to work over a very high dynamic range and so will be able to still operate in very bright or very dark conditions; iii) as mentioned above, has a very high temporal resolution which improves accuracy; iv) has low power consumption compared with an RGB camera; and v) has greater data efficiency in terms of network and upload bandwidth.

[0032] The purpose of the EVS camera 202 is to output events whenever the pixels detect a change in brightness, either lighter or darker than a defined threshold level relative to a base level of brightness.. If the pixel is active due to a perceived increased brightness it will have a value of 1 and may be represented as white. If the the pixel is active due to a perceived decrease in brightness it will have a value of-1 and may be represented as black. So, the event state data is comprised of various events which are, in embodiments, indicate a change in brightness of a pixel which is either above or below a threshold. In other words, the output of the EVS camera emphasises pixels representing objects that move. As will be appreciated, in embodiments, theEU-IPD: SYP357211WO01

[0033] DYC Ref: P131383PCT

[0034] Event State data from the EVS camera 202 is x,y,t where x,y are pixel co-ordinates and t is the time of the event. However, it will be appreciated that the pixel co-ordinates can be represented as an image as will be explained in Figure 4A-4C. In this case, the pixel values in the image may also be termed Event State Data as they are a visual representation of the x,y pixel coordinates output from the EVS camera 202. An example of an Event-based Vision Sensor is the Sony IMX636 sensor. The Event State data output by the EVS camera 202 is fed to the device 100 either by a wired or wireless connection.

[0035] It will be appreciated that although only a single EVS camera 202 is shown in embodiments, the disclosure is not so limited any number of EVS cameras 202 may be provided.

[0036] As will be explained later, the field of view of the EVS camera 202 includes at least a section of the net cord 204.

[0037] A camera surround 203 is provided adjacent the EVS camera 202. The camera surround 203 may cover at least a part of the exterior of the EVS camera 202 and is designed to reduce the wind impact on the EVS camera 202. The camera surround 203 may be shaped to deflect the wind away from the EVS camera 202 or may be a mesh which reduces the speed of the wind impacting the EVS camera 202. By reducing the impact of the wind on the EVS camera 202 and / or the speed of the wind hitting the EVS camera 202, the amount of movement of the EVS camera 202 is reduced. Although the above discusses a camera surround 203, the disclosure is not so limited and any mechanism to reduce vibration of the EVS camera 202 is envisaged such as a vibration damping platform.

[0038] An object tracking system 150 is, in embodiments, also connected to the device 100 via a wired or wireless connection. The object tracking system 150 is configured to detect and track the position of various objects on the tennis court. For example, the object tracking system 150 detects and tracks the position of the tennis ball on the tennis court. Of course, the disclosure is not so limited and any other object, such as one or more player or equipment such as a racket, is also detected. An example of the object tracking system 150 is an object tracking system 150 produced by Hawkeye Innovations Limited. The object tracking system 150 provides the position of the tennis ball at any one time to the device 100 as will be explained later.

[0039] The output from the device 100 is, in embodiments, a notification that the tennis ball has hit the net. This notification is, in embodiments, provided to an umpire of the match and / or provided to the object tracking system 150. The object tracking system 150 may then use the notification to determine if a ‘let service’ is called.

[0040] In embodiments, the notification from the device 100 may be issued when the ball position determined by the object tracking system 150 or the device 100 itself indicates that itEU-IPD: SYP357211WO01

[0041] DYC Ref: P131383PCT

[0042] subsequently landed in the correct service box for a ‘let service’ to be called. In this instance, the notification may be audible to the audience indicating a ‘let service’. Of course, the disclosure is not so limited and the notification (after the position of the tennis ball indicates a subsequent landing in the service box) may be provided to the umpire so he or she can call a let service.

[0043] In embodiments, the notification may be issued only when gameplay requires it. So, for example, in tennis, a ‘let service’ only occurs when the tennis ball is served. During a tennis rally, the tennis ball hitting the net and going over to the opposing side of the court is not a foul and so a notification is not required. However, if any part of the tennis player’s body, clothing or equipment touches the net whilst the ball is in play, they lose the point. Accordingly, in embodiments, the device 100 will issue a notification if the ball hits the net during service, but will not issue a notification if the ball hits the net during service. However, during a rally, the device 100 will issue a notification if a player touches the net during a rally.

[0044] Figures 3A to 3C show a real-world view 300 of the field of view captured by the EVS camera 202 over a period of time. In particular, Figure 3A shows the real-world view of a tennis ball 305A being hit towards a net 310 at a first time ti. At the first time, ti , the position of the tennis ball 305A is (xi, yi, zi, ti) where xi, yi, zi,is the real-world 3D position of the tennis ball at time ti. This position information is provided by the object tracking system 150.

[0045] Figure 3B shows the real-world view of a tennis ball 305B hitting the net 310 at a second time t2 which is later than first time ti. At the second, later, time, t2, the position of the tennis ball 305B is (X2, y2, Z2, t2) where X2, y2, Z2,is the real-world 3D position of the tennis ball at time t3. This position information is provided by the object tracking system 150.

[0046] Figure 3C shows the real-world view of a tennis ball 305C hitting the net 310 at a third time t3which is later than second time t2. At the third time, ts, the position of the tennis ball 305C is (X3, y3, Z3, ts) where X3, ys, Z3,is the real-world 3D position of the tennis ball at time t3. This position information is provided by the object tracking system 150.

[0047] As will be appreciated, the real-world view of Figure 3A shows the tennis ball approaching the net, the view of Figure 3B shows the ball hitting the net and the view of Figure 3C shows the ball travelling over the net into a service box.

[0048] Figures 4A to 4C show a series of images which are rendered from the event state data output by the EVS camera 202 for the real-world view 300 of Figure 3A to 3C over a particular time period. In other words, as noted above, the EVS camera 202 outputs a series of events based upon the brightness changes at pixels positions. The images shown in Figures 4A to 4C are representations which are generated from the event state data output from the EVS cameraEU-IPD: SYP357211WO01

[0049] DYC Ref: P131383PCT

[0050] 202. In embodiments, these images are not created as the output from the EVS camera 202 is event state data embodied as co-ordinate position and a time. The image is thus created to ease explanation. Of course, the image may be analysed to determine whether contact is made between the net and the object. In this case, the event state data may be a particular pixel position and colour for a given frame of the image.

[0051] Referring back to Figure 4A (which is the EVS camera output for the real-world scene shown in Figure 3A), the tennis ball is moving towards the net over the time period, the event state data from pixels 305A capturing the tennis ball at a particular instant are represented as white and the motion of the tennis ball over the time period is represented as a black streak 315. As nothing else is moving in the field of view of the EVS camera 202, the remainder of the image is grey. Of course, these colours are mentioned merely as examples and any colour is envisaged. Referring to Figure 4B, which is the EVS camera output event state data for the real-world scene shown in Figure 3B over a time period, the tennis ball 305A makes contact with the tennis net. In order to establish this, movement of the net at a time the ball passes the net is determined. In other words, the events from a time period starting just before to just after the ball passes the net is analysed. In embodiments, to reduce the amount of processing required, the pixels representing a length of the net cord between 50cm and 1 m either side of the ball is analysed although the disclosure is not so limited and any length in the proximity of the object (ball) and the net is analysed including the entire length of the net may be analysed.

[0052] It is possible to use the flight of the ball to detect whether contact occurs. However, in embodiments, the flight of the ball is ignored and only movement of the net is considered. This is because the ball may create areas of ‘movement’ as it flies though the air such as shadows which may give a false reading as to the location of ball and its movement. Accordingly, to reduce the likelihood of false positive readings, in embodiments, the flight of the ball is not considered when detecting contact between the net and the object. This is identified in the event state data output by the EVS camera 202 where, in the created representative image, a white mark 320 is seen on the net at the point of contact with the tennis ball 305A. Further, other movement along the net cord occurs as a result of the contact of the ball with the tennis net and so this movement is also seen over the time period as a black streak.

[0053] Referring to Figure 4C, which is an image created from the event state data output from the EVS camera for the real-world scene shown in Figure 3C over a time period, the tennis ball 305A travels over the net. Again, similarly to Figure 4A and 4B, the ball is white and its motion over the time period is seen as a black streak. Moreover, as the net cord is still moving from the impact of the ball, this is seen as a black streak.EU-IPD: SYP357211WO01

[0054] DYC Ref: P131383PCT

[0055] As will be apparent, using an EVS camera 202 to capture an impact of a moving object on a net and assists in detecting very small fluctuations in the movement of the object and / or net following impact. This means that even the slightest contact between an object and a net can be detected. Moreover, due to the event state data being only three values (+1 and -1 for changes in brightness and 0 for not change), it is easy to detect slight deviation in movement. In embodiments, the entire event state data stream output from the EVS camera 202 which represented the entire field of view of the EVS camera 202 is analysed by the device 100 to detect the small fluctuations in movement of the projectile. However, the disclosure is not so limited. In embodiments, the event state data representing only a section of the field of view captured by the EVS camera 202 is analysed. This reduces the amount of computational power required by the device 100 to detect the impact. Moreover, by only analysing the event state data from specific regions (either a region of the field of view of the EVS camera or a temporal region as the ball passes the net), the likelihood of receiving false positive results is reduced. In embodiments, the term ‘section’ may include a temporal section, a region of the field of view of the EVS camera 202 or a combination of both.

[0056] In particular, with regard to the temporal section, a short time window of the flight of the ball may be analysed. In embodiments, the short time window will be the time window that the ball passes the net. This time window is determined because the object detection system 150 knows the 3D position of the ball at any time and so the time window can be defined as being the time when the ball is less than a particular (predetermined) distance from the net. For example, in embodiments, the distance may be less than 10cm from the net. This will capture the moment the ball traverses the net and contact with the net can be determined.

[0057] Of course, the predetermined distance may be defined differently. For example, it is possible that the predetermined distance includes a short distance before the ball traverses the net and a longer distance beyond the net so that the position where the ball lands can be established. The position where the ball lands is, in embodiments, established from the object detection system 150. This will allow the device 100 to determine if a ‘let service’ has occurred. The disclosure is not so limited and in embodiments, the device 100 indicates that the ball has hit the net to the object detection system 150 and the object detection system 150 may notify the audience and / or the umpire.

[0058] With regard to the region of the field of view, the position of the tennis ball determined by the object detection system 150 is used to define the event state data of the section of the field of view of the EVS camera 202 to be analysed. In particular, as the position of the tennis ball at any point in time is known from the object detection system 150, the real world position of theEU-IPD: SYP357211WO01

[0059] DYC Ref: P131383PCT

[0060] ball traversing the net is known. Accordingly, an area surrounding the corresponding pixels in the EVS camera 202 is, in embodiments, defined as a region to be analysed. This may be 30cm in the real-world scenario. Therefore, this defined region is analysed in the image for movement. This reduces the amount of event state data to be analysed which saves computational resource and, as noted above, reduces the risk of false positives with the movement of the camera or net due to wind for example.

[0061] In embodiments, the event state data representing the region of the field of view may be analysed over the short time window defined above. This reduces the amount of computational resource even more because the size of the image to be analysed is reduced and the temporal duration of the image stream to be analysed is reduced and the risk of false positives as noted above.

[0062] In order to determine if contact is made, in embodiments, a predetermined number of pixels of the object and / or the net will indicate movement. This is to reduce errors. These pixels may define a contiguous or non-contiguous region of the object and / or net and may be a predetermined number of pixels or a predetermined real-world size. In the event that the predetermined number of pixels register movement, the object and / or net is determined to move.

[0063] In the aforementioned embodiments, the section of the event state data stream from the EVS camera 202 to be analysed is determined after the position of the ball has been established at a particular point in time. In other words, the event state data analysis occurs in post processing. However, in embodiments, the predicted flight of the tennis ball is used to determine the section of the event state data output from the EVS camera 202 to be analysed. For example, the flight of the ball may be predicted from the previous motion of the ball. In embodiments, the distance traversed and the direction of movement over a defined time period is determined from the position of the ball taken between two time points. From this information, it is possible to determine an approximate future position of the ball at any particular time. Accordingly, it is possible to determine an approximate position and time when the ball will traverse the net. Therefore, an area adjacent the predicted position of where the ball crosses the net is used, in embodiments, to determine the section in the event state data stream captured by the EVS camera 202 to be analysed.

[0064] Moreover, as explained above, it is possible to predict the flight of the tennis ball. Therefore, the speed of the tennis ball may be established and provided to the player, his or her coaches and / or the spectators.EU-IPD: SYP357211WO01

[0065] DYC Ref: P131383PCT

[0066] As noted above, it is possible to detect the position of the ball when it lands on the court using the object detection system 150. However, it is also possible to detect when the ball bounces on the ground using the EVS camera 202. In particular, as explained with reference to the net, it is possible to detect small fluctuations in the movement of the ball using the EVS camera 202. Accordingly, it is possible to detect the moment where the ball bounces on the ground as the ball impacting the ground plane causing a change in velocity. As the EVS camera 202 is used, it is possible to observe this moment with high temporal fidelity. This determined moment is used, in embodiments, to determine the position of the ball at that moment using the object detection system 150. Accordingly, it is possible to use the EVS camera 202 to provide the moment the ball hits the ground accurately which may improve the accuracy of the object detection system 150 in certain conditions.

[0067] As noted above, in embodiments, a camera surround 203 is provided to reduce the wind hitting the EVS camera 202. This will reduce movement of the EVS camera 202. It is desirable to reduce the impact of wind on the EVS camera 202 as the EVS camera 202 detects movement. Therefore, if wind moves the EVS camera 202, this may appear as movement across the entire frame and may provide erroneous results. Accordingly, in embodiments, in addition or instead of the camera surround 203, the device 100 may detect wind movement of the EVS camera 202. In embodiments, this movement may be determined by a sensor attached to the EVS camera 202 such as an accelerometer or the like which is configured to detect very small movements. Moreover, the sensor may also quantify the amount of movement by providing the device 100 with an indication of the size of the movement and / or the direction of the movement. Of course, the disclosure is not so limited and the device 100 may detect movement of the EVS camera 202 from the image itself. In order to achieve this, in embodiments, the device 100 analyses the image and in the event that a known fixed reference point (such as a line on the tennis court) moves, the device 100 knows that this movement is caused by movement of the EVS camera 202. In such an instance, the device 100 can correct for this movement or can ignore the images until the known fixed reference point does not appear to move in the captured image.

[0068] In embodiments, if the movement of the EVS camera 202 occurs as the ball passes over the net following a serve, the device 100 may notify the umpire that the EVS camera 202 is moving and therefore the device 100 cannot provide a notification to the umpire. This reduces the likelihood of providing an erroneous decision.

[0069] Although the EVS camera 202 is shown to be separate to the RGB camera(s) in the object detection system 150, the disclosure is not so limited. In particular, the EVS camera sensor may be overlaid onto the RGB camera sensor or interleaved with the RGB sensorEU-IPD: SYP357211WO01

[0070] DYC Ref: P131383PCT

[0071] In some embodiments, the position information comprises further information about the objects. For example, the image analysis may not only detect an object in an image but additionally identify the type of object, such as a person or a sporting projectile. In further embodiments, the position information comprises information indicating a relative distance between two objects, a velocity of an object, an acceleration of an object, pose information indicating a pose of an object identified as a person, or the like.

[0072] The aforesaid embodiments are described with reference to tennis. However, the disclosure is not so limited and any sporting event where a moving object may touch a net is envisaged. For example, volleyball, badminton or the like. In addition, as will be appreciated, although the aforesaid discusses the object and the net moving upon contact of the object with the net, in embodiments, either the movement of the object and / or the movement of the net is envisaged. Further, with regard to the sporting event, the moving object is not limited to sporting projectile. For example, any part of the players’ body, clothing or equipment may touch the net in tennis whilst the ball is in play and this may be detected in embodiments of the disclosure as the net will move upon contact by a player and the movement of the net will be detected by the EVS camera. In embodiments, after the detection of contact between the object associated with the player and the net, the position of the player is used to determine which player made the contact and the umpire may be notified accordingly.

[0073] Although the foregoing describes the device 100 being connected to an EVS camera 202, the disclosure is not so limited. In embodiments, the device 100 is connected to an EVS sensor and thus may be integrated into an EVS camera or the like.

[0074] Figure 5 shows a process carried out by the processing circuitry 102. The processing circuitry 102 is controlled by a computer program product stored in storage 104.

[0075] The process 500 starts in step 505 and moves to step 510. In step 510, the processing circuitry 102 receives a stream of event state data from an Event-based Vision Sensor, the field of view of the Event based Vision Sensor being a sporting event including an object and a net. The process moves to step 515 where the processing circuitry 102 analyses the event state data and determine contact between the net and object based upon the proximity of the net and the object and the movement of the net and / or object determined from the analysed event state data. In the event of a contact, the process moves to step 520 where the processing circuitry 102 is configured to output a notification. The process moves to step 525 where the process ends. In the event that a contact is not detected, the process stops and returns to step 505. In so far as embodiments of the disclosure have been described as being implemented, at least in part, by software-controlled data processing apparatus, it will be appreciated that a non-EU-IPD: SYP357211WO01

[0076] DYC Ref: P131383PCT

[0077] transitory machine-readable medium carrying such software, such as an optical disk, a magnetic disk, semiconductor memory or the like, is also considered to represent an embodiment of the present disclosure.

[0078] It will be appreciated that the above description for clarity has described embodiments with reference to different functional units, circuitry and / or processors. However, it will be apparent that any suitable distribution of functionality between different functional units, circuitry and / or processors may be used without detracting from the embodiments.

[0079] Described embodiments may be implemented in any suitable form including hardware, software, firmware or any combination of these. Described embodiments may optionally be implemented at least partly as computer software running on one or more data processors and / or digital signal processors. The elements and components of any embodiment may be physically, functionally and logically implemented in any suitable way. Indeed the functionality may be implemented in a single unit, in a plurality of units or as part of other functional units. As such, the disclosed embodiments may be implemented in a single unit or may be physically and functionally distributed between different units, circuitry and / or processors.

[0080] Although the present disclosure has been described in connection with some embodiments, it is not intended to be limited to the specific form set forth herein. Additionally, although a feature may appear to be described in connection with particular embodiments, one skilled in the art would recognize that various features of the described embodiments may be combined in any manner suitable to implement the technique.

[0081] Embodiments of the present technique can generally described by the following numbered clauses:

[0082] 1. A device comprising processing circuitry configured to:

[0083] receive a stream of event state data from an Event-based Vision Sensor, the field of view of the Event-based Vision sensor being a sporting event including an object and a net; analyse the event state data and determine contact between the net and object based upon the proximity of the net and the object and the movement of the net and / or object determined from the analysed event state data; and in the event of contact, the processing circuitry being further configured to:

[0084] output a notification.

[0085] 2. A device according to clause 1, wherein the processing circuitry is further configured to:

[0086] receive position information of the object providing the position of the object at the first time; andEU-IPD: SYP357211WO01

[0087] DYC Ref: P131383PCT

[0088] determine the proximity of the object to the net based upon the position information.

[0089] 3. A device according to clause 2, wherein the processing circuitry is configured to:

[0090] analyse the event state data corresponding to a section of the Event-based vision sensor determined by the position information of the object and / or net; and determine contact between the net and object based upon the proximity of the net and the object and the movement of the net and / or object determined from the analysed region.

[0091] 4. A device according to clause 2 or 3, wherein the processing circuitry is configured to:

[0092] analyse the event state data corresponding to a time period when the object and net are separated by less than a predetermined distance.

[0093] 5. A device according to any one of clauses 1 to 4, wherein the processing circuitry is further configured to:

[0094] receive a plurality of events from the Event-based Vision Sensor after contact of the net and the object; and

[0095] determine a bounce of the object.

[0096] 6. A device according to any one of clauses 1 to 5, wherein the processing circuitry is further configured to:

[0097] analyse the output from the Event-based Vision Sensor having a fixed reference points in the field of view; and in the event that the fixed reference points in the image is determined to move;

[0098] issue a notification indicating the Event-based Vision Sensor moved during capture of the image.

[0099] 7. A method comprising:

[0100] receiving a stream of event state data from an Event-based Vision Sensor, the field of view of the Event-based Vision sensor being a sporting event including an object and a net; analysing the event state data and determine contact between the net and object based upon the proximity of the net and the object and the movement of the net and / or object determined from the analysed event state data; and in the event of contact, the method comprises:

[0101] outputting a notification.

[0102] 8. A method according to clause 7, further comprising:EU-IPD: SYP357211WO01

[0103] DYC Ref: P131383PCT

[0104] receiving position information of the object providing the position of the object at the first time; and

[0105] determining the proximity of the object to the net based upon the position information.

[0106] 9. A method according to clause 8, comprising:

[0107] analysing the event state data corresponding to a section of the Event-based vision sensor determined by the position information of the object and / or net; and determining contact between the net and object based upon the proximity of the net and the object and the movement of the net and / or object determined from the analysed region.

[0108] 10. A method according to clause 8 or 9, comprising:

[0109] analysing the event state data corresponding to a time period when the object and net are separated by less than a predetermined distance.

[0110] 11. A method according to any one of clauses 7 to 10, comprising:

[0111] receiving a plurality of events from the Event-based Vision Sensor after contact of the net and the object; and

[0112] determining a bounce of the object.

[0113] 12. A method according to any one of clauses 7 to 11, comprising:

[0114] analysing the output from the Event-based Vision Sensor having a fixed reference points in the field of view; and in the event that the fixed reference points in the image is determined to move;

[0115] issuing a notification indicating the Event-based Vision Sensor moved during capture of the image.

[0116] 13. A computer program comprising computer readable instructions which, when loaded onto a computer, configures the computer to perform a method according to any one of clauses 7 to 12.

[0117] 14. A computer program product configured to store the computer program of clause 13 therein or thereon.

Claims

EU-IPD: SYP357211WO01DYC Ref: P131383PCTCLAIMS1. A device comprising processing circuitry configured to:receive a stream of event state data from an Event-based Vision Sensor, the field of view of the Event-based Vision sensor being a sporting event including an object and a net; analyse the event state data and determine contact between the net and object based upon the proximity of the net and the object and the movement of the net and / or object determined from the analysed event state data; and in the event of contact, the processing circuitry being further configured to:output a notification.

2. A device according to claim 1, wherein the processing circuitry is further configured to:receive position information of the object providing the position of the object at the first time; anddetermine the proximity of the object to the net based upon the position information.

3. A device according to claim 2, wherein the processing circuitry is configured to:analyse the event state data corresponding to a section of the Event-based vision sensor determined by the position information of the object and / or net; and determine contact between the net and object based upon the proximity of the net and the object and the movement of the net and / or object determined from the analysed region.

4. A device according to claim 2, wherein the processing circuitry is configured to:analyse the event state data corresponding to a time period when the object and net are separated by less than a predetermined distance.

5. A device according to claim 1, wherein the processing circuitry is further configured to:receive a plurality of events from the Event-based Vision Sensor after contact of the net and the object; anddetermine a bounce of the object.

6. A device according to claim 1, wherein the processing circuitry is further configured to:analyse the output from the Event-based Vision Sensor having a fixed reference points in the field of view; and in the event that the fixed reference points in the image is determined to move;issue a notification indicating the Event-based Vision Sensor moved during capture of the image.EU-IPD: SYP357211WO01DYC Ref: P131383PCT7. A method comprising:receiving a stream of event state data from an Event-based Vision Sensor, the field of view of the Event-based Vision sensor being a sporting event including an object and a net; analysing the event state data and determine contact between the net and object based upon the proximity of the net and the object and the movement of the net and / or object determined from the analysed event state data; and in the event of contact, the method comprises:outputting a notification.

8. A method according to claim 7, further comprising:receiving position information of the object providing the position of the object at the first time; anddetermining the proximity of the object to the net based upon the position information.

9. A method according to claim 8, comprising:analysing the event state data corresponding to a section of the Event-based vision sensor determined by the position information of the object and / or net; and determining contact between the net and object based upon the proximity of the net and the object and the movement of the net and / or object determined from the analysed region.

10. A method according to claim 8, comprising:analysing the event state data corresponding to a time period when the object and net are separated by less than a predetermined distance.

11. A method according to claim 7, comprising:receiving a plurality of events from the Event-based Vision Sensor after contact of the net and the object; anddetermining a bounce of the object.

12. A method according to claim 7, comprising:analysing the output from the Event-based Vision Sensor having a fixed reference points in the field of view; and in the event that the fixed reference points in the image is determined to move;issuing a notification indicating the Event-based Vision Sensor moved during capture of the image.EU-IPD: SYP357211WO01DYC Ref: P131383PCT13. A computer program comprising computer readable instructions which, when loaded onto a computer, configures the computer to perform a method according to claim 7.

14. A computer program product configured to store the computer program of claim 13 therein or thereon.

Images