Information presentation system for visually impaired people

Abstract

To provide a visually impaired person-purpose information presentation system that can make an information presentation so that a visually impaired person can enjoy sports competitions, having an excited feeling of presence.SOLUTION: According to a visually impaired person-purpose information presentation system 1, a video camera 2 is configured to take a soccer athletic field F, and a processing device 3 is configured to: acquire, by image recognition, a position or shape of a field outer edge being a stationary object, positions of all players of two teams being a playing athlete, and a position of a soccer ball being the stationary object; map the stationary object, playing athlete and dynamic object to an information presentation field having the athletic field F turned to a similar figure at an arbitrary rate to thereby generate an information presentation map; and reproduce the information presentation map on a pin display 4 allowing the visually impaired person to grasp information on a two-dimensional space by touching.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to an information presentation system for visually impaired people that presents spatial information so that visually impaired people can enjoy sports events and the like. [Background technology]

[0002] When visually impaired people try to watch sports events such as soccer or baseball, they cannot enjoy them visually on visual monitors (such as televisions) that people with normal vision (hereafter referred to as sighted people) use to watch sports. Therefore, visually impaired people are forced to use their remaining hearing ability to listen to live sports broadcasts on the radio and follow the flow of the game from the live commentary. However, live commentary by announcers etc. does not always accurately convey the progress of the sports event, so there are cases where visually impaired people are not satisfied with watching sports.

[0003] In this way, when appropriate information presentation differs from that for able-bodied people, such as the visually or hearing impaired, an invention has been proposed that presents content such as live sports broadcasts in an easy-to-understand manner by selecting from a wide variety of presentation methods prepared in advance according to the individual's physical ability (see, for example, Patent Document 1). The invention described in Patent Document 1 replaces part of the original content, such as the commentary, with alternative presentation content, such as the sound of a ball hitting the ground, which is easier to understand audibly, to assist the visually impaired in watching sports, etc., and present the content as more enjoyable. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2007-184740 A Summary of the Invention [Problem to be solved by the invention]

[0005] However, the invention described in Patent Document 1 merely adds auditory information to supplement the live commentary of sports and the like, or partially replaces the live commentary, and does not directly present spatial information about the sport being played to visually impaired people. For example, when watching soccer, you can get a sense of the action of the game by following the movements of the players and the soccer ball, but it is difficult to convey the movements of the main players and the path of the soccer ball to visually impaired people using only real-time audio information.

[0006] Therefore, an object of the present invention is to provide an information presentation system for visually impaired persons that can present information in a way that allows the visually impaired persons to enjoy sports events with a sense of realism. [Means for solving the problem]

[0007] In order to solve the above problems, the present invention provides an imaging means capable of acquiring spatial information of a sports competition which is conducted on a competition field which can be regarded as a plane and which involves the movement of athletes as an image including at least the competition field, fixed object information acquisition means for extracting the positions and shapes of at least fixed objects necessary for the progress of the competition from the image acquired by the imaging means, athlete position information acquisition means for acquiring position information of athletes competing within the competition field, information presentation map generation means for setting an information presentation field which is a similar shape to the competition field at an arbitrary ratio and generating an information presentation map in which the fixed objects and athletes are respectively mapped to corresponding positions on the information presentation field, and the information presentation map generated by the information presentation map generation means is reproduced on a spatial information presentation device which can be experienced by visually impaired persons, allowing visually impaired persons to recognize the position information of the athletes within the competition field using the spatial information presentation device.

[0008] In the above configuration, the imaging means acquires images including the competition field as moving images at a predetermined time interval, and the spatial information presentation device presents information on the movement of the athletes as the competition progresses to the visually impaired person.

[0009] The information presentation map may be generated based on the moving image captured by the imaging means, and a movement history recording means may be provided for recording the position information of the athlete in chronological order each time the information presentation map is generated based on the moving image captured by the imaging means.

[0010] The above configuration is characterized by comprising a condition management support means for generating support information useful for managing the condition of an athlete based on the athlete's movement history information recorded in the movement history recording means.

[0011] In the above configuration, the spatial information presentation device is characterized in that it uses a pin display in which tactile elements that can be converted between an off state in which no tactile pins protrude from the reference surface and an on state in which the tactile pins protrude from the reference surface are arranged at equal intervals on a two-dimensional surface, and the player's position is indicated by the tactile pins in the on state.

[0012] In the above configuration, when there is a dynamic object moving within the competition field during a sports competition, a dynamic object position information acquisition means is provided for acquiring position information of the dynamic object, and the information presentation map generation means generates an information presentation map that includes the dynamic object in its mapping.

[0013] In the above configuration, the imaging means acquires images including the competition field as moving images at a predetermined time interval, and the spatial information presentation device presents information on the movement of athletes and dynamic objects as the competition progresses to the visually impaired person.

[0014] The above configuration is characterized by providing a movement history recording means for recording the position information of the athlete and the dynamic object in chronological order every time an information presentation map is generated based on the moving image acquired by the imaging means.

[0015] In the above configuration, the system is characterized by comprising a condition management support means for generating support information useful for managing the condition of an athlete based on the movement history information of the athlete or dynamic object recorded in the movement history recording means.

[0016] In the above configuration, the spatial information presentation device is characterized in that it uses a pin display in which tactile elements that can be converted between an off state in which no tactile pins protrude from the reference surface and an on state in which the tactile pins protrude from the reference surface are arranged at equal intervals on a two-dimensional surface, and the position of the player and the position of the dynamic object are indicated by the tactile pins in the on state.

[0017] In the above configuration, when there are a plurality of athletes on the playing field during a sporting event, the vibration state of the tactile pins is made different so that each athlete can be identified.

[0018] In the above configuration, when there are a plurality of teams, each consisting of a plurality of players, on the field during a sports competition, the vibration state of the tactile pins is made different so that each team can be identified. Effect of the Invention

[0019] According to the present invention, a sports competition that is held on a competition field that can be considered as a plane and involves the movement of athletes is simplified by using an information presentation map that maps athletes within the information presentation field, and the information presentation map is experienced by visually impaired people via a spatial information presentation device. This allows visually impaired people to know the positions and movements of athletes within the competition field as spatial information, and to enjoy the sports competition with a sense of realism. [Brief description of the drawings]

[0020] [Figure 1] 1 is a schematic configuration diagram showing an embodiment of an information presentation system for visually impaired people. [Diagram 2] 10(a) is an explanatory diagram of an example of the arrangement of cameras photographing a competition field F. FIG. 10(b) is an external view of a photographed image P including the competition field F of interest. [Diagram 3](a) is an image diagram of extracting only the competition field F portion from the photographed image P. (b) is an image diagram of correcting the competition field Pf extracted from the photographed image P to a competition field shape without distortion to create an information presentation field. (c) is an image diagram of an information presentation map in which fixed objects such as the field edge and center line, players from the first team and the second team, and a soccer ball as a dynamic object are mapped in appropriate positions on the information presentation field. [Figure 4] FIG. 2 is a structural explanatory diagram of a pin display. [Diagram 5] FIG. 13 is an explanatory diagram of a display method of the pin display. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0021] Next, an embodiment of an information presentation system for visually impaired people according to the present invention will be described with reference to the attached drawings. Note that the information presentation system for visually impaired people according to the present embodiment presents information suitable for visually impaired people to enjoy sports competitions, but the subject is not limited to presenting information on sports competitions. The information presentation system of this configuration can be applied to any field in which it is desired to present the positions and movement paths of people and objects in a space that can be regarded as a plane as spatial information. It can also be used as an information presentation system for simplifying spatial information and conveying it to sighted people in an easy-to-understand manner.

[0022] FIG. 1 shows an embodiment of an information presentation system 1 for visually impaired people. For example, the system is composed of a video camera 2 that captures images of a competition field F, a processing device 3 that processes the images to generate simplified spatial information, and a pin display 4 that allows the visually impaired person to experience the spatial information generated by the processing device 3 as a tactile sensation of the fingers. The positions of athletes in the competition field F can be identified by the processing device 3 equipped with image recognition technology, but an athlete position information acquisition means 5 (described in detail later) that does not require image processing technology may be provided separately. The information processed by the processing device 3 can also be output and displayed on a visual display device 6 for sighted people (such as a television display or a smartphone screen).

[0023] The video camera 2 is an imaging means capable of acquiring spatial information of a sports competition in which athletes move on a competition field F that can be considered as a plane, as an image including at least the competition field F. If the image including the competition field F is acquired as a moving image at a predetermined time interval (e.g., 30 fps or more), the moving image can be acquired with the same level of smoothness as a television broadcast, but since the information is presented to visually impaired people, it is considered that about 1 fps is sufficient for practical purposes. For example, the image acquisition by the video camera 2 can be performed at a standard 30 fps or 60 fps, and the processing device 3 can record this moving image as a competition video, and generate an information presentation map every 30 frames or every 60 frames.

[0024] Here, FIG. 2(a) shows an example of a case where a soccer court (short side x long side: 45-90m x 90-120m) is taken as the playing field F and a video camera 2 is used to capture the game. Since soccer is a game in which players and a ball move within a rectangular court that can be considered as a plane, if the positions of the players and the ball on the court are simplified into two-dimensional spatial information, the progress of the game can be understood. To achieve this, it is necessary to obtain the soccer court as a distortion-free two-dimensional surface and to accurately reproduce the positions of the players and the ball on the court. In a stadium with a canopy such as a dome stadium, it may be possible to capture a soccer court from directly above, but in a normal stadium, it would require large-scale equipment to capture a soccer court from directly above, making it very impractical.

[0025] Therefore, in this embodiment, the camera support 7 is erected at a position approximately 15 m away from the center of one of the short sides, and the video camera 2 is placed on the top of the camera support 7 (at a height of approximately 7 m). This installation position of the video camera 2 is one example. As long as it can capture an image P (see FIG. 2(b)) that includes the entire range of the competition field F, the detailed installation position of the video camera 2 is not particularly limited. When taking moving images with the video camera 2, it is desirable that the shooting position of the video camera 2 is stably fixed and does not easily move due to the influence of wind, etc., so that the structure of the camera support 7 is preferably a tripod structure that is resistant to lateral external forces and twisting, rather than a simple pole structure.

[0026] The image P captured by the video camera 2 is supplied to the image processor 31 of the processing device 3, and simplified two-dimensional information of the playing field F is obtained using known image recognition technology or the like. First, as shown in FIG. 3(a), only the portion corresponding to the playing field F is extracted from the image P as a playing field image Pf. In order to extract this playing field image Pf, the image processor 31 identifies four lines that form the outer edge of the soccer court (the left and right sidelines, the front goal line connecting both ends of the sidelines, and the back goal line). Note that since the image P captured by the video camera 2 is likely to contain distortion due to the lens, it is desirable to perform distortion correction or the like on the image P before performing the extraction process of the playing field image Pf.

[0027] The trapezoidal image range (see FIG. 3(b)) extracted as the competition field image Pf contains information on fixed objects (such as the outer edge line of the soccer court, the center line, and the center mark), players (players of both teams), and dynamic objects (the soccer ball). Therefore, the image processing unit 31 is provided with fixed object information acquisition means 31a, player position information acquisition means 31b, and dynamic object position information acquisition means 31d. These pieces of information (fixed object information, player position information, dynamic object position information) are supplied to the information presentation map generation means 32.

[0028] This information presentation map generating means 32 generates an information presentation map 8 (see FIG. 3(c)) that simplifies various pieces of information within the competition field F, and the information presentation map is reproduced by the projections and recesses of pins on the pin display 4 controlled via the pin display control means 33. This allows visually impaired people to quickly grasp two-dimensional spatial information such as the positions of players and the ball on the competition field F by touching the information presentation map on the pin display 4. Furthermore, if the information presentation map on the pin display 4 is updated in a short time such as one second, visually impaired people can grasp the movement of players and the ball using only tactile information from their fingers, and can watch soccer with a sense of realism.

[0029] The information group acquired by the image processing unit 31 (fixed object information, player position information, dynamic object position information) can also be supplied to the competition database 34 and stored as a competition history. For example, the movement history of each player and the movement history of dynamic objects during a match are recorded in the movement history recording means 34a, and fixed object information on the competition field F where the competition was held is recorded in the competition field information storage means 34b. Then, by linking the movement history recorded in the movement history recording means 34a and the competition field information recorded in the competition field information storage means 34b and supplying them to the information presentation map generating means 32, the information presentation map can be reproduced in chronological order. That is, according to the information presentation system 1 for visually impaired persons of this embodiment, past competition contents can be reproduced on the pin display 4 like a video image.

[0030] Here, an example of image processing by the image processing unit 31 will be described. First, the fixed object information acquisition means 31a is a function for extracting the position and shape of fixed objects necessary for the progress of the game. The competition field image Pf cut out from the image P can be analyzed by a perspective projection method based on a vanishing point determined by the position and orientation of the video camera 2. Therefore, if the competition field image Pf is transformed and matched with a virtual field frame Fr having the same aspect ratio as the soccer court, a reproduced field image that reproduces the positions and shapes of the sidelines, center lines, etc. drawn on the field surface can be obtained.

[0031] For a soccer court, as shown in FIG. 3(c), the positions and shapes of an outer edge line L1 surrounded by a pair of sidelines and a pair of goal lines, a center line L2 that divides the court in two in the middle, a center circle L3, and a goal area division line L4 can be extracted. In an actual soccer court, many more lines and marks are drawn inside the court, so it is possible to extract all of them as fixed objects. However, if all of the fixed objects that can be extracted are included in the information presentation map 8, there is a concern that the amount of information will be excessive and will hinder visually impaired people from understanding the information, so it is preferable to narrow down the fixed objects appropriately.

[0032] However, in order to recognize the entire soccer court, the outer edge line L1 is an essential fixed object. For example, if the display area of ​​the pin display 4 is almost the same as the aspect ratio of the soccer court, the outer edge of the display area of ​​the pin display 4 can be set to the outer edge line L1, so there is an advantage that it is not necessary to represent the outer edge line L1 with the unevenness of the pins. In addition, since the goal G, which is an important fixed object in soccer, is placed outside the soccer court, if the goal G is included in the information presentation map 8 as one of the fixed objects, the soccer court displayed on the pin display 4 will be slightly smaller. If the display area of ​​the pin display 4 is sufficiently large, this is fine, but if it is desired to display the entire soccer court in the display area of ​​the pin display 4, only two points indicating the opening positions of the goal G may be represented by pins.

[0033] The player position information acquisition means 31b is a function for acquiring position information of players competing in the competition field F. When recognizing players from an image P, an image P with sufficient resolution to extract players at the back of the soccer court is required. However, if an image P is acquired with a high-resolution video camera such as 4K or 8K and pre-processed with noise removal, players can be extracted with high accuracy. In addition, when soccer is set as the sports competition for which information is provided, it is necessary to identify not only the position of each player on the competition field but also the team to which each player belongs. If each team wears a distinguishable uniform, the team to which the player belongs can be identified by image recognition. If the uniforms worn by both teams are similar in color and pattern, and misrecognition is likely to occur, the recognition rate can be increased by using identification markings such as sashes and armbands.

[0034] When obtaining position information of players in the competition field F from the image P, if the competition field image Pf is first cut out, some of the players may be cut off from the image and not be recognized as players. Therefore, image recognition of the players is performed in the image P, and the points on the field where each player stands are pointed out as the position of the player, and the image is cut out in the competition field image Pf and matched with the virtual field frame Fr. In this way, the position information of each player can be specified as points on the information presentation map 8. For example, as shown in FIG. 3(c), the positions of players T1a to T1f belonging to the first team and players T2a to T2f belonging to the second team in the soccer court can be specified and mapped to appropriate positions in the field.

[0035] In addition, when identifying the position of the athlete from the image P acquired by the video camera 2, there is a possibility that the athlete at the back cannot be recognized because he / she is hidden by the player at the front, or the athlete may fall or crouch down, making it difficult to recognize the athlete. Therefore, the athlete position information acquisition means 31b may cache the past athlete position information such as the previous one or the one before, estimate the movement direction and speed from the past athlete position information, predict the behavior, and point out the provisional athlete position. Also, in order to identify each player on the competition field by image recognition of the bib number and uniform number, it is necessary to be able to acquire an image P that can identify the bib number of all the players every time. However, it is practically impossible to acquire an image P that can identify each player as an individual player every time. Therefore, it is possible to identify each player by image recognition of the bib number of each player on the field before the start of the game, and during the game, to match the position of each player in the next image P with the individual player based on the behavior prediction of each player, and to identify the athlete position information.

[0036] Also, all the players may be provided with a GPS position sensor 51, and the player position information acquisition means 5 may be used, which receives the position information from each position sensor 51 with a sensor receiver 52 (shown by a broken line in FIG. 1). For example, when the video camera 2 acquires an image for generating the information presentation map, the sensor receiver 52 is instructed to acquire the player position information, and the player position information at that time is provided to the information presentation map generation means 32 and the competition database 34. In this way, if all the players have the position sensor 51, the position information of each player can be reliably grasped during the competition, and by previously associating the ID of each position sensor 51 with an individual player, it is possible to accurately record who on each team was, when, and where. Note that the position information obtained by the position sensor 51 is in a geographic coordinate system (latitude and longitude), so it is necessary to previously store the geographic coordinate system of the reference position of the competition field F (for example, the center mark in the center of the court, the corner areas at the four corners, etc.) in the processing device 3 as known information.

[0037] When using the above-mentioned athlete position information acquisition means 5, a considerable number of expensive position sensors 51 must be prepared, which raises concerns about a considerable increase in costs, whereas using the athlete information acquisition means 31b using image recognition has the advantage of being able to suppress costs. In addition, when using the athlete position information acquisition means 5, there is a possibility that the position sensor 51 may be damaged during the match, causing the athlete to disappear from the data record. Therefore, if the athlete information acquisition means 31b that identifies the position of the athlete from the image P captured by the video camera 2 is also provided, it is possible to deal with the unlikely event of the loss of player data, and the reliability of the system as a whole can be improved.

[0038] The dynamic object position information acquisition means 31c is a function for acquiring the position information of a dynamic object when there is a dynamic object moving within the competition field during a sport competition. When soccer is set as the sport competition for which information is provided, the only dynamic object moving within the competition field is a soccer ball. When acquiring the position information of the soccer ball, image recognition processing is performed on the image P, and a point on the field where the spherical soccer ball is located is pointed out as the position of the dynamic object, and the point is cut out into the competition field image Pf and matched with the virtual field frame Fr. In this way, the position information of the soccer ball B can be specified as a point on the information presentation map 8, and it can be mapped to an appropriate location within the field.

[0039] Since the soccer ball is smaller than the players, it is desirable to obtain an image P with sufficient resolution to identify the position of the soccer ball by image recognition. In addition, when the soccer ball is behind the players and does not appear in the image P, when it is not visible enough to be recognized as a sphere, or when the soccer ball is kicked up and in the air, it is difficult to continue image recognition of the soccer ball throughout the game. Therefore, the dynamic object position information acquisition means 31c may cache past ball position information such as the previous or the time before, and point to a tentative ball position from the past ball position information. In addition, since the movement of the soccer ball is closely related to the movement of the players, the cache of player position information may be used to predict ball position information taking into account the actions of the players. For example, if there are no players around the soccer ball based on past player position information, it can be predicted that the soccer ball is moving in the previous moving direction and speed. On the other hand, if the soccer ball was recognized near a player last time, but only that player can be confirmed this time, it is highly likely that the soccer ball is under the control of that player, so there is no need to predict the ball's movement based on the previous ball movement direction and speed, and the provisional ball position should be set behind that player.

[0040] Also, the position information of the soccer ball may be obtained by a method other than image recognition. For example, a beacon oscillator is built into the soccer ball, and the beacon from the soccer ball is received by three or more beacon receivers, and the beacon source is geometrically determined from the delay in the reception time of each receiver to identify the position of the soccer ball. This soccer ball position detection method has the advantage that the soccer ball will never go undetected, and that even if the soccer ball is kicked up and in the air, the planar coordinates on the playing field can be accurately identified.

[0041] As described above, the information presentation map generating means 32, which receives the information group acquired by the image processing unit 31, sets an information presentation field in which the competition field is made similar in shape at an arbitrary ratio. A fixed object (outer edge line L1), players (first team players T1a-T1f and second team players T2a-T2f), and a dynamic object (soccer ball B) are respectively mapped to corresponding positions in this information presentation field to generate an information presentation map 8 as shown in FIG. 3(c). The pin display control means 33, which receives the information presentation map 8 from the information presentation map generating means 34, specifies pin positions for reproducing the information presentation map 8 and outputs a control signal to the pin display 4.

[0042] The pin display 4 is one of spatial presentation devices that presents spatial information to visually impaired people through the sense of touch of the fingers. The pin display 4 has a display area 42 formed on one surface (the upper surface in FIG. 4) of any housing 41. The display area 42 has a structure in which tactile elements 423 that can be converted between an OFF state in which tactile pins 422 do not protrude from a reference surface 421a that is the outside of a substantially flat tactile panel 421 and an ON state in which the tactile pins protrude from the reference surface 421a are arranged at equal intervals on a two-dimensional surface. The pin insertion holes 421b provided in the tactile panel 421 have a point-to-point pitch of about 2 mm to correspond to the resolution of skin sensation.

[0043] In the pin display 4, there are various methods for driving the tactile pins 422. For example, the characteristics of a piezoelectric element that expands by controlling current flow can be used to make the tactile pins 422 protrude from the reference surface 421a or pull them back so that they are flush with the reference surface 421a. Since the piezoelectric element has good response to expansion, the tactile pins 422 can be turned on and off at, for example, 50 Hz. Therefore, if the information presentation map 8 is generated in real time based on the moving images acquired by the video camera 2 at 30 fps, spatial information can be presented in real time on the pin display 4. However, even if the display update of the pin display 4 is performed at 30 fps, it is difficult to recognize all the changes while searching with the fingers, so in reality, it is considered that information update of about 1 fps to 2 fps is sufficient.

[0044] Also, by changing the on / off change period of the tactile pins 422, it is possible to create a state in which the tactile pins 422 vibrate at different frequencies. In other words, if the on / off period of the tactile pins 422 is shorter than the update period of the information presentation map 8, it can be used as one of the pieces of identifiable information in the information presentation map 8. Therefore, by changing the vibration frequency of the athletes and dynamic objects mapped on the information presentation map 8 generated by the information presentation map generating means 32, the visually impaired person can distinguish between them from the vibration state of the tactile pins 422. Also, by making the athletes of the first team the first group and the athletes of the second team the second group, and changing the vibration frequency of the first group and the second group, it is possible for the visually impaired person to distinguish between the two teams. For example, if the information presentation map 8 is reproduced on the pin display 4 with the ball B at 0 Hz, the first team players T1a-T1f at 5 Hz, and the second team players T2a-T2f at 10 Hz, visually impaired people can grasp the movements of the players and the ball by team using only the tactile information from their fingers, enabling them to watch soccer with a sense of realism.

[0045] In addition, since the pin display 4 is provided with an operation unit 43 that can be operated by the user, a request such as enlarging / reducing the display contents may be made by operating the operation unit 43. For example, if a pressure sensor or the like is configured to detect whether the tactile pin 422 is intentionally pressed or not, the user can press any point in the display area 42 of the pin display 4, and the pressed point can be recognized as the user's selected point. Then, when the user presses any point in the display area 42 to select a point and operates the enlargement button or reduction button from the operation unit 43, a request for operation to enlarge / reduce the selected point can be made to the processing device 3. The operation request from the pin display 4 is input to the pin display control means 33, which outputs a control signal converted into a pin arrangement for enlarging / reducing the selected point part of the information presentation map 8 to the pin display 4. As a result, the display area 42 of the pin display 4 is updated to information according to the user's request. In addition, when the information presentation map 8 is enlarged / reduced, the pin display control means 33 may request the information presentation map generation means 32 to create an information presentation map according to the resolution, and the information presentation map may be regenerated with objects and athletes of a size according to the resolution.

[0046] Furthermore, by turning on and off the tactile pins 422 of the pin display 4, it is possible to express the ball or pins by raising multiple tactile pins 422 at the same time. For example, as shown in Fig. 5, it is possible to express the ball position as a cross, and further to give a player a distinctive feature by raising one or multiple tactile pins 422 at the same time, and to encourage recognition of the type of pin by skin sensation in combination with the above-mentioned electrification control.

[0047] There is also a method of displaying a rectangle by connecting the tactile pins 422 representing players together to confirm the relative positions of the tactile pins 422 representing players. Even for visually impaired people who use Braille on a daily basis, it is difficult to recognize the positions of the scattered tactile pins 422 of players, balls, etc. by touching them. By displaying a rectangle, even if the fingertip is roughly scanned on the pin display, the finger can touch a line and follow the line to arrive at the player's position as a rectangle vertex. Furthermore, the shape of the rectangle represents the soccer formation, so it is a presentation method that allows visually impaired spectators to know the formation. In addition, it can be used as a tool to confirm the formation for visually impaired soccer players.

[0048] A method for creating the above-mentioned rectangle is to surround the tactile pin 422 representing the player with a circumscribing circle, as shown in FIG. 5, and then form a polygon with the vertex at the point where the circumscribing circle comes into contact with the tactile pin 422 when the circumscribing circle is shrunk.

[0049] Furthermore, if the pin display 4 allows the user to select points, it is also possible to provide information on fixed objects, athletes, and dynamic objects in the displayed information presentation map 8 by voice. For example, when the user selects and specifies a fixed object, athlete, or dynamic object in the information presentation map 8 and operates a voice request button, the name associated with the selected object, the name of the selected athlete, and the like are read out by a synthetic voice. In this way, the user can learn information that cannot be obtained from the spatial information presented by the pin display 4 by operating the display himself, which is highly convenient.

[0050] As described above, the information presentation system 1 for visually impaired people can simplify the spatial information of sports competitions held on a competition field that can be considered to be flat, and present it as spatial information that can be experienced by visually impaired people, making it possible for them to enjoy sports competitions with a sense of realism.

[0051] In the information presentation system 1 for visually impaired persons of this embodiment, soccer is applied as the sport for which spatial information is presented, but the system can be applied to watching ball games such as baseball, rugby, ice hockey, water polo, and badminton, as well as athletics and swimming (sports without moving objects) in general, in which athletes move around on a field that can be considered as flat. Furthermore, the information presentation system 1 for visually impaired persons can be applied to watching sports such as horse racing, bicycle racing, boat racing, and auto racing.

[0052] In addition, in the information presentation system 1 for visually impaired persons of this embodiment, the pin display 4 is used as a spatial presentation device for visually impaired persons, but any device that allows visually impaired persons to experience spatial information can be used instead. For example, the information presentation map may be reproduced using a tactile display that gives a tactile sensation by the protruding pressure of air instead of pins. Alternatively, the information presentation map may be reproduced using a VR device that is worn on the body and gives the sensation of touching virtual objects in a virtual space.

[0053] Furthermore, the information presentation system 1 for visually impaired people in this embodiment not only presents spatial information of sports and various competitions to visually impaired people, but also provides useful information to sighted people as well as visually impaired people by utilizing various information acquired for presenting the spatial information. For example, the movement history recording means 34a of the competition database 34 records the movement history of each athlete, and this information can be appropriately processed to be used for managing the condition of the athletes. To achieve this, the processing device 3 in this embodiment is provided with a condition management support means 35 (shown by a dashed line in FIG. 1) that can receive and process history information from the competition database 34.

[0054] From the history information (information of a certain athlete during a certain match) recorded in the movement history recording means 34a, the movement distance in one second can be determined from the position at a certain time and the position one second before that. By dividing this movement distance by the time (one second), the movement speed [m / s] at that time can be determined. If this movement speed is high, the athlete moved fast. In other words, a high value of the movement speed can be interpreted as a sprint, and a low value as a jog. By counting the number of times the athlete moved at a high movement speed, the number of sprints performed during one match can be determined. Furthermore, by summing up the duration of the athlete's high movement speeds, the sprint time during one match can be determined. Therefore, the condition management support means 35 determines the number of sprints and the sprint time, and displays them to the sighted person on the visual display device 6. It is considered that an athlete who sprints many times and for a long time is more tired than an athlete who does not. Since fatigue leads to injury, for athletes who have a significantly high number of dashes and long dash durations, appropriate measures (condition management) such as "resting the next match" and "asking about physical condition" can be taken based on the history information. The number of dashes and dash time obtained by the condition management support means 35 may be output to the pin display 4 via the pin display control means 33. This is because condition management is also effective for athletes with visual impairments.

[0055] Also, from the history information (information of an athlete during a game) recorded in the movement history recording means 34a, the sum of all the athlete's trajectories, which are a series of all movement positions, can be interpreted as the total movement distance during one game. Athletes who have traveled a large total distance are considered to be more fatigued than athletes who have traveled less. Therefore, the condition management support means 35 calculates the total movement distance during one game and displays it on the visual display device 6 to the sighted players. Since fatigue can lead to injuries, for athletes who have traveled a significantly long total distance, countermeasures (condition management) such as "resting the athlete from the next game" or "asking about their physical condition" can be performed based on the history information. The total movement distance calculated by the condition management support means 35 may be output to the pin display 4 via the pin display control means 33. This is because condition management is also effective for athletes with visual impairments.

[0056] Furthermore, the information presentation system 1 for visually impaired players according to this embodiment can be used as a play feedback tool and a self-learning tool for visually impaired players. While a normal player (sighted player) can learn and improve himself by watching a video of his own play and a reference play, a visually impaired player cannot learn by watching a video. Therefore, he has a problem that he does not know whether his play is good or bad, cannot correct a problem because he cannot check the success or failure of a shot, and cannot learn by watching a model play, and does not have an opportunity to efficiently improve his skills. However, the information presentation system 1 for visually impaired players according to this embodiment records the history information of a match in the competition database 34, so that an information presentation map can be generated based on the history information and reproduced on the pin display 4. In other words, a visually impaired player can also grasp the spatial information of his own play and a reference play, so the information presentation system 1 for visually impaired players can be a play feedback tool and a self-learning tool for visually impaired players.

[0057] The above describes an embodiment of the information presentation system for visually impaired people according to the present invention. However, the present invention is not limited to this embodiment, and the scope of the invention encompasses all information presentation systems for visually impaired people that can be realized as long as the configuration described in the claims is not changed. [Explanation of symbols]

[0058] 1 Information provision system for people with disabilities 2. Video camera 3 Processing equipment 31 Image processing section 31a Fixed object information acquisition means 31b Athlete location information acquisition means 31c Dynamic object location information acquisition means 32 Information presentation map generation method 33 pin display control means 4 pin display F. Competition Field

Claims

1. An imaging device capable of photographing spatial information of a sporting event taking place on a field that can be considered as a plane, with athletes moving about, from a fixed position overlooking the field at an angle, and acquiring a real-time image of the sporting event that includes at least the entire area of ​​the field; fixed object information acquisition means for extracting fixed object information by extracting positions and shapes of fixed objects necessary for the progress of the competition, at least by extracting a competition field image which is a portion corresponding to the competition field from the image acquired by the imaging means and transforming it to fit the competition field into a virtual field frame having the same aspect ratio as the competition field; athlete position information acquisition means for acquiring the positions of the athletes in the images when the imaging means acquires an image, and then extracting and transforming the competition field image from the images and matching it with the field frame to acquire position information of the athletes competing within the competition field; an information presentation map generating means for setting an information presentation field in a similar shape to the competition field at an arbitrary ratio based on the fixed object information acquired by the fixed object information acquiring means and the position information of the athlete acquired by the athlete position information acquiring means, and generating an information presentation map in which the fixed objects and the athlete are respectively mapped to corresponding positions in the information presentation field, An information presentation system for visually impaired people, characterized in that the information presentation map generated by the information presentation map generation means is reproduced in real time on a spatial information presentation device that can be experienced by visually impaired people, allowing the visually impaired people to recognize the position information of the athletes within the competition field on the spatial information presentation device.

2. the imaging means captures real-time images of the sport event including the entire field of the sport event as moving images at a predetermined time interval; 2. The information presentation system for visually impaired people according to claim 1, characterized in that the spatial information presentation device presents information about the movement of the athletes as the competition progresses to the visually impaired people.

3. The information presentation system for visually impaired people as described in claim 2, characterized in that it is provided with a movement history recording means for recording the athlete's location information in chronological order each time the information presentation map is generated based on the moving image acquired by the imaging means.

4. The information presentation system for visually impaired people as described in claim 3, characterized in that it further comprises a condition management support means for generating support information useful for managing the condition of the athlete based on the athlete's movement history information recorded in the movement history recording means.

5. The spatial information presentation device uses a pin display in which tactile elements that can be converted between an OFF state in which tactile pins do not protrude from a reference surface and an ON state in which the tactile pins protrude from the reference surface are arranged at equal intervals on a two-dimensional surface, An information presentation system for visually impaired people as described in any one of claims 1 to 4, characterized in that the tactile pins in the on state indicate the position of the athlete, or the position of the athlete and a line representing the formation connecting the athletes.

6. a dynamic object position information acquisition means for acquiring the position of the dynamic object in the image when there is a dynamic object moving within the competition field during a sports competition, and then extracting and transforming the competition field image from the image and matching it with the field frame to acquire position information of the dynamic object, and when the position of the dynamic object cannot be specified and the position information of the dynamic object cannot be acquired in the image, acquiring the position information of the dynamic object predicted from the past position information of the dynamic object or the past position information of the player, 2. The information presentation system for visually impaired people according to claim 1, wherein the information presentation map generating means generates the information presentation map in which the dynamic object is also mapped.

7. the imaging means captures real-time images of the sport event including the entire field of the sport event as moving images at a predetermined time interval; 7. The information presentation system for visually impaired people according to claim 6, characterized in that the spatial information presentation device presents information on the movement of the athletes and the dynamic objects as the competition progresses to the visually impaired people.

8. The information presentation system for visually impaired people as described in claim 7, characterized in that it is provided with a movement history recording means for recording the position information of the athlete and the dynamic object in chronological order each time the information presentation map is generated based on the moving image acquired by the imaging means.

9. The information presentation system for visually impaired people as described in claim 8, characterized in that it is characterized by comprising a condition management support means for generating support information useful for managing the condition of the athlete based on the movement history information of the athlete or the dynamic object recorded in the movement history recording means.

10. The spatial information presentation device uses a pin display in which tactile elements that can be converted between an OFF state in which tactile pins do not protrude from a reference surface and an ON state in which the tactile pins protrude from the reference surface are arranged at equal intervals on a two-dimensional surface, An information presentation system for visually impaired people as described in any one of claims 6 to 9, characterized in that the tactile pins in the on state indicate the position of the athlete, or the position of the athlete and the line representing the formation connecting the athletes, and the position of the dynamic object.

11. An information presentation system for visually impaired persons as described in claim 5 or claim 10, characterized in that when there are multiple athletes on the competition field during a sports competition, the vibration state of the tactile pins is made different so that each athlete can be identified.

12. An information presentation system for visually impaired people as described in claim 5 or claim 10, characterized in that when there are multiple teams consisting of multiple athletes on the competition field during a sports competition, the vibration state of the tactile pins is made different so that each team can be identified.

Images