Line determination device, line determination program, and line determination method

Abstract

To easily provide information used to predict bicycle races.SOLUTION: A line determination device 10 specifies distances of respective professional cyclists 1a, 1b, 1c, ..., to and from professional cyclists before and behind them at a plurality of points of time of photography based upon 11a-1, 11a-2, ..., obtained by photographing the racing professional cyclists 1a, 1b, 1c, ..., in a race at the plurality of points of time of photography. The line determination device 10 specifies the lines that the professional cyclists 1a, 1b, 1c, ..., belong to respectively based upon the distances.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present invention relates to a line determination device, a line determination program, and a line determination method. [Background technology]

[0002] Publicly managed sports events such as bicycle racing have introduced systems to improve user convenience. For example, systems have been introduced to make it easier for users of publicly managed sports events to understand the status of the race.

[0003] As a technology related to publicly managed racing systems, for example, a racing information distribution system has been proposed in which a distribution server distributes location data identifying the positions of athletes extracted from video information of the race, and a mobile device displays the location data in a chronological order in a schematic format.Another proposed image processing system allows viewers to easily identify a specific racehorse or athlete on the screen by pointing out the position of the racehorse or athlete in the video displayed on the screen. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Japanese Patent Application Laid-Open No. 2007-089648 [Patent Document 2] Japanese Patent Application Laid-Open No. 2006-003965 Summary of the Invention [Problem to be solved by the invention]

[0005] In Keirin races, a runner's run is shown before the race, and users make their bets based on the lines drawn during the run. To provide line information, for example, judges could visually determine the lines, but this requires a lot of work on the part of the judges.

[0006] In one aspect, this case aims to facilitate the provision of information for use in predicting bicycle racing. [Means for solving the problem]

[0007] One proposal provides a line determination device having a memory unit and a processing unit. The memory unit stores a plurality of photographed images of a plurality of cyclists racing at a plurality of photographing times in a bicycle race. The processing unit determines the distance between each of the plurality of cyclists before and after the cyclists at each of the plurality of photographing times based on the plurality of photographed images, and determines the line to which each of the plurality of cyclists belongs based on the distance. [Effects of the Invention]

[0008] According to one aspect, it is possible to easily provide information used for predicting bicycle races. [Brief explanation of the drawings]

[0009] [Figure 1] FIG. 1 is a diagram illustrating an example of a line determination device according to a first embodiment. [Figure 2] FIG. 10 illustrates an example of an information processing system according to a second embodiment. [Figure 3] FIG. 2 is a diagram illustrating an example of the hardware configuration of a line determination server. [Figure 4] FIG. 10 is a block diagram illustrating an example of functions of a line determination server. [Figure 5] FIG. 10 is a diagram illustrating an example of analysis information. [Figure 6] FIG. 10 is a diagram illustrating an example of aggregate information. [Figure 7] FIG. 10 illustrates an example of a provisional line identification process. [Figure 8] 10 is a flowchart illustrating an example of a procedure for a line information providing process. [Figure 9] 10 is a flowchart illustrating an example of a procedure for image collection processing. [Figure 10] 10 is a flowchart illustrating an example of a procedure for an analysis information generation process. [Figure 11]10 is a flowchart illustrating an example of a procedure for a provisional line identification process. [Figure 12] 10 is a flowchart illustrating an example of a procedure for a line identification process. [Figure 13] FIG. 10 is a diagram illustrating an example of a display image. DETAILED DESCRIPTION OF THE INVENTION

[0010] The present embodiment will be described below with reference to the drawings. Note that each embodiment can be implemented in combination with a plurality of other embodiments within a range that does not contradict each other. [First embodiment] First, the first embodiment will be described.

[0011] 1 is a diagram showing an example of a line determination device according to a first embodiment. A line determination device 10 according to the first embodiment determines the lines formed by cyclists 1a, 1b, 1c, etc. in a leg show in a bicycle racing competition.

[0012] In Keirin racing, the racers 1a, 1b, 1c, etc. ride before the race. During the race, the racers 1a, 1b, 1c, etc. may ride in a line. A line is a group formed by linked riders riding together. For example, riders in a line ride in a single file with a small gap between them. Note that when a rider rides alone with a large gap between them, a line of one rider is considered to have been formed.

[0013] Since the athletes 1a, 1b, 1c, etc. often run in the same lines in the race as they did in the leg show, users who bet on Keirin races make their bet predictions taking into account the lines they made in the leg show. Therefore, the line determination device 10 identifies which line each of the athletes 1a, 1b, 1c, etc. belongs to in the leg show.

[0014] The line determination device 10 is a computer that determines the lines that the athletes 1a, 1b, 1c, etc. will take. The line determination device 10 is connected to a camera 2. The camera 2 is a camera that can capture images of the athletes 1a, 1b, 1c, etc. while they are racing in a bicycle race. For example, the camera 2 is installed so that its capture range covers the entire bank along which the athletes 1a, 1b, 1c, etc. will race. Alternatively, the camera 2 may be a 360° camera installed so that it can capture the entire bank from within the bank. Alternatively, the camera 2 may be a plurality of cameras installed so that the combined capture range of each camera covers the entire bank.

[0015] The line determination device 10 has a memory unit 11 and a processing unit 12. The memory unit 11 stores data used in the processing executed by the line determination device 10. The memory unit 11 is, for example, a memory or storage device included in the line determination device 10. The memory unit 11 stores photographed images 11a-1, 11a-2, etc. The photographed images 11a-1, 11a-2, etc. are images of cyclists 1a, 1b, 1c, etc., riding at multiple photographing times in a bicycle race. For example, each of the photographed images 11a-1, 11a-2, etc. is an image taken by a camera 2 at a regular time interval from the start of a leg show to the end of a leg show. Note that each of the photographed images 11a-1, 11a-2, etc. may be a combination of multiple images taken by multiple cameras 2 at the same time.

[0016] The processing unit 12 controls the line determination device 10 and can execute required processing. The processing unit 12 is, for example, a processor or arithmetic circuit included in the line determination device 10. First, the processing unit 12 determines the distance between the preceding and following players 1a, 1b, 1c, etc. at each of a plurality of capture times based on the captured images 11a-1, 11a-2, etc. For example, the processing unit 12 calculates the position coordinates of each of the players 1a, 1b, 1c, etc. on the bank from the captured image taken at a certain capture time, and determines the distance between the preceding and following position coordinates as the distance between each player at that capture time. Note that the processing unit 12 may also detect each player and their wheels from the captured image taken at a certain capture time, and determine the distance between the rear wheel of the preceding player and the front wheel of the following player, expressed in terms of the number of wheels, as the distance between each player at that capture time.

[0017] After identifying the distance between the athletes, the processing unit 12 identifies a provisional line candidate to which each of the athletes 1a, 1b, 1c, ... belongs at each of the multiple image capture times based on the identified distance. The provisional line candidate is a group of athletes who were running together at each image capture time. Here, the processing unit 12 identifies the provisional line candidate based on whether the distance is less than a first threshold. For example, if the distance between two athletes before and after each other at a certain image capture time is less than the first threshold, the processing unit 12 determines that the two athletes belong to the same provisional line candidate at that image capture time. Furthermore, if the distance between two athletes before and after each other at a certain image capture time is equal to or greater than the first threshold, the processing unit 12 determines that the two athletes belong to different provisional line candidates at that image capture time.

[0018] The processing unit 12 identifies a provisional line to which each of the players 1a, 1b, 1c, ... belongs based on the frequency with which each provisional line candidate is identified. The provisional lines are provisionally identified lines to which each of the players 1a, 1b, 1c, ... belongs. For example, the processing unit 12 calculates the number of times each provisional line candidate has been identified. Then, the processing unit 12 prioritizes the provisional line candidate that has been identified the most frequently as the provisional line, so that each player does not belong to multiple provisional lines.

[0019] Then, the processing unit 12 identifies the line to which each of the players 1a, 1b, 1c, etc. belongs based on the provisional lines. Here, the processing unit 12 identifies the line for each of the players belonging to the provisional line based on whether the distance is less than a second threshold value that is smaller than the first threshold value. For example, the processing unit 12 executes the following process for each provisional line to determine the line.

[0020] The processing unit 12 selects the photographed image in which the length of the sequence of players belonging to the provisional line to be processed (line length) is the shortest among the photographed images in which the provisional line to be processed is identified as a provisional line candidate.For each player belonging to the provisional line to be processed, if the distance between the two players in front and behind the player identified based on the selected photographed image is less than a second threshold, the processing unit 12 determines that the two players belong to the same line.Furthermore, if the distance between the two players in front and behind the player identified based on the selected photographed image is equal to or greater than the second threshold, the processing unit 12 determines that the two players belong to different lines.

[0021] According to the first embodiment, the storage unit 11 stores photographed images 11a-1, 11a-2, etc. of the racers 1a, 1b, 1c, etc., captured at multiple photographing times during a bicycle race. The processing unit 12 determines the distance between each of the racers 1a, 1b, 1c, etc., and the racers before and after each of the racers at each of the multiple photographing times based on the photographed images 11a-1, 11a-2, etc. Then, the processing unit 12 determines the line to which each of the racers 1a, 1b, 1c, etc., belongs, based on the distance.

[0022] This allows the line determination device 10 to automatically determine the lines drawn by the racers 1a, 1b, 1c, .... Therefore, the line determination device 10 can easily provide information used for predicting bicycle racing.

[0023] Furthermore, the processing unit 12 identifies provisional line candidates to which each of the players 1a, 1b, 1c, etc. belongs at each of the multiple shooting times based on the distance, and identifies a line based on the frequency at which each provisional line candidate is identified.

[0024] Here, since runners belonging to the same line often run close to each other during a race or leg show, each line is identified as a provisional line candidate at many shooting times. Therefore, the line determination device 10 can improve the accuracy of line determination by identifying the line based on the frequency with which each provisional line candidate is identified.

[0025] The processing unit 12 identifies provisional line candidates based on whether the distance is less than a first threshold, and identifies provisional lines to which each of the players 1a, 1b, 1c, ... belongs based on the frequency at which each provisional line candidate is identified. The processing unit 12 identifies a line for each of the players belonging to a provisional line based on whether the distance is less than a second threshold that is smaller than the first threshold.

[0026] Here, even if two runners belong to the same line, they may temporarily run apart. Therefore, the line determination device 10 identifies a provisional line candidate if the distance between the preceding and following runners is less than a first threshold. Then, the line determination device 10 determines a line from the provisional line using a second threshold that is smaller than the first threshold. This allows the line determination device 10 to improve the accuracy of line determination.

[0027] Second Embodiment Next, a second embodiment will be described. The second embodiment provides information indicating the line that a cyclist forms during a leg show in a bicycle race.

[0028] 2 is a diagram showing an example of an information processing system according to a second embodiment. The information processing system according to the second embodiment has a line determination server 100, a display server 200, and an external server 300. The line determination server 100 and the display server 200 are installed at a velodrome 20. The line determination server 100 and the display server 200 are connected to a network 40 via a network 30. The external server 300 is connected to the network 40. The network 30 is, for example, a LAN (Local Area Network) of the velodrome 20. The network 40 is, for example, a wide area network such as the Internet.

[0029] The velodrome 20 is a stadium where bicycle races are held. A bank 21 is installed in the velodrome 20. The bank 21 is a course along which the athletes 22a, 22b, 22c, etc. run in bicycle races. The athletes 22a, 22b, 22c, etc. are athletes who compete in bicycle races. The athletes 22a, 22b, 22c, etc. run on the bank 21 during their leg show before the race. During their leg show, the athletes 22a, 22b, 22c, etc. run in the same line as in the race.

[0030] Furthermore, a camera 23 and a monitor 24 are installed at the velodrome 20. The camera 23 and the monitor 24 are connected to a network 30. The camera 23 photographs the athletes 22a, 22b, 22c, etc. running during the leg show. The camera 23 is installed so that the entire bank 21 is within its photographic range. The camera 23 photographs its photographic range at regular time intervals from the start of the leg show to the end of the leg show, and transmits the photographed images to the line determination server 100.

[0031] The monitor 24 displays information used by users who place bets on bicycle races to predict their bets under the control of the display server 200. For example, the monitor 24 displays a display image including the names of the athletes 22a, 22b, 22c, etc., odds, information on the lines that the athletes 22a, 22b, 22c, etc. specified by the line determination server 100 set in their leg shows, and the like.

[0032] The line determination server 100 is a server computer that identifies the lines formed by the athletes 22a, 22b, 22c, etc. when they show their legs. The line determination server 100 acquires images taken by the camera 23 at regular time intervals when the athletes show their legs from the camera 23. The line determination server 100 identifies the distance between the athletes in front and behind from the acquired images. The line determination server 100 identifies the line to which each of the athletes 22a, 22b, 22c, etc. belongs based on the distance between the athletes. The line determination server 100 transmits information indicating the identified lines to the external server 300.

[0033] The display server 200 is a server computer that controls the monitor 24. The display server 200 acquires display images from the external server 300 and displays the acquired display images on the monitor 24. The external server 300 is a server computer that generates display images for displaying information used by users to predict their bets. The external server 300 acquires the leg show lines identified by the line judgment server 100 from the line judgment server 100. The external server 300 generates a display image including information such as athlete names, odds, and leg show lines, and transmits the generated display image to the display server 200.

[0034] 3 is a diagram showing an example of the hardware configuration of the line determination server. The line determination server 100 is entirely controlled by a processor 101. A memory 102 and multiple peripheral devices are connected to the processor 101 via a bus 109. The processor 101 may be a multiprocessor. The processor 101 is, for example, a CPU (Central Processing Unit), an MPU (Micro Processing Unit), or a DSP (Digital Signal Processor). At least some of the functions realized by the processor 101 executing a program may be realized by an electronic circuit such as an ASIC (Application Specific Integrated Circuit) or a PLD (Programmable Logic Device).

[0035] The memory 102 is used as a main storage device of the line determination server 100. The memory 102 temporarily stores at least a part of the OS (Operating System) program and application programs to be executed by the processor 101. The memory 102 also stores various data used in processing by the processor 101. As the memory 102, for example, a volatile semiconductor storage device such as a RAM (Random Access Memory) is used.

[0036] The peripheral devices connected to the bus 109 include a storage device 103, a GPU (Graphics Processing Unit) 104, an input interface 105, an optical drive device 106, a device connection interface 107, and a network interface 108.

[0037] The storage device 103 electrically or magnetically writes and reads data to and from a built-in recording medium. The storage device 103 is used as an auxiliary storage device for a computer. The storage device 103 stores an OS program, application programs, and various data. Note that the storage device 103 may be, for example, an HDD (Hard Disk Drive) or an SSD (Solid State Drive).

[0038] The GPU 104 is connected to a monitor 31. The GPU 104 displays an image on the screen of the monitor 31 in accordance with an instruction from the processor 101. The monitor 31 may be a display device using an organic EL (Electro Luminescence) display device, a liquid crystal display device, or the like.

[0039] The input interface 105 is connected to a keyboard 32 and a mouse 33. The input interface 105 transmits signals sent from the keyboard 32 and the mouse 33 to the processor 101. The mouse 33 is an example of a pointing device, and other pointing devices can also be used. Examples of other pointing devices include a touch panel, a tablet, a touch pad, and a trackball.

[0040] The optical drive device 106 uses a laser beam or the like to read data recorded on the optical disc 34. The optical disc 34 is a portable recording medium on which data is recorded so that it can be read by reflected light. The optical disc 34 includes a DVD (Digital Versatile Disc), a DVD-RAM, a CD-ROM (Compact Disc Read Only Memory), a CD-R (Recordable) / RW (Rewritable), etc.

[0041] The device connection interface 107 is a communication interface for connecting peripheral devices to the line determination server 100. For example, a memory device 35 or a memory reader / writer 36 can be connected to the device connection interface 107. The memory device 35 is a recording medium equipped with a function for communicating with the device connection interface 107. The memory reader / writer 36 is a device for writing data to the memory card 37 or reading data from the memory card 37. The memory card 37 is a card-type recording medium.

[0042] The network interface 108 is connected to the network 30. The network interface 108 transmits and receives data to and from other computers or communication devices via the network 30.

[0043] The line determination server 100 can realize the processing functions of the second embodiment with the hardware configuration described above. The line determination device 10 shown in the first embodiment can also be realized by the same hardware as the line determination server 100 shown in FIG. 3. The display server 200 and the external server 300 can also be realized by the same hardware as the line determination server 100. The processor 101 is an example of the processing unit 12 shown in the first embodiment. The memory 102 or the storage device 103 is an example of the storage unit 11 shown in the first embodiment.

[0044] The line determination server 100 realizes the processing functions of the second embodiment by executing a program recorded on, for example, a computer-readable recording medium. The program describing the processing to be executed by the line determination server 100 can be recorded on various recording media. For example, the program to be executed by the line determination server 100 can be stored in a storage device 103. The processor 101 loads at least a portion of the program in the storage device 103 into the memory 102 and executes the program. The program to be executed by the line determination server 100 can also be recorded on a portable recording medium such as an optical disc 34, a memory device 35, or a memory card 37. The program stored on the portable recording medium becomes executable after being installed on the storage device 103 under the control of, for example, the processor 101. The processor 101 can also directly read and execute the program from the portable recording medium.

[0045] Next, the function of the line determination server 100 will be described in detail. 4 is a block diagram showing an example of the functions of the line determination server. The line determination server 100 has a storage unit 110, an image collection unit 120, an analysis unit 130, a provisional line identification unit 140, a line identification unit 150, and a transmission unit 160. The storage unit 110 is realized using a storage area of ​​the memory 102 or the storage device 103. The image collection unit 120, the analysis unit 130, the provisional line identification unit 140, the line identification unit 150, and the transmission unit 160 are realized by the processor 101 executing a program stored in the memory 102.

[0046] The storage unit 110 stores photographed images 111-1, 111-2,..., analysis information 112, and compilation information 113. The photographed images 111-1, 111-2,... are images of running athletes 22a, 22b, 22c,... taken by the camera 23 at regular time intervals during leg showing. The analysis information 112 is information recording the results of identifying provisional line candidates, which are groups of athletes who were running together at the time each photographed image 111-1, 111-2,... was taken. The compilation information 113 is information compiling the number of times each provisional line candidate was identified.

[0047] The image collection unit 120 collects images of the athletes 22a, 22b, 22c, ... running during leg showing from the camera 23. The image collection unit 120 causes the camera 23 to capture images within the capture range at regular time intervals and acquires the images captured by the camera 23. The image collection unit 120 stores the acquired captured images in the storage unit 110 as captured images 111-1, 111-2, ...

[0048] The analysis unit 130 identifies provisional line candidates from each of the photographed images 111-1, 111-2, ... collected by the image collection unit 120, and records the identified provisional line candidates in the analysis information 112. The analysis unit 130 identifies position information of each player from the photographed image to be processed (for example, photographed image 111-1) among the photographed images 111-1, 111-2, .... For example, the analysis unit 130 detects people from the photographed image 111-1. The analysis unit 130 identifies the color of the hat of each detected person, and identifies each person as the player with the car number corresponding to the hat color. The analysis unit 130 calculates the position coordinates of each player on the bank 21 from the bank 21 shown in the photographed image 111-1 and the detected position of each person.

[0049] The analysis unit 130 determines whether the distance between each player and the preceding and following players is less than threshold x. The analysis unit 130 sets the preceding and following players whose distance is less than threshold x to belong to the same provisional line candidate. The analysis unit 130 also sets the preceding and following players whose distance is equal to or greater than threshold x to belong to different provisional line candidates. The analysis unit 130 then records the identified provisional line candidates in the analysis information 112. The analysis unit 130 also calculates the distance (line length) between the position of the foremost player and the position of the last player among the players belonging to the provisional line candidates, and records the calculated line length in the analysis information 112.

[0050] The provisional line identification unit 140 identifies a provisional line that is a provisional line based on the provisional line candidates identified by the analysis unit 130. The provisional line identification unit 140 tallies the number of times each provisional line candidate has been identified in the tabulated information 113. The provisional line identification unit 140 refers to the tabulated information 113 and identifies, as provisional lines, provisional line candidates that have been identified the most times in descending order. Note that, if the same racers belong to the provisional line candidates that have been identified the most times, the provisional line identification unit 140 prioritizes the provisional line candidate that has the most racers and the provisional line candidate that has the racer with the lowest car number as the provisional line.

[0051] The line identification unit 150 identifies a line based on the provisional line identified by the provisional line identification unit 140. The line identification unit 150 identifies each provisional line by performing the following process. The line identification unit 150 selects the captured image with the shortest line length from among the captured images in which the provisional line to be processed is recorded in the analysis information 112 as a provisional line candidate. The line identification unit 150 identifies the position information of each player belonging to the provisional line to be processed from the selected captured image.

[0052] The line identification unit 150 determines whether the distance between each player belonging to the provisional line being processed and the preceding and following players is less than threshold y, which is less than threshold x. The line identification unit 150 sets the preceding and following players whose distance is less than threshold y as belonging to the same line. The line identification unit 150 also sets the preceding and following players whose distance is equal to or greater than threshold y as belonging to different lines. The line identification unit 150 determines lines that group together players who are determined to belong to the same line for each player belonging to the provisional line being processed. Then, the line identification unit 150 outputs line information indicating the determined lines.

[0053] The transmitting unit 160 transmits the line information output by the line identifying unit 150 to the external server 300. For example, the transmitting unit 160 transmits to the external server 300 line information converted according to a data format rule of TCP (Transmission Control Protocol) / IP (Internet Protocol) that is set in advance between the line determination server 100 and the external server 300.

[0054] 4 indicate part of the communication paths, and communication paths other than those shown in the figure can also be set. Next, the information stored in storage unit 110 will be described in detail.

[0055] 5 is a diagram showing an example of analysis information. The analysis information 112 is information that records the results of identifying provisional line candidates. The analysis information 112 records provisional line candidates and line lengths identified based on each of the captured images 111-1, 111-2, ...

[0056] In the example of Fig. 5, there are five photographed images 111-1, 111-2, ..., and the analysis information 112 has items for provisional line candidate and line length corresponding to each of the first to fifth photographed images. The provisional line candidate item is set with the car number of the runner belonging to the identified provisional line candidate. The line length item is set with the line length of the identified provisional line candidate.

[0057] FIG. 6 is a diagram showing an example of the tally information. The tally information 113 is information that tallys up the number of times each provisional line candidate has been identified. The tally information 113 has fields for provisional line candidate and number of times identified. The provisional line candidate field contains the car number of the player belonging to the identified provisional line candidate. The number of times identified is contained in the field for number of times identified.

[0058] Next, the specification of the provisional line will be described. 7 is a diagram showing an example of the provisional line identification process. Based on the photographed images 111-1, 111-2, ..., the analysis unit 130 calculates the distance between the previous and next runners at the time of each photographed image 111-1, 111-2, ..., and identifies runners whose distance is less than threshold x as belonging to the same provisional line candidate. The provisional line identification unit 140 then tallies the number of times each provisional line candidate has been identified, and identifies the provisional line candidate with the highest number of times as the provisional line. The example in FIG. 7 describes a case where five photographed images were taken during the leg show in which runners with car numbers 1 to 9 (runners 1 to 9) ran.

[0059] The analysis unit 130 calculates the distance between the number 1 player and the number 2 player behind the number 1 player from the first photographed image, and assumes that the calculated distance is equal to or greater than the threshold x. Then, the analysis unit 130 determines that the number 1 player and the number 2 player belong to different provisional line candidates at the time the first photographed image was taken.

[0060] Furthermore, the analysis unit 130 determines that the number 2 player and the number 3 player belong to the same provisional line candidate because the distance between them in the first photographed image is less than the threshold x. Furthermore, the analysis unit 130 determines that the number 3 player and the number 4 player belong to different provisional line candidates because the distance between them in the first photographed image is equal to or greater than the threshold x. Furthermore, the analysis unit 130 determines that the number 4 player and the number 5 player belong to the same provisional line candidate because the distance between them in the first photographed image is less than the threshold x. Furthermore, the analysis unit 130 determines that the number 5 player and the number 6 player belong to the same provisional line candidate because the distance between them in the first photographed image is less than the threshold x.

[0061] Furthermore, the analysis unit 130 determines that the number 6 player and the number 7 player belong to different provisional line candidates because the distance between them in the first photographed image is equal to or greater than the threshold x. Furthermore, the analysis unit 130 determines that the number 7 player and the number 8 player belong to the same provisional line candidate because the distance between them in the first photographed image is less than the threshold x. Furthermore, the analysis unit 130 determines that the number 8 player and the number 9 player belong to different provisional line candidates because the distance between them in the first photographed image is equal to or greater than the threshold x.

[0062] As a result, the analysis unit 130 identifies, as the provisional line candidates at the time of shooting of the first photographed image, the provisional line candidate to which the number 1 player belongs, the provisional line candidate to which the number 2 and number 3 players belong, and the provisional line candidate to which the number 4, number 5 and number 6 players belong. Furthermore, the analysis unit 130 identifies, as the provisional line candidates at the time of shooting of the first photographed image, the provisional line candidate to which the number 7 and number 8 players belong, and the provisional line candidate to which the number 9 player belongs.

[0063] Furthermore, from the second photographed image, analysis unit 130 identifies potential provisional lines for player number 1, potential provisional lines for players number 2 and 3, potential provisional lines for players number 4, 5 and 6, and potential provisional lines for players number 7, 8 and 9. Furthermore, from the third photographed image, analysis unit 130 identifies potential provisional lines for players number 1, 2 and 3, potential provisional lines for players number 4, 5 and 6, and potential provisional lines for players number 7, 8 and 9.

[0064] Furthermore, from the fourth captured image, analysis unit 130 identifies potential provisional lines for players numbered 1, 2, and 3, potential provisional lines for players numbered 4, 5, and 6, and potential provisional lines for players numbered 7, 8, and 9. Furthermore, from the fifth captured image, analysis unit 130 identifies potential provisional lines for players numbered 1, 2, and 3, potential provisional lines for player numbered 6, potential provisional lines for players numbered 4 and 5, potential provisional lines for player numbered 7, and potential provisional lines for players numbered 8 and 9.

[0065] The provisional line identification unit 140 tallyes the number of times each provisional line candidate has been identified in the tally information 113. Then, the provisional line identification unit 140 identifies the provisional line candidate that has been identified the most as the provisional line. In the example of FIG. 7, the provisional line candidate for players numbered 1, 2, and 3 has been identified three times, the provisional line candidate for players numbered 4, 5, and 6 has been identified four times, and the provisional line candidate for players numbered 7, 8, and 9 has been identified three times. Therefore, the provisional line identification unit 140 identifies the provisional lines to which players numbered 1, 2, and 3 belong, the provisional lines to which players numbered 4, 5, and 6 belong, and the provisional lines to which players numbered 7, 8, and 9 belong.

[0066] In this way, the analysis unit 130 identifies provisional line candidates at the time of shooting of each captured image, and the provisional line identification unit 140 identifies a provisional line based on the number of times the provisional line candidates have been identified. Here, athletes belonging to the same line often run close together when showing their legs. Therefore, the provisional line identification unit 140 identifies the provisional line candidate that has been identified as the provisional line candidate at many of the shooting times as the provisional line. This allows the provisional line identification unit 140 to improve the accuracy of line determination.

[0067] Next, a procedure for the process performed by the line determination server 100 to provide line information to the external server 300 will be described. 8 is a flowchart showing an example of the procedure for line information provision processing. The processing shown in FIG. 8 will be described below in order of step number.

[0068] [Step S11] When leg exposure begins, the image collection unit 120 executes image collection processing, which will be described in detail later (see FIG. 9). [Step S12] The analysis unit 130 executes an analysis information generation process, which will be described in detail later (see FIG. 10).

[0069] [Step S13] The provisional line identification unit 140 executes provisional line identification processing, the details of which will be described later (see FIG. 11). [Step S14] The line identification unit 150 executes a line identification process, which will be described in detail later (see FIG. 12).

[0070] [Step S15] The transmitting unit 160 transmits the line information to the external server 300. For example, the transmitting unit 160 transmits the line information converted according to TCP / IP data format rules preset between the line determination server 100 and the external server 300 to the external server 300.

[0071] In this manner, the line determination server 100 identifies the line and transmits information about the identified line to the external server 300. Next, details of each process performed by the line determination server 100 will be described. First, the image collection process performed by the image collection unit 120 will be described.

[0072] 9 is a flowchart showing an example of the procedure for image collection processing. The processing shown in FIG. 9 will be explained below in order of step number. [Step S21] The image collection unit 120 causes the camera 23 to capture images of the capture range and acquires the images captured by the camera 23.

[0073] [Step S22] The image collection unit 120 stores the photographed images acquired in step S21 in the storage unit 110 as photographed images 111-1, 111-2, . . . [Step S23] The image collection unit 120 waits for a certain period of time.

[0074] [Step S24] The image collection unit 120 determines whether or not the leg exposure has ended. If the image collection unit 120 determines that the leg exposure has ended, it ends the process. If the image collection unit 120 determines that the leg exposure has not ended, it proceeds to step S21.

[0075] In this way, the image collection unit 120 can collect images of the athletes 22a, 22b, 22c, ... running during the leg show from the camera 23. Next, the analysis information generation process by the analysis unit 130 will be described.

[0076] 10 is a flowchart showing an example of the procedure for the analysis information generation process. The process shown in FIG. 10 will be described below in order of step number. [Step S31] The analysis unit 130 assigns 1 to a variable i (i=1).

[0077] [Step S32] The analysis unit 130 identifies position information of each player from the i-th captured image (e.g., captured image 111-1) of the captured images 111-1, 111-2, .... For example, the analysis unit 130 detects people from the captured image 111-1. The analysis unit 130 identifies the color of the hat of each detected person and identifies each person as the player with the car number corresponding to the hat color. Then, the analysis unit 130 calculates the position coordinates of each player on the track 21 from the track 21 shown in the captured image 111-1 and the detected position of each person.

[0078] [Step S33] The analysis unit 130 assigns 1 to the variable j (j=1). [Step S34] The analysis unit 130 determines whether the distance between the jth player from the front (the jth player) and the j+1th player is less than the threshold x. For example, the analysis unit 130 calculates the distance between the position coordinates of the jth player calculated in step S32 and the position coordinates of the j+1th player, and determines whether the calculated distance is less than the threshold x. If the analysis unit 130 determines that the distance between the jth player and the j+1th player is less than the threshold x, it proceeds to step S35. If the analysis unit 130 determines that the distance between the jth player and the j+1th player is equal to or greater than the threshold x, it proceeds to step S36.

[0079] [Step S35] The analysis unit 130 determines that the jth player and the j+1th player belong to the same provisional line candidate, and then the process proceeds to step S38. [Step S36] The analysis unit 130 determines that the jth player and the j+1th player belong to different provisional line candidates.

[0080] [Step S37] The analysis unit 130 records the provisional line candidate to which the jth player belongs in the analysis information 112. For example, the analysis unit 130 sets the car number of the player who belongs to the same provisional line candidate as the jth player in the provisional line candidate field corresponding to the i-th captured image. The analysis unit 130 also calculates the distance between the position of the frontmost player and the position of the rearmost player among the players who belong to the same provisional line candidate as the jth player as the line length, and sets the calculated line length in the line length field of the analysis information 112.

[0081] [Step S38] The analysis unit 130 determines whether j+1 is less than the number of players 22a, 22b, 22c, ... (j+1<number of players). If the analysis unit 130 determines that j+1 is less than the number of players 22a, 22b, 22c, ..., the process proceeds to step S39. On the other hand, if the analysis unit 130 determines that j+1 is equal to or greater than the number of players 22a, 22b, 22c, ..., the process proceeds to step S40.

[0082] [Step S39] The analysis unit 130 adds 1 to j (j++), and the process proceeds to step S34. [Step S40] The analysis unit 130 records the provisional line candidate to which the j+1th player belongs in the analysis information 112. For example, the analysis unit 130 sets the car number of the player who belongs to the same provisional line candidate as the j+1th player in the provisional line candidate field corresponding to the i-th captured image. The analysis unit 130 also calculates the line length of the provisional line candidate that belongs to the j+1th player, and sets the calculated line length in the line length field of the analysis information 112.

[0083] [Step S41] The analysis unit 130 determines whether i is less than the number of captured images 111-1, 111-2, ... (i<number of captured images). If the analysis unit 130 determines that i is less than the number of captured images 111-1, 111-2, ..., the process proceeds to step S42. On the other hand, if the analysis unit 130 determines that i is equal to or greater than the number of captured images 111-1, 111-2, ..., the process ends.

[0084] [Step S42] The analysis unit 130 adds 1 to i (i++), and the process proceeds to step S32. In this way, the analysis unit 130 identifies the positions of the players 22a, 22b, 22c, etc. from each of the captured images 111-1, 111-2, etc., and sets the players before and after each other who are closer than the threshold x as the same provisional line candidate. This allows the analysis unit 130 to identify, as a provisional line candidate, a group of players who were running together at the time of capture of each of the captured images 111-1, 111-2, etc. Next, the provisional line identification process performed by the provisional line identification unit 140 will be described.

[0085] 11 is a flowchart showing an example of the procedure for the provisional line specification process. The process shown in FIG. 11 will be described below in order of step number. [Step S51] The provisional line identification unit 140 tallyes the number of times a provisional line candidate has been identified in the tally information 113. For example, the provisional line identification unit 140 sets the car number of a player belonging to the provisional line candidate recorded in the analysis information 112 in the provisional line candidate field of the tally information 113, and sets the number of times the provisional line candidate has been recorded in the analysis information 112 in the identification count field.

[0086] [Step S52] The tentative line identification unit 140 selects the tentative line candidate that has been identified the most times from among the unselected tentative line candidates based on the tally information 113. Note that if there are multiple tentative line candidates that have been identified the most times, the tentative line identification unit 140 selects multiple tentative line candidates.

[0087] [Step S53] The provisional line identification unit 140 excludes provisional line candidates that include car numbers included in the identified provisional line from the provisional line candidates selected in step S52 (selected provisional line candidates).

[0088] [Step S54] The tentative line identification unit 140 determines whether all selected tentative line candidates have been excluded in step S53. If the tentative line identification unit 140 determines that all selected tentative line candidates have been excluded, it proceeds to step S52. If the tentative line identification unit 140 determines that all selected tentative line candidates have not been excluded, it proceeds to step S55.

[0089] [Step S55] The tentative line identification unit 140 determines whether there are multiple selected tentative line candidates. If the tentative line identification unit 140 determines that there are multiple selected tentative line candidates, it proceeds to step S56. If the tentative line identification unit 140 determines that there is only one selected tentative line candidate, it proceeds to step S60.

[0090] [Step S56] The provisional line identification unit 140 determines whether the car numbers of the selected provisional line candidates overlap. For example, if a player belonging to one selected provisional line candidate also belongs to another selected provisional line candidate, the provisional line identification unit 140 determines that the car numbers of the selected provisional line candidates overlap. If the provisional line identification unit 140 determines that the car numbers of the selected provisional line candidates overlap, it proceeds to step S57. If the provisional line identification unit 140 determines that the car numbers of the selected provisional line candidates do not overlap, it proceeds to step S60.

[0091] [Step S57] The provisional line identification unit 140 excludes from the selected provisional line candidates any selected provisional line candidates with overlapping car numbers other than the provisional line candidate with the most racers. [Step S58] The temporary line identification unit 140 determines whether the selected temporary line candidates have the same vehicle number. If the temporary line identification unit 140 determines that the selected temporary line candidates have the same vehicle number, it proceeds to step S59. If the temporary line identification unit 140 determines that the selected temporary line candidates have no same vehicle number, it proceeds to step S60.

[0092] [Step S59] The provisional line identification unit 140 excludes from the selected provisional line candidates any selected provisional line candidates with overlapping car numbers other than the provisional line candidate to which the player with the lowest car number belongs. For example, the provisional line identification unit 140 compares the car numbers included in each selected provisional line candidate with overlapping car numbers in ascending order, and excludes from the selected provisional line candidates any selected provisional line candidate other than the one with the lowest car number.

[0093] [Step S60] The tentative line identification unit 140 determines the selected tentative line candidate as the tentative line. [Step S61] The provisional line identification unit 140 determines whether all players belong to any provisional line. If the provisional line identification unit 140 determines that all players belong to any provisional line, it ends the processing. If the provisional line identification unit 140 determines that there are any players remaining that do not belong to any provisional line, it proceeds to step S52.

[0094] In this way, the provisional line identification unit 140 prioritizes provisional line candidates that have been identified many times as provisional lines. As a result, the provisional line identification unit 140 can identify runners who often raced close to each other as belonging to the same provisional line. Therefore, the provisional line identification unit 140 can improve the accuracy of line determination. Note that, when the provisional line candidates that have been identified the most times have the same car number, the provisional line identification unit 140 prioritizes provisional line candidates that have a larger number of runners or provisional line candidates to which runners with lower car numbers belong as provisional lines. As a result, the provisional line identification unit 140 can identify provisional lines so that each runner does not belong to multiple provisional lines. Next, the line identification process by the line identification unit 150 will be described.

[0095] 12 is a flowchart showing an example of the procedure for the line identification process. The process shown in FIG. 12 will be described below in order of step number. [Step S71] The line identification unit 150 selects an unselected tentative line.

[0096] [Step S72] The line identification unit 150 selects the captured image with the shortest line length among the captured images in which the provisional line (selected provisional line) selected in step S71 is recorded as a provisional line candidate. For example, the line identification unit 150 extracts the record in which the selected provisional line is set in the provisional line candidate item of the analysis information 112. The line identification unit 150 selects the captured image corresponding to the record with the shortest line length set in the line length item among the extracted records.

[0097] [Step S73] The line identification unit 150 identifies the position information of each player belonging to the selected provisional line from the captured image (selected captured image) selected in step S72. For example, in the analysis information generation process, the line identification unit 150 identifies the position coordinates of each player belonging to the selected provisional line among the position coordinates of the players identified from the selected captured image.

[0098] [Step S74] The line identification unit 150 substitutes 1 for the variable k (k = 1). [Step S75] The line identification unit 150 determines whether the distance between the k-th player and the (k + ۱)-th player among the players belonging to the provisional line is less than a threshold y (y < x) which is smaller than the threshold x. For example, the line identification unit 150 calculates the distance between the position coordinates of the k-th player and the position coordinates of the (k + ۱)-th player identified in step S73, and determines whether the calculated distance is less than the threshold y. If the line identification unit 150 determines that the distance between the k-th player and the (k + ۱)-th player is less than the threshold y, the process proceeds to step S76. If the line identification unit 150 determines that the distance between the k-th player and the (k + ۱)-th player is greater than or equal to the threshold y, the process proceeds to step S77.

[0099] [Step S76] The line identification unit 150 sets that the k-th player and the (k + ۱)-th player belong to the same line. Then, the process proceeds to step S78. [Step S77] The line identification unit 150 sets that the k-th player and the (k + ۱)-th player belong to different lines.

[0100] [Step S78] The line identification unit 150 determines whether k+1 is less than the number of players belonging to the provisional selection line (k+1<number of players in the provisional selection line). If the line identification unit 150 determines that k+1 is less than the number of players belonging to the provisional selection line, it proceeds to step S79. If the line identification unit 150 determines that k+1 is equal to or greater than the number of players belonging to the provisional selection line, it proceeds to step S80.

[0101] [Step S79] The line identification unit 150 adds 1 to k (k++), and the process then proceeds to step S75. [Step S80] The line identification unit 150 determines the lines of each player who belongs to the selected provisional line. The line identification unit 150 determines a line that collectively identifies players who are determined to belong to the same line.

[0102] [Step S81] The line identification unit 150 determines whether all tentative lines have been selected. If the line identification unit 150 determines that all tentative lines have been selected, it proceeds to step S82. If the line identification unit 150 determines that unselected tentative lines remain, it proceeds to step S71.

[0103] [Step S82] The line identification unit 150 outputs line information indicating the determined line. In this way, the line identification unit 150 determines whether the distance between the preceding and following runners for each provisional line is less than the threshold y based on the captured image recorded as the provisional line candidate with the shortest line length. Then, the line identification unit 150 determines that the preceding and following runners whose distance is less than the threshold y belong to the same line, and determines the line. In this way, the line identification unit 150 can automatically determine the line, making it easy to provide information used for predicting bicycle racing results.

[0104] Furthermore, in the analysis information generation process, the analysis unit 130 determines that two adjacent players whose distance is less than a large threshold x belong to the same provisional line candidate, thereby enabling the analysis unit 130 to determine that two players who belong to the same line but are temporarily separated from each other belong to the same provisional line candidate. Here, the analysis unit 130 may also determine that two adjacent players whose distance is temporarily less than the threshold x belong to the same provisional line candidate. Therefore, the line identification unit 150 determines that two adjacent players whose distance is less than a threshold y, which is smaller than the threshold x, belong to the same line, based on the captured image recorded as the provisional line candidate with the shortest line length. This allows the line identification unit 150 to determine that two adjacent players whose distance is temporarily less than the threshold x belong to different lines. Therefore, the line identification unit 150 can improve the accuracy of line identification.

[0105] Next, a description will be given of how to use the line information output by the line determination server 100. The line determination server 100 transmits the output line information to the external server 300. The external server 300 then generates a display image including the acquired line information and transmits the generated display image to the display server 200. The display server 200 acquires the display image from the external server 300 and displays the acquired display image on the monitor 24.

[0106] 13 is a diagram showing an example of a display image. Display image 50 is an image displayed on monitor 24 to provide race information to users who are placing bets on bicycle races. Display image 50 is generated by external server 300 and displayed on monitor 24 by display server 200. Display image 50 includes information indicating the display content, information indicating the participating athletes, information indicating odds, and a line display area 51.

[0107] The information indicating the display content is the content displayed on the display image 50, and includes, for example, the name of the track where the race will be held, the race number, the race name, the type of odds, and the time until the voting deadline. The information indicating the participating athletes is a list of the athletes participating in the race, and includes, for example, the car numbers and the names of the athletes. The information indicating the odds is a list of the odds for the race, and includes, for example, the odds corresponding to each combination of two-horse bets.

[0108] The line display area 51 displays line information for the leg shots of the race output by the line determination server 100. For example, the line display area 51 displays "2," "5," "6," "8," "1," "7," "3," "9," and "4" spaced apart. The line display area 51 indicates that the runners numbered 2, 5, and 6 are on the same line, the runners numbered 8, 1, and 7 are on the same line, and the runners numbered 3, 9, and 4 are on the same line.

[0109] In this way, the display image 50 displays the race information and the race leg line side by side. Here, the athletes 22a, 22b, 22c, etc. often run in the same line as the leg line in the race. By displaying the display image 50 on the monitor 24, the user can consider their bets while looking at the lines and odds that are likely to be drawn in the race. Therefore, by outputting the line information, the line determination server 100 can provide the user with information to use in predicting the outcome of a Keirin race.

[0110] Although the embodiments have been described above, the configuration of each part shown in the embodiments can be replaced with other parts having similar functions. Also, any other components or processes may be added. Furthermore, any two or more configurations (features) of the above-described embodiments may be combined. [Explanation of symbols]

[0111] 1a, 1b, 1c,... Players 2 Cameras 10 Line Judgment Device 11 Storage section 11a-1, 11a-2,... Photographed image 12 Processing section

Claims

1. a storage unit that stores a plurality of photographed images of a plurality of cyclists racing at a plurality of photographing times in a bicycle race; a processing unit that specifies a distance between each of the plurality of runners and the preceding and succeeding runners at each of the plurality of shooting times based on the plurality of captured images, and specifies a line representing a group of runners running together to which each of the plurality of runners belongs by determining whether the preceding and succeeding runners belong to the same line based on the distance; A line determination device having the above structure.

2. the processing unit identifies provisional line candidates to which the plurality of players belong at each of the plurality of photographing times by determining whether or not the preceding and succeeding players belong to the same provisional line candidate based on the distance, and identifies the line based on the frequency at which each of the provisional line candidates is identified. The line determination device according to claim 1.

3. the processing unit determines whether the preceding and following players belong to the same provisional line candidate based on whether the distance is less than a first threshold, thereby identifying the provisional line candidate; determines a provisional line to which each of the plurality of players belongs based on a frequency at which each of the provisional line candidates is identified; and determines, for each player belonging to the provisional line, whether the preceding and following players belong to the same line based on whether the distance is less than a second threshold that is smaller than the first threshold, thereby identifying the line; 3. The line determination device according to claim 2.

4. On the computer, In a bicycle race, based on a plurality of photographed images of a plurality of cyclists racing at a plurality of photographing times, a distance between each of the plurality of cyclists and the cyclists before and after the plurality of cyclists at each of the plurality of photographing times is determined; Identifying a line, which is a group of runners running together and to which each of the plurality of runners belongs, by determining whether or not runners in front and behind each other belong to the same line based on the distance. A line determination program that executes the process.

5. The computer In a bicycle race, based on a plurality of photographed images of a plurality of cyclists racing at a plurality of photographing times, a distance between each of the plurality of cyclists and the cyclists before and after the plurality of cyclists at each of the plurality of photographing times is determined; Identifying a line, which is a group of runners running together and to which each of the plurality of runners belongs, by determining whether or not runners in front and behind each other belong to the same line based on the distance. Line determination method.

Images