Race management system and race management method

Abstract

The present invention aims to provide a race management system and a race management method that allow viewers to experience a highly realistic race using actual moving objects even in places where it is difficult to hold a race for safety reasons. The race management system 100 includes a course setting unit 31 that sets a course for measuring a time according to the topography of the viewing location 111, a movement trajectory acquisition unit 35 that acquires the movement trajectories of airplanes 101A to 101C that move along the course at each of a plurality of recording locations 110A to 110C that are different locations, and an XR image provision unit 39 that provides viewers at the viewing location 111 with an XR image in which an image of the airplanes 101A to 101C is superimposed on an image of the viewing location 111 based on the movement trajectories of at least two airplanes 101A to 101C out of the plurality of airplanes 101A to 101C.

Description

[Technical field]

[0001] The present invention relates to a race management system and a race management method. [Background technology]

[0002] Conventionally, there has been known a technique for creating a sense of realism in a racing game by utilizing a communication network such as the Internet. For example, Patent Document 1 describes this type of technique.

[0003] Patent Document 1 describes a system that processes images and sounds recognized during a race by a racer selected by a user and transmits the processed images and sounds from the racer to a client terminal of the user who selected the racer. According to Patent Document 1, a user can play a racing game based on images and sounds captured by an actual racer. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Special Publication No. 2014-520303 Summary of the Invention [Problem to be solved by the invention]

[0005] However, it is difficult to use actual aircraft for night races in the air or on city streets, or at night, due to the danger involved. Also, races require participants to gather in the same place, and the costs of preparing the venue, schedule adjustments, and other preparations are huge.

[0006] The present invention has been made in consideration of the above circumstances, and aims to provide a race management system and a race management method that allow users to experience a highly realistic race using actual moving objects, even in locations where it is difficult to hold the race for safety reasons. [Means for solving the problem]

[0007] In order to achieve the above-mentioned objective, one aspect of the present invention is a race management system that includes a course setting unit that sets a course for measuring times according to the topography of the viewing location, a movement trajectory acquisition unit that acquires movement trajectories of moving bodies that move along the course at each of a plurality of different recording locations, and an XR image providing unit that provides viewers at the viewing location with XR images in which images of the moving bodies are superimposed on an image of the viewing location based on the movement trajectories of at least two of the plurality of moving bodies.

[0008] Another aspect of the present invention is a race management method executed by a computer, the race management method including: a course setting step for setting a course for measuring times according to the topography of the viewing location; a movement trajectory acquisition step for acquiring movement trajectories of moving bodies moving along the course at each of a plurality of different recording locations; and an XR image provision step for providing an XR image in which an image of the moving bodies is superimposed on an image of the viewing location based on the movement trajectories of at least two of the plurality of moving bodies to a viewer at the viewing location. Effect of the Invention

[0009] According to the present invention, it is possible to provide a race management system and a race management method that allow the experience of a highly realistic race using actual moving objects, even in locations where it is difficult to hold races for safety reasons. [Brief description of the drawings]

[0010] [Figure 1] FIG. 1 is a schematic diagram showing a race management system according to an embodiment of the present invention. [Diagram 2] 1 is a block diagram showing a hardware configuration of a race management device according to an embodiment of the present invention. [Diagram 3] FIG. 2 is a functional block diagram showing an example of the functional configuration of the race management device according to the present embodiment. [Figure 4]FIG. 11 is a flow chart showing an example of an input process of tournament information input by the tournament organizing committee. [Diagram 5] FIG. 11 is a flow diagram showing an example of a process from the determination of the match cards to the start of measurement. [Figure 6] A flow chart showing an example of a process for registering flight information in a race management device. [Figure 7] FIG. 11 is a flow diagram showing an example of a process for outputting a win / loss determination. [Figure 8] FIG. 11 is a flow diagram showing an example of a generation process of an XR image. [Figure 9] FIG. 13 is a diagram showing an example of an XR image provided to a viewer. [Figure 10] FIG. 13 is a diagram showing an example of a display of an advertisement for a 3D aircraft model. [Figure 11] FIG. 11 is a flow diagram showing an example of a process for providing XR images at a venue. [Figure 12] FIG. 13 is a diagram showing another example of the provision form of an XR image. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0011] Hereinafter, an embodiment of the present invention will be described with reference to the drawings.

[0012] <System Overview> Fig. 1 is a schematic diagram showing a race management system 100 according to an embodiment of the present invention. As shown in Fig. 1, the race management device 1 collects flight information of airplanes 101A to 101C that have flown in a time competition on courses set at recording locations 110A to 110C around the world, and provides XR footage of motor sports based on the collected information to viewers at a viewing location 111 or via a predetermined communication network such as the Internet. The airplanes 101A to 101C are, for example, moving bodies such as small propeller aircraft.

[0013] Recording locations 110A to 110C are different locations. The layout, start position, altitude, and start direction of the course are set according to the topography of viewing location 111 and recording locations 110A to 110C. For example, the layout of the course is set according to the urban environment, buildings, roads, and spectator locations of the host city that is the viewing location 111.

[0014] In the course set in the recording locations 110A to 110C, a plurality of inflatable pylons 102 are placed in the air according to the course layout. The airplanes 101A to 101C fly the specified course by passing between the pylons 102. The course is set so that the pylons 102 can be seen from anywhere in the viewing location 111 described below, regardless of the ground environment or altitude. The course may be automatically generated by software, or the set course may be automatically corrected by software.

[0015] Flight information during the flight of the airplanes 101A to 101C may be acquired via a USB memory or an SD card, or may be acquired by real-time transmission using wireless communication. In real-time transmission, it is preferable that the delay (delay latency) of milliseconds occurring in the actual flight is corrected on software.

[0016] Recording location 110A is the race venue for airplane 101A, recording location 110B is the race venue for airplane 101B, and recording location 110C is the race venue for airplane 101C. Since the flying areas are different, environmental differences arise between recording locations 110A to 110C. The environmental differences are altitude, air density, temperature, humidity, wind, latitude, earth gravity, etc. The environmental differences are reflected in the race by a computer as handicaps. The environmental differences are managed by distinguishing between those that are constant for each recording location 110C, such as altitude, latitude, longitude, and earth gravity, and those that change for each recording time, such as air density, temperature, humidity, and wind.

[0017] The viewing location 111 is a venue for public viewing or the like. At the viewing location 111, XR images generated by measurement technology and AR reproduction technology of airplanes 101A to 101C moving three-dimensionally in the air are provided. The XR (Extended Reality / Cross Reality) images include AR (Augmented Reality) images and VR (Virtual Reality) images. In the following description, the images refer to moving images that change over time. The method of viewing the images is not limited to AR goggles or VR goggles, and a method using retinal projection technology may be used.

[0018] For example, an XR image in which 3D aircraft models of the airplanes 101A to 101C are synthesized with an image captured of the viewing location 111 is provided by the race management device 1. An image of the pylon 102 is also synthesized with the XR image.

[0019] At the viewing location 111, XR images are provided to viewers using hardware such as a mobile terminal 5, such as a smartphone or tablet, and a head-mounted display 6. The head-mounted display 6 may be AR glasses. The XR images are also provided as video content that is visualized and made into a program as a live race commentary. The provision of XR images at the viewing location 111 is carried out, for example, by distribution over a communication network or by television, with the final day of the time attack being treated as race day.

[0020] The XR image does not necessarily have to show an actual airplane flying at the viewing location 111, but an AR image may be generated by superimposing the 3D aircraft models of the airplanes 101A to 101C like ghosts on an image captured of an actual airplane flying. In this case, it is preferable to adjust the position of the 3D aircraft data in the virtual space using a program that corrects the online time lag (delay latency) between the flight of the real airplane and the flight of the 3D aircraft data.

[0021] In the following description, when there is no need to distinguish between the airplanes 101A to 101C, the alphabet will be omitted and they will be described as airplane 101, and when there is no need to distinguish between the recording locations 110A to 110C, they will be described as recording location 110.

[0022] <Hardware configuration> Next, an example of hardware constituting the race management device 1 will be described. Fig. 2 is a block diagram showing the hardware configuration of the race management device 1 according to this embodiment. The race management device 1 includes a CPU (Central Processing Unit) 11 as a processor, a ROM (Read Only Memory) 12, a RAM (Random Access Memory) 13, a bus 14, an input / output interface 15, an output unit 16, an input unit 17, a storage unit 18, a communication unit 19, and a drive 20.

[0023] The CPU 11 executes various processes according to a program recorded in the ROM 12 or a program loaded from the storage unit 18 to the RAM 13. The RAM 13 also stores data and the like required for the CPU 11 to execute various processes. The CPU 11, the ROM 12, and the RAM 13 are interconnected via a bus 14. An input / output interface 15 is also connected to this bus 14.

[0024] An output unit 16, an input unit 17, a storage unit 18, a communication unit 19, and a drive 20 are connected to the input / output interface 15. The output unit 16 is composed of a display, a speaker, etc., and outputs various information as images and sounds. The input unit 17 is composed of a keyboard, a mouse, etc., and inputs various information. The storage unit 18 is composed of a hard disk, a DRAM (Dynamic Random Access Memory), etc., and stores various data. The communication unit 19 communicates with other devices via a network including the Internet.

[0025] Removable media 21, which may be a magnetic disk, an optical disk, a magneto-optical disk, or a semiconductor memory, is appropriately attached to the drive 20. Programs read from the removable media 21 by the drive 20 are installed in the storage unit 18 as necessary. The removable media 21 can also store various data stored in the storage unit 18 in the same manner as the storage unit 18.

[0026] The hardware configuration described here is merely an example. The computer described in this embodiment including the race management device 1 may have a configuration common to that of Fig. 2, or may have a different configuration. In addition, the computer may be composed of two or more computers.

[0027] <Functional configuration> Next, there will be described a functional configuration of the race management device 1. Fig. 3 is a functional block diagram showing an example of the functional configuration of the race management device 1 according to this embodiment.

[0028] As shown in Figure 3, the race management device 1 includes a course setting unit 31, a match card setting unit 32, a match card presentation unit 33, a token management unit 34, a movement trajectory acquisition unit 35, an environmental information acquisition unit 36, a handicap setting unit 37, a win / lose determination unit 38, and an XR image providing unit 39 as functional units realized on a processor.

[0029] The course setting unit 31, the match card setting unit 32, and the match card presenting unit 33 will be described with reference to Fig. 4. Fig. 4 is a schematic diagram showing an example of tournament information input by the tournament organizing committee.

[0030] As shown in Fig. 4, the organizing committee of the race that sponsors the race inputs the race information into the race management device 1 using a computer 2 connected to the race management device 1 via a predetermined communication network such as the Internet. Adminweb is a web interface exclusively for administrators that is realized by the race management device 1.

[0031] The competition information is input to the race management device 1 in order to create, start, end, etc. of a competition. The competition information includes information for creating teams, setting courses for each team, creating match cards (match schedules), setting and changing the flights / runs to be adopted, etc. Note that a flight refers to a flight at the recording location 110, and a run refers to flying a course from start to finish.

[0032] The course setting unit 31 sets and registers a course for measuring the time at the recording location 110 based on the input competition information. The course is generated based on the latitude and longitude information of each of the recording locations 110A to 110C, and is the same course. Although the course itself is common to each of the recording locations 110A to 110C, the recording locations 110A to 110C are different, so the latitude and longitude of the set course are different. In addition, the height measured by technology such as GPS is obtained by viewing the earth as an ellipsoid, so it is necessary to convert it into an altitude or the like that takes into account the actual geoid. The course in this embodiment is set according to the topography of the viewing location 111, taking into account these influences so that the XR image is appropriate.

[0033] The match card setting unit 32 acquires and registers match cards included in the tournament information input from the tournament executive committee. The match cards include information about teams as participants participating in the same race. For example, the match cards are first determined in a predetermined format such as a league format, a tournament format, etc., and the content of the whole or part of the tournament is then determined. Then, in the measurement described below, the match using the measurement (for example, a one-on-one match between player A and player B, or a preliminary match between players A to D) is linked and managed.

[0034] The match card presenting unit 33 presents information about match cards to the teams participating in the tournament and the general public. The information about match cards includes, in addition to the teams, a designated period designated as a period for time attack, and the like.

[0035] Information about the match cards is presented to the teams via Playerweb. Playerweb is a web interface exclusively for tournament participants, realized by the race management device 1. Teams obtain information about the match cards using a computer 3 connected to Playerweb via a communications network. Teams can also perform operations such as displaying and correcting team information via Playerweb using the computer 3. In addition, the match card presenting unit 33 makes the match cards available to the general public via Publicweb, which is connected to the communications network. The general public can learn about information about the match cards and the tournament via the computer.

[0036] Next, the token management unit 34, the movement trajectory acquisition unit 35, and the environmental information acquisition unit 36 ​​will be described with reference to Fig. 5 and Fig. 6. Fig. 5 is a flow diagram showing an example of the processing until the start of measurement after the match is determined.

[0037] As shown in Figure 5, when a team decides to participate, each team creates a flight plan. Based on the plan, a real-time broadcast of the flight run is made available to the public via Publicweb. The real-time broadcast is, for example, a video captured by a ground camera.

[0038] The token management unit 34 of the race management device 1 issues a token for preventing fraud. For example, the token is used to detect tampering with target information or to encrypt the information in order to prevent tampering (one example of fraud). In this embodiment, the token management unit 34 issues a token when the matches have been decided and before recording in the recording location 110.

[0039] The issued token is stored in a recording medium 30 such as a USB. The recording medium 30 in which the token is stored is connected to an RDU (Remote Data Unit) 25 mounted on each of the airplanes 101A to 101C.

[0040] Furthermore, environmental information is acquired at an airport or the like near the recording location 110 where the flight for the specified course is performed. The timing of acquiring the environmental information may be immediately before the flight, during the flight, or immediately after the flight. In this embodiment, the environmental information is acquired when the token is issued. In terms of acquiring the environment more accurately, it is preferable to acquire the information during the flight. In the following description, the time of flight is defined as a time interval including immediately before the flight, during the flight, and immediately after the flight.

[0041] The environmental information includes altitude, air density, temperature, humidity, wind, latitude, earth's gravity, etc. The environmental information is input by a computer connected to the race management device 1 via a predetermined communication network such as the Internet. The environmental information acquisition unit 36 ​​of the race management device 1 acquires environmental information at the time of the flight of the airplanes 101A-101C at each of the recording locations 110A-110C. Note that the above-mentioned token may have environmental information corresponding to each of the recording locations 110A-110C embedded therein.

[0042] 6 is a flow diagram showing an example of a process for registering flight information in the race management device 1. In a state where the recording medium 30 in which the token is stored is connected to the RDU 25, the airplane 101 performs a flight / run along the course set by the course setting unit 31.

[0043] With the recording medium 30 connected to the RDU 25, the airplane 101 flies the course set by the course setting unit 31, and flight information including the movement trajectory is stored from the RDU 25 to the recording medium 30. The movement trajectory includes information indicating the movement route of the airplane 101 that changes over time. The flight information is collected via the recording medium 30. During the flight, an arbitrary number of runs (for example, three or five runs) are made. The arbitrary number of runs is a predetermined number set as a rule of the competition, and may be one run.

[0044] As shown in FIG. 3, in addition to the RDU 25, the airplane 101 is equipped with a display system 26 and a three-dimensional data logger 27 as a configuration for realizing race management.

[0045] The display system 26 is configured, for example, with an ultra-high brightness head-up display. The display system 26 displays course information showing the positions of the pylons 102, etc., in the pilot's line of sight using AR technology. The display system 26 may project the movement trajectory of the airplane 101 recorded in another recording location 110. The display system 26 may also display, in the pilot's line of sight, markers of times that are indicators of world records, personal bests, runs of rival airplanes 101, etc.

[0046] The display system 26 performs on-board real-time AR synthesis while constantly grasping the current position information inside the aircraft 101 moving at high speed. This enables safer high-altitude races for beginners, and competition classes can be set according to skill, making it possible to hold competitions in which athletes of a wide range of levels can participate. Note that the display system 26 does not necessarily need to perform AR synthesis. Pilots may perform flights / runs by grasping the course using pylons 102 floating in the air, without relying on AR technology.

[0047] The three-dimensional data logger 27 acquires flight information during flight along the course. The three-dimensional data logger 27 is composed of a GPS device, an acceleration sensor, and the like. The flight information includes a movement trajectory indicating the trajectory of the airplane, such as position information, aircraft attitude, aircraft speed, and gravity acceleration. The position information is precisely acquired based on the attitude, GPS position, inertial navigation system, acceleration information, and the like. Judging of race rules such as deviation from the course may be performed in real time by automatic judgment by a computer.

[0048] In this embodiment, the three-dimensional data logger 27 acquires the aircraft trajectory, aircraft attitude, aircraft speed, G (gravity), penalties for the course, and the like as a movement trajectory during a flight / run. These data are zipped as a JSON (JavaScript Object Notation) file and binary data XML and stored on the recording medium 30. The data is stored in a predetermined format in a predetermined unit so that it cannot be tampered with. The data stored on the recording medium 30 is uploaded to the race management device 1 after being extracted from the airplane 101.

[0049] The movement trajectory acquisition unit 35 acquires flight information including movement trajectories from the data uploaded to the race management device 1. The flight information including movement trajectories is registered in association with each team. Of any number of runs, a predetermined number (e.g., three runs) are registered. At this time, the data may be encrypted.

[0050] 6, when the flight / run starts, the cameras also start taking videos. In this embodiment, videos of the flight / run are taken by an onboard camera 22 that is mounted on the airplane 101 and takes an image of the pilot's starting point, and a ground camera 23 that takes an image of the airplane 101 from the ground. Data of the videos taken by the onboard camera 22 and the ground camera 23 is uploaded to the race management device 1 via Playerweb.

[0051] Next, the handicap setting section 37 and the win / loss determination section 38 will be described with reference to Fig. 7. Fig. 7 is a flow chart showing an example of a win / loss determination output process.

[0052] The handicap setting unit 37 assigns handicaps to the airplanes 101A to 101C based on the environmental information acquired by the environmental information acquisition unit 36. The handicaps are intended to eliminate advantages and disadvantages due to environmental differences. The handicaps are calculated, for example, by applying parameters of the environmental information to a predetermined mathematical formula that is set theoretically or empirically. The handicaps are assigned by reflecting the number of seconds based on the environmental information in the measured time.

[0053] The winner determination unit 38 performs a winner determination for the airplanes 101A to 101C based on the movement trajectories and handicaps of the airplanes 101A to 101C. In this way, a winner is determined from among the airplanes 101A to 101C recorded at different locations.

[0054] The winning / losing determination unit 38 outputs the result of the winning / losing determination. The output information output by the winning / losing determination unit 38 includes the flight / run results and the match / contest results.

[0055] The flight / run result is, for example, the result time (sec) or run time (sec) showing the result of each of the airplanes 101A to 101C running the course, the penalty time (sec) showing the penalty, the handicap (±sec) set by the handicap setting unit 37, etc. The match / contest result is, for example, win / lose information that determines the outcome, such as win, loss, or draw, the points acquired for each win, loss, or draw, the total points that are the sum of the points acquired so far, and the team point ranking. Furthermore, the match / contest result (including a qualifying round with multiple people) may include a ranking of the fastest time during the run of the course, the fastest time for each team or player, a bonus for the fastest time, etc.

[0056] The output information output by the winner / loser determination unit 38 is provided to the competition executive committee via Adminweb. The competition executive committee checks the flight / run results and the match / competition results contained in the output information. After checking, the competition executive committee selects invalid and acceptable flight / run data, and inputs the selection result to the race management device 1 by the computer 2 via Adminweb. When the selection result is input from the competition executive committee, the winner / loser determination unit 38 again outputs output information that reflects the input result.

[0057] Furthermore, the output information output by the winner / loser determination unit 38, except for information whose disclosure is restricted in advance, is provided to the teams via Playerweb and is also made public via Publicweb. The output information is provided and made public in real time. Information whose disclosure is restricted in advance is, for example, result data of tournaments such as the semi-finals, finals, and third place deciding matches. The result data is not automatically made public. The result data is provided or made public after the XR image is made public at the viewing location 111, etc.

[0058] Next, the XR image providing unit 39 will be described. The XR image providing unit 39 provides XR images generated based on the movement trajectories and handicaps of the airplanes 101A to 101C to a viewer at the viewing location 111 and a viewer of a video distribution service distributed via a communication network such as the Internet. The format of the XR images may differ depending on the viewer to whom they are provided. For example, an AR image is provided to the viewer at the viewing location 111, and a VR image is provided to the viewer of the video distribution service.

[0059] Generation of an XR image will be described with reference to Fig. 8. Fig. 8 is a flow diagram showing an example of a generation process of an XR image.

[0060] As shown in FIG. 8, the flight / run data including the movement trajectory is provided to a processing tool to perform production processing of image content. The flight / run data is provided to the processing tool via ARweb. ARweb is a web interface for providing information about AR images and AR images. The processing tool processes the flight / run data to process it into AR images and VR images. The processed flight / run data processed by the processing tool is output to an AR / VR editing tool. In addition to the processed flight / run data, a 3D aircraft model and a 3D city model are input to the editing tool.

[0061] The 3D aircraft model is three-dimensional information indicating the shape of the aircraft of the airplane 101 provided by the team. The 3D aircraft model can be obtained, for example, by scanning the actual airplanes 101A to 101C with high precision and converting them into polygon data. This 3D aircraft model can also be used for promotion, such as distributing it free of charge for personal use or distributing high-definition commercial data for a fee. The distributed 3D aircraft model can be used in games, VR clusters, and the like, and developed as derivative content, becoming known to many people.

[0062] The 3D city model is three-dimensional information showing the topography (shape of the city) of the viewing location 111. The 3D city model may be the latest geographical data acquired by aerial surveying, or open data of the 3D city model may be used.

[0063] The editing tool outputs AR image content data and VR image content data based on processed flight / run data (movement trajectory), aircraft 3D model, and 3D city model.

[0064] The editing tool also outputs a VR image from the pilot's viewpoint as content. The VR image is created by combining an image captured by the onboard camera 22 with ground data such as a 3D city model. This allows the scenery of the viewing location 111 to be reflected in the video data of the onboard camera 22, resulting in a composite image that allows a pilot to have a simulated experience. The composite image may also be created by combining the scenery of the viewing location 111 based on the 3D city model with the background of the pilot in an image captured of the pilot in the cockpit.

[0065] Here, the content data will be described with reference to FIG. 9. FIG. 9 is a diagram showing an example of an XR image provided to a viewer. FIG. 9 shows an AR image (XR image) in which an image based on an aircraft 3D model is superimposed on an image taken of an actual viewing location 111. The AR image in this example includes an airplane 101A, an airplane 101B, a pylon 102, and an advertisement image 60. The positions of the airplane 101A, the airplane 101B, and the pylon 102 in the AR image are set based on the position of the camera that captured the viewing location 111, the course layout, the movement trajectory, the position information of the 3D city model, and the like. The advertisement image 60 is a company name, a product name, and the like. The position of the advertisement image 60 is set based on the advertisement information set in advance and the position information of the 3D city model, and the like.

[0066] 9, in addition to the AR image, a race information display section 51, a pilot information display section 52, and a pilot image section 53 are displayed. The race information display section 51 displays information about the race, such as the measured time. The pilot information display section 52 displays information about the pilots, such as the pilot names of the airplanes 101A and 101B and the teams to which the pilots belong. The pilot image section 53 is a composite image in which a 3D city model of the viewing location 111 is composited with the background of the pilots in an image capturing the pilots in the cockpits of the airplanes 101A and 101B.

[0067] An example of an advertisement displayed on a 3D aircraft model will be described with reference to FIG. 10. FIG. 10 is a diagram showing an example of an advertisement displayed on a 3D aircraft model. FIG. 10 shows an airplane 101 displayed in an AR image or a VR image. In this example, an advertisement image 61 such as a company name or product name is superimposed on the wing of the airplane 101 of the aircraft 3D model. Therefore, it is possible to display the advertisement in an XR image by image processing without the need to display the advertisement on the actual airplane 101 by painting or the like.

[0068] In addition, the display mode of the letters, coloring, etc. of the airplane 101 can be changed while playing back the XR image (during the race). The display mode can also change advertisements depending on the passage of time or the race situation, so it can be used for business purposes such as expanding sponsor slots and holding special races for sponsors, which are not possible in actual races.

[0069] In addition, the flight / run data including the movement trajectory is provided to a sound production tool for performing a process of producing a 3D sound. The sound production tool outputs audio data that realizes a 3D sound corresponding to the AR image and the VR image based on the flight / run data.

[0070] Next, a method for providing XR images including AR images and VR images will be described. Fig. 11 is a flow diagram showing an example of a process for providing XR images at a venue.

[0071] The XR image provider 39 outputs content data to an AR / VR mobile app installed on the mobile terminal 5 of the viewer at the viewing location 111 and an AR / VR headset app installed on the head mounted display 6. The data is output via a predetermined communication network such as the Internet. As a result, the AR image or VR image is displayed on the viewer's mobile terminal 5 or head mounted display 6. Note that on the head mounted display 6, the viewed video can also be switched from the AR image to an information program about the tournament or a normal captured image while viewing the XR image.

[0072] Furthermore, the content data is input to an AR / VR mobile application for projection in order to project it at the viewing location 111, and the AR / VR projection is performed on the town by superimposing it on the shooting data of the viewing location 111. Furthermore, the shooting data of the projected AR / VR is utilized for real-time distribution through a video distribution system. In this embodiment, the shooting data of the projected AR / VR is broadcast and distributed through a communication network, and is provided to viewers who are not at the viewing location 111.

[0073] Also, the room of the viewing location 111 may be set as a viewing venue, and a transparent window in the room may be set as a screen, on which the airplanes 101A to 101C, the pylon 102, the advertisement image 60, etc. may be displayed. In this case, a transparent LED, a single focus projector, etc. may be used as a display device.

[0074] Audio data for reproducing the stereophonic sound is input to the hall audio 40. The audio data is reproduced in synchronization with the AR and VR images provided. By combining the stereophonic sound with the images, a more realistic experience can be provided to the viewers.

[0075] The broadcast will incorporate audio and video commentary from tournament officials and experts, audio and video reports from reporters, and audio and video interviews with teams and players.

[0076] As described above, the race management system 100 of this embodiment comprises a course setting unit 31 that sets a course for measuring time, a movement trajectory acquisition unit 35 that acquires movement trajectories of airplanes 101A-101C (moving bodies) that move along the course at each of a plurality of different recording locations 110A-110C, an environmental information acquisition unit 36 ​​that acquires environmental information that indicates the environment at the time of measurement of the movement trajectories corresponding to each of the recording locations 110A-110C, a handicap setting unit 37 that sets handicaps for the airplanes 101A-101C based on the environmental information, and a win / loss determination unit 38 that determines a win / loss between at least two of the plurality of airplanes 101A-101C that took measurements at each of the recording locations, reflecting the handicap.

[0077] In addition, the race management method of this embodiment includes a course setting step (for example, the flow of FIG. 4) for setting a course along which time is to be measured, a movement trajectory acquisition step (for example, the flow of FIG. 6) for acquiring movement trajectories of airplanes 101A-101C (moving bodies) moving along the course at each of a plurality of different recording locations 110A-110C, an environmental information acquisition step (for example, the flow of FIG. 5) for acquiring environmental information indicating the environment at the time of measurement of the movement trajectories corresponding to each of the plurality of recording locations 110A-110C, a handicap setting step (for example, the flow of FIG. 7) for setting handicaps for the airplanes 101A-101C based on the environmental information, and a win / loss determination step (for example, the flow of FIG. 7) for determining a win / loss between at least two airplanes 101A-101C among the plurality of airplanes 101A-101C that have been measured at each of the recording locations 110A-110C, while reflecting the handicap.

[0078] By configuring the race management system 100 and the race management method in this manner, the winning or losing outcome is determined by taking into account the environment of each recording location 110A-110C for the measurement records of the aircraft 101A-101C taken at the different recording locations 110A-110C, so that a fair race can be held between the aircraft 101A-101C that were actually taken at different locations.

[0079] In addition, the race management system 100 of this embodiment includes a match card setting unit 32 that sets match cards between multiple airplanes 101A to 101C, and a match card presentation unit 33 that presents match cards to the teams piloting the airplanes 101A to 101C, a movement trajectory acquisition unit 35 records the movement trajectories in association with the match cards, and a win / loss determination unit 38 determines the outcome of the match between the airplanes 101A to 101C corresponding to the match cards.

[0080] This means that even in races where the measurement itself is conducted alone, teams can approach the race with consideration for their opponents, balancing safety to avoid race penalties with shortening the measurement time.

[0081] In addition, the race management system 100 of this embodiment further includes a token management unit 34 that issues a token to prevent fraud before measuring the movement trajectory, and the movement trajectory acquisition unit 35 acquires the movement trajectory, along with the token, where measurement was performed while the recording medium 30 in which the token is stored was connected to the airplane 101.

[0082] As a result, even if the race is held at different recording locations 110A to 110C, the token can prevent tampering with the movement trajectory, etc., and therefore a fairer race can be realized.

[0083] Furthermore, as described in the above embodiment, the race management system 100 of this embodiment includes a course setting unit 31 that sets a course for measuring times according to the terrain of the viewing location 111, a movement trajectory acquisition unit 35 that acquires the movement trajectories of the airplanes 101A to 101C that move along the course at each of the multiple recording locations 110A to 110C that are different locations, and an XR image providing unit 39 that provides a viewer at the viewing location 111 with an XR image in which an image of the airplanes 101A to 101C is superimposed on an image of the viewing location 111 based on the movement trajectories of at least two of the multiple airplanes 101A to 101C.

[0084] In addition, the race management method of this embodiment includes a course setting step (for example, the flow of Figure 4) for setting a course for measuring a time according to the topography of the viewing location 111, a movement trajectory acquisition step (for example, the flow of Figure 6) for acquiring the movement trajectories of a moving object moving along the course at each of multiple recording locations 110A to 110C which are different locations, and an XR image provision step (for example, the flow of Figure 8 and Figure 11) for providing an XR image in which an image of the airplanes 101A to 101C is superimposed on an image of the viewing location 111 based on the movement trajectories of at least two of the multiple airplanes 101A to 101C to a viewer at the viewing location 111.

[0085] By configuring the race management system 100 and the race management method in this way, it is possible to provide viewers with a viewing environment using XR technology in which it feels as if the race is taking place at the viewing location 111, even in places that would be impossible to do in real life, such as the sky or roads in urban areas, or night races. It is also possible to realize a race between athletes who would be unable to be in the same place. Furthermore, viewers who are present at the viewing location 111 can get excited with a sense of realism.

[0086] Furthermore, the XR image providing unit 39 of this embodiment provides the viewer with an XR image that is generated so that at least two of the multiple airplanes 101A to 101C start at the same time and in the same position.

[0087] This makes it possible to use XR to recreate a race situation in which cars start from the same position at the same time, something that would be impossible in reality due to collisions, providing viewers with a visual experience that only XR images can provide.

[0088] In addition, the race management system 100 of this embodiment further includes an environmental information acquisition unit 36 ​​that acquires environmental information indicating the environment at the time of measuring the movement trajectories corresponding to each of the multiple recording locations 110A to 110C, and a handicap setting unit 37 that sets handicaps for the airplanes 101A to 101C based on the environmental information, and an XR image providing unit 39 provides the viewer with an XR image reflecting the handicap by adjusting the positions of the airplanes 101A to 101C on the movement trajectories based on the handicap.

[0089] This allows handicaps to be reflected in the XR image race, such as by playing back the planes 101A to 101C in unfavorable environments a few seconds ahead. For example, by adjusting the playback timing, the XR image is generated so that the first to cross the finish line is the winner. Viewers can watch the XR images without being aware of the handicap numbers, so the easy-to-understand rules can enhance the sense of immersion.

[0090] In addition, in this embodiment, the XR image providing unit 39 provides, together with the XR image, a composite image obtained by combining the scenery of the viewing location with a camera image actually captured when measuring the movement trajectory.

[0091] By combining the scenery at the viewing location with on-board camera images capturing the pilots, the viewer can feel as if the airplanes 101A to 101C are actually flying at the viewing location 111, further enhancing the sense of realism when viewing the race.

[0092] Furthermore, in this embodiment, the XR image providing unit 39 superimposes an advertisement image on the image of the airplanes 101A to 101C or the viewing location 111 in the XR image.

[0093] This allows advertisements for the race or show to be added to the images of the airplanes 101A to 101C and to the models that make up the scenery of the viewing location 111, making it possible to display advertisements using XR images that are not possible in conventional races using actual aircraft.

[0094] Although one embodiment of the present invention has been described above, the present invention is not limited to the above-described embodiment, and modifications, improvements, etc. within the scope that can achieve the object of the present invention are included in the present invention.

[0095] In the above embodiment, the audience is described as viewing the image using AR goggles or VR goggles at the viewing location 111, but the XR image of this embodiment can also be viewed at a location other than the viewing location 111, for example, at home.

[0096] FIG. 12 is a diagram showing another example of the form in which an XR image is provided. Figure 12 shows an XR image G1 including a streetscape simulating the viewing location 111 scaled down at a predetermined ratio, an airplane 101, the trajectory of the airplane 101, a pylon 102, and an advertising image 60, an XR image G2 provided to the viewer at the viewing location 111, and a desk D.

[0097] The XR image G1 is an XR image including a streetscape and an airplane 101 that mimics the viewing location 111 and is reduced at a predetermined ratio. The XR image G1 is presented to the viewer via the AR goggles. Here, the desk D is a real desk located near the viewer. That is, the viewer views the XR image G1 superimposed on the real desk D located nearby via the AR goggles. The predetermined ratio can be arbitrarily set by the viewer.

[0098] The XR image G2 is an XR image provided to a viewer at the viewing location 111. That is, for example, the XR image G2 may be a two-dimensional XR image that can be viewed with VR goggles or the like when watching a race from the ground of the viewing location 111 (which may be the rooftop of a building, etc.). Also, for example, the XR image G2 may be a two-dimensional XR image that is synthesized using XR technology with various information, on-board images, etc., provided to a viewer in a video distribution service. Note that the XR image G2 may be arranged as a curved surface on the AR. In this way, a person viewing the XR image from a location other than the viewing location 111, such as at home, can view multiple XR images, such as an overhead XR image G1 and an XR image G2 that is said to be viewed from the ground (for example, the rooftop of a building). This allows the viewer to simultaneously view the XR image (various information) that is possible only because the viewer is not at the viewing location 111, while also experiencing a sense of realism. In addition to these, cockpit images during flight, live images, and images distributed via designated SNS etc. may also be displayed in AR like the XR image G2 described above.

[0099] As another example, it is assumed that a desk D and a diorama on the desk actually exist near the viewer. In this case, as the above-mentioned XR image G1, the XR image G1 including the airplane 101, the trajectory of the airplane 101, the pylon 102, the advertising image 60, and the like superimposed on the desk D and the diorama on the desk can be viewed, and the viewer can enjoy watching the race from anywhere other than the viewing location 111.

[0100] In the above embodiment, the handicap setting unit 37 sets the handicap based on the environmental information, but other methods can be adopted for setting the handicap. For example, the skill difference between beginners, experts, and other pilots (teams) can be digitally corrected to enable handicap races. Also, a "fan boost" method can be adopted in which cheers from spectators are quantified and added to the movement trajectory so that the cheers from spectators affect the team's time and results.

[0101] In the above embodiment, an example was described in which a race is provided to the viewer as content using AR images or VR images in which airplanes 101A to 101C are superimposed on an image captured of viewing location 111, but it is also possible to perform a performance that is not actually performed. For example, the size of the displayed airplane 101 (aircraft 3D model) may be reduced or deformed for performance purposes. Furthermore, images of a race set in a virtual space such as a narrow space, underground space, underwater, or outer space that cannot be performed on an actual course may be provided.

[0102] XR images can also be applied to simulator games in which the player pilots an airplane. The player can fly / run the game airplane along the same course as the pilot actually flies. By adding environmental information to this game space and correcting and reproducing the information, a highly realistic game space can be created. For example, the effects of wind, air pressure, and turbulence generated by the aircraft can be applied to the airplane in the game space.

[0103] In addition, after the game, the flight trajectory of the player can be projected onto an AR image, and the game play at the viewing location 111 can be reproduced. In addition, a competition can be held for game players only, and a match between pilots of the actual airplanes 101A to 101C and game players can be realized. For example, an XR image can be generated that combines a race image of the airplanes 101A to 101C of the teams participating in the competition with a game image of the game players (general participants). The game competition may be held in another game space such as the metaverse. Furthermore, a real pilot training program can be implemented in which top game players aim to participate in a real competition.

[0104] In addition, a miniature race track can be reproduced in AR, and the race can be viewed in an AR sandbox. Furthermore, the trajectories of the airplanes 101A to 101C, which are accurately mapped based on a 3D city model, can be displayed using AR technology on a miniature that accurately reproduces the city of the viewing location 111, thereby creating content that can be enjoyed from a god's perspective. In this case, AR advertisements, etc., projected on the 3D city model when the XR image is provided may also be faithfully reproduced.

[0105] In addition, NFTs (Non-Fungible Tokens) may be used for part of the content to be provided. For example, 3D aircraft models of the airplanes 101A to 101C, flight information including the trajectory of the flight, original aircraft coloring, avatar pilots that are avatars of pilots, etc. may be converted into assets by NFTs.

[0106] In the above embodiment, a manned airplane is described as an example of a moving object, but the moving object to which the present invention is applied is not limited to a manned airplane. The moving object may be, for example, any moving object such as an unmanned aerial vehicle, a car, a motorcycle, a ship, a bicycle, or a moving living thing.

[0107] In addition, the above-mentioned series of processes can be executed by hardware or software. In other words, the above-mentioned functional configuration is merely an example and is not particularly limited. In other words, it is sufficient that the race management device has a function capable of executing the above-mentioned series of processes as a whole, and the type of functional block used to realize this function is not particularly limited to the above-mentioned example. In addition, the location of the functional block is not particularly limited and may be arbitrary. For example, the functional block of the race management device may be transferred to another device, etc. Conversely, the functional block of the other device may be transferred to a server, etc. In addition, one functional block may be configured as a single piece of hardware, may be configured as a single piece of software, or may be configured as a combination of them.

[0108] When a series of processes is executed by software, a program constituting the software is installed in a computer or the like from a network or a recording medium. The computer may be a computer built into dedicated hardware. The computer may also be a computer capable of executing various functions by installing various programs, such as a server, a general-purpose smartphone, or a personal computer.

[0109] The recording medium containing such a program may be configured not only as a removable medium (not shown) that is distributed separately from the device main body in order to provide the program, but also as a recording medium provided in a state in which it is pre-installed in the device main body, etc. Since the program can be distributed via a network, the recording medium may be mounted on or accessible to a computer that is connected or connectable to the network.

[0110] In this specification, the steps describing the program recorded on the recording medium include not only processes performed in chronological order, but also processes that are not necessarily performed in chronological order but are performed in parallel or individually. In addition, in this specification, the term "system" refers to an overall device composed of multiple devices, multiple means, etc. [Explanation of symbols]

[0111] 1 Race Management Device 30 Recording media 31 Course Setting Section 32 Match Card Setting Section 33 Match Card Presentation 34 Token Management Unit 35 Movement trajectory acquisition section 36 Environmental Information Acquisition Department 37 Handicap Setting Department 38 Win / Loss Judgment Department 39 XR Image Provider 100 Race Management System 101A, 101B, 101C Airplane 110A, 110B, 110C Recording location 111 Viewing Location

Claims

1. A course setting unit that sets a course for measuring a time according to the topography of a viewing location; a movement trajectory acquisition unit that acquires a movement trajectory of a moving object moving along the course at each of a plurality of recording locations that are different from each other; an XR image providing unit that provides an XR image in which an image of the moving body is superimposed on an image of the viewing location based on the movement trajectories of at least two of the moving bodies among the plurality of moving bodies, to a viewer at the viewing location; an environmental information acquisition unit that acquires environmental information indicating an environment at the time of measurement of the movement trajectory corresponding to each of the plurality of recording locations; a handicap setting unit that sets a handicap for the moving object based on the environmental information; Equipped with The XR image providing unit is and adjusting a position of the moving object on the movement trajectory based on the handicap, thereby providing the XR image reflecting the handicap to the viewer. Race management system.

2. The XR image providing unit is providing the viewer with the XR image generated so that the starts of at least two of the plurality of moving objects are simultaneous and at the same position; The race management system of claim 1.

3. The XR image providing unit is providing a composite image obtained by combining a camera image actually captured when measuring the movement trajectory with a scenery of the viewing location together with the XR image; A race management system according to claim 1 or 2.

4. The XR image providing unit is An advertisement image is superimposed on an image of the moving object or the viewing location in the XR image. A race management system according to claim 1 or 2.

5. 1. A computer implemented method of race management comprising the steps of: A course setting step for setting a course for measuring a time according to the topography of a viewing location; a movement trajectory acquisition step of acquiring a movement trajectory of a moving object moving along the course at each of a plurality of recording locations that are different from each other; an XR image providing step of providing an XR image in which an image of the moving body is superimposed on an image of the viewing location based on the movement trajectories of at least two of the plurality of moving bodies to a viewer at the viewing location; an environmental information acquisition step of acquiring environmental information indicating an environment at the time of measurement of the movement trajectory corresponding to each of the plurality of recording locations; a handicap setting step of setting a handicap for the moving object based on the environmental information; Including, In the X-ray image providing step, and adjusting a position of the moving object on the movement trajectory based on the handicap, thereby providing the XR image reflecting the handicap to the viewer. Race management methods.

Images