Generation device

Abstract

The present application relates to a generation device configured from a server that generates background data on the basis of imaging data of an automobile data recorder provided by a user of a vehicle, creates data including the background data as route data of a travel simulator executed by a user terminal, and distributes the route data to the user.

Description

Technical Field

[0001] The present invention relates to a device for generating background data of a vehicle driving simulator. Background Art

[0002] As a vehicle driving simulator used for games, driving training, etc., there is a simulator that simulates vehicle driving on roads in the real world. In addition, Japanese Patent Laid-Open No. 2001-22264 describes a driving simulator that obtains traffic information and weather information in the real world and reflects them in the simulation.

[0003] In the driving simulator as described above, the user can only drive along a route prepared in advance. Summary of the invention

[0004] A generating device for solving the above-mentioned problem generates background data of three-dimensional computer graphics used in a driving simulator for simulating the driving of a vehicle on a road in the real world based on video data of a drive recorder.

[0005] Background data of a driving simulator corresponding to the real world can be easily generated.

[0006] Features, advantages, technical and industrial significance of exemplary embodiments of the present invention are described below with reference to the accompanying drawings, in which like reference numerals represent like components. BRIEF DESCRIPTION OF THE DRAWINGS

[0007] Figure 1 This is a diagram schematically showing the configuration of one embodiment of a generating device.

[0008] Figure 2 This is a sequence diagram showing the processing procedure related to the generation and distribution of route data in the generation device. DETAILED DESCRIPTION

[0009] Below, refer to Figure 1 and Figure 2 An embodiment of the generating device is described in detail.

[0010] <About the structure of the generating device>

[0011] First, refer to Figure 1 , the structure of the generating device of the present embodiment is described. The generating device of the present embodiment is configured as a device for generating background data used in a driving simulator. The driving simulator here is configured to simulate the driving of a vehicle on a road in the real world. The driving simulator can be a simulator for games such as competitions, or a simulator for vehicle driving training.

[0012] exist Figure 1The vehicle 30 shown is provided with a driving recorder 31 for photographing the outside of the vehicle. In addition, the vehicle 30 is provided with a memory 32 capable of storing photographing data of the driving recorder 31, a communication module 33 for communicating outside the vehicle, and a positioning system 34 for detecting the position of the vehicle 30. An example of the positioning system 34 is a satellite positioning system. The photographing data of the driving recorder 31 recorded in the memory 32 includes not only the image outside the vehicle photographed by the driving recorder 31, but also the information of the photographing location and the photographing date and time acquired from the positioning system 34.

[0013] The driving simulator is executed on a computer terminal (hereinafter referred to as user terminal 20) owned by a user of the vehicle 30. Examples of the user terminal 20 include a personal computer, a consumer game console, a smart phone, etc. The user terminal 20 includes a processing circuit 21 and a memory 22. A program for the driving simulator is stored in the memory 22. The user terminal 20 operates as a driving simulator by reading and executing the program through the processing circuit 21. Data of driving routes that can be driven on the driving simulator (hereinafter referred to as route data) are stored in the memory 22. The driving simulator is configured to be able to add routes that can be driven on the simulator by acquiring new route data.

[0014] The generating device of this embodiment is composed of Figure 1 The server 10 shown in the figure has a configuration. The server 10 includes a processing circuit 11 and a memory 12. The server 10 performs processing related to the generation of route data of the driving simulator by the processing circuit 11 executing a program stored in the memory 12.

[0015] <About the creation of route data>

[0016] Next, refer to Figure 2 Next, a description will be given of a process of generating route data performed by the server 10. The server 10 generates route data using the image data captured by the drive recorder 31 when the vehicle 30 actually travels on the generated route.

[0017] When creating route data, the user of the vehicle 30 sends the captured data of the driving recorder 31 to the server 10 (S1). Figure 2 In the case of the vehicle 30, the captured data is directly sent to the server 10. Alternatively, the captured data may be sent to the server 10 via the user terminal 20. In this case, the captured data of the driving recorder 31 is first transferred to the user terminal 20 using a removable storage medium such as a memory card or Wi-Fi communication. Then, the captured data is sent from the user terminal 20 to the server 10.

[0018] In contrast, the server 10 obtains information required for creating route data other than the photographing data, such as road map information and terrain information around the route (S2). Then, the server 10 creates route data based on them (S3) and sends it to the user terminal 20 (S5). The user terminal 20 saves the received route data in the memory 22 (S6).

[0019] In addition to the data of the route itself, the route data also includes the background data of the route. When creating the route data, the server 10 generates background data (S4) based on the shooting data of the driving recorder 31. The background data includes 3D models of objects such as buildings and vegetation around the route. The shooting data of the driving recorder 31 includes images of the object observed from multiple angles. In addition, the camera data includes information on the shooting locations of the above multiple images. The server 10 creates a 3D model of the object by using photogrammetry of such multiple images. Specifically, the server 10 analyzes and integrates the parallax information of the images of the object taken from multiple angles to create a 3D model of the object. In addition, the server 10 calculates the color and texture of the surface of the 3D model by analyzing the image. For distant objects whose appearance changes little as the vehicle 30 moves on the route, the background data can be created as a 2D image instead of a 3D model.

[0020] <Effects of Implementation Methods>

[0021] The function and effect of this embodiment will be described.

[0022] The server 10 generates background data based on the captured data of the drive recorder 31 provided by the user of the vehicle 30. Then, the server 10 creates route data including the generated background data and transmits it to the user of the vehicle 30. Thus, the user can travel on the route captured by the drive recorder 31 in the driving simulator.

[0023] According to the generation device of the present embodiment described above, the following effects can be achieved.

[0024] (1) A route that the user has actually traveled can be easily added to the route that can be traveled on the driving simulator.

[0025] (2) When the route data of the driving simulator is created using only existing road map information and terrain information, the appearance of objects around the route cannot be reproduced. In contrast, the server 10 of the present embodiment generates background data of the route that can be driven on the driving simulator based on the shooting data of the driving recorder 31. That is, the server 10 generates background data based on the image captured by the actual vehicle 30. Therefore, the background of the route that can be driven on the driving simulator can be made close to reality.

[0026] <Other Implementation Methods>

[0027] This embodiment can be implemented by being modified as follows. This embodiment and the following modified examples can be implemented in combination with each other within the range that there is no technical contradiction.

[0028] The server 10 may also be configured to generate background data separately based on any one of the time period, season, and weather when the captured data was captured. The appearance of objects around the route changes depending on the time period, season, and weather. Therefore, if background data is generated separately based on them, changes in the appearance of objects caused by the time period, season, and weather can be reproduced on the driving simulator. For example, background data based on daytime captured data and background data based on nighttime captured data are generated separately. In this case, the route data created by the server 10 includes background data for daytime and nighttime. In such a case, in the driving simulator, by specifying the time period of travel and switching the background data used according to the specified time period, a background depiction suitable for the time period can be performed.

[0029] The server 10 may be configured to change the display content of the billboard when generating the background data when the image of the billboard is included in the captured data. The use of store signs in the driving simulator sometimes requires the permission of the owner. In such a case, if the display content of the billboard in the background data is different from the actual content, no permission is required. In addition, by making the display content of the billboard in the background data the content specified by the driving simulator or the provider of the route data, advertising can be performed.

[0030] The server 10 may be configured to set the vehicle included in the image of the captured data as another vehicle that appears in the driving simulator. In this case, the server 10 determines the vehicle model, body color, etc. by image analysis of the captured data, and sends this information together with the route data to the user terminal 20. The user terminal 20 causes the vehicle for which the server 10 provides information to appear as another vehicle encountered during driving in the driving simulator. In this case, the vehicle encountered during driving in the real world appears in the driving simulator, so the experience in the driving simulator is close to reality.

[0031] The generation of background data and the creation of route data may be performed by the user terminal 20. In addition, the generation of background data and the creation of route data may be performed by a user terminal 20 different from a terminal that executes the driving simulator.

Claims

1. A generating device, wherein: The generating device is configured to generate background data used in a driving simulator that simulates the driving of a vehicle on a road in the real world based on the imaged data of the drive recorder.

2. The generating device according to claim 1, wherein: The generating device is configured to generate the background data based on the photographing data provided by a user of a vehicle provided with the drive recorder, The generating device is configured to send the generated background data to the user.

3. The generating device according to claim 1, wherein: The generating device is configured to generate the background data individually according to any one of a time period, a season, and weather when the image data is captured.

4. The generating device according to claim 1, wherein: The generating device is configured to change display content of the billboard when generating the background data, when the image of the billboard is included in the photographic data.

5. The generating device according to claim 1, wherein: The generating device is configured to set a vehicle included in the image of the captured data as another vehicle appearing in the driving simulator.

Images