Information processing device, information processing method, and information processing program

Abstract

This invention provides an information processing device, an information processing method, and an information processing program that can measure traffic conditions from a bird's-eye view and as reproducible data. [Solution] The information processing device acquires driving information of a subject's simulated vehicle as subject driving information, projects the subject driving information along with the traffic conditions in the virtual space, and further generates a virtual space by projecting object information about objects that behave in the virtual space based on the behavior information of other subjects participating in the virtual space in real time, and object information about objects that learn the behavior patterns of other subjects based on the behavior information of other subjects who have participated in the virtual space in the past and behave autonomously in the virtual space, and then simulates the traffic conditions between the simulated vehicle and the objects in the virtual space using the subject driving information and object information.

Description

Technical Field

[0001] The present invention relates to an information processing apparatus, an information processing method, and an information processing program, and more particularly to an information processing apparatus, an information processing method, and an information processing program for simulating vehicle driving.

Background Art

[0002] In recent years, urban development and traffic rule-making in line with a moving space where various moving entities coexist have been demanded, and thus, the development of traffic simulation technology for urban development and traffic rule-making has been desired.

[0003] Traffic simulation technology, for example, reproduces the operation of vehicles on a computer and allows subjects to experience various traffic situations in a simulated manner. For example, the walking environment simulator disclosed in Patent Document 1 is said to be able to simulate crossing a roadway for a pedestrian as a subject.

[0004] Such traffic simulation technology is desired to be measurable as reproducible data from an overhead perspective of the traffic situation. However, the walking environment simulator disclosed in Patent Document 1 does not consider these points and cannot be said to fully meet social needs.

Prior Art Documents

Patent Documents

[0005]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0006] Therefore, an object of the present invention is to provide an information processing apparatus, an information processing method, and an information processing program that can be measured as reproducible data from an overhead perspective of the traffic situation.

Means for Solving the Problems

[0007] In other words, the information processing device according to the first embodiment is characterized by comprising: a driving information acquisition unit that acquires driving information relating to the driving of a simulated vehicle by a subject as subject driving information; a virtual space generation unit that projects the subject driving information together with traffic conditions in a virtual space, and further generates a virtual space on which object information relating to objects that act in the virtual space based on the behavior information of other subjects who are participating in the virtual space in real time using other information processing devices, and object information relating to objects that learn the behavior patterns of other subjects based on the behavior information of other subjects who have participated in the virtual space in the past and act autonomously in the virtual space; and a calculation unit that simulates the traffic conditions between the simulated vehicle and the objects in the virtual space using the subject driving information and the object information.

[0008] A second embodiment may further include a learning unit in the information processing device according to the first embodiment, which acquires data on traffic conditions simulated by the arithmetic unit as learning data and learns new objects in the virtual space.

[0009] A third aspect is that, in the information processing device according to the first aspect, the traffic conditions may include passing through a pedestrian crossing without a traffic signal.

[0010] A fourth aspect may be that, in the information processing device according to the first aspect, other subjects participate in the virtual space as driver objects using a simulated vehicle that allows them to experience driving a vehicle.

[0011] A fifth aspect may be that, in the information processing device according to the first aspect, other subjects participate in the virtual space as cyclist objects using a simulated bicycle that allows them to experience riding a bicycle.

[0012] The sixth embodiment is an information processing device according to the first embodiment in which other subjects participate in the virtual space as pedestrian objects using a simulated walking device that allows them to experience walking in a simulated manner.

[0013] A seventh embodiment is an information processing device according to the sixth embodiment, in which another subject may use a simulated walking device that determines the direction of movement in the virtual space by waving controllers held in both hands.

[0014] The eighth aspect is an information processing device according to the seventh aspect, in which the simulated walking device may display a hand-raising crossing of a pedestrian object in the virtual space by raising the hand holding the controller.

[0015] The ninth aspect may further include an extraction unit in the information processing device according to the first aspect that extracts the degree of risk of driving a simulated vehicle by a subject based on simulated traffic conditions.

[0016] The information processing method according to the tenth embodiment is characterized by causing a computer to perform the following steps: a driving information acquisition step of acquiring driving information relating to the driving of a simulated vehicle by a subject as subject driving information; a virtual space generation step of projecting the subject driving information together with traffic conditions in a virtual space, and further projecting object information relating to objects that act in the virtual space based on the behavior information of other subjects participating in the virtual space in real time using another information processing device, and object information relating to objects that learn the behavior patterns of other subjects based on the behavior information of other subjects who have previously participated in the virtual space and act autonomously in the virtual space; and a calculation step of simulating the traffic conditions between the simulated vehicle and the objects in the virtual space using the subject driving information and the object information.

[0017] The information processing program according to the 11th embodiment is characterized by providing a computer with: a driving information acquisition function that acquires driving information relating to the driving of a simulated vehicle by a subject as subject driving information; a virtual space generation function that projects the subject driving information along with traffic conditions in a virtual space, and further generates a virtual space on which object information relating to objects that act in the virtual space based on the behavior information of other subjects participating in the virtual space in real time using other information processing devices, and object information relating to objects that learn the behavior patterns of other subjects based on the behavior information of other subjects who have previously participated in the virtual space and act autonomously in the virtual space; and a calculation function that simulates traffic conditions between the simulated vehicle and objects in the virtual space using the subject driving information and object information. [Effects of the Invention]

[0018] The information processing device according to the present invention is characterized by comprising: a driving information acquisition unit that acquires driving information relating to the driving of a simulated vehicle by a subject as subject driving information; a virtual space generation unit that projects the subject driving information together with the traffic conditions in a virtual space, and further generates a virtual space on which object information relating to objects that act in the virtual space based on the behavior information of other subjects who are participating in the virtual space in real time using another information processing device, and object information relating to objects that learn the behavior patterns of other subjects based on the behavior information of other subjects who have participated in the virtual space in the past and act autonomously in the virtual space is projected; and a calculation unit that simulates the traffic conditions between the simulated vehicle and objects in the virtual space using the subject driving information and object information. As such, the traffic conditions can be measured as reproducible data from an overview perspective.

[0019] Furthermore, the information processing method and information processing program according to the present invention, like the information processing apparatus according to the present invention described above, can measure traffic conditions as reproducible data from an overview perspective. [Brief explanation of the drawing]

[0020] [Figure 1]FIG. 1 is a diagram for explaining the outline of the information processing apparatus according to the present embodiment. [Figure 2] FIG. 2 is a table showing measurable data of the information processing apparatus according to the present embodiment. [Figure 3] FIG. 3 is a block diagram for explaining the hardware configuration of the information processing apparatus according to the present embodiment. [Figure 4] FIG. 4 is a block diagram for explaining the functional configuration of the information processing apparatus according to the present embodiment. [Figure 5] FIG. 5 is a diagram for explaining the simulated walking apparatus according to the present embodiment. [Figure 6] FIG. 6 is a diagram for explaining the simulated walking apparatus according to the present embodiment. [Figure 7] FIG. 7 is a diagram for explaining the first embodiment of the information processing apparatus according to the present embodiment. [Figure 8] FIG. 8 is a diagram for explaining the second embodiment of the information processing apparatus according to the present embodiment. [Figure 9] FIG. 9 is a diagram for explaining the third embodiment of the information processing apparatus according to the present embodiment. [Figure 10] FIG. 10 is an example of a flowchart of the information processing program according to the present embodiment. [Figure 11] FIG. 11 is an example of a flowchart of the information processing program according to another embodiment.

MODE FOR CARRYING OUT THE INVENTION

[0021] An example of the information processing apparatus 10 according to an embodiment of the present disclosure will be described with reference to FIGS. 1 to 9. The information processing apparatus 10 is a so-called computer and is called a server, a personal computer (hereinafter referred to as a PC), a notebook PC, a tablet PC, a smartphone, or the like.

[0022] (Regarding the outline of the information processing apparatus 10) First, the outline of the information processing apparatus 10 will be described with reference to FIG. 1. The information processing device 10 may be configured as a traffic simulator in a virtual space, or as a driving simulator for a vehicle driving on a road in a virtual space. In detail, the information processing device 10 can create a situation in virtual space 5 where cars 1, bicycles 2, pedestrians 3, and new mobility devices 4 are mixed together, and measure human behavior through experiences in virtual space 5. The information processing device 10 can provide a measurement environment in which multiple people using different modes of transportation (avatars 6) can mutually recognize each other under the interaction 8 in virtual space 5. In other words, the information processing device 10 can construct an environment in which it is possible to measure the reactions of people using different modes of transportation by having multiple people participate in virtual space 5 using simulators (simulation devices) of different modes of transportation and have a reproducible simulated experience. Specifically, the information processing device 10 can link the timing of a person's judgment with the positional relationship of surrounding traffic participants, measure what their gaze is looking at, and link questionnaires given to participants as avatars 6 with their behavioral data to enable acceptance and psychological analysis. It can also evaluate (risk and perception) the autonomous vehicle and other traffic participants, and furthermore, allow them to experience traffic safety from each perspective and evaluate variability and acceptance. Avatar 6 is an object that embodies other subjects participating in the virtual space in real time using other information processing devices, and acts within the virtual space under the control of the other subjects. Model 7 is an object that learns the behavioral patterns of other subjects based on the behavioral information of other subjects who have previously participated in the virtual space, and then acts autonomously in the virtual space. Alternatively, Model 7 may be an object that learns its own behavioral patterns based on its own behavioral information from previously participating in the virtual space, and then acts autonomously in the virtual space.

[0023] The various simulators shown in Figure 1 refer to the driving simulator 1a, the bicycle simulator 2a, the walking simulator 3a, and the new mobility simulator 4a. Driving simulator 1a is a device that simulates the behavior of vehicle 1 and the driver's reactions under various road conditions and driving conditions. It can simulate actual driving, allow users to learn driving skills safely, test the performance and behavior of vehicle 1, and provide a simulated experience to other road users. Simulation means to carry out something in a simulated manner, and in this embodiment, it includes the meaning of computer simulation, which means to simulate or test a target phenomenon on a computer, and to analyze and measure the phenomenon that occurs in a virtual space constructed on the computer. Specifically, the simulation involves performing calculations or measurements under constantly changing environmental conditions, and accumulating the calculated or measured results each time.

[0024] The bicycle simulator 2a is a device that simulates the behavior of bicycle 2 and the driver's reactions under various road conditions and driving conditions. It can simulate actual driving, allow users to learn driving skills safely, test the performance and behavior of bicycle 2, and provide a simulated experience to other road users. The walking simulator 3a is a device that simulates the behavior and reactions of a pedestrian 3 under various road conditions and walking conditions. It can simulate walking, allow users to safely learn walking techniques, test the performance and behavior of shoes and other footwear, and provide a simulated experience to other road users. New Mobility 4 refers to new modes of transportation, such as electric scooters and manned drones, which have recently emerged. New Mobility Simulator 4a is a device that simulates the behavior and reactions of these new modes of transportation under various road conditions and driving conditions. The subject of the information processing device 10 can experience driving these means of transportation in a virtual space, and this experience can be simulated (measured and stored in real time) from an overhead perspective.

[0025] (Measurable data of the information processing device 10) Referring to Figure 2, the data that the information processing device 10 can measure will be explained. Figure 2 is a table showing the measurable data of the information processing device 10 according to this embodiment. The information processing device 10 can measure the position (x, y, z), attitude angle (yaw, pitch, roll), speed (m / s), and turn signal (ON / OFF flag) of car 1 in the virtual space. Furthermore, the information processing device 10 can measure the position (head, body, hands), posture angle (head, body, hands), velocity (m / s), gaze direction (yaw, pitch, roll), recognized object ID (ID of the object the gaze is directed at), and decision flag (ON / OFF flag) of the pedestrian 3 in the virtual space. Furthermore, the information processing device 10 can measure the position (x, y, z), posture angle (yaw, pitch, roll), lean angle (sensor value [rad]), steering angle (sensor value [rad]), brake operation amount (sensor value), speed (sensor value [rad]), and pedal force (sensor value) of the bicycle 2 in the virtual space.

[0026] (Hardware configuration of the information processing device 10) Next, with reference to Figure 3, an example of the hardware configuration of the information processing device 10 according to this embodiment will be described. Figure 3 is a block diagram illustrating the hardware configuration of the information processing device 10 according to this embodiment. The information processing device 10 includes a communication unit 10a, a ROM 10b, a RAM 10c, a storage unit 10d, a processing unit 10e, and an input / output interface 10f, among other things. Furthermore, the information processing device 10 includes an input device 10g and an output device 10h, which perform data input and output via an input / output interface 10f as external devices.

[0027] The communication unit 10a is equipped with a function for bidirectional communication with other information processing devices. When the communication unit 10a performs bidirectional communication with other information processing devices, it may do so via the information communication network 15, or it may connect directly to the other information processing devices to perform bidirectional communication. The communication unit 10a may use wired communication or wireless communication for communication with other information processing devices.

[0028] ROM10b can be used as a recording device and stores the BIOS (Basic Input Output System), which is necessary for controlling the operation of each functional part of the information processing device 10, as well as various data used by the BIOS. The BIOS is a program that manages the basic input / output functions of the information processing unit 10. It is the first program to run when the information processing unit 10 is powered on, and it controls hardware such as the communication unit 10a, ROM 10b, RAM 10c, storage unit 10d, processing unit 10e, and input / output interface 10f, preparing the OS (Operating System) to start up.

[0029] RAM10c is used to configure the main memory accessed by the processing unit 10e, and is also used to temporarily store various data acquired or generated by the information processing device 10 before storing them in the storage unit 10d.

[0030] The storage unit 10d is implemented using an HDD (Hard Disk Drive), SSD (Solid State Drive), online storage, etc., and stores the OS, the information processing programs described later, other application software, and various data used by these programs. The storage unit 10d also stores various data acquired or generated by the information processing device 10.

[0031] The processing unit 10e includes a CPU (Central Processing Unit), an MPU (Micro Processing Unit), a GPU (Graphics Processing Unit), etc., and is realized by logic circuits and dedicated circuits formed by integrated circuits (IC (Integrated circuit) chips, LSI (Large-Scale Integration)), etc. The input / output interface 10f is an interface for sending and receiving data to and from external devices such as the input device 10g and the output device 10h. The input device 10g includes a keyboard, mouse, etc., and accepts user input for operations on the information processing device 10. The output device 10h includes a monitor, printer, etc., and displays data generated by the information processing device 10 to the user.

[0032] (Functional configuration of the information processing device 10) Next, with reference to Figure 4, an example of the functional configuration of the information processing device 10 will be described. Figure 4 is a block diagram illustrating an example of the functional configuration of the information processing device 10. The information processing device 10 loads the information processing program, described later, stored in the memory unit 10d, into the main memory, which is composed of RAM 10c or the like. The processing unit 10e accesses the main memory into which the information processing program has been loaded and executes the information processing program. The information processing device 10 executes an information processing program, and the processing unit 10e is equipped with functional units such as an operation information acquisition unit 20, a virtual space generation unit 21, a calculation unit 22, an extraction unit 23, and a learning unit 24.

[0033] The driving information acquisition unit 20 acquires driving information related to the subject's driving of the simulated vehicle as subject driving information. A subject is defined as a person who participates in a virtual space using the information processing device 10 to experience simulated driving of a vehicle. A simulated vehicle is a device that simulates how an automobile behaves while driving under various road and driving conditions, or how a driver reacts while driving. The basic configuration of a simulated vehicle consists of a field of view simulation device, an acoustic simulation device, a steering feel simulation device, a kinesthetic feel simulation device, and a control unit. However, not all of these are essential components, and the essential components vary depending on the purpose of use of the simulated vehicle. The field of view simulation device displays the scenery outside the vehicle (road, background, obstacles, preceding vehicles, oncoming vehicles, etc.) as seen by the driver through the window. In this embodiment, it is configured with several liquid crystal displays as a set. The field of view image is updated approximately every 50 to 100 ms based on vehicle motion information. The sound simulation device uses data from actual vehicles, such as engine noise, tire noise, and wind noise, to simulate the noise levels of a real vehicle according to the driving conditions, giving the driver a sense of speed. The steering feel simulation device simulates steering wheel resistance, instrument displays, and movements. It uses a motor to provide steering feel and simulates speed through the movement of the meters. It also reproduces the force and resistance of the accelerator and brake pedals to closely resemble those of a real vehicle. A kinesthetic simulation device is a device that simulates inertial forces and vibrations from vehicle motion. By moving the driver's seat where the driver sits and the field of view simulation device, the acceleration of the vehicle is simulated through these movements. The control unit calculates the vehicle's motion based on the driver's input (amount of accelerator and brake pedal depression, steering input, gear selection, etc.). The driving information acquisition unit 20 acquires driving information related to the subject's driving of the simulated vehicle, such as the amount the accelerator pedal and brake pedal are pressed, steering operations, and gear selection, as subject driving information.

[0034] The virtual space generation unit 21 projects subject driving information along with traffic conditions in the virtual space, and further generates a virtual space by projecting object information about objects that behave in the virtual space based on the behavior information of other subjects participating in the virtual space in real time using other information processing devices, and object information about objects that learn the behavior patterns of other subjects based on the behavior information of other subjects who have participated in the virtual space in the past and behave autonomously in the virtual space. Traffic conditions in the virtual space refer to the shape and congestion of surrounding roads, the shape of surrounding buildings, the status of other vehicles, and the status of other traffic participants such as pedestrians and cyclists. These traffic conditions in the virtual space may be stored in advance in the memory unit 10d, or they may reflect the real-time situation of a predetermined location. Traffic conditions may include crossing pedestrian crossings without traffic signals.

[0035] An object that acts in a virtual space based on the behavioral information of other subjects participating in the virtual space in real time using other information processing devices is an avatar that embodies the other subjects participating in the virtual space in real time within the virtual space. This avatar becomes one of the objects in the virtual space and acts within that space under the control of other test subjects.

[0036] An object that autonomously acts in a virtual space by learning the behavioral patterns of other subjects based on the behavioral information of other subjects who have participated in the virtual space in the past refers to a mathematical model that captures the behavioral patterns of other subjects as mathematical phenomena and expresses them using mathematical formulas, and a machine learning model that learns the regularities of the behavioral patterns of other subjects and makes predictions. Mathematical models and machine learning models become objects within a virtual space and act autonomously under specific conditions within that virtual space. Furthermore, mathematical models and machine learning models may be objects that learn their own behavioral patterns based on their past actions in the virtual space and act autonomously within that virtual space.

[0037] The virtual space generation unit 21 calculates position information, speed information, acceleration information, and attitude information of the simulated vehicle in the virtual space based on the subject's driving information acquired by the driving information acquisition unit 20, such as the amount of pressure applied to the accelerator and brake pedals, steering operations, and gear position, and projects (maps) this information onto the virtual space. Specifically, the virtual space generation unit 21 sequentially calculates position information of the simulated vehicle in the virtual space, which changes in real time based on the subject's driving information, stores the calculation results in the storage unit 10d, and projects (maps) them onto the virtual space.

[0038] Other subjects may participate in the virtual space as driver objects using a simulated vehicle that allows them to experience driving a vehicle. In other words, other subjects may participate in the virtual space using a driving simulator. Alternatively, other subjects may participate in the virtual space as cyclist objects using a simulated bicycle that allows them to experience riding a bicycle. In other words, other subjects may participate in the virtual space using a bicycle simulator. Alternatively, other subjects may participate in the virtual space as pedestrian objects using a simulated walking device that allows them to experience walking in a simulated manner. In other words, other subjects may participate in the virtual space using a walking simulator. Other subjects may participate in the virtual space as pedestrian objects by using a simulated walking device that determines the direction of movement in the virtual space by shaking controllers held in both hands. Note that a simulated walking device refers to a walking simulator. Furthermore, when the user raises the hand holding the controller, the accelerometer and other sensors implemented within the device detect the hand movement and amount of movement, and display a hand-raising crossing of a pedestrian object in the virtual space.

[0039] The simulated walking device will be described with reference to Figures 5 and 6. Figures 5 and 6 are diagrams illustrating the simulated walking device according to this embodiment. The simulated walking device includes a right controller 31, a left controller 32, and a head-mounted display (HMD) 33, all mounted on the pedestrian 30. The HMD33 displays images of the virtual space to the pedestrian 30. The right controller 31 and left controller 32 are operated by holding them in the left and right hands, respectively, as shown in Figure 5. The pedestrian 30 walks by swinging both arms, which are holding the right controller 31 and left controller 32, back and forth, and can determine the direction of movement in the virtual space by changing the magnitude of the arm swing on the left and right sides. The magnitude of the arm swing (stroke amount) is converted into a movement amount, and the positions of the right controller 31 and left controller 32 are averaged to determine the direction of travel. When stopping, both arms holding the right controller 31 and left controller 32 are lowered. The walking simulator may also include a simulated walking device and a treadmill 3b (see Figure 1). The simulated walking device can also be used together with the treadmill 3b to provide a simulated walking experience to the walker 30. A treadmill is a device used for running and walking indoors, and is also called a room runner, running machine, jogging machine, or walking machine. Furthermore, the treadmill 3b may be an omnidirectional treadmill that allows walking freely in any direction, forward, backward, left, or right.

[0040] As shown in Figure 6, the pedestrian 30 can display a posture in the virtual space where one arm of the pedestrian 30's object (avatar) is raised by raising either the right controller 31 or the left controller 32 to a position higher than the height of the HMD 33.

[0041] The calculation unit 22 simulates the traffic situation between the simulated vehicle and objects in the virtual space using the subject's driving information and object information. The calculation unit 22 calculates the relative relationships between the simulated vehicle and other objects such as traffic participants in the virtual space, specifically the relative position and orientation relationships, relative velocity relationships, and relative acceleration relationships. Furthermore, it continuously calculates the positional relationships on the map within the virtual space and stores the calculation results in the storage unit 10d.

[0042] The extraction unit 23 extracts the degree of risk of the subject driving the simulated vehicle based on the simulated traffic conditions. The degree of risk is expressed using factors related to the occurrence of situations where one traffic entity, such as a car, bicycle, or pedestrian, passes by and another traffic entity approaches the same location immediately afterward, as well as dangerous movements such as sudden braking or abrupt steering maneuvers (distance to collision, time, etc.). It can also be called a conflict index. Conflict indices include, for example, the TTC index and the PET index.

[0043] The TTC index represents the time to collision. The TTC index is the time it takes for two vehicles traveling on a road to collide if they maintain their angle and speed without taking evasive action (slowing down, correcting direction) at the start of measurement. The index value is expressed in seconds. As the TTC index decreases, the risk of collision increases, and a value of zero indicates a collision. The PET index is a measure that expresses the time to reach a point after an action has occurred as an index value. The PET index is defined as the time it takes for vehicle 2 (the rear vehicle) to reach a point where vehicle 1 (the front vehicle) is considered a potential collision location at the start of measurement. It is a conflict index that uses time as a component of the index value. As the PET index value decreases, the risk of collision increases.

[0044] The learning unit 24 acquires data on traffic conditions simulated by the calculation unit 22 as training data and performs training on new objects in the virtual space. In other words, the learning unit 24 uses the traffic situation data simulated by the calculation unit 22 as training data to generate a new object that extracts the behavioral patterns of the subject driving the simulated vehicle.

[0045] (First embodiment of the information processing device 10) A first embodiment of the information processing device 10 will be described with reference to Figure 7. Figure 7 is a diagram illustrating the first embodiment of the information processing device 10 according to this embodiment. Figure 7 shows a configuration in which the driving simulator (DS) 40 and the pedestrian VR 45 used in the walking simulator are directly connected via a local communication network. The information processing device 10 according to the first embodiment is built into the driving simulator 40 as a PC (DS_PC) 41 for the driving simulator. The DS_PC41 incorporates two graphics boards 41a and 41b. The DS_PC41 is connected to an external device, a monitor 42 (42a, 42b, 42c, 42d, 42e), via the two graphics boards 41a and 41b. The monitor 42 corresponds to the field of view simulation device described above. Furthermore, the DS_PC41 is connected to the DS control system controller 43 as an external device via USB. The DS control system controller 43 receives input for the driving operations of the simulated vehicle (accelerator and brake pedal depression, steering operation, gear selection, etc.).

[0046] DS_PC41 is connected to the pedestrian VR45 used in the walking simulator via a WiFi router 44. The pedestrian VR45 provides the wearer of the walking simulator with images of the virtual space. The pedestrian VR45 includes a VR_PC46, an operation monitor 47, and a VR HMD48. The VR_PC46 incorporates a graphics board 46a and controls the operation monitor 47 and the VRHMD48. The pedestrian VR45 wirelessly provides the VRHMD48, which has the same functionality as the HMD33 described above, with images of the virtual space to the wearer, the pedestrian.

[0047] (Second embodiment of the information processing device 10) A second embodiment of the information processing device 10 will be described with reference to Figure 8. Figure 8 is a diagram illustrating the second embodiment of the information processing device 10 according to this embodiment. Figure 8 shows a configuration in which simulators (Unity, etc.) 50, simulator (VISSIM, etc.) 60, and simulator (Unity, etc.) 70, which are installed at multiple locations, are simultaneously connected via a high-speed network. The information processing device 10 shown in Figure 8 constitutes the core of three simulators (50, 60, and 70) connected by local communication (Protobuf@UDP:80a, 80b, and 80c). The simulator (Unity® etc.) 50 is a simulator centered around the Unity etc. simulation 51, which is an information processing device 10, and includes the functions of data management 52, display 53, other vehicle controller 54, operation device 55, and UDPManager 56. Unity® is a game development platform, and simulators such as (Unity) 50 are simulators built on Unity or similar platforms. However, the game development platform is not limited to Unity; for example, Unreal Engine, Godot®, etc., may be used instead of Unity.

[0048] The simulator (VISSIM, etc.) 60 is a traffic simulator centered around the traffic simulator 61, which is an information processing device 10, and includes the functions of data management 62, traffic simulator 63, and UDPManager 64. VISSIM is multimodal traffic flow simulation software. However, traffic flow simulation software is not limited to VISSIM; SUMO® or other alternatives may be used instead. The simulator (Unity®) etc. 70 is also a simulator configured around the information processing device 10 and is equipped with the functions of UDPManager 71.

[0049] (Third embodiment of the information processing device 10) A third embodiment of the information processing device 10 will be described with reference to Figure 9. Figure 9 is a diagram illustrating the third embodiment of the information processing device 10 according to this embodiment. Figure 9 shows an example in which the information processing device 10 is implemented on the server of a client-server system. The information processing device 10 according to the third embodiment is implemented as the server 81 of a client-server system. The bicycle simulator 82, driving simulator 83, driving simulator 84, walking simulator 85, and other traffic agents 86 are implemented as clients of the client-server system.

[0050] (Regarding information processing methods and information processing programs) Next, with reference to Figure 10, an information processing program according to one embodiment of the present invention will be described along with an information processing method. Figure 10 is an example of a flowchart of the information processing program according to this embodiment. The information processing method is executed by the processing unit 10e of the information processing device 10 based on the information processing program. The information processing program includes an operation information acquisition step S20, a virtual space generation step S21, and a calculation step S22, among others. The information processing program enables the processing unit 10e of the information processing device 10 to perform functions such as acquiring driving information, generating a virtual space, and calculation. These functions are executed in the order shown in the flowchart of Figure 10, but the order can be changed as appropriate. Since each function overlaps with the descriptions of the various functional units of the information processing device 10 mentioned above, detailed explanations are omitted.

[0051] The driving information acquisition function acquires driving information related to the subject's driving of a simulated vehicle as subject driving information (S20: Driving information acquisition step).

[0052] The virtual space generation function projects subject driving information along with traffic conditions in the virtual space, and further generates the virtual space by projecting object information relating to objects that behave in the virtual space based on the behavior information of other subjects participating in the virtual space in real time using other information processing devices, and object information relating to objects that learn the behavior patterns of other subjects based on the behavior information of other subjects who have participated in the virtual space in the past and behave autonomously in the virtual space (S21: virtual space generation step).

[0053] The calculation function simulates the traffic situation between the simulated vehicle and objects in the virtual space using subject driving information and object information (S22: calculation step).

[0054] (Regarding other embodiments of information processing methods and information processing programs) Next, with reference to Figure 11, an information processing program according to another embodiment of the present invention will be described along with an information processing method according to that other embodiment. Figure 11 is an example of a flowchart of an information processing program according to another embodiment. The flowchart of the information processing program according to another embodiment shown in Figure 11 differs from the flowchart of the information processing program shown in Figure 10 in that it includes the addition of extraction step S23 and learning step S24. Information processing methods according to other embodiments are executed by the processing unit 10e of the information processing device 10 based on the information processing program according to another embodiment shown in Figure 11. The information processing program according to another embodiment shown in Figure 11 includes an operation information acquisition step S20, a virtual space generation step S21, a calculation step S22, an extraction step S23, and a learning step S24, among others.

[0055] The information processing program according to another embodiment shown in Figure 11 enables the processing unit 10e of the information processing device 10 to implement functions such as driving information acquisition, virtual space generation, calculation, extraction, and learning. These functions are executed in the order shown in the flowchart of Figure 11, but the order can be changed as appropriate. Below, we will describe only the differences between the information processing method and information processing program shown in Figure 11 and the information processing method and information processing program shown in Figure 10, based on the other embodiments of the information processing method and information processing program shown in Figure 11. Furthermore, since each function overlaps with the descriptions of the various functional units of the information processing device 10 mentioned above, detailed explanations will be omitted.

[0056] The extraction function extracts the degree of risk of the subject driving the simulated vehicle based on simulated traffic conditions (S23: Extraction step).

[0057] The learning function acquires data on traffic conditions simulated by the computation function as training data and learns new objects in the virtual space (S24: Learning function).

[0058] Furthermore, the present invention is not limited to the information processing apparatus 10, information processing method, and information processing program according to the above-described embodiment, and can be implemented by various other modifications or applications without departing from the gist of the present invention as described in the claims. Also, although the word "data" is used in the above-described embodiment, the word "data" can be replaced with "information," and the word "information" can be replaced with "data." [Explanation of Symbols]

[0059] 1 car 1a Driving Simulator 2 Bicycles 2a Bicycle Simulator 3 Pedestrians 3a Walking simulator 3b Treadmill 4. New Mobility 4a New Mobility Simulator 5. Virtual Space 6 Avatars 7 models 8. Interactions 10 Information Processing Devices 10a Communications Department 10b ROM (Read Only Memory) 10c RAM (Random Access Memory) 10d storage section 10e Processing Unit 10f Input / Output Interface 10g input device 10h output device 15. Information and Communication Networks 20. Driving Information Acquisition Unit 21 Virtual Space Generation Unit 22 Arithmetic section 23 Extraction part 24 Learning Department 30 pedestrians 31 Right Controller 31a Right swing range 32 Left Controller 32a Left swing range 33. Head-mounted display (HMD) 34 Pedestrian crossing 40 Driving Simulators 41 PC for driving simulator 41a Graphics Card 41b Graphics Card 42 monitors 42a Monitor 42b Monitor 42c monitor 42d monitor 42e Monitor 43 DS control system controller 44 WIFI routers 45 Pedestrian VR 46 VR PC 46a Graphics Card 47 Operation monitor 48 HMD 50 Simulators

Claims

1. A driving information acquisition unit acquires driving information related to the subject's driving of a simulated vehicle as subject driving information, A virtual space generation unit projects the subject's driving information along with the traffic conditions in the virtual space, and further generates the virtual space by projecting object information relating to objects that act in the virtual space based on the behavior information of other subjects participating in the virtual space in real time using other information processing devices, and object information relating to objects that learn the behavior patterns of other subjects based on the behavior information of other subjects who have previously participated in the virtual space and act autonomously in the virtual space. A calculation unit that simulates the traffic situation between the simulated vehicle and the object using the subject driving information and the object information in the virtual space, An information processing device characterized by comprising:

2. The information processing apparatus according to claim 1, further comprising a learning unit that acquires data relating to the traffic conditions simulated by the calculation unit as learning data and learns new objects in the virtual space.

3. The information processing device according to claim 1, characterized in that the aforementioned traffic conditions include passing through a pedestrian crossing without traffic signals.

4. The information processing device according to claim 1, characterized in that the other subjects participate in the virtual space as driver objects using a simulated vehicle that allows them to experience driving a vehicle.

5. The information processing device according to claim 1, characterized in that the other subjects participate in the virtual space as cyclist objects using a simulated bicycle that allows them to experience riding a bicycle.

6. The information processing device according to claim 1, characterized in that the other subjects participate in the virtual space as pedestrian objects using a simulated walking device that allows them to experience walking in a simulated manner.

7. The information processing device according to claim 6, characterized in that the other subject uses the simulated walking device to determine the direction of movement in the virtual space by shaking controllers held in both hands.

8. The information processing device according to claim 7, characterized in that the simulated walking device displays the hand-raising crossing of the pedestrian object in the virtual space by raising the hand holding the controller.

9. The information processing apparatus according to claim 1, further comprising an extraction unit that extracts the degree of risk of the subject driving a simulated vehicle based on the simulated traffic conditions.

10. On the computer, A driving information acquisition step is performed to acquire driving information related to the subject's driving of a simulated vehicle as subject driving information, A virtual space generation step involves projecting the subject's driving information along with the traffic conditions in the virtual space, and further projecting object information relating to objects that act in the virtual space based on the behavior information of other subjects participating in the virtual space in real time using another information processing device, and object information relating to objects that learn the behavior patterns of other subjects based on the behavior information of other subjects who have previously participated in the virtual space and act autonomously in the virtual space, thereby generating the virtual space. A calculation step of simulating the traffic situation between the simulated vehicle and the object using the subject driving information and the object information in the virtual space, An information processing method characterized by causing the following to be executed.

11. On the computer, A driving information acquisition function that acquires driving information related to the subject's driving of a simulated vehicle as subject driving information, A virtual space generation function that projects the subject's driving information along with the traffic conditions in the virtual space, and further projects object information relating to objects that act in the virtual space based on the behavior information of other subjects participating in the virtual space in real time using other information processing devices, and object information relating to objects that learn the behavior patterns of other subjects based on the behavior information of other subjects who have previously participated in the virtual space and act autonomously in the virtual space, thereby generating the virtual space. A calculation function that simulates the traffic situation between the simulated vehicle and the object using the subject driving information and the object information in the virtual space, An information processing program characterized by achieving this.

Images