Information Processing Apparatus, Information Processing System, and Information Processing Program

Abstract

To provide an information processing device that is configured to create a pace note in a vehicle race, whose contents can be easily used by a driver.SOLUTION: An information processing device comprises: an obtaining part that obtains vehicle information concerning a vehicle and including a steering angle of a steering wheel of the vehicle which is running on a running section on which the vehicle runs in a vehicle race; a separating part that separates the running section into a straight road and a curve road, in accordance with a change in the steering angle of the vehicle which is running on the running section obtained as the vehicle information by the obtaining part; and a generating part that generates characteristics information showing the characteristics of the curve road separated by the separating part, by expression according to steering angle information concerning the steering angle set by a driver of the vehicle.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present invention relates to an information processing device, an information processing system, and an information processing program. [Background technology]

[0002] Patent Document 1 describes a technology that allows a drivable area to be easily determined even for a vehicle used in an off-road environment. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2014-228941 Summary of the Invention [Problem to be solved by the invention]

[0004] In the technology described in Patent Document 1, the above-mentioned drivable area is detected by image analysis of images captured by a stereo camera. In this case, if the hues of the drivable area and other areas on the road surface are similar, a configuration that detects the drivable area by image analysis may not be able to correctly distinguish between the drivable area and other areas.

[0005] By the way, there is a "rally" as a vehicle competition held on public roads. In a rally, participants compete in a time attack on special stages (SS), which are sections used for competitions, and the winner is determined by the total time achieved on each special stage.

[0006] Because the special stage is a public road, there are dangerous spots, such as sections where the road surface conditions change and curves where it is difficult to see ahead. Therefore, in rallies, a "reconnaissance" is conducted before the actual competition, in which the special stage is run a set number of times within a set time. Unlike during the actual competition, during reconnaissance, the special stage may not be closed, in which case the drivers are only allowed to drive within the set speed limit. Furthermore, during reconnaissance, the distance of straight sections, the characteristics of curves, and dangerous points are confirmed, and a pace note containing this confirmed information is generated. Then, during the actual competition, the co-driver reads out the pace note generated in advance, and the driver relies on it to drive the special stage at full speed, exceeding the set speed limit.

[0007] For the reasons mentioned above, pace notes generated in a rally must be highly accurate in order to be effectively used in the actual competition. Therefore, if pace notes are generated using only information detected by image analysis, as in the technology described in Patent Document 1, there is a risk that the road surfaces of special stages may not be correctly distinguished, which is undesirable.

[0008] SUMMARY OF THE INVENTION It is therefore an object of the present invention to provide an information processing device, an information processing system, and an information processing program that generate pace notes in a vehicle competition that are easy for drivers to use. [Means for solving the problem]

[0009] The information processing device of the first aspect includes an acquisition unit that acquires vehicle information regarding the vehicle, including the steering angle of the steering wheel of the vehicle while traveling on a driving section in a vehicle competition; a separation unit that separates the driving section into a straight road and a curved road in accordance with changes in the steering angle of the vehicle while traveling on the driving section acquired as the vehicle information by the acquisition unit; and a generation unit that generates feature information that indicates the characteristics of the curved road separated by the separation unit in an expression that matches steering angle information regarding the steering angle set by the driver of the vehicle.

[0010] The information processing device of the second aspect is the first information processing device, wherein the acquisition unit acquires the wheel speed of the vehicle while traveling on the driving section as the vehicle information, and the generation unit uses the wheel speed while traveling on the driving section acquired by the acquisition unit as the vehicle information to generate the feature information indicating the distance of the straight road and the distance of the curved road separated by the separation unit.

[0011] The information processing device of the third aspect is the first or second information processing device, wherein the acquisition unit acquires the wheel speed and acceleration of the vehicle while traveling on the traveling section as the vehicle information, and the generation unit generates the characteristic information indicating the danger of the vehicle traveling on the traveling section using at least one of the wheel speed and the acceleration while traveling on the traveling section acquired by the acquisition unit as the vehicle information.

[0012] The information processing device of a fourth aspect is the third information processing device, wherein the feature information generated by the generation unit is information indicating at least one of a vertical and horizontal displacement occurring in the vehicle.

[0013] The information processing device of a fifth aspect is the third or fourth information processing device, wherein the feature information generated by the generating unit is information indicating a friction coefficient of a road surface in the travel section.

[0014] An information processing device of a sixth aspect is an information processing device of any one of the third to fifth aspects, wherein the acquisition unit acquires, as the vehicle information, voice uttered by an occupant of the vehicle while traveling along the traveling section, and the generation unit combines the voice with at least one of the wheel speed and the acceleration while traveling along the traveling section acquired by the acquisition unit as the vehicle information, to generate the characteristic information indicating the danger of the traveling section.

[0015] An information processing device of a seventh aspect is an information processing device of any of the third to sixth aspects, wherein the acquisition unit acquires an exterior image of the vehicle as the vehicle information, and includes an estimation unit that estimates the vehicle behavior of the vehicle using the exterior image acquired by the acquisition unit as the vehicle information, and the generation unit generates the characteristic information indicating the danger of the driving section using the vehicle behavior estimated by the estimation unit.

[0016] An information processing device of an eighth aspect is an information processing device of any of the first to seventh aspects, and includes a first display device that displays various information, and a first display control unit that arranges the feature information generated by the generation unit in chronological order and displays it on the first display device.

[0017] The information processing device of a ninth aspect is the information processing device of the eighth aspect, further comprising a correction unit that accepts correction of the characteristic information displayed on the first display device.

[0018] The information processing device of the 10th aspect is the information processing device of the 9th aspect, wherein the correction unit corrects the characteristic information by accepting a selection of one of a plurality of correction candidates displayed on the first display device, and the plurality of correction candidates include a first correction candidate that performs correction with predetermined correction content and a second correction candidate that performs correction with correction content set by the driver of the vehicle.

[0019] An information processing device of an eleventh aspect is an information processing device of any one of the first to tenth aspects, wherein the vehicle competition includes at least one of rally, circuit, short circuit, gymkhana, dirt trial, and driving education which is training for improving competitive skills.

[0020] An information processing system of a twelfth aspect includes an information processing device according to any one of the first to eleventh aspects, and a second display control unit that displays, on a second display device provided in the vehicle, changes in the steering angle of the vehicle while traveling along the traveling section in a manner that matches the steering angle information.

[0021] The information processing program of the thirteenth aspect causes a computer to execute a process of acquiring vehicle information about a vehicle, including the steering angle of the steering wheel of the vehicle while the vehicle is traveling on a driving section in a vehicle competition, separating the driving section into a straight road and a curved road according to changes in the steering angle of the vehicle while traveling on the driving section acquired as the vehicle information, and generating characteristic information that indicates the characteristics of the separated curved road in an expression that matches the steering angle information about the steering angle set by the driver of the vehicle. [Effects of the Invention]

[0022] According to the first aspect, it is possible to provide an information processing device that generates pace notes for a vehicle competition in a manner that is easy for the driver to use. Specifically, according to the first aspect, it is possible to generate pace notes that indicate the characteristics of the curved roads in the driving section of the vehicle competition in an expression that matches the steering angle information set by the driver.

[0023] According to the second aspect, it is possible to generate pace notes that indicate the distance of the straight road and the distance of the curved road in the driving section in the vehicle competition.

[0024] According to the third aspect, it is possible to generate pace notes indicating the dangers of vehicle travel in a travel section in a vehicle competition.

[0025] According to the fourth aspect, it is possible to generate pace notes that indicate at least one of vertical and horizontal displacements that occur in a vehicle while the vehicle is traveling through a travel section in a vehicle competition.

[0026] According to the fifth aspect, it is possible to generate pace notes that include information indicating the friction coefficient of the road surface of the driving section in the vehicle competition.

[0027] According to the sixth aspect, it is possible to generate pace notes indicating the dangers of vehicle travel in a travel section in a vehicle competition.

[0028] According to the seventh aspect, it is possible to generate pace notes indicating the dangers of vehicle travel in a travel section in a vehicle competition.

[0029] According to the eighth aspect, a pace note can be generated in which characteristic information of the driving sections traveled in a vehicle competition is arranged in chronological order.

[0030] According to the ninth aspect, the content of the generated pace note can be corrected.

[0031] According to the tenth aspect, the content of the generated pace note can be corrected with a plurality of correction contents.

[0032] According to the eleventh aspect, an information processing device can be provided that generates pace notes for vehicle competitions including at least one of rallies, circuits, short circuits, gymkhanas, dirt trials, and driving education in a format that is easy for drivers to use.

[0033] According to the twelfth aspect, it is possible to provide an information processing system that generates pace notes for a vehicle competition in a manner that is easy for the driver to use. Also, according to the twelfth aspect, it is possible to make the driver aware of the discrepancy between the steering angle information set by the driver and the steering angle of the steering wheel while traveling in a travel section.

[0034] According to the thirteenth aspect, it is possible to provide an information processing program that generates pace notes in a vehicle competition with content that is easy for drivers to use. [Brief explanation of the drawings]

[0035] [Figure 1] FIG. 1 is a diagram illustrating a schematic configuration of an information processing system. [Figure 2] FIG. 2 is a block diagram showing a hardware configuration of the information processing device. [Figure 3] FIG. 2 is a block diagram illustrating an example of a functional configuration of an information processing device. [Figure 4]FIG. 2 is a block diagram showing the hardware configuration of a vehicle. [Figure 5] 10 is a flowchart showing the flow of a pace note generation process by an information processing device. [Figure 6] FIG. 4 is an explanatory diagram of steering wheel steering angle information set by a driver. [Figure 7] FIG. 4 is a waveform diagram showing an example of the steering angle and the wheel speed of the drive wheels during reconnaissance. [Figure 8] 10 is a flowchart showing the flow of a pace note generation process by an information processing device. [Figure 9] FIG. 10 is a waveform diagram showing an example of the wheel speed and acceleration of the drive wheels during reconnaissance. [Figure 10] 10 is a first display example of a pace note displayed on a display unit of an information processing device. [Figure 11] 10 is a second display example of a pace note displayed on the display unit of an information processing device. DETAILED DESCRIPTION OF THE INVENTION

[0036] The information processing system 10 according to this embodiment will be described below. FIG. 1 is a diagram showing a schematic configuration of an information processing system 10. As shown in FIG.

[0037] 1, the information processing system 10 includes an information processing device 20 and a vehicle 40. The information processing device 20 and the vehicle 40 are connected via a network N and are capable of communicating with each other. In this embodiment, the network N is the Internet.

[0038] The information processing device 20 generates pace notes that indicate the characteristics of special stages, which are sections driven in rallies, which are vehicle competitions held on public roads. In this embodiment, the information processing device 20 generates characteristic information based on the characteristics of the special stages driven during a "reconnaissance" test run of the special stage a set number of times within a set time before the actual competition, and generates pace notes that include the generated characteristic information. During the reconnaissance test run of the special stage, the special stage may be open, unlike during the actual competition. In such cases, driving is permitted only within the set speed limit. Details of the characteristic information will be described later. As an example, the characteristic information input into the pace notes may include information indicating the length of straight sections, the characteristics of curves, and dangerous points. Then, during the actual competition, the co-driver reads out the pace notes generated in advance, and the driver relies on them to drive the special stage at full speed at speeds exceeding the set speed limit.

[0039] As an example, vehicle 40 is an automobile. Vehicle 40 may be any of a gasoline vehicle, a hybrid vehicle, and an electric vehicle, but in this embodiment, as an example, vehicle 40 is a gasoline vehicle. Vehicle 40 may also be either a competition vehicle used in the actual competition or a general vehicle other than a competition vehicle, but in this embodiment, as an example, vehicle 40 is a competition vehicle.

[0040] Next, a hardware configuration of the information processing device 20 will be described. Fig. 2 is a block diagram showing the hardware configuration of the information processing device 20. As an example, the information processing device 20 may be a portable personal computer (notebook PC), a smartphone, or a mobile terminal such as a tablet terminal. In this embodiment, as an example, the information processing device 20 is a tablet terminal.

[0041] 2, the information processing device 20 includes a CPU 21 (Central Processing Unit), a ROM 22 (Read Only Memory), a RAM 23 (Random Access Memory), a storage unit 24, an input unit 25, a display unit 26, and a communication unit 27. Each component is connected to each other via a bus 28 so as to be able to communicate with each other.

[0042] The CPU 21 is a central processing unit that executes various programs and controls various components. That is, the CPU 21 reads programs from the ROM 22 or the storage unit 24 and executes the programs using the RAM 23 as a work area. The CPU 21 controls the above-mentioned components and performs various arithmetic processing in accordance with the programs recorded in the ROM 22 or the storage unit 24. In this embodiment, the ROM 22 or the storage unit 24 stores an information processing program for executing at least the pacenote generation processing described below.

[0043] The ROM 22 stores various programs and various data. The RAM 23 serves as a working area for temporarily storing programs or data.

[0044] The storage unit 24 is configured by a storage device such as a hard disk drive (HDD), a solid state drive (SSD), or a flash memory, and stores various programs and various data.

[0045] The input unit 25 includes various buttons, a microphone, a camera, etc., and is used to perform various inputs.

[0046] Display unit 26 is, for example, a liquid crystal display, and displays various information. Display unit 26 employs a touch panel system, and also functions as input unit 25. Display unit 26 is an example of a "first display device."

[0047] The communication unit 27 is an interface for communicating with other devices. For this communication, for example, a wired communication standard such as Ethernet (registered trademark) or FDDI, or a wireless communication standard such as 4G, 5G, or Wi-Fi (registered trademark) is used. When executing the information processing program, the information processing device 20 uses the hardware resources described above to execute processing based on the information processing program.

[0048] Next, the functional configuration of the information processing device 20 will be described. FIG. 3 is a block diagram showing an example of the functional configuration of the information processing device 20 according to this embodiment.

[0049] 3, the CPU 21 of the information processing device 20 has, as functional components, an acquisition unit 21A, a separation unit 21B, a generation unit 21C, an estimation unit 21D, a display control unit 21E, and a correction unit 21F. Each functional component is realized by the CPU 21 reading and executing an information processing program stored in the ROM 22 or the storage unit 24.

[0050] The acquisition unit 21A acquires vehicle information related to the vehicle 40 transmitted from the vehicle 40. The vehicle information includes, for example, steering angle information (described later) set by the driver of the vehicle 40, the steering angle of the steering wheel of the vehicle 40 during reconnaissance, the wheel speed of each wheel, acceleration about three axes (X-axis, Y-axis, and Z-axis), voices uttered by the driver and co-driver who are occupants of the vehicle 40, and an exterior image of the vehicle 40 captured by an imaging unit 45 (described later).

[0051] The separation unit 21B separates the special stage into a straight road and a curved road in accordance with the change in steering angle during the reconnaissance acquired by the acquisition unit 21A as vehicle information.

[0052] The generation unit 21C generates characteristic information to be input into the pace notes. Specifically, the generation unit 21C generates, as characteristic information, curve road information that expresses the characteristics of the curve road separated by the separation unit 21B in accordance with steering angle information related to the steering angle of the steering wheel set by the driver of the vehicle 40. Furthermore, the generation unit 21C generates, as characteristic information, straight distance information indicating the distance of the straight road separated by the separation unit 21B and curve distance information indicating the distance of the curve road, using the wheel speed during reconnaissance acquired as vehicle information by the acquisition unit 21A. Furthermore, the generation unit 21C generates, as characteristic information, caution information indicating the danger of vehicle 40 traveling on the special stage, using at least one of the wheel speed and acceleration during reconnaissance acquired as vehicle information by the acquisition unit 21A.

[0053] The estimation unit 21D estimates the vehicle behavior of the vehicle 40 using the vehicle exterior images during the reconnaissance acquired by the acquisition unit 21A as vehicle information.

[0054] The display control unit 21E causes the pace note, in which the feature information generated by the generation unit 21C is arranged in chronological order, to be displayed on the display unit 26. The display control unit 21E is an example of a "first display control unit." The correction unit 21F accepts corrections to the characteristic information displayed on the display unit .

[0055] Next, a description will be given of the hardware configuration of the vehicle 40. FIG.

[0056] 4, the vehicle 40 includes an ECU 15 (Electronic Control Unit), an imaging unit 45, a detection unit 46, an input unit 47, an in-vehicle display unit 48, and a communication unit 49. Each component is connected to each other via a bus 50 so as to be able to communicate with each other.

[0057] The ECU 15 includes a CPU 41 , a ROM 42 , a RAM 43 , and a storage unit 44 . The CPU 41 is a central processing unit that executes various programs and controls each part. That is, the CPU 41 reads programs from the ROM 42 or the storage unit 44 and executes the programs using the RAM 43 as a work area. The CPU 41 controls each of the above components and performs various arithmetic processing in accordance with the programs recorded in the ROM 42 or the storage unit 44. The CPU 41 is an example of a "second display control unit."

[0058] The ROM 42 stores various programs and various data. The RAM 43 serves as a working area for temporarily storing programs or data.

[0059] The storage unit 44 is configured by a storage device such as an HDD, an SSD, or a flash memory, and stores various programs and various data.

[0060] The imaging unit 45 includes, for example, a CCD (Charge Coupled Device) image sensor. The imaging unit 45 captures an image of the outside of the vehicle 40. The outside image captured by the imaging unit 45 of the outside of the vehicle 40 is stored in the storage unit 44 and transmitted to the information processing device 20 as vehicle information. The imaging unit 45 may also be configured as an imaging device for other purposes, such as a drive recorder.

[0061] The detection unit 46 is a variety of sensors for detecting various state quantities related to the vehicle 40. As an example, the detection unit 46 is configured to include a steering angle sensor that detects a steering angle, a wheel speed sensor that detects a wheel speed, an acceleration sensor that detects an acceleration acting on the vehicle 40, and a yaw rate sensor that detects a yaw rate. The detection unit 46 uses the various sensors described above to detect the steering angle, wheel speed, acceleration, yaw rate, and the like during reconnaissance. The various state quantities detected by the detection unit 46 are stored in the memory unit 44 and transmitted to the information processing device 20 as vehicle information. As an example, the acceleration sensor is a three-axis acceleration sensor that detects acceleration applied in the longitudinal direction of the vehicle 40 as the X-axis direction, the lateral direction of the vehicle 40 as the Y-axis direction, and the vertical direction of the vehicle 40 as the Z-axis direction.

[0062] The input unit 47 includes various buttons, a microphone, and the like, and is used to perform various inputs.

[0063] The interior display unit 48 is a display device that is arranged in a position visible to the driver in the cabin of the vehicle 40 and that displays various types of information. The interior display unit 48 includes, for example, a liquid crystal display that displays the current location of the vehicle 40 and a map of the area around the current location based on stored map data, and a HUD (Head-Up Display) that displays various types of information on a portion of the windshield of the vehicle 40. The interior display unit 48 is an example of a "second display device." The liquid crystal display of the interior display unit 48 employs a touch panel system and also functions as the input unit 47.

[0064] The communication unit 49 is an interface for communicating with other devices. For example, a wireless communication standard such as 4G, 5G, or Wi-Fi (registered trademark) is used for this communication. The vehicle 40 transmits position information of the vehicle 40 to the information processing device 20 in real time or at regular intervals using GPS communication. Note that the vehicle 40 is not limited to using the Global Positioning System (GPS) as a positioning system using artificial satellites, and may also use a Global Navigation Satellite System (GNSS), a Quasi-Zenith Satellite System (QZSS), a Global Navigation Satellite System (GLONASS), a BeiDou Navigation Satellite System (BeiDou Navigation Satellite System), Galileo, an Indian Regional Navigational Satellite System (IRNSS), or the like.

[0065] 5 is a flowchart showing the flow of a pace note generation process in which the information processing device 20 generates characteristic information to be input into a pace note and displays the generated characteristic information. The CPU 21 reads out an information processing program from the ROM 22 or the storage unit 24, loads it into the RAM 23, and executes it, thereby performing the pace note generation process.

[0066] 5, the CPU 21 acquires vehicle information from the vehicle 40. Then, the process proceeds to step S11. In the present embodiment, as an example, the driver or co-driver operates the information processing device 20 after the recce to transmit a request to transmit vehicle information to the vehicle 40. Then, the CPU 21 acquires the vehicle information transmitted from the vehicle 40 in response to the transmission request.

[0067] In step S11, the CPU 21 separates the special stage into straight roads and curved roads in accordance with the change in steering angle during the reconnaissance acquired as vehicle information in step S10. Then, the process proceeds to step S12. As an example, the separation of the special stage into straight roads and curved roads is performed as follows.

[0068] 6 is an explanatory diagram of steering angle information of the steering wheel 17 set by the driver of the vehicle 40. In the present embodiment, as an example, the steering angle information is initially set by the driver before the reconnaissance.

[0069] In this embodiment, a setting mode for setting steering angle information of the steering wheel 17 is executed by performing a predetermined operation on the input unit 47 of the vehicle 40. In this embodiment, as an example, the steering angle of the steering wheel 17 at the timing when the driver makes a sound during execution of the setting mode is set as steering angle information in an expression (e.g., L1, R1) corresponding to the sound made by the driver. By performing this operation multiple times while changing the steering angle of the steering wheel 17, multiple steering angles are set as steering angle information in an expression corresponding to the sound made by the driver (e.g., L1 to L6 and R1 to R6), as shown in FIG. 6. The steering angle information set by the driver is stored in the storage unit 44 and transmitted to the information processing device 20 as vehicle information.

[0070] Here, the steering wheel 17 shown in Fig. 6 is in a state where the steering angle is 0, which is a neutral position. The steering angle information L1, steering angle information R1, etc. shown by solid lines in Fig. 6 indicate multiple steering angles of the steering wheel 17 in expressions corresponding to the voices uttered by the driver. Note that in Fig. 6, the steering angle information closer to the reference line S shown by the dashed line, i.e., the larger the number, indicates a smaller steering angle, and the steering angle information farther from the reference line S, i.e., the smaller the number, indicates a larger steering angle. As an example, the steering angle information L3 indicates the steering angle when the steering wheel 17 is rotated approximately 90 degrees clockwise from the neutral position shown in Fig. 6 in an expression corresponding to the voices uttered by the driver.

[0071] Figure 7 is a waveform diagram showing an example of the steering angle and the wheel speed of the drive wheels during reconnaissance. Hereinafter, the waveform diagram showing an example of the steering angle during reconnaissance will be referred to as "first waveform diagram 60," and the waveform diagram showing an example of the wheel speed of the drive wheels during reconnaissance will be referred to as "second waveform diagram 61." In Figure 7, the vertical axis of first waveform diagram 60 represents the steering angle, the vertical axis of second waveform diagram 61 represents the wheel speed, and the horizontal axes of first waveform diagram 60 and second waveform diagram 61 represent time.

[0072] Here, the CPU 21 determines that a section of a special stage traveled at a steering angle within the range between two pieces of steering angle information that result in the smallest steering angle on each of the left and right sides of the steering wheel 17, among those set as steering angle information, is a straight road. In this embodiment, the CPU 21 determines that a section of a special stage traveled at a steering angle within range A between steering angle information L6 and steering angle information R6 shown in FIG. 6 during reconnaissance is a straight road. Also, in the first waveform diagram 60 shown in FIG. 7, the section of a special stage whose waveform is within boxes 60A, 60B, 60C, and 60D in the first waveform diagram 60 is traveled at a steering angle within range A shown in FIG. 6. Furthermore, the CPU 21 determines, among the sections of the special stage, the sections other than those determined as straight roads as curved roads.

[0073] 5, in step S12, the CPU 21 generates characteristic information to be input into the pace note, and then the process proceeds to step S 13. The subroutine processing in step S12 will be described later.

[0074] In step S13, the CPU 21 displays the pace note, which is a chronological arrangement of the characteristic information generated in step S12, on the display unit 26. Then, the process ends. An example of the pace note display in step S13 will be described later.

[0075] FIG. 8 is a flowchart showing the flow of the pace note generation process by the information processing device 20, which is a subroutine process in step S12 shown in FIG.

[0076] In step S20 shown in Fig. 8, the CPU 21 generates curved road information that expresses the characteristics of the curved road separated in step S11 shown in Fig. 5 as feature information in accordance with the steering angle information of the steering wheel 17 set by the driver of the vehicle 40. Then, the process proceeds to step S21.

[0077] Here, the CPU 21 generates curved road information using the steering angle information acquired as vehicle information in step S10 shown in FIG. 5 and changes in the steering angle during reconnaissance. In this embodiment, the CPU 21 generates curved road information that represents, as a characteristic of each curved road, the steering angle of the steering wheel 17 when entering each curved road during reconnaissance, in accordance with the steering angle information corresponding to that steering angle. The "steering angle information corresponding to the steering angle" refers to steering angle information set at a position closest to that steering angle. As an example, if the steering angle of the steering wheel 17 when entering a curved road is within the range between steering angle information L3 and steering angle information L4 shown in FIG. 6 and the steering angle is closer to steering angle information L4 than to steering angle information L3, the CPU 21 generates curved road information with "L4" as a characteristic of the curved road. In this way, in this embodiment, the amount by which the driver of the vehicle 40 turned the steering wheel 17 during reconnaissance is converted into information as the curved road information.

[0078] In step S21, the CPU 21 generates, as feature information, straight distance information indicating the distance of the straight road separated in step S11 shown in FIG. 5, and curve distance information indicating the distance of the curved road. Then, the process proceeds to step S22. The straight distance information is generated by multiplying the traveling time of each straight road on the special stage by the average wheel speed during traveling on each straight road. As an example, the CPU 21 obtains the traveling time of each straight road indicated by the waveforms within boxes 60A, 60B, 60C, and 60D from the first waveform diagram 60 shown in FIG. 7. The CPU 21 also obtains the wheel speed of each straight road indicated by the waveforms within boxes 60A, 60B, 60C, and 60D from the second waveform diagram 61 shown in FIG. 7. Then, the CPU 21 calculates the average wheel speed on each straight path of the special stage showing the waveform within frames 60A, 60B, 60C, and 60D, and generates straight distance information indicating the distance of each straight path by multiplying the calculated average wheel speed by the traveling time of the corresponding straight path. In this embodiment, as an example, the straight distance information is expressed as numbers in 10-meter increments, such as "50," "80," and "100."

[0079] The curve distance information is generated by multiplying the travel time of each curved road in the special stage by the average wheel speed during travel on each curved road. As an example, the CPU 21 acquires the travel time of each curved road indicated by the waveforms outside the boxes 60A, 60B, 60C, and 60D from the first waveform diagram 60 shown in FIG. 7 . The CPU 21 also acquires the wheel speed of each curved road indicated by the waveforms outside the boxes 60A, 60B, 60C, and 60D from the second waveform diagram 61 shown in FIG. 7 . The CPU 21 then calculates the average wheel speed of each curved road in the special stage indicated by the waveforms outside the boxes 60A, 60B, 60C, and 60D, and multiplies the calculated average wheel speed by the travel time of the corresponding curved road to generate curve distance information indicating the distance of each curved road. In this embodiment, as an example, the curve distance information is expressed using characters such as "short" and "long" depending on the calculated distance of the curved road.

[0080] Returning to Fig. 8, in step S22, the CPU 21 generates grip information indicating the coefficient of friction of the road surface of the special stage as feature information. Then, the process proceeds to step S23. In this embodiment, as an example, the grip information is expressed as a road surface grip level on a 10-level scale according to the coefficient of friction between the vehicle 40 and the road surface of the special stage, which is estimated by the CPU 21 based on changes in wheel speed during recce. As an example, if the friction coefficient estimated by the CPU 21 is "0.8", the road surface grip level is "10", and in this case, "10" is generated as grip information.

[0081] In step S23, the CPU 21 determines whether or not there is a risk of the vehicle 40 moving during the reconnaissance, and if it determines that there is a risk of the vehicle 40 moving (step S23: YES), the process proceeds to step S24. On the other hand, if the CPU 21 determines that there is no risk of the vehicle 40 moving (step S23: NO), the process proceeds to step S13 shown in Figure 5. In this embodiment, the CPU 21 determines that there is a risk of the vehicle 40 moving during the reconnaissance if the amount of change per unit time in the detected value of at least one of the wheel speed sensors and acceleration sensors provided in the detection unit 46 of the vehicle 40 is equal to or greater than a predetermined threshold.

[0082] In step S24, the CPU 21 generates, as feature information, warning information indicating the danger of traveling on the special stage for the vehicle 40. Then, the process proceeds to step S13 shown in FIG.

[0083] A specific example of the warning information generated in step S24 will be described below. Figure 9 is a waveform diagram showing an example of the wheel speed and acceleration of the drive wheels during reconnaissance. Hereinafter, the waveform diagram showing an example of the acceleration applied in the vertical direction to vehicle 40 during reconnaissance will be referred to as "third waveform diagram 62," and the waveform diagram showing an example of the acceleration applied in the lateral direction to vehicle 40 during reconnaissance will be referred to as "fourth waveform diagram 63." In Figure 9, the vertical axis of second waveform diagram 61 represents wheel speed, the vertical axis of third waveform diagram 62 represents acceleration applied in the vertical direction to vehicle 40, the vertical axis of fourth waveform diagram 63 represents acceleration applied in the lateral direction to vehicle 40, and the horizontal axes of second waveform diagram 61, third waveform diagram 62, and fourth waveform diagram 63 represent time.

[0084] The second waveform diagram 61 shown in Fig. 9 indicates that there is a risk of vehicle 40 traveling in the section of the special stage where the waveforms within boxes 61A and 61B are shown. Specifically, the waveforms within boxes 61A and 61B are the sections where the amount of change in the detection value per unit time of the wheel speed sensor is equal to or exceeds a predetermined threshold, indicating that the drive wheels are spinning. In this embodiment, as an example, the warning information for the section where the drive wheels are spinning is expressed by the words "slip."

[0085] The third waveform diagram 62 shown in FIG. 9 indicates that a danger to vehicle 40 occurred in the section of the special stage indicated by the waveform within boxes 62A and 62B. Specifically, the waveform within boxes 62A and 62B is the section where the change in the detected value per unit time of the acceleration sensor exceeded a predetermined threshold, and the waveform portion within box 62A indicates a sudden increase in acceleration in the upward direction, while the waveform portion within box 62B indicates a sudden increase in acceleration in the downward direction. In other words, the waveform portions within boxes 62A and 62B indicate the section where a gap (such as a step or obstacle) was passed during reconnaissance. In this embodiment, as an example, the caution information for the section of the special stage where there is a gap is expressed by the word "Care."

[0086] The fourth waveform diagram 63 shown in FIG. 9 indicates that a danger to vehicle 40 occurred in the section of the special stage indicated by the waveforms within boxes 63A, 63B, and 63C. Specifically, the waveforms within boxes 63A, 63B, and 63C are the portions where the change in the detected value per unit time of the acceleration sensor exceeded a predetermined threshold, and the waveform portions within boxes 63A and 63B indicate a sudden increase in acceleration to the left, while the waveform portion within box 63C indicates a sudden increase in acceleration to the right. In other words, the waveform portions within boxes 63A, 63B, and 63C indicate a sharp curve (a curve with a large curvature) that was traversed during reconnaissance. In this embodiment, as an example, the caution information for the sharp curve of the special stage is expressed in the text "Tough."

[0087] Next, a specific example of the pace note displayed in step S13 shown in FIG. 5 will be described. Fig. 10 shows a first display example of a pace note displayed on the display unit 26 of the information processing device 20. When an application for displaying a predetermined pace note is executed, the CPU 21 causes the display unit 26 of the information processing device 20 to display the display example shown in Fig. 10. In this embodiment, it is assumed that the application is pre-installed in the information processing device 20.

[0088] The display example shown in Fig. 10 shows a portion of a pace note into which characteristic information generated by the information processing device 20 has been input as a result of the pace note generation process shown in Fig. 5 and Fig. 8. The pace note shown in Fig. 10 displays, as an example, a characteristic information display section 70, a first correction button 71, a second correction button 72, a number input button 73, a page switching button 74, and a line switching button 75.

[0089] The characteristic information display unit 70 is a part that displays the characteristic information generated by the information processing device 20 as a result of the pace note generation process shown in Figures 5 and 8. The characteristic information display unit 70 is provided with a first display area 70A that displays the characteristic information, and a second display area 70B that displays the page number of the pace note.

[0090] 10, the first display area 70A displays, as feature information, "R3 to L5 30" on the first line, "! Slippery R2 Immediately L6 50" on the second line, and "L6 to R4 50! Tough R1" on the third line. Note that in the first display area 70A, the lines surrounded by a dashed-line frame 70C indicate lines to be edited, where the feature information can be edited.

[0091] As an example, in the feature information "R3 to L5 30" displayed on the first line of the first display area 70A, "R3" and "L5" are the curved road information generated in step S20 shown in FIG. 8, and "30" is the straight distance information generated in step S21 shown in FIG. 8. The feature information "R3 to L5 30" indicates that there is a section in the special stage that goes from the curved road at R3 to the curved road at L5, followed by a straight road of 300 m. In addition, the "slippery" in "! Slippery R2," which is part of the feature information displayed on the second line, and the "tough" in "! Tough R1," which is part of the feature information displayed on the third line, are caution information generated in step S24.

[0092] In the second display area 70B shown in FIG. 10, "1 / 16" is displayed as the page number, indicating that the feature information of the first page of the pace notes, which has a total of 16 pages, is displayed.

[0093] The first correction buttons 71 are sections that accept corrections to the feature information displayed on the feature information display section 70 with correction content predetermined (prepared) by the creator of the application. As an example, the first correction buttons 71 include a first correction button 71A with an "!" (exclamation mark) symbol displayed in a rectangular frame, a first correction button 71B with an "x" (cross mark) symbol displayed in a rectangular frame, and a first correction button 71C with an "_" (underline) symbol displayed in a rectangular frame. In this embodiment, by pressing any of the first correction buttons 71, the feature information can be corrected using the symbol corresponding to the pressed first correction button 71.

[0094] The second correction buttons 72 are a section that accepts corrections to the characteristic information displayed on the characteristic information display unit 70 using correction content set by the driver of the vehicle 40. As an example, the second correction buttons 72 include a second correction button 72A with the word "slow" displayed in a rectangular frame, a second correction button 72B with the word "care" displayed in a rectangular frame, and a second correction button 72C with the word "go" displayed in a rectangular frame. In this embodiment, by pressing any of the second correction buttons 72, the characteristic information can be corrected using the character corresponding to the pressed second correction button 72. Note that the display content of the second correction buttons 72A, 72B, and 72C shown in FIG. 10 is an example, and the expression can be changed as appropriate to suit the preferences of each driver.

[0095] The number input buttons 73 are a section for accepting corrections to the feature information displayed on the feature information display section 70, and are a section for inputting numbers as the corrections. As an example, the number input buttons 73 include ten buttons with ten different numbers, "0," "1," "2," "3," "4," "5," "6," "7," "8," and "9," displayed within a rectangular frame. In this embodiment, by pressing any of the number input buttons 73, the feature information can be corrected using the number corresponding to the pressed number input button 73.

[0096] The page switching buttons 74 are used to switch pages of feature information displayed in the feature information display section 70. The page switching buttons 74 include a previous page switching button 74A for switching the page of feature information displayed in the feature information display section 70 to the previous page, and a next page switching button 74B for switching the page of feature information displayed in the feature information display section 70 to the next page. In this embodiment, when the previous page switching button 74A or the next page switching button 74B is pressed, page switching is performed.

[0097] The row switching button 75 is a part for switching the row of characteristic information to be corrected. The row switching button 75 includes an up row switching button 75A for switching the row of characteristic information to be corrected up by one row, and a down row switching button 75B for switching the row of characteristic information to be corrected down by one row. In this embodiment, row switching is performed when the up row switching button 75A or the down row switching button 75B is pressed.

[0098] Fig. 11 is a second display example of the pace notes displayed on the display unit 26 of the information processing device 20. The display example shown in Fig. 11 shows the state after the characteristic information displayed on the characteristic information display unit 70 in Fig. 10 has been corrected.

[0099] 11 displays a correction indicator 76 indicating corrections to the characteristic information. Specifically, "correction indicator 76A" is displayed on the first line of the first display area 70A of the characteristic information display section 70, "correction indicator 76B" on the second line, and "correction indicator 76C and correction indicator 76D" on the third line.

[0100] The correction display 76A indicates the correction to "R3" displayed as the characteristic information on the first line of the first display area 70A, and the number "4" is displayed in a balloon. Also, a double strikethrough is displayed on the number "3" of "R3" displayed as the characteristic information on the first line of the first display area 70A. That is, in this embodiment, the correction display 76A indicates that "R3" displayed as the characteristic information on the first line of the first display area 70A has been corrected to "R4." Here, the CPU 21 of the information processing device 20 performs the above correction from "R3" to "R4" in the following manner, as an example.

[0101] When the number "3" of "R3" displayed as feature information on the first line of the first display area 70A is pressed for a predetermined period of time or longer, the CPU 21 displays a double strikethrough over the number "3." Thereafter, when the number input button 73 displaying the number "4" is pressed, the CPU 21 displays a correction display 76A in which the number "4" is displayed in a speech bubble. Then, when a swipe operation is performed on the displayed correction display 76A, the CPU 21 displays the correction display 76A at the position shown in FIG. 11.

[0102] The correction display 76B indicates the correction to "L6 50" displayed as feature information on the second line of the first display area 70A, and the "L6 50" is underlined. In this embodiment, the correction display 76B indicates that "L6 50" displayed as feature information on the second line of the first display area 70A has been identified as a target for review. Here, as an example, the CPU 21 corrects the above-mentioned "L6 50" in the following manner.

[0103] When the first correction button 71C is pressed, the CPU 21 enables adding "_ (underline)" to the characteristic information in the line to be corrected in the characteristic information display section 70. After that, when a swipe operation is performed on "L6 50" displayed as characteristic information on the second line in the first display area 70A, the CPU 21 adds an underline to "L6 50."

[0104] The correction display 76C indicates the correction content for "R4" displayed as characteristic information on the third line of the first display area 70A, and the symbol and characters "! Slow" are displayed in a speech bubble. In this embodiment, the correction display 76C indicates that slow driving on the curved road indicated by the curved road information for "R4" displayed as characteristic information on the third line of the first display area 70A is recommended. Here, as an example, the CPU 21 corrects the above-mentioned "R4" in the following manner.

[0105] When the second correction button 72A is pressed consecutively within a predetermined time after the first correction button 71A is pressed, the CPU 21 displays a correction display 76C in which the symbol "!" (exclamation point) and the word "slow" are displayed in the same speech bubble. After that, when a swipe operation is performed on the displayed correction display 76C, the CPU 21 displays the correction display 76C at the position shown in FIG.

[0106] The correction display 76D indicates the correction content for "! Tough R1" displayed as feature information on the third line of the first display area 70A, and an "x (cross mark)" symbol is displayed on the "! Tough" symbol and the character. In this embodiment, the correction display 76D indicates that the feature information "! Tough" displayed on the third line of the first display area 70A is unnecessary. Here, as an example, the CPU 21 corrects the above "! Tough R1" in the following manner.

[0107] When the first correction button 71B is pressed, the CPU 21 displays a correction display 76D in which an "x (cross)" symbol is displayed within an oval. After that, when a swipe operation is performed on the displayed correction display 76D, the CPU 21 displays the correction display 76D at the position shown in Fig. 11. When the oval of the correction display 76D is pressed, the CPU 21 accepts adjustment of the dimensions of the oval.

[0108] Conventionally, pace notes are created by the driver describing the characteristics of the special stage during recce in words, such as the curve characteristics (e.g. angle and distance) and road surface conditions, and the co-driver writing down the driver's words in a paper notebook. When creating pace notes on paper, as the special stage is long in distance, it is a lot of work to record the characteristics of each curve one by one, and there is also a risk of errors in writing down the pace notes. Possible causes of errors in writing down pace notes include errors in the driver's expression and errors in writing down the co-driver's.

[0109] In contrast to this, in this embodiment, as described above, the information processing device 20 generates the characteristics of the special stage as characteristic information based on the vehicle information acquired from the vehicle 40, and then generates a pace note into which the generated characteristic information is input. Therefore, according to this embodiment, the burden on the driver and co-driver is reduced compared to when pace notes are generated on paper, and errors that occur due to manual work can be reduced.

[0110] Furthermore, in this embodiment, the CPU 21 separates the special stage into straight roads and curved roads in accordance with changes in steering angle during reconnaissance acquired as vehicle information, and generates curved road information that expresses the characteristics of the separated curved roads in accordance with the steering angle information set by the driver of the vehicle 40. In this embodiment, the CPU 21 generates the curved road information using changes in steering angle during reconnaissance detected by the steering angle sensor provided in the detection unit 46 of the vehicle 40, so that subjective information along the driving line actually driven by the driver can be entered into the pace notes.

[0111] Here, the information that drivers need in a rally is not objective information such as the shape and distance of special stages, but subjective information such as "the driver will enter a curve that will require the driver to turn the steering wheel x x degrees." Therefore, if only information detected by image analysis is used as an alternative method for generating pace notes by computer, it may be possible to generate objective information such as the shape and distance of special stages, but it will not be possible to generate the subjective information that drivers need.

[0112] In contrast to this, in the present embodiment, with the above configuration, curve road information expressed in accordance with the steering angle information set by the driver is input into the pace note, so that the pace note can be generated in a way that is easy for the driver to use.

[0113] In this embodiment, the CPU 21 uses the wheel speed of the vehicle 40 during reconnaissance acquired as vehicle information to generate straight distance information indicating the distance of the separated straight roads and curve distance information indicating the distance of the curved roads. Here, the distance of the straight roads on a special stage can also be referred to as the "distance between curved roads," and by understanding the distance of the straight roads, the driver can determine how much acceleration is acceptable between curved roads. Then, according to this embodiment, the information processing device 20 can automatically generate pace notes indicating the distance of the straight roads and the distance of the curved roads on a special stage.

[0114] Furthermore, in this embodiment, the CPU 21 generates warning information indicating the danger of the vehicle 40 traveling on the special stage, using at least one of the wheel speed and acceleration of the vehicle 40 during the reconnaissance, which is acquired as vehicle information.

[0115] Here, if pace notes are generated on paper as in the past, there is a risk that the road surface conditions of the special stage (e.g., whether it has rained or there is moss) will be overlooked. Also, if only information detected by image analysis is used as an alternative method for generating pace notes by computer, there is a risk that the safe driving areas and other areas of the special stage road surface will not be correctly distinguished from each other if their hues are similar.

[0116] In contrast, with the above-described configuration, the present embodiment can generate pace notes that more accurately indicate the dangers of vehicle 40's driving on special stages compared to when pace notes are generated on paper or when only information detected by image analysis is used.

[0117] As an example, in this embodiment, CPU 21 generates, as warning information, information indicating at least one of vertical and horizontal displacements occurring in vehicle 40. Therefore, according to this embodiment, it is possible to generate a pace note indicating a section passing through a gap (such as a step or an obstacle) as information indicating vertical displacement occurring in vehicle 40 while traveling on a special stage, or to generate a pace note indicating a section passing through a sharp curve as information indicating horizontal displacement occurring in vehicle 40.

[0118] As another example, in this embodiment, the CPU 21 generates grip information indicating the friction coefficient of the road surface of the special stage as warning information. As an example, the CPU 21 displays the grip information on the display unit 26 when a predetermined operation is received from the input unit 25 on the pace note display screen shown in FIG. 10 or 11. Therefore, according to this embodiment, the information processing device 20 can automatically generate a pace note indicating the grip information indicating the friction coefficient of the road surface of the special stage. In this embodiment, by presenting the grip information to the driver, it is possible to support the vehicle speed when entering the curved road of the special stage.

[0119] In this embodiment, the CPU 21 arranges the generated characteristic information in chronological order and displays it on the display unit 26. That is, according to this embodiment, a pace note can be generated in which the characteristic information of a special stage is arranged in chronological order. In this embodiment, the generated characteristic information is displayed on the display unit 26 in chronological order, so that the characteristic information can be checked in accordance with the running order of each section of the special stage.

[0120] Furthermore, in this embodiment, the CPU 21 accepts corrections to the characteristic information displayed on the display unit 26. Rally reconnaissance is often conducted "twice." Therefore, according to this embodiment, the driver and co-driver can review the pace notes automatically generated by the information processing device 20 based on the vehicle information during the first reconnaissance during the second reconnaissance, and correct the content of the pace notes generated by the information processing device 20 if necessary.

[0121] In this embodiment, the CPU 21 corrects the characteristic information by accepting a selection of one of the multiple correction candidates displayed on the display unit 26. In this embodiment, the multiple correction candidates include a first correction button 71 as a first correction candidate for which correction is made with a predetermined (prepared) correction content, and a second correction button 72 as a second correction candidate for which correction is made with a correction content set by the driver of the vehicle 40 (see FIGS. 10 and 11). Therefore, according to this embodiment, the content of the pace note generated by the information processing device 20 can be corrected with multiple correction contents.

[0122] (others) In the above embodiment, in step S23 shown in FIG. 8 , the CPU 21 determines that a danger to the vehicle 40 has arisen during reconnaissance if the amount of change per unit time in the detected value of at least one of the wheel speed sensors and the acceleration sensor provided in the detection unit 46 of the vehicle 40 is equal to or greater than a predetermined threshold. However, this is not limited to this. In step S23, the CPU 21 may determine that a danger to the vehicle 40 has arisen during reconnaissance if the amount of change per unit time in the detected value of at least one of the wheel speed sensors and the acceleration sensor is equal to or greater than a predetermined threshold and the voice uttered by at least one of the driver and co-driver during reconnaissance, acquired as vehicle information, is a danger voice indicating danger. In this case, the CPU 21 generates warning information by combining at least one of the wheel speed and acceleration during the reconnaissance with the voice uttered during the reconnaissance. As an example, expressions such as "danger" and "wow" are stored in the storage unit 44 as danger voices. In this case, for example, when the change in the detection value per unit time of the acceleration sensor exceeds a predetermined threshold and at least one of the driver and co-driver emits a warning voice such as "Danger" in the section of the special stage where the change is above the predetermined threshold, the CPU 21 determines that there is a danger to the vehicle 40 during reconnaissance and generates warning information. With this configuration, as in the above embodiment, it is possible to generate pace notes that more accurately indicate the danger to the vehicle 40 on the special stage than when pace notes are generated using paper notes or when only information detected by image analysis is used.

[0123] Alternatively, the CPU 21 may generate warning information based on the vehicle behavior of the vehicle 40 estimated using vehicle exterior images acquired during reconnaissance, rather than on the changes in the detection values ​​per unit time of the various sensors included in the detection unit 46 of the vehicle 40 and the sounds made by the driver and co-driver during reconnaissance. In this case, in step S23 shown in FIG. 8 , the CPU 21 determines that a risk of vehicle 40 traveling has arisen during reconnaissance if the vehicle behavior per unit time is extreme. As an example, the CPU 21 estimates the vehicle behavior based on the flow of pixels (video) in the vehicle exterior images acquired during reconnaissance as the vehicle information. Specifically, the CPU 21 estimates the vehicle behavior using an algorithm that calculates the movement of the image capture unit 45 from the movement of pixels between frames of the exterior images. The CPU 21 then estimates that a case in which the amount of movement of the image capture unit 45 exceeds a predetermined standard as a "case of extreme vehicle behavior," and determines that a risk of vehicle 40 traveling has arisen during reconnaissance. With this configuration, as in the above embodiment, it is possible to generate pace notes that more accurately indicate the danger of vehicle 40's driving on a special stage than when pace notes are generated on paper.

[0124] Furthermore, the CPU 21 may generate caution information using the generated curved road information and straight distance information. As an example, the CPU 21 may generate caution information when a curved road immediately following a straight road corresponds to a sharp curve road set by the driver. A sharp curve road can be set by the driver during execution of a setting mode for setting steering angle information. As an example, steering angle information of "L1," "L2," "L3," "R1," "R2," and "R3" shown in FIG. 6 can be stored in the memory unit 44 as a "sharp curve road." In this case, if the curved road information of the curved road immediately following a straight road is "L2," etc., the CPU 21 generates caution information, and the caution information is expressed in the pace note with the word "Caution."

[0125] In the above embodiment, the CPU 41 of the vehicle 40 may cause the in-vehicle display unit 48 to display changes in the steering angle of the vehicle 40 during reconnaissance in a manner that matches the steering angle information. As a result, with this configuration, steering angle information (e.g., L3) corresponding to the steering angle of the steering wheel actually rotated by the driver during reconnaissance is displayed on the HUD of the in-vehicle display unit 48. Therefore, with this configuration, it is possible to make the driver aware of any discrepancy between the steering angle information set by the driver and the steering angle during reconnaissance. Furthermore, with this configuration, if the driver recognizes a discrepancy between the steering angle information and the steering angle during reconnaissance, it is possible to reset the steering angle information. Note that the timing for resetting the steering angle information is arbitrary, and it is expected that it will be performed before or after reconnaissance, for example.

[0126] In the above embodiment, the steering angle at the timing when the driver utters a voice during execution of the setting mode is set as the steering angle information in an expression corresponding to the voice uttered by the driver. However, instead of or in addition to this, other methods of setting the steering angle information may be provided.

[0127] As an example, the steering angle information may be set by attaching tape with "L1" and "R1" written on it to the steering wheel in positions as shown by dashed or solid lines in Fig. 6 and capturing an image of the steering wheel with the tape attached. In this case, the information processing device 20 or the vehicle 40 identifies the positions of the tape on the captured steering wheel and the content of the writing by performing image recognition processing, and the steering angle information is set based on the content recognized in the image.

[0128] As another example, steering angle information may be set by manually inputting expressions corresponding to a plurality of steering angles while the setting mode is being executed by the driver or co-driver operating the input unit 47. As an example, if the driver describes the steering angle when the steering wheel 17 is rotated approximately 90 degrees clockwise from the neutral position shown in Fig. 6 as "L3," the co-driver operates the input unit 47 to set the expression "L3" as the steering angle information.

[0129] In the information processing system 10 of the above embodiment, the images outside the vehicle during reconnaissance captured by the imaging unit 45 of the vehicle 40 may be displayed on the in-vehicle display unit 48, the display unit 26 of the information processing device 20, or a display unit of another device different from the vehicle 40 and the information processing device 20. By displaying the images outside the vehicle during reconnaissance in this way, it is possible to check the contents of the pace notes displayed on the display unit 26 of the information processing device 20 while viewing the video of the reconnaissance.

[0130] In the information processing system 10 of the above embodiment, a 3D image of the special stage may be obtained using GPS data during reconnaissance of the vehicle 40, and the obtained 3D image of the special stage may be displayed on the in-car display unit 48, the display unit 26 of the information processing device 20, or a display unit of another device different from the vehicle 40 and the information processing device 20. By displaying a 3D image of the special stage in this way, it is possible to check the contents of the pace notes displayed on the display unit 26 of the information processing device 20 while confirming objective information such as the shape and distance of the special stage.

[0131] In the above embodiment, the information processing device 20 acquires the vehicle information transmitted from the vehicle 40. However, not all vehicle information is necessarily transmitted by the vehicle 40, and vehicle information may be acquired by the information processing device 20. As an example, the outside image captured by the imaging unit 45 of the vehicle 40 in the above embodiment may be captured and acquired by the information processing device 20.

[0132] In the above embodiment, the expressions in the pace notes are merely examples and can be changed as appropriate to suit the preferences of each driver. For example, steering angle information may be expressed in seven or more levels, such as "L7" and "R7," characteristic information such as the distance of curves may be displayed in the pace notes, and characteristic information to be corrected may be distinguished from other characteristic information by different shades of color.

[0133] In the above embodiment, rally has been described as an example of a vehicle competition, but this is not a limitation. For example, vehicle competitions include, in addition to rally, races on circuit and short circuit races, gymkhana, dirt trial, and driving education, which is training to improve competitive skills. In driving education, a driver drives on a course arbitrarily set on a paved road based on a driving menu designed to improve competitive skills. In other words, the information processing system 10 in the above embodiment can be used in vehicle competitions including at least one of rally, circuit, short circuit, gymkhana, dirt trial, and driving education. Therefore, according to the above embodiment, it is possible to provide an information processing device, an information processing system, and an information processing program that generate pace notes for vehicle competitions including at least one of rally, circuit, short circuit, gymkhana, dirt trial, and driving education in a manner that is easy for drivers to use. Of the vehicle competitions listed above, rallies can be said to be vehicle competitions that take place on public roads, races on circuits and short circuits, etc., and dirt trials can be said to be vehicle competitions that take place on dedicated courses, and gymkhana and driver education can be said to be vehicle competitions that take place on courses set up arbitrarily on paved roads (for example, courses made up of pylons lined up in squares, parking lots, etc.).

[0134] In the above embodiment, the pace note generation process executed by the CPU 21 by loading software (programs) may be executed by various processors other than a CPU. Examples of processors in this case include dedicated electrical circuits, such as programmable logic devices (PLDs) (such as field-programmable gate arrays (FPGAs)) whose circuit configuration can be changed after manufacture, and application-specific integrated circuits (ASICs) that are processors with circuit configurations specifically designed to execute specific processes. The pace note generation process may be executed by one of these various processors, or by a combination of two or more processors of the same or different types (e.g., multiple FPGAs, or a combination of a CPU and an FPGA). The hardware structure of these various processors is, more specifically, an electrical circuit that combines circuit elements such as semiconductor devices.

[0135] In the above embodiment, the information processing program is pre-stored (installed) in the ROM 22 or the storage unit 24, but the present invention is not limited to this. The information processing program may be provided in a form recorded on a recording medium such as a CD-ROM (Compact Disk Read Only Memory), a DVD-ROM (Digital Versatile Disk Read Only Memory), or a USB (Universal Serial Bus) memory. The information processing program may also be downloaded from an external device via the network N. [Explanation of symbols]

[0136] 10 Information Processing Systems 20 Information processing equipment 21A Acquisition Department 21B Separation part 21C Generation part 21D Estimation part 21E display control unit (an example of a first display control unit) 21F Correction Department 26 display unit (an example of a first display device) 40 vehicles 41 CPU (an example of a second display control unit) 48 In-car display unit (an example of a second display device)

Claims

1. an acquisition unit that acquires vehicle information related to the vehicle, including a steering angle of a steering wheel of the vehicle while the vehicle is traveling in a traveling section of the vehicle competition; a separation unit that separates the travel section into a straight road and a curved road in accordance with a change in the steering angle of the vehicle while traveling on the travel section acquired by the acquisition unit as the vehicle information; a generating unit that generates feature information indicating the characteristics of the curved road separated by the separating unit in an expression that matches steering angle information regarding the steering angle set by the driver of the vehicle; An information processing device comprising:

2. the acquisition unit acquires, as the vehicle information, a wheel speed of the vehicle traveling in the travel section; The information processing device according to claim 1, wherein the generation unit generates the feature information indicating the distance of the straight road and the distance of the curved road separated by the separation unit using the wheel speed during travel on the travel section acquired by the acquisition unit as the vehicle information.

3. the acquisition unit acquires, as the vehicle information, a wheel speed and an acceleration of the vehicle traveling in the travel section; 3. The information processing device according to claim 1, wherein the generation unit generates the characteristic information indicating the risk of the vehicle traveling on the traveling section using at least one of the wheel speed and the acceleration during traveling on the traveling section acquired by the acquisition unit as the vehicle information.

4. The information processing device according to claim 3 , wherein the feature information generated by the generating unit is information indicating at least one of a vertical and horizontal displacement occurring in the vehicle.

5. The information processing device according to claim 3 , wherein the characteristic information generated by the generating unit is information indicating a friction coefficient of the road surface of the travel section.

6. the acquisition unit acquires, as the vehicle information, a voice uttered by an occupant of the vehicle while the vehicle is traveling along the travel section; 6. An information processing device as described in any one of claims 3 to 5, wherein the generation unit combines the audio with at least one of the wheel speed and the acceleration during travel on the travel section acquired as the vehicle information by the acquisition unit to generate the characteristic information indicating the danger of the travel section.

7. the acquisition unit acquires, as the vehicle information, an outside image of the vehicle, an estimation unit that estimates a vehicle behavior of the vehicle using the outside-of-vehicle image acquired by the acquisition unit as the vehicle information; The information processing device according to claim 3 , wherein the generating unit generates the feature information indicating the risk of the travel section by using the vehicle behavior estimated by the estimating unit.

8. a first display device that displays various information; a first display control unit that arranges the feature information generated by the generation unit in chronological order and displays the same on the first display device; The information processing device according to claim 1 , further comprising:

9. The information processing apparatus according to claim 8 , further comprising a correction unit that accepts correction of the feature information displayed on the first display device.

10. the correction unit corrects the feature information by accepting a selection of one of a plurality of correction candidates displayed on the first display device, 10. The information processing device according to claim 9, wherein the plurality of correction candidates include a first correction candidate for performing correction according to a predetermined correction content, and a second correction candidate for performing correction according to a correction content set by a driver of the vehicle.

11. The information processing device according to claim 1 , wherein the vehicle competition includes at least one of rally, circuit, short circuit, gymkhana, dirt trial, and driving education as training for improving competitive skills.

12. An information processing device according to any one of claims 1 to 11; a second display control unit that displays, on a second display device provided in the vehicle, a change in the steering angle of the vehicle while the vehicle is traveling in the traveling section, in an expression that matches the steering angle information; An information processing system comprising:

13. On the computer, acquiring vehicle information about the vehicle, including a steering angle of the steering wheel of the vehicle while the vehicle is traveling in a traveling section of the vehicle competition; dividing the travel section into a straight road and a curved road in accordance with a change in the steering angle of the vehicle while traveling on the travel section acquired as the vehicle information; generating feature information that indicates the separated characteristics of the curved road in an expression that matches steering angle information regarding the steering angle set by the driver of the vehicle; An information processing program for executing processing.

Images