Virtual space production device
The virtual space production device addresses vehicle shaking during VR services by adjusting actuator drive based on tilt and passerby proximity, preventing contact and ensuring safe operation.
Patent Information
- Application Number
- JP2023021090
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2023-02-14
- Publication Date
- 2024-11-21
- Estimated Expiration
- 2043-02-14
AI Technical Summary
Conventional virtual reality systems using vehicles as motion platforms face issues with vehicles shaking significantly during VR services, posing a risk of contact with passersby when stopped on ramps.
A virtual space production device that includes an AV device, actuator, and control unit to manage vehicle vibrations, using inclination and proximity sensors to adjust actuator drive amounts based on tilt and passerby presence to prevent contact.
Prevents contact between a stopped vehicle providing VR services and passersby by dynamically adjusting vehicle vibrations based on tilt and proximity, ensuring safe operation.
Smart Images

Figure 0007588167000001 
Figure 0007588167000002 
Figure 0007588167000003
Abstract
Description
[Technical field]
[0001] The present invention relates to a virtual space creating device that creates a simulated experience for occupants by constructing a virtual space inside a moving body such as a vehicle. [Background technology]
[0002] Conventionally, there is known a technology that uses a vehicle as a motion platform to create a virtual space within the vehicle cabin and provide a simulated experience for the occupants (see, for example, Patent Document 1).
[0003] The virtual reality system of Patent Document 1 is configured to include an image presentation means for presenting an image to a user based on image information representing a virtual space, and a control means for controlling the acceleration and deceleration of the vehicle with a drive pattern that moves the vehicle, stops it, and returns the vehicle to its original position so as to present a sensation or movement corresponding to the image information representing the virtual space.
[0004] According to the virtual reality system disclosed in Patent Document 1, by using a vehicle as a motion platform, it is possible to present the user with sensations or movements corresponding to video information. [Patent Document 1] JP 2017-102401 A DISCLOSURE OF THEINVENTION [Problem to be solved by the invention]
[0005] However, in the virtual reality system of Patent Document 1, for example, when a virtual reality (sometimes abbreviated as VR) service is provided to a user in a virtual space constructed inside the vehicle by using the parked vehicle as a motion platform, the vehicle may shake significantly due to the provision of the VR service. In such a case, if a person passes by the vehicle, there is a concern that the vehicle providing the VR service may come into contact with the person.
[0006] The present invention has been made in consideration of the above-mentioned situation, and aims to provide a virtual space presentation device that can prevent contact between a moving body and an object, even when the moving body, such as a vehicle providing a VR service, is stopped on a slope. [Means for solving the problem]
[0007] In order to achieve the above object, a virtual space production device according to the present invention includes AV equipment for providing audiovisual (AV) information to a passenger of a moving body, an actuator for generating a load related to vibration of the moving body, and a control unit for controlling the AV equipment and the actuator, and when providing a virtual reality service (VR service) by using the moving body in a stopped state, the virtual space production device produces a simulated experience for the passenger in a virtual space by driving the AV equipment and the actuator, The moving body is a four-wheeled vehicle, and the actuator has a function of assisting the expansion and contraction of a suspension device provided for each of the four wheels, and the vehicle an information acquisition unit that acquires tilt information related to a tilt state of the tilted object; vehicle and a determination unit that determines whether the tilt angle exceeds a predetermined tilt angle threshold. vehicle When it is determined that the AV device and the actuator are in a tilted state exceeding a predetermined tilt angle threshold, Regarding the expansion and contraction of the provision of the VR service The driving amount is vehicle The most important feature of this system is that it reduces the amount of tilt compared to normal conditions when the system is not tilted. Effect of the Invention
[0008] According to the present invention, even when a moving body such as a vehicle providing a VR service is stopped on a slope, contact between the moving body and an object can be prevented in advance. [Brief description of the drawings]
[0009] [Figure 1] 1 is a schematic diagram illustrating the configuration of a virtual space presentation device according to an embodiment of the present invention. [Diagram 2] 1 is a schematic configuration diagram of a vehicle to which a virtual space production device is applied. [Figure 3A] 13A to 13C are diagrams illustrating the operation of the embodiment of the virtual space production device in a case where a vehicle is parked on a ramp. [Figure 3B] 13A to 13C are diagrams illustrating the operation of the embodiment of the virtual space production device in a case where a vehicle is parked on a ramp. [Figure 4A] 13A to 13C are diagrams illustrating the operation of an embodiment of a virtual space presentation device in a case where a passerby is present in the monitoring area of the vehicle after switching to VR mode. [Figure 4B] 13A to 13C are diagrams illustrating the operation of an embodiment of a virtual space presentation device in a case where a passerby is present in the monitoring area of the vehicle after switching to VR mode. [Figure 4C] 13A to 13C are diagrams for explaining the operation of an embodiment of a virtual space presentation device in a case where the result of determining whether or not a passerby is present in the vehicle's monitoring area is reversed after switching to VR mode. [Figure 5A] FIG. 11 is a flowchart illustrating the operation of the virtual space production device. [Figure 5B] FIG. 11 is a flowchart illustrating the operation of the virtual space production device. [Figure 6A] FIG. 13 is a diagram explaining the operation of a first modified example of the virtual space presentation device in a case where a passerby is present in the monitoring area of the vehicle after switching to the VR mode. [Figure 6B] FIG. 13 is a diagram explaining the operation of a first modified example of the virtual space presentation device in a case where a passerby is present in the monitoring area of the vehicle after switching to the VR mode. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0010] A virtual space production device 11 according to an embodiment of the present invention will be described in detail below with reference to the drawings as appropriate. In the drawings shown below, components having common functions are given common reference symbols. In this case, in principle, duplicated explanations will be omitted. In addition, the size and shape of components may be distorted or exaggerated for convenience of explanation.
[0011] [Summary of virtual space production device 11 according to an embodiment of the present invention] First, the gist of a virtual space production device 11 according to an embodiment of the present invention will be described. A virtual space production device 11 according to an embodiment of the present invention includes an AV device 57 (see FIG. 1) that provides audiovisual (AV) information to a passenger in a moving body such as a vehicle 10, an actuator (see "SUS actuator 59" shown in FIG. 1) that generates a load related to vibration of the moving body, and a control unit (see "VR control unit 67" shown in FIG. 1) that controls the AV device 57 and the SUS actuator 59, and when providing a virtual reality (VR) service, the virtual space production device 11 produces a simulated experience for the passenger in a virtual space by driving the AV device 57 and the SUS actuator 59. The projection device further includes an information acquisition unit 61 (see FIG. 1) that acquires tilt information related to the tilt state of a moving body (vehicle 10), and a judgment unit 63 (see FIG. 1) that judges whether or not the moving body (vehicle 10) is in a tilt state exceeding a predetermined first tilt angle threshold TAth1 based on the tilt information acquired by the information acquisition unit 61. When the judgment unit 63 judges that the moving body is in a tilt state exceeding the first tilt angle threshold TAth1, a VR control unit 67 reduces a drive amount DAsus of at least the SUS actuator 59 out of the AV equipment 57 and the SUS actuator 59 compared to a normal time when the moving body is not in a tilted state. This makes it possible to prevent contact between the vehicle 10 (moving body) and a passerby (object) 60 even when the moving body such as the vehicle 10 providing a VR service is stopped on the slope 20. The virtual space production device 11 according to the embodiment of the present invention will be described in detail below.
[0012] [Overall configuration of virtual space production device 11 according to an embodiment of the present invention] Next, the schematic configuration of the virtual space production device 11 according to the embodiment of the present invention will be described with reference to Figs. 1, 2, 3A, 3B, 4A, 4B, and 4C as appropriate. Fig. 1 is a schematic configuration diagram of the virtual space production device 11 according to the embodiment of the present invention. Fig. 2 is a schematic configuration diagram of a vehicle 10 to which the virtual space production device 11 is applied. Figs. 3A and 3B are diagrams for explaining the operation of the embodiment of the virtual space production device 11 in a case where the vehicle 10 is parked on a ramp 20. Figs. 4A and 4B are diagrams for explaining the operation of the embodiment of the virtual space production device 11 in a case where a passerby (object) 60 exists in the monitoring area 62 of the vehicle 10. Fig. 4C is a diagram for explaining the operation of the embodiment of the virtual space production device 11 in a case where the presence / absence determination result of the passerby (object) 60 in the monitoring area 62 of the vehicle 10 is reversed.
[0013] As shown in Figures 1 and 2, the virtual space production device 11 is configured by connecting input system elements 13 and output system elements 15 so that they can communicate data with each other via a communication medium 17 such as a CAN (Controller Area Network).
[0014] As shown in FIG. 1, the input system elements 13 include a surroundings monitoring device 21, a vehicle speed sensor 23, a parking brake (PB) sensor 25, a seat belt (SB) sensor 27, an inclination angle sensor 29, a suspension (SUS) sensor 31, and an HMI (Human-Machine Interface) 33.
[0015] On the other hand, the output system elements 15, as shown in FIG. 1, are composed of a VR-ECU 51, a BRK-ECU 53, an ENG-ECU 55, an AV equipment 57, a suspension (SUS) actuator 59, a PB actuator 81, a door lock (DR) actuator 83, and a communication device 85.
[0016] [Outline of the configuration of the input system element 13] The periphery monitoring device 21 belonging to the input system elements 13 monitors the presence or absence of a passerby (object) 60 in a monitoring area (see reference numeral 62 shown in FIG. 4A) set around the vehicle 10, and outputs presence or absence information regarding the presence or absence of the passerby (object) 60 in the monitoring area 62. The presence or absence information regarding the passerby (object) 60 in the monitoring area 62 by the periphery monitoring device 21 is sent to the VR-ECU 51 etc. via the communication medium 17.
[0017] Specifically, the periphery monitoring device 21 includes a camera 41, a radar 43, and a lidar 45, as shown in FIGS.
[0018] 2, the cameras 41 include a front camera 41a that monitors the area in front of the vehicle 10, a pair of side cameras 41b and 41c that monitor the left and right sides of the vehicle 10, and a rear camera 41d that monitors the area behind the vehicle 10. The cameras 41 detect and output information on the presence or absence of a pedestrian (object) 60 present around the vehicle 10 through an image of the vehicle 10.
[0019] As shown in FIG. 2, the radar 43 is provided at each of the four corners of the vehicle 10, and detects and outputs information regarding the presence or absence of a passerby (object) 60 at each corner.
[0020] As shown in FIG. 2, the lidar 45 is provided at the front of the vehicle 10 and at the center in the vehicle width direction, and detects and outputs information regarding the presence or absence of a pedestrian (object) 60 in front of the vehicle 10.
[0021] The vehicle speed sensor 23 has a function of detecting the traveling speed (vehicle speed) of the vehicle 10. Information related to the vehicle speed detected by the vehicle speed sensor 23 is sent to the BRK-ECU 53 and the like via the communication medium 17.
[0022] The parking brake (PB) sensor 25 detects and outputs an ON signal when the parking brake (PB) is applied. The ON / OFF signal from the PB sensor 25 is sent to the VR-ECU 51 and the like via the communication medium 17.
[0023] The seat belt (SB) sensor 27 detects and outputs an ON signal when a seat belt (SB) associated with a seat in which an occupant is seated is fastened. The ON / OFF signal from the SB sensor 27 is sent to the VR-ECU 51 and the like via the communication medium 17.
[0024] The inclination angle sensor 29 has a function of acquiring information related to the inclination angle of the vehicle 10. The information related to the inclination angle of the vehicle 10 obtained by the inclination angle sensor 29 is sent to the VR-ECU 51 and the like via the communication medium 17.
[0025] The SUS sensor 31 detects and outputs SUS information relating to the expansion / contraction state of the suspension device 19, such as sprung acceleration, unsprung acceleration, stroke position, etc., which are physical quantities generated in association with the expansion / contraction operation of the suspension device 19. The SUS information relating to the expansion / contraction state of the suspension device 19 from the SUS sensor 31 is sent to the VR-ECU 51 etc. via the communication medium 17. The SUS information is referred to when the VR-ECU 51 controls the expansion / contraction state of the suspension device 19.
[0026] The HMI (Human-Machine Interface) 33 includes a VR mode switch 37. The VR mode switch 37 is operated by a passenger when a virtual space is created in the vehicle interior and a VR service is provided. Operation information of the VR mode switch 37 is sent to the VR-ECU 51 and the like via the communication medium 17.
[0027] [Outline of the configuration of the output system element 15] The VR-ECU 51 belonging to the output system element 15 is responsible for control related to the provision of VR services using VR contents. The VR-ECU 51 is configured by a microcomputer equipped with a CPU (Central Processing Unit), a ROM (Read Only Memory), a RAM (Random Access Memory), etc. This microcomputer reads and executes programs and data stored in the ROM, and operates to control the execution of various functions of the VR-ECU 51, including a function for acquiring various types of information, a determination function, a calculation function, and a VR control function, which will be described below.
[0028] As a VR service using VR contents, the VR-ECU 51 reproduces the behavior and engine sound of a kart running on a circuit, and presents video and audio of a movie, for example, by driving the AV equipment 57 and the SUS actuator 59. The VR contents may be downloaded in advance via the communication device 85 and stored in a memory such as a RAM of the VR-ECU 51.
[0029] In order to provide a VR service using VR content, the VR-ECU 51 is configured to include an information acquisition unit 61, a determination unit 63, a calculation unit 65, and a VR control unit 67, as shown in FIG.
[0030] The information acquisition unit 61 acquires time-series information such as information on the presence or absence of a pedestrian (object) 60 in the monitoring area 62 from the perimeter monitoring device 21, information related to the vehicle speed detected by the vehicle speed sensor 23, operation information of the parking brake (PB) from the PB sensor 25, fastening information of the seat belt (SB) from the SB sensor 27, inclination information related to the inclination angle of the vehicle 10 from the inclination angle sensor 29, SUS information related to the extension / contraction state of each of the multiple suspension devices 19a, 19b, 19c, 19d (hereinafter sometimes collectively referred to as suspension devices 19) from the SUS sensor 31, and operation information of the VR mode switch 37.
[0031] Each piece of information acquired by the information acquisition unit 61, including information on the presence or absence of an object in the monitoring area 62, information related to the vehicle speed, parking brake (PB) operation information, seat belt (SB) fastening information, inclination information related to the inclination angle of the vehicle 10, SUS information, and operation information of the VR mode switch 37, is sent to a judgment unit 63, etc.
[0032] The determination unit 63 determines whether or not the vehicle 10 is in a tilt state exceeding a predetermined first tilt angle threshold TAth1, based on the tilt information related to the tilt angle TA of the vehicle 10 acquired by the information acquisition unit 61. The predetermined first tilt angle threshold TAth1 will be described in detail later. Furthermore, the determination unit 63 determines whether or not the vehicle 10 is in a tilt state exceeding a predetermined second tilt angle threshold value TAth2, based on the tilt information related to the tilt angle TA of the vehicle 10 acquired by the information acquisition unit 61. The predetermined second tilt angle threshold value TAth2 will be described in detail later. Further, the determination unit 63 determines whether or not a passerby (object) 60 is present in the monitored area 62 based on the monitoring information acquired by the information acquisition unit 61. Then, after the information acquisition unit 61 acquires presence information indicating that a passerby (object) 60 is present in the monitoring area 62, the judgment unit 63 judges whether the blank time TM during which the presence information is not acquired exceeds a predetermined first time length TMth1. The result of the determination by the determination unit 63 is sent to the calculation unit 65 and the VR control unit 67, respectively.
[0033] As shown in Figures 3A and 3B, when the determination unit 63 after transition to the VR mode determines that the vehicle 10 is in an inclination state exceeding a predetermined first inclination angle threshold TAth1, the calculation unit 65 refers to the inclination angle-output ratio table 66 shown in Figure 3B to calculate the output ratio value LOnw corresponding to the current inclination angle value TAnw of the vehicle 10.
[0034] Note that after the transition to the VR mode, the parking posture including the inclination state of the vehicle 10 varies moment by moment during the provision of the VR service. Therefore, after the transition to the VR mode, it is beneficial to calculate the value LOnw of the output ratio corresponding to the current inclination angle value TAnw of the vehicle 10 with reference to the inclination angle-output ratio table 66, and adjust the drive amount DAsus of the SUS actuator 59 using the calculated value LOnw of the output ratio.
[0035] Here, the relationship characteristics of the inclination angle-output ratio table 66 will be described. In the inclination angle-output ratio table 66 shown in FIG. 3B, a fixed value of 100% is associated with the value LO of the output ratio for the value range (0 <= TA <= TAth1) where the inclination angle TA ranges from 0 to the first inclination angle threshold value TAth1. In this embodiment, when the inclination angle TA converges within the value range from 0 to the first inclination angle threshold value TAth1 after the transition to the VR mode, the VR-ECU 51 adopts a configuration that unconditionally permits the continuation of the VR mode on the assumption that there is no risk of the vehicle 10 slipping downward.
[0036] Also, a characteristic value that linearly decreases from 100% to 0% is associated with the value LO of the output ratio for the value range (TAth1 < TA <= TAth2) where the inclination angle TA ranges from the first inclination angle threshold value TAth1 to the second inclination angle threshold value TAth2. In this embodiment, when the inclination angle TA falls within the value range from the first inclination angle threshold value TAth1 to the second inclination angle threshold value TAth2 after the transition to the VR mode, the VR-ECU 51 adopts a configuration that permits the continuation of the VR mode conditionally (by reducing the drive amount of the SUS actuator 59) on the assumption that the risk of the vehicle 10 slipping downward is not very high.
[0037] And a fixed value of 0% is associated with the value LO of the output ratio for the range where the tilt angle TA exceeds the second tilt angle threshold TAth2 (TA > TAth2). In the present embodiment, after the transition to the VR mode, when the tilt angle TA exceeds the second tilt angle threshold TAth2, the VR-ECU 51 adopts a configuration in which it interrupts the continuation of the VR mode, considering that the risk of the vehicle 10 slipping downward is high.
[0038] Next, the calculation unit 65 multiplies the calculated value LOnw of the output ratio by the drive amount DAsus_st of the SUS actuator 59 in the normal state when the vehicle 10 is not in the tilted state. In the calculation unit 65, the reduced drive amount DAsus_rd of the SUS actuator 59 is calculated according to the current tilt angle value TAnw of the vehicle 10 [DAsus_st * LOnw = DAsus_rd]. Thereby, when the vehicle 10 is in a tilted state exceeding the predetermined tilt angle threshold TAth1, the drive amount DAsus of the SUS actuator 59 is reduced as compared with the normal state when the vehicle 10 is not in the tilted state.
[0039] Further, when the determination unit 63 determines, after the transition to the VR mode, that there is a pedestrian (object) 60 in the monitoring area 62, the calculation unit 65 refers to the separation distance-output ratio table 68 shown in FIG. 4B and calculates the value LOnw of the output ratio according to the current separation distance value DTnw between the vehicle 10 and the pedestrian 60.
[0040] Here, the relationship characteristics of the separation distance-output ratio table 68 will be described. In the separation distance-output ratio table 68 shown in FIG. 4B, a fixed value of 0% is associated with the value LO of the output ratio for the range where the separation distance DT ranges from 0 to the first separation distance threshold DTth1 (0 =< DT =< DTth1). In the present embodiment, after the transition to the VR mode, when the separation distance DT falls within the range from 0 to the first separation distance threshold DTth1, the VR-ECU 51 adopts a configuration in which it interrupts the continuation of the VR mode, considering that there is a pedestrian (object) 60 in the monitoring area 62 and the risk of contact is high.
[0041] Also, a characteristic value that linearly increases from 0% to 100% is associated as the value LO of the output ratio for a range of values (DTth1 < DT <= DTth2) where the separation distance DT ranges from the first separation distance threshold DTAth1 to the second separation distance threshold DTth2. When adjusting the driving amount DAsus of the SUS actuator 59 using such characteristics, it acts so that the reduction degree related to the driving amount of the SUS actuator 59 increases as the separation distance DT becomes smaller. In addition, in this embodiment, when, after the transition to the VR mode, the separation distance DT falls within the range from the first separation distance threshold DTAth1 to the second separation distance threshold DTth2, the VR-ECU 51 determines that there is a pedestrian (object) 60 in the monitoring area 62 but the risk of contact is not very high, and adopts a configuration that permits the continuation of the VR mode on the condition that (the driving amount of the SUS actuator 59 is reduced).
[0042] And a fixed value of 100% is associated as the value LO of the output ratio for a range of values where the separation distance DT exceeds the second separation distance threshold DTth2 (DT > DTth2). In this embodiment, when the separation distance DT exceeds the second separation distance threshold DTth2, the VR-ECU 51 determines that there is no pedestrian (object) 60 in the monitoring area 62, and adopts a configuration that unconditionally permits the transition to the VR mode and the continuation of the VR mode.
[0043] Next, the calculation unit 65 multiplies the driving amount DAsus_st of the SUS actuator 59 in normal times when there is no pedestrian (object) 60 in the monitoring area 62 by the calculated value LOnw of the output ratio. In the calculation unit 65, the reduced driving amount DAsus_rd of the SUS actuator 59 is calculated according to the current value DTnw of the separation distance between the vehicle 10 and the pedestrian 60 [DAsus_st * LOnw = DAsus_rd]. Thereby, when there is a pedestrian (object) 60 in the monitoring area 62, the driving amount DAsus of the SUS actuator 59 is reduced compared to normal times when there is no pedestrian (object) 60 in the monitoring area 62. As a result, the contact risk of the vehicle 10 with respect to the pedestrian (object) 60 can be reduced.
[0044] Then, after the determination by the determination unit 63 after the transition to the VR mode results in a determination that the object 60 exists in the monitoring area 62, if a reversed determination that the existence information is not acquired is made, and if a determination is made that the blank time TM during which the existence information is not acquired exceeds a predetermined time length TMth, the calculation unit 65 calculates an output ratio value LOnw corresponding to the current blank time value TMnw with reference to the blank time-output ratio table 70 shown in FIG. 4C.
[0045] Here, the relationship characteristics of the blank time-output ratio table 70 will be described. In the blank time-output ratio table 70 shown in FIG. 4C, a fixed value of 0% is associated with the output ratio value LO for the value range (0 <= TM <= TMth1) where the integrated value TM of the blank time reaches from 0 to the first blank time threshold TMth1. In the present embodiment, when the presence / absence state in the VR mode changes from (present) to (absent) and the integrated value TM of the blank time belongs to the value range from 0 to the first blank time threshold TMth1, the VR-ECU 51 adopts a configuration in which it considers that the return to the VR mode is too early and waits for the return to the VR mode.
[0046] Also, a characteristic value that linearly increases gradually from 0% to 100% is associated with the output ratio value LO for the value range (TMth1 < TM <= TMth2) where the integrated value TM of the blank time reaches from the first blank time threshold TMAth1 to the second blank time threshold TMth2. In the present embodiment, when the presence / absence state in the VR mode changes from (present) to (absent) and the integrated value TM of the blank time comes to belong to the value range from the first blank time threshold TMAth1 to the second blank time threshold TMth2, the VR-ECU 51 adopts a configuration in which it considers that the preparation period for the return to the VR mode has arrived and gradually causes the return to the VR mode. As a result, the driving amount DAsus of the SUS actuator 59 is increased as the integrated value TM of the blank time becomes longer. This is because the risk of the vehicle 10 contacting a passerby (object) 60 can be reduced as the integrated value TM of the blank time becomes longer without reducing the driving amount DAsus of the SUS actuator 59.
[0047] A fixed value of 100% is associated as the output ratio value LO for the range (TM>TMth2) in which the integrated value TM of the blank time exceeds the second blank time threshold TMth2. In this embodiment, when the integrated value TM of the blank time falls into a range exceeding the second blank time threshold TMth2 after the presence / absence state in the VR mode is inverted from (present) to (absent), the VR-ECU 51 determines that the time to return to the VR mode has arrived, and performs a complete return to the VR mode.
[0048] Next, the calculation unit 65 multiplies the drive amount DAsus_st of the SUS actuator 59 in normal times when no object 60 is present in the monitoring area 62 by the calculated value LOnw of the output ratio. The calculation unit 65 calculates the drive amount DAsus_rd of the SUS actuator 59 after reduction (increase with respect to the initial value) according to the current integrated value TMnw of the blank time [DAsus_bn*LOnw=DAsus_rd]. As a result, when a determination is made that an object 60 is present in the monitored area 62, and then an inverted determination is made that the presence information is not to be acquired, and a determination is made that the integrated value TM of the blank time during which the presence information is not acquired exceeds a predetermined first blank time threshold value TMth1, the drive amount DAsus of the SUS actuator 59 is reduced (increased from the initial value) compared to normal times when no passerby (object) 60 is present in the monitored area 62.
[0049] The VR control unit 67 uses the drive amount DAsus of the SUS actuator 59 (including the drive amount DAsus_rd of the SUS actuator 59 after reduction) to independently control the drive of each of the multiple SUS actuators 59 .
[0050] The BRK-ECU 53, like the VR-ECU 51, belongs to the output system elements 15. The BRK-ECU 53 includes an information acquisition unit 71 and a braking control unit 73, as shown in FIG.
[0051] The BRK-ECU 53 generates braking fluid pressure (secondary fluid pressure) for applying a braking force to the vehicle 10 by driving a brake motor to operate a motor cylinder device (for example, see JP 2015-110378 A: not shown) depending on the level of braking fluid pressure (primary fluid pressure) generated in a master cylinder (not shown) by the driver's braking operation.
[0052] The BRK-ECU 53 is configured by a microcomputer equipped with a CPU (Central Processing Unit), a ROM (Read Only Memory), a RAM (Random Access Memory), etc. This microcomputer reads and executes programs and data stored in the ROM, and operates to control the execution of various functions of the BRK-ECU 53, including a function of acquiring various information and a function of controlling braking based on braking operations, etc.
[0053] The information acquisition unit 61 has the function of acquiring various information including information relating to the current vehicle speed detected by the vehicle speed sensor 23, and braking operation information relating to the amount of operation and depression torque of the brake pedal detected by the brake pedal sensor (both not shown).
[0054] The braking control unit 63 performs braking control of the vehicle 10 by operating the motor cylinder device through driving of the braking motor based on information related to the braking operation of the driver acquired via the brake pedal sensor.
[0055] The ENG-ECU 55, like the VR-ECU 51 and the BRK-ECU 53, belongs to the output system elements 15. The ENG-ECU 55 includes an information acquisition unit 75 and a drive control unit 77, as shown in FIG.
[0056] The ENG-ECU 55 has a function of controlling the drive of an internal combustion engine (not shown) based on information related to the driver's acceleration operation (amount of depression of the accelerator pedal) acquired via an accelerator pedal sensor (not shown), etc.
[0057] In detail, the ENG-ECU 55 controls the operation of the internal combustion engine by controlling a throttle valve (not shown) that adjusts the amount of air intake into the internal combustion engine, an injector (not shown) that injects fuel gas, and an ignition plug (not shown) that ignites the fuel.
[0058] The ENG-ECU 55 is configured by a microcomputer equipped with a CPU (Central Processing Unit), a ROM (Read Only Memory), a RAM (Random Access Memory), etc. This microcomputer reads and executes programs and data stored in the ROM, and operates to control the execution of various functions of the ENG-ECU 55, including a function of acquiring various information and a function of controlling the drive of the internal combustion engine.
[0059] The information acquisition unit 75 has a function of acquiring various information including acceleration / deceleration operation information relating to the amount of operation of the accelerator pedal detected by the accelerator pedal sensor.
[0060] The drive control unit 77 controls the drive of the internal combustion engine based on information related to the driver's acceleration operation (the amount of depression of the accelerator pedal) acquired via the accelerator pedal sensor.
[0061] The AV equipment 57 includes a display device, an audio device, an AV playback device, etc. The AV equipment 57 is driven by a VR control function of the VR-ECU 51.
[0062] The SUS actuator 59 is provided in each of the suspension devices 19a, 19b, 19c, 19d provided for each wheel of the vehicle 10. Each of the multiple SUS actuators 59 is arranged in parallel with a spring member (none shown) provided between the sprung member (vehicle body) and the unsprung member (wheels with tires mounted thereon, etc.) of the vehicle 10.
[0063] The SUS actuator 59 acts as a virtual damper that cushions the expansion and contraction force of the spring member when the vehicle 10 is traveling, and also plays a role in giving the occupants a sense of realism in the virtual space in scenes where VR services are provided by using the vehicle 10 as a motion platform.
[0064] The parking brake (PB) actuator 81 has a function of driving a PB provided in the vehicle 10. When the VR mode switch 37 is turned on by a passenger, the PB actuator 81 is driven to be turned on by the VR control function of the VR-ECU 51.
[0065] The door lock (DR) actuator 83 has a function of driving a DR provided in the vehicle 10. When the VR mode switch 37 is turned on by an occupant, the DR actuator 83 is driven to be on (doors are locked) by the VR control function of the VR-ECU 51.
[0066] The communication device 85 is used, for example, when acquiring required data and information from outside the vehicle 10 .
[0067] [Definitions of terms used in this specification] Here, the terms used in this specification are defined. The inclined state of the vehicle 10 refers to a parking posture that comprehensively includes a state in which the vehicle 10 is inclined in the vehicle length direction, a state in which the vehicle 10 is inclined in the vehicle width direction, and a combination of these inclined states. The "predetermined first inclination angle threshold TAth1" refers to a critical inclination angle at which it is considered that there is no risk of the vehicle 10 sliding down while the vehicle 10 is used as a motion platform to provide a VR service. The first inclination angle threshold TAth1 generally takes different values depending on the attributes of the vehicle 10, including the vehicle type, weight, and center of gravity. Therefore, the first inclination angle threshold TAth1 may be set to an appropriate value depending on the attributes of the vehicle 10, including the vehicle type, weight, and center of gravity. The "predetermined second inclination angle threshold TAth2" refers to a critical inclination angle at which the risk of the vehicle 10 sliding down while providing a VR service using the vehicle 10 as a motion platform is deemed high. The second inclination angle threshold TAth2, like the first inclination angle threshold TAth1, generally takes different values depending on the attributes of the vehicle 10, including the vehicle type, weight, and center of gravity. Therefore, the second inclination angle threshold TAth2 may be set to an appropriate value depending on the attributes of the vehicle 10, including the vehicle type, weight, and center of gravity.
[0068] [Operation of the virtual space production device 11 according to the embodiment] Next, the operation of virtual space production device 11 according to the embodiment will be described with reference to Fig. 5A and Fig. 5B. Fig. 5A and Fig. 5B are flow charts illustrating the operation of virtual space production device 11 according to the embodiment. It is assumed that the vehicle 10 is stopped and the VR mode switch 37 has been turned on by the occupant.
[0069] 5A, the VR-ECU 51 turns on the PB actuator 81 and the DR actuator 83. As a result, the vehicle 10 is maintained in the parked state and the doors are locked.
[0070] In step S13, the VR-ECU 51 checks whether or not the seat belt (SB) switch is on, that is, whether or not the occupant is restrained by fastening the seat belt.
[0071] If it is determined as a result of the investigation in step S13 that the occupant is not restrained by fastening the seat belt (No in step S13), the VR-ECU 51 advances the process to the next step S14. On the other hand, when it is determined as a result of the investigation in step S13 that the occupant is restrained by fastening the seat belt (Yes in step S13), the VR-ECU 51 causes the process to jump to step S15.
[0072] In step S14, the VR-ECU 51 issues a warning to the occupant to fasten the seat belt using the AV device 57. Thereafter, the process returns to step S13, and the subsequent processes are performed.
[0073] In step S15 , the information acquisition unit 61 of the VR-ECU 51 grasps the parking posture of the vehicle 10 based on the inclination information related to the inclination angle of the vehicle 10 detected by the inclination angle sensor 29 .
[0074] In step S16, the judgment unit 63 of the VR-ECU 51 judges, based on the inclination information related to the inclination angle TA of the vehicle 10 acquired by the information acquisition unit 61, whether or not the vehicle 10 is in an inclination state exceeding the first inclination angle threshold TAth1.
[0075] When it is determined in step S16 that the vehicle 10 is in a tilt state exceeding the first tilt angle threshold TAth1 (Yes in step S16), the VR-ECU 51 advances the flow of the process to the next step S17. On the other hand, if the result of the judgment in step S16 indicates that the vehicle 10 is not in an inclined state exceeding the first inclination angle threshold TAth1 (No in step S16), the VR-ECU 51 determines that there is no risk of the vehicle 10 rolling back even if the transition to the VR mode is permitted with respect to the parking posture of the vehicle 10, and jumps the processing flow to step S18.
[0076] In step S17, the VR-ECU 51 uses the AV device 57 to move the vehicle 10 onto a flat road, and then issues a warning to the occupant to restart the VR mode (by resetting the VR mode switch 37). Then, the series of processing flows is terminated.
[0077] In step S18, the information acquisition unit 61 of the VR-ECU 51 acquires monitoring information including the presence or absence of a passerby (object) 60 in the monitoring area 62 monitored by the periphery monitoring device 21.
[0078] In step S19, the determination unit 63 of the VR-ECU 51 determines, based on the monitoring information acquired by the information acquisition unit 61, whether or not a passerby (object) 60 is present in the monitoring area 62.
[0079] As a result of the determination in step S19, when it is determined that a passerby (object) 60 is present in the monitoring area 62 (Yes in step S19), the VR-ECU 51 advances the flow of the process to the next step S20. On the other hand, when it is determined in step S19 that no passerby (object) 60 is present in the monitoring area 62 (No in step S19), the VR-ECU 51 causes the process to jump to step S21.
[0080] In step S20, the VR-ECU 51 causes the AV equipment 57 to issue a warning that transition to the VR mode is rejected because a passerby (object) 60 is present in the monitoring area 62. Thereafter, the process flow returns to step S18, and the subsequent processes are performed.
[0081] In step S21, the VR-ECU 51 permits the transition to the VR mode, since it considers that there is no risk of contact between the vehicle 10 and the pedestrian (object) 60 even if the transition to the VR mode is permitted. This causes the vehicle 10 to be transformed into an entertainment facility that uses the vehicle 10 as a motion platform.
[0082] In step S22, the VR-ECU 51 continues providing the VR service while successively adjusting the drive amount of the SUS actuator 59 until the VR mode is interrupted / ended.
[0083] On the other hand, in the subroutine SUB (VR mode), in parallel with the processing of step S22, the VR-ECU 51 acquires monitoring information and determines whether or not an object is present, and sequentially calculates the drive amount of the SUS actuator 59 based on the object presence / absence determination result.
[0084] That is, in step S31 of the subroutine SUB (VR mode) shown in FIG. 5B, the information acquisition unit 61 of the VR-ECU 51 acquires monitoring information including the presence or absence of a passerby (object) 60 in the monitoring area 62 by the periphery monitoring device 21.
[0085] In step S32, the determination unit 63 of the VR-ECU 51 determines, based on the monitoring information acquired by the information acquisition unit 61, whether or not a passerby (object) 60 is present in the monitoring area 62.
[0086] If the result of the judgment in step S32 is that a passerby (object) 60 is present in the monitoring area 62 (the separation distance DT is less than or equal to the second separation distance threshold DTth2) (Yes in step S32), the VR-ECU 51 advances the processing to the next step S33. On the other hand, if the result of the judgment in step S32 is that there is no pedestrian (object) 60 in the monitoring area 62 (the separation distance DT exceeds the second separation distance threshold DTth2) (No in step S32), the VR-ECU 51 jumps the processing flow to step S34.
[0087] In step S33, the VR-ECU 51 calculates the drive amount DAsus of the SUS actuator 59 based on the result of the object presence / absence determination. Using the drive amount DAsus of the SUS actuator 59 calculated in this manner, the VR-ECU 51 continues providing the VR service in step S22 shown in FIG. 5A.
[0088] In step S33, the VR-ECU 51 calculates the drive amount DAsus of the SUS actuator 59 based on the object presence / absence determination result (while referring to the separation distance-output ratio table 68 shown in FIG. 4B). After that, the VR-ECU 51 returns the process flow to step S31, and causes subsequent processes to be performed until the VR mode is terminated, for example, by turning off the VR mode switch 37.
[0089] In step S34, the VR-ECU 51 judges whether the presence / absence state in the VR mode has been inverted from (present) to (not present). In step S34, it is assumed that after it has been judged in step S32 that the passerby 60 is present in the monitoring area 62 (Yes in step S32), it is judged that the passerby 60 is not present, and then it is judged that the presence / absence state in the VR mode has been inverted. It should be noted that the flowcharts shown in Figs. 5A and 5B are intended to provide an overview of the processing flow of the present invention.
[0090] If the result of the judgment in step S34 is that the presence / absence state in the VR mode has not been inverted from (present) to (absent) (No in step S34), the VR-ECU 51 returns the processing flow to step S31 and performs subsequent processing until the VR mode is terminated, for example, by turning off the VR mode switch 37. On the other hand, if the result of the judgment in step S34 is that the presence / absence state in the VR mode has been inverted from (present) to (not present) (Yes in step S34), the VR-ECU 51 advances the processing flow to the next step S35.
[0091] In step S35, the VR-ECU 51 sets the output ratio value LO to an initial value (0%).
[0092] In step S36, the VR-ECU 51 accumulates the blank time to obtain an accumulated value TM of the blank time.
[0093] In step S37, the VR-ECU 51 determines whether the integrated value TM of the blank time has exceeded a first blank time threshold value TMth1 (see FIG. 4C).
[0094] If it is determined in step S37 that the integrated value TM of the blank time does not exceed the first blank time threshold value TMth1 (No in step S37), the VR-ECU 51 returns the process flow to step S36 and loops the process of [step S36 ⇒ step S37] as long as the reversal of the presence / absence state in the VR mode continues (the non-existent state continues). The VR-ECU 51 causes the subsequent processes to be performed until the VR mode is ended by, for example, turning off the VR mode switch 37. On the other hand, if it is determined in step S37 that the integrated value TM of blank time exceeds the first blank time threshold value TMth1 (Yes in step S37), the VR-ECU 51 advances the process to the next step S38.
[0095] In step S38, the VR-ECU 51 calculates the drive amount DAsus of the SUS actuator 59 based on the integrated value TM of the blank time (while referring to the blank time-output ratio table 70 shown in FIG. 4C). At this time, the VR-ECU 51 reduces the drive amount DAsus of the SUS actuator 59 compared to a normal time when no pedestrian (object) 60 is present in the monitoring area 62 (increases it from the initial value). In short, the drive amount DAsus of the SUS actuator 59 increases (gradually increases) as the integrated value TM of the blank time increases. As the integrated value TM of the blank time increases, the risk of contact between the vehicle 10 and the pedestrian (object) 60 decreases, and therefore the need to suppress the drive amount DAsus of the SUS actuator 59 decreases. The increase in the drive amount DAsus of the SUS actuator 59 based on the integrated value TM of the blank time may be updated, for example, every time a predetermined time elapses during the section in which the blank time continues.
[0096] Thereafter, the VR-ECU 51 returns the process flow to step S31, and causes the subsequent processes to be performed until the VR mode is ended by, for example, turning off the VR mode switch 37.
[0097] [First Modification of Virtual Space Rendering Device 11] Next, a first modified example of virtual space presentation device 11 will be described with reference to Fig. 6A and Fig. 6B. Fig. 6A and Fig. 6B are diagrams for explaining the operation of the first modified example of virtual space presentation device 11 in the case where a passerby (object) 60 is present in monitoring area 62 of vehicle 10 after switching to the VR mode.
[0098] In a first variant of the virtual space presentation device 11, after switching to the VR mode, in the case where a passerby (object) 60 is present in the monitoring area 62 of the vehicle 10 as shown in FIG. 6A, the output ratio value LO for each of the multiple suspension devices 19a, 19b, 19c, 19d provided on the vehicle 10 is calculated based on the magnitude relationship between each of the multiple suspension devices 19a, 19b, 19c, 19d and the passerby (object) 60. In the example shown in FIGS. 6A and 6B, the separation distance DT1 between the left rear suspension device 19c of the vehicle 10 and the pedestrian (object) 60 is smaller than the separation distance DT2 between the right front suspension device 19b of the vehicle 10 and the pedestrian (object) 60 (DT1 <DT2)。 With reference to the separation distance-output ratio table 68 shown in FIG. 6B, the output ratio value LO1 corresponding to the separation distance DT1 is smaller than the output ratio value LO2 corresponding to the separation distance DT2 (LO1 <LO2)。 As a result, the drive amount DAsus of the SUS actuator 59 provided in the left rear suspension device 19c of the vehicle 10 is smaller than the drive amount DAsus of the SUS actuator 59 provided in the right front suspension device 19b of the vehicle 10. In short, according to the first modified example of the virtual space presentation device 11, the drive amount DAsus of the SUS actuator 59 provided in the suspension device 19c having a smaller separation distance DT from the pedestrian (object) 60 is reduced compared to the drive amount DAsus of the SUS actuator 59 provided in the suspension device 19b having a larger separation distance DT from the pedestrian (object) 60, thereby reducing the risk of the vehicle 10 coming into contact with the pedestrian (object) 60.
[0099] [Second Modification of Virtual Space Rendering Device 11] Next, a second modified example of virtual space production device 11 will be described with reference to FIG. 5A.
[0100] In the second modified example of the virtual space production device 11, in step S16 shown in Fig. 5A, the second tilt angle threshold TAth2 is applied as the determination threshold instead of the first tilt angle threshold TAth1. In short, the determination unit 63 of the VR-ECU 51 determines whether or not the vehicle 10 is in a tilt state exceeding the second tilt angle threshold TAth2, based on the tilt information related to the tilt angle TA of the vehicle 10 acquired by the information acquisition unit 61.
[0101] If the result of the judgment in step S16 is that the vehicle 10 is in an inclined state exceeding the second inclination angle threshold TAth2 (Yes in step S16), the VR-ECU 51 determines that there is a high risk of the vehicle 10 slipping down while providing VR services using the vehicle 10 as a motion platform, and proceeds to the next step S17. On the other hand, if the result of the judgment in step S16 indicates that the vehicle 10 is not in an inclined state exceeding the second inclination angle threshold TAth2 (No in step S16), the VR-ECU 51 determines that the risk of the vehicle 10 rolling back is relatively low with respect to the parking posture of the vehicle 10 even if transition to the VR mode is permitted, and jumps the processing flow to step S18.
[0102] In step S17, after the VR-ECU 51 moves the vehicle 10 onto a flat road using the AV device 57, it causes a warning to be issued to prompt the occupant to restart the VR mode (by resetting the VR mode switch 37). Then, the series of processing flow is terminated.
[0103] In steps S18 to S21, the VR-ECU 51 causes the same processing as in the above-described embodiment to be performed.
[0104] In step S22, the VR-ECU 51 continues to provide the VR service while sequentially adjusting the driving amount of the SUS actuator 59 until the VR mode is interrupted / ended. Here, it is known from the determination result of step S16 according to the second modification example that the vehicle 10 is not in an inclined state exceeding the second inclination angle threshold TAth2 (TA < TAth2).
[0105] Among these, when the inclination angle TA converges to a value range from 0 to the first inclination angle threshold TAth1 (0 <= TA <= TAth1), referring to the inclination angle-output ratio table 66 shown in FIG. 3B, a fixed value of 100% is associated as the value LO of the output ratio for the same value range (0 <= TA <= TAth1). Therefore, when the inclination angle TA converges to the same value range (0 <= TA <= TAth1), the VR-ECU 51 unconditionally permits the continuation of the VR mode without reducing the driving amount DAsus of the SUS actuator 59, considering that there is no risk of the vehicle 10 slipping downward.
[0106] On the other hand, when the inclination angle TA belongs to a value range from the first inclination angle threshold TAth1 to the second inclination angle threshold TAth2 (TAth1 < TA <= TAth2), a characteristic value that linearly decreases gradually from 100% to 0% is associated as the value LO of the output ratio for the same value range (TAth1 < TA <= TAth2). Therefore, when the tilt angle TA belongs to the same value range (TAth1 < TA <= TAth2), the VR-ECU 51 considers that the risk of the vehicle 10 slipping downward is not very high, and permits the continuation of the VR mode, subject to the condition of appropriately reducing the driving amount DAsus of the SUS actuator 59.
[0107] In step S22, the VR-ECU 51 continues to provide the VR service while sequentially adjusting the driving amount of the SUS actuator 59 based on the presence or absence of an object and the tilted posture of the vehicle 10 until the VR mode is interrupted / ended.
[0108] According to the second modification of the virtual space presentation device 11, since the driving amount DAsus of the SUS actuator 59 provided in the suspension device 19c is adjusted according to the parking posture of the vehicle 10, the risk of the vehicle 10 slipping downward can be reduced, and the effect of suppressing the contact risk of the vehicle 10 with respect to the pedestrian (object) 60 accompanying the downward movement of the vehicle 10 can be further enhanced.
[0109] 〔Other Embodiments〕 The plurality of embodiments described above are examples of the implementation of the present invention. Therefore, the technical scope of the present invention should not be limitedly interpreted by these. This is because the present invention can be implemented in various forms without departing from the gist or its main features.
[0110] For example, in the embodiment of the present invention, in order to suppress the contact risk of the vehicle 10 with respect to the pedestrian (object) 60, a configuration in which the driving amount DAsus of the SUS actuator 59 provided in the suspension device 19b is reduced has been exemplified and described. However, the present invention is not limited to this example. For example, instead of or in addition to the configuration in which the driving amount DAsus of the SUS actuator 59 provided in the suspension device 19b is reduced, the contact risk of the vehicle 10 with respect to the pedestrian (object) 60 may be suppressed by suppressing the high-frequency band among the frequency characteristics regarding the driving pattern of the SUS actuator 59.
[0111] In the embodiment of the present invention, the operation control according to the present invention is performed using the VR-ECU 51 that functions independently of other ECUs, but the present invention is not limited to this example. An integrated ECU that integrates multiple functions may be used to perform the operation control according to the present invention.
[0112] Furthermore, when performing the operational control of the present invention using the integrated ECU, a configuration may be adopted in which software capable of executing the operational control of the present invention, which is stored in an external server (not shown), is downloaded via communication device 75 into a memory provided in the integrated ECU and executed, thereby performing the operational control of the present invention using the integrated ECU. [Explanation of symbols]
[0113] 10 Vehicles (moving objects) 11 Virtual space production device 21 Periphery monitoring device 29 Inclination sensor 51 VR-ECU (control unit) 57 AV equipment 59 SUS actuator (actuator) 61 Information Acquisition Department 63 Judgment section 65 Calculation section 67 VR control unit (control unit)
Claims
1. A virtual space production device comprising: AV equipment for providing audiovisual (AV) information to a passenger of a moving body; an actuator for generating a load related to vibration of the moving body; and a control unit for controlling the AV equipment and the actuator, the virtual space production device producing a simulated experience for the passenger in a virtual space by driving the AV equipment and the actuator when providing a virtual reality service (VR service) using the moving body in a stopped state, The moving body is a four-wheeled vehicle, The actuator has a function of assisting the expansion and contraction of a suspension device provided for each of the four wheels, an information acquisition unit that acquires tilt information related to a tilt state of the vehicle; a determination unit that determines whether or not the vehicle is in a tilt state exceeding a predetermined tilt angle threshold based on the tilt information acquired by the information acquisition unit, When the determination unit determines that the vehicle is in an inclined state exceeding a predetermined inclination angle threshold, the control unit reduces an extension / contraction drive amount of at least the actuator among the AV equipment and the actuator, related to the provision of the VR service, compared to a normal time when the vehicle is not in an inclined state. A virtual space production device characterized by:
2. The virtual space production device according to claim 1, When the vehicle is in an inclined state exceeding a predetermined inclination angle threshold, the control unit reduces an expansion / contraction drive amount of an actuator on a lower side in a tilt direction of the suspension device compared to an expansion / contraction drive amount of an actuator on an upper side in the tilt direction. A virtual space production device characterized by:
Citation Information
Patent Citations
Virtual reality producing device, virtual reality production controller, and virtual reality production control program
JP2006047478A
Control device of vehicle
JP2016168875A
Virtual reality system
JP2017102401A
Method and system for controlling vehicle body motion and occupant experience
JP2019218055A
Method and system for controlling vehicle body motion and occupant experience
JP2021113046A
