Vehicle development support system

Abstract

Provided is a vehicle development support system that makes it possible to, without producing an actual device, evaluate the operational sensation of an operator of an operation device together with the behavior of vehicle-mounted equipment accompanying the operator operation.　This vehicle development support system comprises a conversion-to-video device for generating a video including an operation device to be mounted in a vehicle, a virtual operation device for displaying the video including the operation device that has been generated by the conversion-to-video device and outputting an operation signal corresponding to pseudo-operation input by an operator in relation to the displayed operation device video, an ECU for outputting a control signal for controlling vehicle-mounted equipment in response to the operation signal, a real-time simulator for simulating the behavior of the vehicle-mounted equipment according to the control signal and outputting the simulation results to the conversion-to-video device and ECU, and a synchronization device for synchronizing communication for inputting the simulation results of the real-time simulator into the ECU and communication for inputting the control signal into the real-time simulator. The conversion-to-video device updates the video including the operation device according to the simulation results of the real-time simulator.　

Description

[Technical Field]

[0001] The present invention relates to a vehicle development support system that supports the development of a vehicle. [Background technology]

[0002] BACKGROUND ART Conventionally, a vehicle planning support system is known that displays a vehicle model (exterior model and interior model) on a screen and evaluates the vehicle model through a driving simulation in a virtual space (see Patent Document 1 below). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Patent No. 4666209 Summary of the Invention [Problem to be solved by the invention]

[0004] The operating feel of vehicle-equipped operating devices varies depending on their layout and configuration, so sensory evaluation is an important part of vehicle development. However, creating various actual devices and conducting sensory evaluations at the planning and design stages of development is costly and time-consuming.

[0005] In contrast, the above-mentioned conventional technology aims to reduce the cost and time required for evaluation by providing evaluators with images of a virtual space and a vehicle model. However, when it comes to operating devices such as steering wheels and pedals, the evaluation only visually evaluates their layout and dimensions through images, and does not allow for a physical evaluation of the operating feel of the operating devices. Furthermore, while the above-mentioned conventional technology performs driving simulations, it does not support simulations of the operation of in-vehicle devices or vehicle behavior associated with inputs from operating devices, making it difficult to properly evaluate the operation of the operating devices and the associated operation of the in-vehicle devices. For this reason, the above-mentioned conventional technology makes it difficult to evaluate the operator's operating feel of operating devices equivalent to real devices together with the associated operation of the in-vehicle devices.

[0006] In view of the problems with the conventional technology, the present invention aims to provide a vehicle development support system that can evaluate the operator's operating feel for an operating device together with the operation of on-board equipment associated with that operation, without having to produce an actual device. [Means for solving the problem]

[0007] In order to solve these problems, a vehicle development support system in one embodiment of the present invention has a visualization device that generates an image including an operating device mounted on a vehicle, a virtual operating device that displays an image including the operating device generated by the visualization device and outputs an operation signal in response to a pseudo-operation input by an operator to the displayed image of the operating device, an ECU that outputs a control signal for controlling in-vehicle equipment in response to the operation signal, a real-time simulator that simulates the operation of the in-vehicle equipment in response to the control signal and outputs the simulation results to the visualization device and the ECU, and a synchronization device that synchronizes communication for inputting the simulation results of the real-time simulator to the ECU and communication for inputting the control signal to the real-time simulator, and the visualization device updates the image including the operating device in response to the simulation results of the real-time simulator. [Effects of the Invention]

[0008] In the vehicle development support system according to one embodiment of the present invention, it is possible to evaluate the operator's operational feel for an operating device together with the operation of in-vehicle equipment that accompanies that operation, without producing an actual device. [Brief explanation of the drawings]

[0009] [Figure 1] 1 is an explanatory diagram showing a system configuration of a vehicle development support system according to an embodiment of the present invention; [Figure 2] FIG. 2 is a block diagram showing the signal flow of the vehicle development support system. [Figure 3] FIG. 2 is a block diagram showing the signal flow of the vehicle development support system. [Figure 4] FIG. 1 is a sequence diagram showing signal processing in one control cycle for each part in the vehicle development support system. [Figure 5] FIG. 2 is a block diagram showing an example of the configuration of a virtual operation device in the vehicle development support system. [Figure 6] FIG. 2 is an explanatory diagram showing an example of a pseudo-operation input in the virtual space of the virtual operation device. [Figure 7] FIG. 10 is an explanatory diagram showing another example of pseudo operation input in the virtual space of the virtual operation device. [Figure 8] FIG. 2 is an explanatory diagram showing the positional relationship between the virtual space of the virtual operating device and the actual operating device. DETAILED DESCRIPTION OF THE INVENTION

[0010] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, embodiments of the present invention will be described with reference to the drawings. In the following description, the same reference numerals in different drawings denote parts with the same functions, and duplicated descriptions in each drawing will be omitted as appropriate.

[0011] A vehicle development support system 1 according to an embodiment of the present invention includes a visualization device 30 that generates an image including an operating device mounted on a vehicle, a virtual operating device 10 that displays an image including the operating device generated by the visualization device 30 and outputs an operation signal corresponding to a pseudo-operation input by an operator to the displayed image of the operating device, an ECU 2 that outputs a control signal for controlling in-vehicle equipment based on the operation signal, a real-time simulator 20 that simulates the operation of the in-vehicle equipment based on the control signal and outputs the simulation results to the visualization device 30 and the ECU 2, and a synchronization device 4 that synchronizes communication for inputting the simulation results of the real-time simulator 20 to the ECU 2 and communication for inputting the control signal to the real-time simulator 20, and the visualization device 30 updates the image including the operating device based on the simulation results of the real-time simulator 20.

[0012] 1, a vehicle development support system 1 according to an embodiment of the present invention is configured as a closed-loop system involving an operator (person) M sitting in a cockpit C. In this vehicle development support system 1, the cockpit C in which the operator M sits is installed in a frame 1M.

[0013] The vehicle development support system 1 includes an ECU (Electronic Control Unit) 2 mounted on a vehicle and on-board devices 3 controlled by the ECU 2. While the example shown in FIG. 1 includes multiple ECUs 2 and multiple on-board devices 3, it is also possible to specify an evaluation target and include a single ECU 2 and a single on-board device 3. Selected or all of the multiple ECUs 2 and multiple on-board devices 3 become evaluation targets. The multiple ECUs 2 in the vehicle development support system 1 are connected to each other so as to be able to communicate with each other via a communication line L1 of an on-board network (for example, a CAN (Controller Area Network)), just like in an actual vehicle.

[0014] The vehicle development support system 1 includes a virtual operation device 10. The virtual operation device 10 matches the position coordinates of the operation device of the in-vehicle device 3 installed in the frame body 1M with the coordinate system of the virtual space, allowing the operator M to virtually operate the operation device in the virtual space while actually touching the operation device installed in the frame body 1.

[0015] According to this virtual operation device 10, an image of an operation device mounted on a vehicle is displayed in a virtual space for the operator M to view, and an operation signal is output as a pseudo-operation input to the operation device in the virtual space that matches the operation of the real operation device. The output operation signal is transmitted to the ECU 2 and the in-vehicle device 3 described above. Furthermore, the virtual operation device 10 installs the vehicle's operation mechanisms (steering operation mechanism, accelerator operation mechanism, brake operation mechanism, shift operation mechanism, and switches for operating the in-vehicle device 3) in the virtual space in correspondence with the operation devices installed in the frame 1M. In this case, the operation devices installed in the frame 1M may be those that simulate the shape of the installed operation device, and it is even more preferable if they simulate the texture and feel of the device.

[0016] The vehicle development support system 1 includes one or more virtual ECUs 2V as needed. The virtual ECU 2V replaces the actual ECU (real ECU) installed in a real vehicle and simulates the electronic control behavior (electronic control function) of the real ECU when installed in the vehicle, and can be configured using a general-purpose controller such as a rapid control prototyping (RCP) controller or a PC. By configuring an ECU under development with this virtual ECU 2V, it is possible to evaluate the cooperation of ECUs throughout the vehicle even during development. The virtual ECU 2V is one form of the ECU 2, and unless otherwise distinguished from the real ECU, the ECU 2 described below will include the virtual ECU 2V.

[0017] The vehicle development support system 1 includes a real-time simulator 20. The real-time simulator 20 can be configured by a computer including multiple processors and a memory storing programs executed by the processors. The real-time simulator 20 calculates physical state quantities that operate the on-vehicle device 3 based on control signals output from the ECU 2 (real ECU) or the virtual ECU 2V, and simulates the operation of the on-vehicle device 3 as well as the vehicle behavior associated with the operation of the on-vehicle device 3.

[0018] The software configuration of the real-time simulator 20 includes a vehicle motion calculation unit (vehicle motion calculation model) 21 that calculates the physical state quantities of the on-board equipment and vehicle to be controlled and outputs simulation results, an exterior environment calculation unit (exterior environment calculation model) 22 that calculates the exterior environment that affects the vehicle behavior and reflects it in the simulation results, and an event generation unit (event generation model) 23 that generates an event in the exterior environment and reflects it in the simulation results.

[0019] The vehicle development support system 1 includes a visualization device 30. The visualization device 30 is configured with a computer that processes image information, and transmits images of the vehicle interior, including images of the operating devices mounted on the actual vehicle, to the virtual operation device 10. The visualization device 30 also updates the images in accordance with the simulation results of the real-time simulator 20 and transmits the updated images to the virtual operation device 10.

[0020] The visualization device 30 generates video information based on the simulation results of the real-time simulator 20 and allows the operator M to view the generated video information via the virtual operation device 10, and is equipped with a video information generation unit 31 which is a program that operates the processor of the visualization device 30 to generate video information, and a video display output unit 32 which is a program that operates the processor of the visualization device 30 to output the generated video information.

[0021] The vehicle development support system 1 includes a synchronization device 4 that synchronizes communication for inputting the simulation results of the real-time simulator 20 to the ECU 2 with communication for inputting control signals from the ECU 2 to the real-time simulator 20 .

[0022] The synchronization device 4 is an interface that synchronously connects the communication line L1 on the ECU 2 side with the communication line L2 on the real-time simulator 20 side, and the process of the ECU 2 transmitting a control signal and the process of the real-time simulator 20 transmitting a simulation result can be synchronized via this synchronization device 4. Note that one ECU 2 and another ECU 2 provided in the vehicle development support system 1 are communicably connected to each other via the communication line L1 of the in-vehicle network (for example, CAN), so that they can communicate with each other in a synchronized manner.

[0023] Some of the on-board equipment 3 to be mounted on a vehicle is arranged in a frame 1M of the vehicle development support system 1. The on-board equipment 3 arranged in the frame 1M includes various sensors and actuators that operate the equipment.

[0024] In the vehicle development support system 1, for example, on-board equipment of the powertrain system can be omitted from the framework 1M. However, in the vehicle development support system 1, the ECUs that control all on-board equipment to be installed in the actual vehicle, including the on-board equipment omitted from the framework 1M, can be arranged using the ECU2 (actual ECU) and the virtual ECU2V.

[0025] The following describes the signal flow in such a vehicle development support system 1. Figure 2 shows a case where an on-vehicle device 3 controlled by an ECU 2 to be evaluated is mounted in a frame 1M. The on-vehicle device 3 here includes an actuator 3A that operates the device and a sensor 3B that detects the operation of the actuator 3A.

[0026] 2, when an operator M performs a pseudo operation input a on the virtual operation device 10, the virtual operation device 10 inputs an operation signal b to the ECU 2 to be evaluated. Depending on the type of the in-vehicle device 3, the operation signal b is input to the in-vehicle device 3, which causes an actuator 3A to operate, and a detection signal c from a sensor 3B that detects the operation is input to the ECU 2 as an input signal.

[0027] The ECU 2 performs arithmetic processing according to the input signal and outputs a control signal d. At this time, a closed loop is formed between the ECU 2 and the in-vehicle device 3, in which the actuator 3A operates in response to the control signal d, the sensor 3B detects this operation and transmits a detection signal c to the ECU 2, and the ECU 2 outputs the control signal d based on the detection signal c.

[0028] Furthermore, between ECU2 and another ECU2', a closed loop is formed in which the control signal d output by ECU2 is transmitted to the other ECU2', the other ECU2' performs arithmetic processing according to the control signal d and transmits a control signal e to ECU2, and ECU2 transmits a control signal d based on the control signal e to ECU2'.

[0029] Between the ECU 2 and the real-time simulator 20, a control signal d is transmitted to the real-time simulator 20 via the synchronizer 4, and the real-time simulator 20 performs calculation processing (such as vehicle motion calculation processing) according to the control signal d, and the simulation result f, which is the physical state quantity that operates the on-board equipment 3 and the vehicle, is transmitted to the ECU 2 via the synchronizer 4.

[0030] At this time, the control signal d of the ECU 2 to be evaluated is processed and output according to the operation signal b, the detection signal c, the control signal e, and the simulation result f, and the simulation result f of the real-time simulator 20 reflects the operation of the virtual operation device 10, the operation of the ECU 2, the operation of the in-vehicle equipment 3, and the operation of other ECUs 2'.

[0031] In addition, the other ECU2' here can be configured as an ECU2 to which another operation signal b is input, and in this case, the simulation result f of the real-time simulator 20 is sent to the other ECU2' as well as to the ECU2, and a control signal e is sent from the other ECU2' to the real-time simulator 20.

[0032] 3 shows a case where the in-vehicle device controlled by the ECU 2 to be evaluated is not installed in a frame 1M. In this case, when an operation signal b associated with a pseudo-operation input a from an operator M is input from the virtual operation device 10 to the ECU 2 to be evaluated, the ECU 2 outputs a control signal d, which is then transmitted to another ECU 2' and also to the real-time simulator 20 via the synchronizer 4. As described above, a closed loop is formed between the ECU 2 and the other ECU 2' in which a control signal e is fed back in response to the transmission of the control signal d. Similarly, a closed loop is formed between the ECU 2 and the real-time simulator 20 in which a simulation result f is fed back in response to the transmission of the control signal d. As described above, the other ECU 2' in this case can also be configured to receive the operation signal b and the simulation result f as input.

[0033] 4 shows signal processing for one control cycle of each system configuration in the vehicle development support system 1. Here, the ECU 2 and real-time simulator 20 are communicatively connected via a synchronizer 4, thereby synchronizing the processing for each control cycle. That is, the ECU 2 and real-time simulator 20 are capable of transmitting and receiving synchronized signals, just like other ECUs connected to the ECU 2 via an in-vehicle network (e.g., CAN).

[0034] In each control cycle, ECU2 determines whether or not operation signal b was input in the previous control cycle (step S10), and if operation signal b was not input in the previous control cycle, it skips the following steps and ends the current control cycle.

[0035] Furthermore, ECU2 determines whether or not a detection signal c was input from sensor 3B in the previous control cycle (step S12), and if a detection signal c was input, calculates a control signal d based on the detection signal c (step S13), and if a detection signal c was not input, skips step S13.

[0036] Furthermore, the ECU 2 determines whether or not a simulation result f has been input from the real-time simulator 20 in the previous control cycle (step S14), and if a simulation result f has been input, it calculates a control signal d based on the simulation result f (step S15), and if a simulation result f has not been input, it skips step S15.

[0037] Then, when the ECU 2 calculates the control signal d for one control cycle, it transmits the calculated control signal d to the in-vehicle device 3 and the real-time simulator 20, and ends the processing of one control cycle.

[0038] In response to this, when the control signal d is transmitted from the ECU 2, the in-vehicle device 3 operates the actuator 3A in accordance with the control signal d (step S01), detects the operating state of the actuator 3A with the sensor 3B, and transmits the detection signal c to the ECU 2 (step S02).

[0039] On the other hand, in a control cycle synchronized with the processing of the ECU 2 described above, the real-time simulator 20 determines whether or not there has been a change in the settings (step S20). If there has been a change in the settings, the outside-vehicle environment calculation unit 22 performs outside-vehicle environment calculation processing (step S21). If there has been no change in the settings, the initial settings or the previous settings are maintained (step S24).

[0040] Next, the real-time simulator 20 determines whether or not there is an event generation instruction (step S22). If there is an event generation instruction, calculation processing for the event generation is performed (step S23). If there is no event generation instruction, step S23 is skipped.

[0041] The real-time simulator 20 also determines whether or not a control signal d has been received (step S25), and if it has been received, performs vehicle motion calculations according to the control signal d (step S26), but if it has not been received, skips step S26. The real-time simulator 20 then transmits the simulation result f calculated in one control cycle to the ECU 2 (step S27), and ends the current control cycle.

[0042] In this way, the ECU 2 and the real-time simulator 20 perform processing in control cycles that are synchronized with each other. In contrast, the visualization device 30 does not necessarily perform processing that is synchronized with each control cycle of the ECU 2 or the real-time simulator 20, but synchronizes the control signal d output by the ECU 2 that reflects the simulation result f with the video display output of the visualization device 30 at a predetermined timing that provides a sense of realism with respect to the input timing of the pseudo operation input a.

[0043] Specifically, when the visualization device 30 receives the simulation result f transmitted from the real-time simulator 20 (step S30), the image information generation unit 31 generates image information (step S31), and the image display output unit 32 outputs an image signal to the virtual operation device 10 (step S32). At this time, by performing the image output (step S32) every time the control cycle of the ECU 2 or the real-time simulator 20 is performed multiple times, the image output of the visualization device 30 can be synchronized with the output timing of the control signal d.

[0044] According to the vehicle development support system 1 configured as above, by connecting the ECU 2 and the real-time simulator 20 via the synchronizer 4, the real-time simulator 20 is put into a state where it simulates the sensors and ECUs connected to the in-vehicle network, and output information of the sensors and ECUs that can only be obtained by actually driving the vehicle can be generated as a simulation result f of the real-time simulator 20 and uploaded to the in-vehicle network. This simulates the situation in which the vehicle is actually driving, operates the ECU 2 and in-vehicle devices 3 by operating the virtual operation device 10, and reflects the operating states in real time on video, allowing the operating performance of the ECU 2 and in-vehicle devices 3 to be evaluated while viewing the video.

[0045] 5 shows an example of the configuration of the virtual operation device 10 and the visualization device 30. The virtual operation device 10 includes a sensor unit 10A made up of various sensors, an information processing unit 10B made up of one or more processors, a head-mounted display 10D, and an operation device (including the operation unit of the in-vehicle device 3) that the operator M actually touches and operates. The operation device that the operator M actually touches and operates may be one that generates a signal, or one that does not generate a signal.

[0046] The sensor unit 10A includes an eye gaze sensor (eye gaze detection device 10A1) that detects the eye gaze of the operator M, an input action sensor (action detection device 10A2) that detects the movement of the hands, etc. of the operator M, and transmits information on the direction of the eye gaze and the movement of the hands, etc. of the operator M to the information processing unit 10B. The sensor unit 10A and the head-mounted display 10D can be integrated into one unit.

[0047] The information processing unit 10B is equipped with an input action determination unit 10B1 and an image generation unit 10B2 as a program for arithmetic processing of information sent from the sensor unit 10A, and generates an image corresponding to the direction in which the gaze of the operator M is facing, and synthesizes an input image accompanying the movement of a hand or the like into the image, and performs input action determination to output an operation signal b based on that movement. Note that, although an example in which the operation signal b is output based on the movement of the image has been shown here, the operation signal b may also be output based on the movement of an actual operation device installed in the frame body 1M.

[0048] In addition to the components described above, the visualization device 30 also includes an image database 10C. The image database 10C stores image data necessary for the information processing unit 10B to generate images. This image data includes a vehicle interior image database 10C1 that allows images of the vehicle interior of the development vehicle (vehicle interior images) to be changed in various settings, and an operation device image database 10C2 that allows images of various operation devices (operation device images) mounted on the development vehicle to be changed in various settings. As described above, the visualization device 30 updates the images in accordance with the simulation results f of the real-time simulator 20, and at that time, it retrieves images of the operation devices from the image database 10C.

[0049] The head-mounted display 10D is worn on the head of the operator M, allowing the operator to view the image generated by the information processing unit 10B and the virtual space. By wearing the head-mounted display 10D and viewing the image generated by the information processing unit 10B, the operator M views, in the virtual space, an image of the operating device equipped in the development vehicle and an image of the vehicle interior of the development vehicle, and also views an input image that simulates the movement of the operator M's hands and the like detected by the sensor unit 10A (motion detection device).

[0050] In this case, the image of the virtual space displayed on the head-mounted display 10D has the same spatial coordinates as the actual operating devices installed around the cockpit C, so the sensation of operating the actual operating device overlaps with the sensation of pseudo-operating the operating device displayed in the virtual space, giving the operator M the sensation of actually operating the operating device in the virtual space. Here, it is preferable that the display of the virtual space be stereoscopically viewed with parallax provided. This allows the operator M to recognize the virtual space as a three-dimensional real space, increasing the sense of reality of the sensation described above, and giving the operator M the sensation of being in a real vehicle and operating it.

[0051] The information processing unit 10B of the virtual operation device 10 receives the output of the visualization device 30, i.e., the image of the simulation result f of the real-time simulator 20. The input image of the simulation result f is synthesized with the image of the virtual operation device 10 in correspondence with the operation signal b output by the virtual operation device 10, and is output to the head-mounted display 10D.

[0052] In this case, the image displayed on the head-mounted display 10D can only be viewed by the operator M alone, but by displaying the image displayed on the head-mounted display 10D on a display 33 such as a flat panel display, the image viewed by the operator M can be viewed by multiple evaluators, allowing the information for evaluation to be shared.

[0053] 6, the virtual operation device 10 of the vehicle development support system 1 displays a composite image of an image F of the simulation result f described above, an image of the vehicle interior G, and an image P of an operation device such as an accelerator pedal 11, a steering wheel 12, a brake pedal 13, a shift lever 14, and a center panel 15. In addition, an input image H showing a pseudo operation input a of the operator M is displayed compositely with the above-mentioned images as an image with movement that matches the hand movement of the pseudo operation input a.

[0054] According to this virtual operation device 10, when an operator M performs a pseudo operation input a, in the virtual space viewed by the operator M, the input image H performs a movement simulating the operation in response to the pseudo operation input a, and the operation device image P moves in response to this movement, thereby outputting an operation signal b. Here, as described above, the ECU 2 and real-time simulator 20 perform processing in control cycles synchronized with each other, and the video output of the visualization device 30 is synchronized with the control cycle of the real-time simulator 20 to an extent that a sense of realism can be achieved, and similarly, the video display output of the visualization device 30 and the output of the operation signal b of the virtual operation device 10 are synchronized at a predetermined timing to an extent that a sense of realism can be achieved.

[0055] As a result, the pseudo operation input a gives the operator M the feeling of operating the operation device displayed in the virtual space, and the operator M can evaluate the operation feel of the operation device to be installed in the development vehicle through the pseudo operation in the virtual space. Figure 6 shows an example of the pseudo operation input a in which the operator operates the steering wheel 12 with the right hand while touching the center panel with the index finger of the left hand.

[0056] 7 shows an example in which the steering wheel 12 or the shift lever 14 is operated by the pseudo operation input a. When a driving operation to run the vehicle is performed by such a pseudo operation input a, the image F of the simulation result f is an image simulating the vehicle behavior corresponding to that operation, as described above. This allows the operator M to experience the situation of driving the vehicle by viewing the image F, while also experiencing the feeling of operating the installed operating devices.

[0057] In this case, the operation device image P and vehicle interior image G to be displayed in the virtual space can be appropriately selected from the image database 10C and displayed as images to be installed in the development vehicle, so that the settings of the operation device and vehicle interior that affect the operation evaluation can be made in parallel at the planning and development stage when the operation evaluation of the ECU 2 and the in-vehicle equipment 3 is being performed. In addition, the operation device image P and vehicle interior image G are displayed as images that correspond to the line of sight of the operator M, so that evaluation at the planning and development stage can be performed with more realistic images.

[0058] 8 shows the positional relationship between the virtual space of the virtual operation device 10 and the actual operation devices installed in the frame 1M. As described above, the position coordinates in the virtual space match the position coordinates of the operation device including the actual in-vehicle equipment 3 installed in the frame 1M. In the illustrated example, the positions of the images of the operation device image P, such as the accelerator pedal 11, steering wheel 12, brake pedal 13, shift lever 14, and center panel 15, displayed in the virtual space correspond to the models of the operation devices installed in the frame 1M (accelerator pedal model 11', steering wheel model 12', brake pedal model 13', shift lever model 14', and center panel model 15').

[0059] In this case, for example, models of operating devices that generate electrical signals include an accelerator pedal model 11', a steering wheel model 12', a brake pedal model 13', a shift lever model 14', as well as wipers, window opening and closing, side mirrors, etc. These models can be created using a 3D printer or the like, and do not need to be immobile as long as they are not the subject of the motion evaluation.

[0060] As models of operating devices to be installed in the frame 1M, models that do not generate electrical signals include a model 15' of a center panel (touch panel), as well as various electrical switches such as air conditioner control switches. In this case, the operation of the center panel 15 can be evaluated by transitioning images in the virtual space.

[0061] In this way, according to the vehicle development support system 1 of the present invention, the operating device realized within the frame body 1M can be a model, which reduces production time and costs, and by overlaying the operating feel of this model with simulated operating input to an operating device in a virtual space whose three-dimensional positional relationship with the model is consistent, it is possible to achieve a sensory evaluation of the HMI (Human Machine Interface) for a new operating device of a vehicle being developed.

[0062] As described above, the vehicle development support system 1 according to the embodiment of the present invention can evaluate the operation of the ECU 2 and the in-vehicle devices 3 at the planning and design stage of vehicle development, while also evaluating the operability of the operating devices mounted on the vehicle under development and the fit of the vehicle interior. This makes it possible to decide on the direction of development and identify issues at an early stage in vehicle development, thereby effectively supporting vehicle development.

[0063] Although the embodiments of the present invention have been described in detail above with reference to the drawings, the specific configurations are not limited to these embodiments, and the present invention also includes design changes within the scope of the present invention. Furthermore, the above-described embodiments can be combined by utilizing each other's technologies as long as there are no particular contradictions or problems in their purposes, configurations, etc. [Explanation of symbols]

[0064] 1: Vehicle development support system, 1M: Frame, 2: ECU, 2V: Virtual ECU, 3: On-board equipment, 3A: Actuator, 3B: Sensor, 4: Synchronous device, 10: Virtual operation device, 11: Accelerator pedal, 11': Accelerator pedal model, 12: Steering wheel, 12': Steering wheel model, 13: Brake pedal, 13': Model of brake pedal, 14: Shift lever, 14': Shift lever model, 15: Center panel, 15': Model of center panel, 20: Real-time simulator, 21: Vehicle motion calculation unit, 22: Outside vehicle environment calculation unit, 23: Event generation unit, 30: Visualization device, 31: Video information generation unit, 32: Video display output unit, 33: Display, M: Operator, C: Cockpit, L1, L2: Communication line, P: Image of the control device, F: Video, G: Image inside the vehicle, H: Input image

Claims

1. an imaging device that generates an image including an operating device mounted on a vehicle; a virtual operation device that displays an image including the operation device generated by the imaging device and outputs an operation signal corresponding to a pseudo operation input by an operator to the displayed image of the operation device; an ECU that outputs a control signal for controlling an in-vehicle device in response to the operation signal; a real-time simulator that simulates the operation of the in-vehicle device based on the control signal and outputs the simulation results to the imaging device and the ECU; a synchronization device that synchronizes communication for inputting the simulation result of the real-time simulator to the ECU with communication for inputting the control signal to the real-time simulator; the visualization device updates a video including the operation device in accordance with a simulation result of the real-time simulator, thereby reflecting, in the video, an operation of the in-vehicle device resulting from the pseudo-operation input; A vehicle development support system characterized in that the operating device simulates the shape or texture of an actual device to be installed in a development vehicle.

2. The position coordinates of the operation device displayed on the virtual operation device in the virtual space are the same as the position coordinates of the actual operation device that the operator can actually touch in the pseudo-operation input by the operator.

2. The vehicle development support system according to claim 1.

3. the virtual operation device has a motion detection device that detects a motion of an operator, and detects a pseudo-operation input by the operator using the motion detection device; 3. The vehicle development support system according to claim 1, wherein the action detection device detects the operator's line of sight and displays a vehicle interior image corresponding to the detected line of sight.

4. 4. The vehicle development support system according to claim 1, further comprising a display device that allows a plurality of people to view an image of the simulation result synthesized with an image of the virtual operation device.

5. 5. The vehicle development support system according to claim 1, wherein the real-time simulator calculates an external environment that affects vehicle behavior and reflects the calculated environment in the simulation results.

6. 6. The vehicle development support system according to claim 5, wherein said real-time simulator generates an event in response to an external environment of the vehicle and reflects the event in the simulation results.

7. 7. The vehicle development support system according to claim 1, wherein the ECU is mounted on a frame having a cockpit in which an operator sits.

Images