On-vehicle device and on-vehicle control program

Abstract

To provide an on-vehicle device and an on-vehicle control program which can improve operability of an occupant to a function of a vehicle.SOLUTION: When an own-vehicle image 30 and a perimeter monitoring image are displayed as a perimeter monitoring display on a multi-media display, a receiving part of a multi-media ECU receives, as predetermined operation, touch operation to the own-vehicle image 30. When the receiving part receives the touch operation to the own-vehicle image 30, an executing part controls an advanced operation support ECU so that an adaptive cruise control function is activated as one example of predetermined processes.SELECTED DRAWING: Figure 7

Description

[Technical Field]

[0001] The present invention relates to an in-vehicle device and an in-vehicle control program. [Background technology]

[0002] Patent document 1 proposes superimposing a first image simulating another vehicle and a second image simulating a target trajectory on a third image simulating a road on which the vehicle is located, and when displaying the second image, it proposes highlighting, among multiple sections into which the target trajectory is divided in the longitudinal direction, the first section which is closer to the vehicle than the reference vehicle that was referenced when generating the target trajectory, compared to the second section which is further back from the vehicle than the reference vehicle. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Patent No. 7048398 Summary of the Invention [Problem to be solved by the invention]

[0004] The perimeter monitoring display as in Patent Document 1 displays surrounding targets such as other vehicles, but does not allow for operation of functions of the vehicle such as driving assistance functions in association with the perimeter monitoring display. In particular, it is cumbersome to operate each of the multiple vehicle functions using different devices and methods, and there is room for improvement in operability.

[0005] The present invention has been made in consideration of the above circumstances, and has an object to provide an in-vehicle device and an in-vehicle control program that can improve the operability of vehicle functions by the occupant. [Means for solving the problem]

[0006] The vehicle-mounted device according to the first aspect includes a display control unit that displays a surrounding monitoring image on a display unit provided in the vehicle together with an image of the vehicle itself that resembles the vehicle based on the detection results of a detection unit that detects targets around the vehicle, a reception unit that receives operations performed by an occupant of the vehicle on the display unit, and an execution unit that causes each unit of the vehicle to execute predetermined processing related to the functions of the vehicle in accordance with the operations received by the reception unit.

[0007] According to the first aspect, the display control unit displays the surroundings monitoring image on the display unit provided in the vehicle together with an image of the host vehicle that resembles the vehicle, based on the detection result of the detection unit that detects targets around the vehicle.

[0008] The receiving unit receives predetermined vehicle occupant operations on the display unit, and the executing unit performs predetermined processing related to the vehicle functions in accordance with the operations received by the receiving unit. This allows the occupant to operate the vehicle's functions, such as the driving assistance function, on the surroundings monitoring display, thereby improving the occupant's operability of the vehicle functions.

[0009] The in-vehicle device of the second aspect is the in-vehicle device of the first aspect, wherein the execution unit executes a driving assistance function or an autonomous driving function, which performs part or all of at least one of vehicle operation and operation assistance, as the predetermined processing.

[0010] According to the second aspect, it is possible to execute a driving assistance function or an automatic driving function on the periphery monitoring display.

[0011] The in-vehicle device of the third aspect is the in-vehicle device of the first or second aspect, wherein the execution unit changes the settings of a driving assistance function or an autonomous driving function that performs part or all of at least one of vehicle operation and operation assistance as the predetermined processing.

[0012] According to the third aspect, it is possible to change settings such as on / off of the driving assistance function or the automatic driving function on the periphery monitoring display.

[0013] The in-vehicle device according to the fourth aspect is an in-vehicle device according to any one of the first to third aspects, wherein when the receiving unit receives a touch operation on the image of the vehicle itself, the execution unit executes a preceding vehicle following function as the predetermined processing.

[0014] According to the fourth aspect, the preceding vehicle following function can be activated on the surroundings monitoring display.

[0015] The in-vehicle device according to the fifth aspect is an in-vehicle device according to any one of the first to fourth aspects, wherein when the receiving unit receives a slide operation of the image of the vehicle in the forward or backward direction, the execution unit executes control of acceleration or deceleration of the vehicle as the predetermined processing.

[0016] According to the fifth aspect, it is possible to intuitively operate instructions to accelerate or decelerate the vehicle on the periphery monitoring display.

[0017] The in-vehicle device according to the sixth aspect is an in-vehicle device according to any one of the first to fifth aspects, wherein when the receiving unit receives a slide operation of the image of the vehicle to the right or left, the execution unit executes a lane change assistance function to the right or left as the predetermined processing.

[0018] According to the sixth aspect, the lane change assist function can be intuitively operated on the periphery monitoring display.

[0019] The in-vehicle device of the seventh aspect is an in-vehicle device of any one of the first to sixth aspects, wherein when the receiving unit receives a touch operation on an image of a lane boundary line, the execution unit changes the settings of the lane departure prevention function as the predetermined processing.

[0020] According to the seventh aspect, it is possible to change settings such as on / off of the lane departure prevention function on the periphery monitoring display.

[0021] An in-vehicle device according to an eighth aspect is an in-vehicle device according to any one of the first to seventh aspects, wherein when the receiving unit receives a touch operation on the front end of the image of the vehicle, the execution unit changes the settings of an automatic headlight control function as the predetermined processing.

[0022] According to the eighth aspect, it is possible to change settings such as on / off of the automatic headlamp control function on the periphery monitoring display.

[0023] In a ninth aspect of the in-vehicle device, in the in-vehicle device of any one of the first to eighth aspects, when the reception unit receives a slide operation to the image of the vehicle itself or an image of a preceding vehicle that imitates a preceding vehicle in front of the vehicle, or a slide operation to a distance image that represents the distance between the vehicle and the preceding vehicle, while the preceding vehicle following function is operating, the execution unit adjusts the distance between the vehicles as the predetermined processing.

[0024] According to the ninth aspect, it is possible to specify the inter-vehicle distance on the periphery monitoring display while the preceding vehicle following function is in operation.

[0025] The in-vehicle device according to a tenth aspect is an in-vehicle device according to any one of the first to ninth aspects, wherein when the receiving unit receives a slide operation of a trajectory that imitates a preceding vehicle ahead of the vehicle and overtakes an image of the preceding vehicle, the execution unit executes overtaking of the preceding vehicle as the predetermined processing.

[0026] According to the tenth aspect, an instruction to overtake the leading vehicle can be intuitively operated on the periphery monitoring display.

[0027] An in-vehicle device according to an eleventh aspect is an in-vehicle device according to any one of the first to tenth aspects, wherein when the receiving unit receives a pinch operation on the display unit, the execution unit enlarges or reduces the image displayed on the display unit in accordance with the pinch operation as the predetermined processing.

[0028] According to the eleventh aspect, the area can be enlarged or reduced on the perimeter monitoring display in an intuitive manner.

[0029] The in-vehicle device according to the 12th aspect is an in-vehicle device according to any one of the first to 11th aspects, wherein when the receiving unit receives a single touch operation on the image of the vehicle, a touch operation on the display unit for a predetermined period of time or longer, or two touch operations within a predetermined period of time, the execution unit enlarges and displays the image displayed on the display unit as the predetermined processing.

[0030] According to the twelfth aspect, it is possible to easily perform an operation for enlarging the display on the periphery monitoring display.

[0031] The in-vehicle device of a thirteenth aspect is an in-vehicle device of any one of the first to twelfth aspects, wherein when the receiving unit receives a rotating touch operation on the display unit, the execution unit rotates the surrounding monitoring image displayed on the display unit as the predetermined processing.

[0032] According to the thirteenth aspect, it is possible to easily give an instruction to rotate the periphery monitoring image displayed on the periphery monitoring display.

[0033] The in-vehicle device of a 14th aspect is an in-vehicle device of any one of the first to 13th aspects, wherein when the receiving unit receives touch operations at multiple points on the display unit, the execution unit changes the angle of view of the image displayed on the display unit as the predetermined processing.

[0034] According to the fourteenth aspect, it is possible to change the angle of view of the image displayed on the periphery monitoring display.

[0035] In a 15th aspect of the in-vehicle device, in the in-vehicle device of any one of the first to fourteenth aspects, when the receiving unit receives a touch operation on a surrounding vehicle image representing a surrounding vehicle of the vehicle while the preceding vehicle following function is operating, the execution unit sets the surrounding vehicle corresponding to the touch operation as the preceding vehicle to be followed by the vehicle as the predetermined processing.

[0036] According to the fifteenth aspect, it is possible to set a leading vehicle to be followed on the periphery monitoring display.

[0037] The in-vehicle device of the 16th aspect is an in-vehicle device of any one of the 1st to 15th aspects, wherein when the execution unit receives a touch operation on the image of the vehicle when the shift position of the vehicle is in a parking position, the execution unit displays a customization screen for customizing predetermined functions of the vehicle as the predetermined processing.

[0038] According to the sixteenth aspect, it is possible to instruct a transition to a customized screen on the periphery monitoring display.

[0039] The vehicle-mounted device according to a 17th aspect is an in-vehicle device according to any one of the first to sixteenth aspects, wherein when the receiving unit receives a touch operation on the display unit while the parking assistance function of the vehicle is operating, the execution unit sets, as the predetermined processing, a position corresponding to the touch operation as the parking position of the vehicle in the parking assistance function.

[0040] According to the seventeenth aspect, it is possible to specify the parking position of the vehicle in the parking assistance function on the periphery monitoring display.

[0041] The in-vehicle control program of the 18th aspect causes a computer to display a surrounding monitoring image on a display unit provided in the vehicle together with an image of the vehicle that resembles the vehicle based on the detection results of a detection unit that detects targets around the vehicle, accept operations performed by an occupant of the vehicle on the display unit, and perform predetermined processing related to the functions of the vehicle on each part of the vehicle in accordance with the accepted operations.

[0042] According to the 18th aspect, it is possible to operate functions of the vehicle, such as driving assistance functions, on the surrounding monitoring display, thereby providing an in-vehicle device and an in-vehicle control program that can improve occupant operability of vehicle functions. [Effects of the Invention]

[0043] As described above, according to the present invention, it is possible to provide an in-vehicle device and an in-vehicle control program that can improve the operability of vehicle functions for the occupant. [Brief explanation of the drawings]

[0044] [Figure 1] 1 is a diagram showing an outline of the interior of a vehicle equipped with an in-vehicle device according to an embodiment of the present invention; [Figure 2] FIG. 2 is a block diagram showing the configuration of a control system of the in-vehicle device according to the present embodiment. [Figure 3] 2 is a block diagram showing the configuration of the main parts of the electrical systems of a meter ECU, a multimedia ECU, and an advanced driving assistance ECU in the in-vehicle device according to the present embodiment. FIG. [Figure 4] FIG. 10 is a diagram showing an example of a periphery monitoring display. [Figure 5] FIG. 10 is a diagram showing another example of a perimeter monitoring display. [Figure 6] FIG. 2 is a functional block diagram showing the functional configuration of a multimedia ECU. [Figure 7] FIG. 10 is a diagram for explaining an example of a predetermined process performed by an execution unit of a multimedia ECU of the in-vehicle device according to the present embodiment. [Figure 8] 4 is a flowchart showing an example of the flow of processing performed by a multimedia ECU of the in-vehicle device according to the present embodiment. [Figure 9] FIG. 10 is a diagram showing a state of a slide operation on an image of the host vehicle. [Figure 10] 10A and 10B are diagrams illustrating touch operations on lane boundary lines such as white lines; [Figure 11] FIG. 10 is a diagram showing a touch operation on the front end of the image of the host vehicle. [Figure 12] 10 is a flowchart showing an example of a modified example of the flow of processing performed by the multimedia ECU of the in-vehicle device according to the embodiment. [Figure 13] 10A and 10B are diagrams illustrating a sliding operation of a trajectory in which an image of a leading vehicle overtakes an image of the host vehicle. [Figure 14]10A and 10B are diagrams showing a state of a slide operation on a vehicle distance image showing a vehicle distance to a preceding vehicle. [Figure 15] 10A and 10B are diagrams illustrating other examples of operations accepted on the periphery monitoring display and examples of processing corresponding to the operations in the in-vehicle device according to the present embodiment. [Figure 16] 10A and 10B are diagrams showing examples of conditional operations that are accepted on the periphery monitoring display and examples of processing corresponding to the operations in the in-vehicle device according to the present embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0045] An example of an embodiment of the present invention will be described in detail below with reference to the drawings. Fig. 1 is a diagram showing an outline of the interior of a vehicle equipped with an on-board device according to this embodiment. Note that the arrow UP shown in Fig. 1 indicates the upper side in the vertical direction of the vehicle, and the arrow RH indicates the right side in the width direction of the vehicle. In the following description, the vertical direction and the left-right direction refer to the up and down in the vertical direction of the vehicle and the left and right in the width direction of the vehicle, respectively.

[0046] 1, an instrument panel 70 is provided at the front of the passenger compartment of a vehicle 10. A windshield glass 74 is provided at the front end of the instrument panel 70. The windshield glass 74 extends in the vertical and lateral directions of the vehicle, and separates the interior and exterior of the passenger compartment.

[0047] The right end of the windshield glass 74 is fixed to a front pillar 76 on the right side of the vehicle. The front pillar 76 extends in the vertical direction of the vehicle, and the windshield glass 74 is fixed to the inner end in the vehicle width direction of the front pillar 76. The left end of the windshield glass 74 is fixed to a front pillar on the left side of the vehicle (not shown).

[0048] The instrument panel 70 extends in the vehicle width direction, and a steering wheel 72 is provided on the right side of the instrument panel 70. That is, in this embodiment, as an example, a right-hand drive vehicle is used in which the steering wheel 72 is provided on the right side, and the driver's seat is located on the right side of the vehicle.

[0049] A display 14, which is an example of a display unit, is provided in a position corresponding to the front of the steering wheel 72 on the instrument panel 70, and a multimedia display 15, which is another example of a display unit, is provided in the center of the instrument panel 70. The display 14 and the multimedia display 15 are, for example, configured with a touch panel including a liquid crystal display, and display the vehicle's running status, the operating status of driving assistance devices, etc., and also accept touch operations.

[0050] Next, a description will be given of the configuration of the control system of the in-vehicle device 12 according to this embodiment. Fig. 2 is a block diagram showing the configuration of the control system of the in-vehicle device 12 according to this embodiment.

[0051] The in-vehicle device 12 according to this embodiment includes a meter ECU (Electronic Control Unit) 16, a multimedia ECU 17, a driving condition detection sensor 18, a surrounding conditions monitoring device 20 as an example of a detection unit, and an advanced driving assistance ECU 22, each of which is connected to a vehicle network 24.

[0052] The meter ECU 16 is connected to a display 14 and controls the display 14 to display a plurality of meters, monitor the vehicle periphery, and display various vehicle information. If an abnormality or the like occurs in the vehicle, the meter ECU 16 notifies the occupants by displaying the abnormality on the display 14. Examples of the various vehicle information displayed on the display 14 include the operating status of driving assistance devices, etc. The display mode of the display 14 can be switched by a switch (not shown) or the like, and can be changed to a display mode according to the driver's preference.

[0053] The multimedia ECU 17 is connected to the multimedia display 15 and controls the multimedia display 15 to display information such as the results of monitoring the surroundings of the vehicle, map images, and setting screens for various vehicle functions.

[0054] The driving condition detection sensor 18 detects the driving condition of the vehicle 10. The driving condition detection sensor 18 includes at least one of various sensors such as a vehicle speed sensor, an acceleration sensor, a gyro sensor, an accelerator opening sensor, and a brake sensor.

[0055] The surrounding condition monitoring device 20 detects information indicating the surrounding environment of the vehicle, and includes at least one device selected from various devices such as a GPS (Global Positioning System) device, an in-vehicle communication device, a navigation system, a radar device, an ultrasonic sensor, and a camera.

[0056] The advanced driving assistance ECU 22 has a function of acquiring surrounding information detected by the surrounding condition monitoring device 20, providing the surrounding information to other ECUs, and controlling the steering and braking as necessary. For example, when the driving state detection sensor 18 detects an accelerator release and the surrounding condition monitoring device 20 detects a preceding vehicle, intersection, etc., the advanced driving assistance ECU 22 controls the brakes to assist deceleration. Specifically, the advanced driving assistance ECU 22 controls various driving assistance functions, such as an adaptive cruise control function as an example of a preceding vehicle following function that controls acceleration and deceleration by following the preceding vehicle in accordance with changes in its speed, a lane tracing assist function that warns of the possibility of lane or road deviation and partially assists with steering to avoid deviation from the lane or road, and a lane change assist function as an example of a lane change assist function that partially assists with steering required for lane changes. Note that the preceding vehicle following function is not limited to the adaptive cruise control function and may be another preceding vehicle following function. Furthermore, the lane change function is not limited to the lane change assist function and may be another lane change function. Furthermore, the driving assistance function is not limited to the above, and various other driving assistance functions may be applied.

[0057] 3 is a block diagram showing the configuration of the main parts of the electrical systems of the meter ECU 16, the multimedia ECU 17, and the advanced driving assistance ECU 22 in the on-board device 12 according to this embodiment. Note that the meter ECU 16, the multimedia ECU 17, and the advanced driving assistance ECU 22 basically have the configuration of a general computer, so the meter ECU 16 will be described here as a representative.

[0058] The meter ECU 16 is configured by a general microcomputer including a CPU (Central Processing Unit) 16A, a ROM (Read Only Memory) 16B, a RAM (Random Access Memory) 16C, a storage 16D, an interface (I / F) 16E, and a bus 16F.

[0059] The CPU 16A is a central processing unit that executes various programs to control the overall operation of the device. The ROM 16B pre-stores various control programs, such as a vehicle display program, and various parameters. The RAM 16C is used as a work area when the CPU 16A executes the various programs. The storage 16D is composed of various storage units, such as a hard disk drive (HDD), a solid state drive (SSD), and a flash memory, and stores various data and application programs. The I / F 16E is connectable to the vehicle network 24 and transmits and receives various data to and from other ECUs, such as the meter ECU 16, connected to the vehicle network 24. The above-described components of the meter ECU 16 are electrically connected to each other via a bus 16F. In this embodiment, the vehicle display program is described as being stored in the ROM 16B, but it may also be stored in the storage 16D.

[0060] In this embodiment, an SA (Situation Awareness) view display (periphery monitoring display) that displays the vehicle situation around the vehicle is possible on at least one of the display 14 and the multimedia display 15. The surroundings monitoring display displays an image of the host vehicle that resembles the host vehicle, as well as target images that represent targets (e.g., vehicles such as a leading vehicle) that exist around the host vehicle and are detected by the traveling state detection sensor 18 and the surroundings monitoring device 20, thereby informing the occupant of the situation around the host vehicle.

[0061] FIG. 4 is a diagram showing an example of a periphery monitoring display, and FIG. 5 is a diagram showing another example of a periphery monitoring display.

[0062] As an example of the periphery monitoring display, a host vehicle image 30 and a periphery monitoring image are displayed as shown in Fig. 4. As the periphery monitoring image, a leading vehicle image 34 simulating a vehicle leading the vehicle 10 and a surrounding vehicle image 36 simulating vehicles surrounding the vehicle 10 are displayed as examples of target images, along with white lines 32 indicating the driving lane, etc. The leading vehicle image 34 and the surrounding vehicle image 36 are displayed based on information from an ultrasonic sensor such as a clearance sonar as the surrounding situation monitoring device 20, for example.

[0063] As another example of the periphery monitoring display, as shown in Fig. 5, an overhead image including a target image showing a target present at the actual traveling position may be displayed as the periphery monitoring image, and the host vehicle image 30 may be displayed within the overhead image. The overhead image may include, for example, a crosswalk image 38, a traffic light image 40, a median strip image 42, a sign image 44, and an image 36 of a surrounding vehicle such as a truck or a motorcycle. The overhead image may be displayed using information from a radar device or a camera as the surrounding situation monitoring device 20. The example of the periphery monitoring display in Fig. 5 also shows an example in which guidance is displayed simultaneously, and a guidance image 46 and a guidance lane 48 are displayed within the overhead image.

[0064] Here, a functional configuration will be described, which functions when the CPU 16A, 17A of at least one of the meter ECU 16 and the multimedia ECU 17, which perform the periphery monitoring display, executes a program stored in the ROM 16B, 17B. Since the functional configurations of the meter ECU 16 and the multimedia ECU 17 are the same, the multimedia ECU 17 will be described below as a representative. Figure 6 is a functional block diagram showing the functional configuration of the multimedia ECU 17.

[0065] As shown in FIG. 6, the multimedia ECU 17 has the functions of a display control unit 25, a reception unit 26, and an execution unit 28, as a result of the CPU 17A executing a program stored in the ROM 17B.

[0066] The display control unit 25 displays a surroundings monitoring image on the multimedia display 15 together with the host vehicle image 30 based on the detection result of the target object around the vehicle 10 detected by the surroundings monitoring device 20.

[0067] The accepting unit 26 accepts a predetermined operation on the multimedia display 15. For example, a touch operation on the vehicle image 30 is accepted.

[0068] The execution unit 28 causes each part of the vehicle 10 to execute predetermined processing related to the functions of the vehicle 10 in response to the operation received by the reception unit 26. In this embodiment, the execution unit 28 controls the advanced driving assistance ECU 22 to perform processing such as activation of various driving assistance functions as the predetermined processing.

[0069] For example, as shown in FIG. 7, when the vehicle image 30 and the surrounding monitoring image are displayed on the multimedia display 15 as a surrounding monitoring display, the multimedia ECU 17 receives a touch operation on the vehicle image 30 as a predetermined operation through the reception unit 26.

[0070] When the receiving unit 26 receives a touch operation on the host vehicle image 30, the executing unit 28 controls the advanced driving assistance ECU 22 to activate an adaptive cruise control function as an example of predetermined processing. Note that Fig. 7 is a diagram for explaining an example of predetermined processing performed by the executing unit 28 of the multimedia ECU 17 of the in-vehicle device 12 according to this embodiment. Here, the predetermined processing is described as being performed by the multimedia ECU 17, but it may also be performed by the meter ECU 16.

[0071] Next, a process performed by the multimedia ECU 17 of the in-vehicle device 12 according to this embodiment and configured as described above will be described. Fig. 8 is a flowchart showing an example of the flow of the process performed by the multimedia ECU 17 of the in-vehicle device 12 according to this embodiment. The process of Fig. 8 starts, for example, when a predetermined operation to start a perimeter monitoring display is performed. Furthermore, although the process of Fig. 8 will be described below as a process performed by the multimedia ECU 17, it may also be a process performed by the meter ECU 16.

[0072] In step 100, the CPU 17A detects surrounding targets and proceeds to step 102. In this embodiment, the CPU 17A detects surrounding targets by acquiring the detection results of the traveling state detection sensor 18 and the detection results of the surrounding situation monitoring device 20.

[0073] In step 102, the CPU 17A displays the host vehicle image 30 and the surroundings monitoring image on the multimedia display 15, and then proceeds to step 104. For example, as shown in FIG. 4, the host vehicle image 30 is displayed, and target images such as a leading vehicle image 34 and a surrounding vehicle image 36 are displayed as the surroundings monitoring image, thereby performing a surroundings monitoring display.

[0074] In step 104, the CPU 17A determines whether or not an operation has been performed on the vehicle image 30. For example, the determination is made by determining whether or not a touch operation has been performed on the vehicle image 30. If the determination is negative, the process proceeds to step 108, and if the determination is affirmative, the process proceeds to step 106.

[0075] In step 106, the CPU 17A executes predetermined processing and proceeds to step 108. The predetermined processing may control the advanced driving assistance ECU 22 to execute a driving assistance function or an automated driving function that performs at least a part or all of vehicle operation and / or operation assistance, or may change the setting of the driving assistance function or the automated driving function that performs at least a part or all of vehicle operation and / or operation assistance. For example, the predetermined processing may change the on / off setting of an active cruise control function as an example of an automated driving function, or a lane departure prevention function that prevents the vehicle from leaving its lane as an example of a driving assistance function (e.g., a lane departure alert (LDA) function that issues a lane departure warning, or a function that not only issues a lane departure warning but also provides steering assistance). Alternatively, the predetermined processing may execute a lane change assist (LCA) function or an overtaking function as an example of a lane change assistance function that assists the vehicle in changing lanes. As a more specific example of the predetermined processing, for example, the advanced driving assistance ECU 22 may be controlled to switch the operation of the adaptive cruise control function on or off, as described above. In addition, in an autonomously driven vehicle, as shown in FIG. 9, predetermined processing may be executed in response to a slide operation on the host vehicle image 30. For example, when a slide operation on the host vehicle image 30 in the forward direction (upward in FIG. 9) is received, the vehicle may accelerate, and when a slide operation on the host vehicle image 30 in the backward direction (downward in FIG. 9) is received, the vehicle may decelerate. This allows intuitive operation of instructions to accelerate or decelerate the vehicle 10 on the periphery monitoring display. Furthermore, when a slide operation on the host vehicle image 30 in the left direction in FIG. 9 is received, the lane change assist function in the left direction may be activated, and when a slide operation on the host vehicle image 30 in the right direction is received, the lane change assist function in the right direction may be activated. This allows intuitive operation of the lane change assist function on the periphery monitoring display. Furthermore, as shown in FIG. 10, when a touch operation on a lane boundary line such as a white line 32 is received, the setting of the lane departure alert function may be changed as predetermined processing. This makes it possible to change settings such as on / off of the lane departure alert function on the periphery monitoring display.Furthermore, as shown in FIG. 11 , when a touch operation on the front edge of the host vehicle image 30 is received, the settings of the automatic headlight control function may be changed as a predetermined process. This makes it possible to change settings such as turning the automatic headlight control function on and off on the perimeter monitoring display. The automatic headlight control function may include a function to automatically switch between high beam, low beam, and parking lights, a function to prevent dazzling only oncoming vehicles even when the high beam is on, and a function to automatically switch the headlight direction. For example, an automatic high beam function may be applied that not only turns the high beam on and off but also automatically switches between high beam, low beam, and parking lights.

[0076] In step 108, the CPU 17A determines whether to end the periphery monitoring display. This determination is made by determining whether an instruction to operate another function, such as an air conditioning operation or an audio operation, has been issued. If the determination is negative, the process returns to step 100 and the above-described processing is repeated. If the determination is positive, the series of processing is terminated and processing to perform the instructed function is started.

[0077] By performing the processing in this manner, it becomes possible to operate the functions of the vehicle, such as the driving assistance function, on the surroundings monitoring display, thereby improving convenience.

[0078] Next, a modified example of the processing performed by the multimedia ECU 17 of the in-vehicle device 12 according to this embodiment will be described. Fig. 12 is a flowchart showing an example of the flow of the modified example of the processing performed by the multimedia ECU 17 of the in-vehicle device 12 according to this embodiment. The processing in Fig. 12 starts, for example, when a predetermined operation to start a perimeter monitoring display is performed.

[0079] In step 200, the CPU 17A detects surrounding targets and proceeds to step 202. In this embodiment, the CPU 17A detects surrounding targets by acquiring the detection results of the traveling state detection sensor 18 and the detection results of the surrounding situation monitoring device 20.

[0080] In step 202, the CPU 17A displays the host vehicle image 30 and the surroundings monitoring image on the multimedia display 15, and then proceeds to step 204. For example, as shown in Fig. 4, the host vehicle image 30 is displayed, and target images such as a leading vehicle image 34 and a surrounding vehicle image 36 are displayed as the surroundings monitoring image, thereby performing a surroundings monitoring display.

[0081] In step 204, the CPU 17A determines whether or not an operation has been performed on the vehicle image 30. For example, the determination is made by determining whether or not a touch operation has been performed on the vehicle image 30. If the determination is negative, the process proceeds to step 212, and if the determination is affirmative, the process proceeds to step 206.

[0082] In step 206, the CPU 17A determines whether or not the active cruise control (ACC) is operating. If the determination is negative, the process proceeds to step 208, and if the determination is affirmative, the process proceeds to step 210.

[0083] In step 208, the CPU 17A activates the adaptive cruise control (ACC) and then proceeds to step 212.

[0084] On the other hand, in step 210, the CPU 17A performs processing according to the received operation and proceeds to step 212. For example, when a sliding operation in the up / down direction in FIG. 9 is received on the host vehicle image 30 or the leading vehicle image 34, the processing according to the received operation controls the advanced driving assistance ECU 22 to adjust the inter-vehicle distance according to the direction of the sliding operation. This enables the specification of the inter-vehicle distance while the adaptive cruise control function is operating. Alternatively, when a sliding operation in the left / right direction in FIG. 9 is received on the host vehicle image 30, the advanced driving assistance ECU 22 controls the lane change in the direction corresponding to the sliding direction. This allows intuitive operation of the lane change assist function on the periphery monitoring display. Alternatively, as shown in FIG. 13, when a sliding operation of the host vehicle image 30 along a trajectory to overtake the leading vehicle image 34 is received, the advanced driving assistance ECU 22 controls the advanced driving assistance ECU 22 to perform control to overtake the leading vehicle. This allows intuitive operation of an instruction to overtake the leading vehicle on the periphery monitoring display. Alternatively, as shown in Fig. 14, when a slide operation is received on the inter-vehicle image 50 showing the distance between the vehicle 10 and the preceding vehicle, a process of adjusting the inter-vehicle distance is performed according to the direction of the slide operation. Specifically, as shown in the upper part of Fig. 14, when a slide operation is received to move the inter-vehicle image 50 from in front to the side of the host vehicle image 30, the inter-vehicle distance is adjusted to shorten the inter-vehicle distance. On the other hand, as shown in the lower part of Fig. 14, when a slide operation is received to move the inter-vehicle image 50 in the forward direction of the host vehicle image 30, the inter-vehicle distance is adjusted to lengthen the inter-vehicle distance. This makes it possible to specify the inter-vehicle distance on the periphery monitoring display while the adaptive cruise control function is operating.

[0085] In step 212, the CPU 17A determines whether to end the periphery monitoring display. This determination is made by determining whether an instruction to operate another function, such as an air conditioning operation or an audio operation, has been issued. If the determination is negative, the process returns to step 200 and the above-described processing is repeated. If the determination is positive, the series of processing is terminated and processing to perform the instructed function is started.

[0086] In this way, even in the modified example, it is possible to operate functions of the vehicle, such as driving assistance functions, on the surroundings monitoring display, thereby improving convenience.

[0087] Next, other operation examples accepted on the periphery monitoring display and processing examples corresponding to the operations will be described in the in-vehicle device 12 according to this embodiment. Fig. 15 is a diagram showing other operation examples accepted on the periphery monitoring display and processing examples corresponding to the operations in the in-vehicle device 12 according to this embodiment.

[0088] When a pinch operation, in which two fingers are pinched together, is received on the perimeter monitoring display, the displayed image may be enlarged or reduced in accordance with the pinch operation. For example, when a pinch out operation, in which two fingers are touched apart as shown in FIG. 15 , is received on the perimeter monitoring display, the displayed image may be enlarged in accordance with the amount of movement of the two fingers. This allows an area to be enlarged intuitively on the perimeter monitoring display, improving operability. Alternatively, when a pinch in operation, in which two fingers are touched together as shown in FIG. 15 , is received on the perimeter monitoring display, the displayed image may be reduced in accordance with the amount of movement of the two fingers. This allows an area to be reduced intuitively on the perimeter monitoring display, improving operability. Furthermore, the enlargement or reduction by the focus operation may be centered on the host vehicle image 30, or may be centered on the point where the fingers are detected.

[0089] Furthermore, as shown in FIG. 15 , when a single touch operation on the host vehicle image 30, a long-press touch operation on the host vehicle image 30 for a predetermined period of time or longer, or a double tap (two touch operations within a predetermined period of time) is received on the periphery monitoring display, the image displayed with the host vehicle image 30 at the center may be enlarged. This makes it possible to easily perform an enlarged display operation on the periphery monitoring display. Alternatively, when a touch operation on the host vehicle image 30 is received on the periphery monitoring display, it may be received as a menu display instruction and a predetermined menu screen may be displayed. This makes it possible to display the menu screen from the periphery monitoring display, improving operability.

[0090] 15, when a touch operation of rotating a finger is received on the periphery monitoring display, the displayed host vehicle image 30 and periphery monitoring image may be rotated in the direction of the finger rotation, allowing a 360-degree view. This makes it possible to easily issue a rotation command for the image displayed on the periphery monitoring display, improving operability.

[0091] Furthermore, as shown in FIG. 15, when a touch operation (multi-touch operation) using two fingers or the like at multiple locations is received on the perimeter monitoring display, the angle of view of the displayed image may be changed. For example, when a touch operation of sliding two fingers up or down is received, the angle of view of the image may be changed in a direction corresponding to the sliding direction and displayed. To change the angle of view, for example, the angle from which the host vehicle image 30 is viewed downward may be changed to display the host vehicle image 30 and the perimeter monitoring image. Alternatively, the display range of the displayed perimeter monitoring image may be changed. This makes it possible to easily change the angle of view of the image displayed on the perimeter monitoring display, improving operability.

[0092] Furthermore, an example of a conditional operation accepted on the periphery monitoring display and an example of a process corresponding to the operation will be described. Fig. 16 is a diagram showing an example of a conditional operation accepted on the periphery monitoring display and an example of a process corresponding to the operation in the in-vehicle device 12 according to this embodiment.

[0093] For example, as shown in Fig. 16, when a touch operation on a surrounding vehicle image 36 is received on the perimeter monitoring display while adaptive cruise control (ACC) is operating, the surrounding vehicle corresponding to the touch operation may be set as a preceding vehicle that the vehicle 10 follows using the active cruise control function. For example, the preceding vehicle is set by transmitting an instruction to set the surrounding vehicle corresponding to the touch operation as a preceding vehicle from the meter ECU 16 or the multimedia ECU 17 to the advanced driving assistance ECU 22. This makes it possible to set a preceding vehicle that the vehicle 10 follows using the adaptive cruise control function on the perimeter monitoring display, improving operability.

[0094] 16, when a touch operation is received on the host vehicle image 30 while the shift position is in the parking position (P) on the periphery monitoring display, a customization screen for customizing predetermined functions of the vehicle may be displayed. For example, a customization screen for setting the content to be displayed on the display 14 or the multimedia display 15 may be displayed. This makes it possible to instruct the periphery monitoring display to transition to the customization screen, improving operability.

[0095] Furthermore, as shown in FIG. 16 , when a touch operation is received on the perimeter monitoring display while the parking assist function is operating, the touch position corresponding to the received touch operation may be set as the parking position of the vehicle 10 in the parking assist function. For example, the parking position is set by transmitting information specifying the touch position corresponding to the touch operation as the parking position from the meter ECU 16 or the multimedia ECU 17 to the advanced driving assistance ECU 22. This makes it possible to specify the parking position of the vehicle 10 in the parking assist function on the perimeter monitoring display, improving operability. Note that the parking assist function may apply automatic driving that parks the vehicle in a parking space near a parking space, or may apply an auto valet parking function that performs automatic driving in a parking lot and automatically parks the vehicle in a designated space.

[0096] In the above embodiment, an example has been described in which the periphery monitoring display is possible on at least one of the display 14 and the multimedia display 15, but the present invention is not limited to this. For example, the periphery monitoring display may be displayed on a HUD (Head-Up Display), and operations may be accepted on the periphery monitoring display.

[0097] In the above embodiment, the display 14 is controlled by the meter ECU 16, and the multimedia display 15 is controlled by the multimedia ECU 17. However, this is not limiting. For example, the display 14 and the multimedia display 15 may be controlled by a single ECU.

[0098] Furthermore, in each of the above embodiments, the processing performed by the multimedia ECU 17 has been described as software processing performed by executing a program, but this is not limited to this. For example, the processing may be performed by hardware such as a GPU (Graphics Processing Unit), an ASIC (Application Specific Integrated Circuit), or an FPGA (Field-Programmable Gate Array). Alternatively, the processing may be a combination of both software and hardware. Furthermore, if the processing is software, the program may be stored in various storage media and distributed.

[0099] Furthermore, the present invention is not limited to the above, and it goes without saying that various modifications can be made without departing from the spirit of the present invention. [Explanation of symbols]

[0100] 10 vehicles 12 Onboard equipment 14 Display 15 Multimedia Displays 16 Meter ECU 16A, 17A CPU 17 Multimedia ECU 20 Periphery monitoring device (detection unit) 22 Advanced Driver Assistance ECU 26 Reception Department 28 Executive Department 30 Vehicle image 32 White line (periphery monitoring image) 34 Leading vehicle image (surrounding surveillance image) 36 Surrounding vehicle images (surrounding surveillance images) 38 Crosswalk image (perimeter monitoring image) 40 Traffic light image (surrounding area monitoring image) 42 Median strip image (surrounding surveillance image) 44 Sign image (perimeter monitoring image) 46 Guide Image 48 Guide Lane 50 Inter-vehicle image

Claims

1. a display control unit that displays a surrounding monitoring image on a display unit provided in the vehicle together with an image of the vehicle itself based on a detection result of a detection unit that detects targets around the vehicle; a reception unit that receives an operation by an occupant of the vehicle with respect to the display unit; an execution unit that causes each unit of the vehicle to execute a predetermined process related to a function of the vehicle in response to the operation received by the reception unit; An in-vehicle device comprising:

2. The in-vehicle device according to claim 1 , wherein the execution unit executes a driving assistance function or an automatic driving function that performs at least one of a part of a vehicle operation and an operation assistance as the predetermined process.

3. The in-vehicle device according to claim 1 , wherein the execution unit changes settings of a driving assistance function or an automatic driving function that performs part or all of at least one of vehicle operation and operation assistance as the predetermined process.

4. The in-vehicle device according to claim 1 , wherein the execution unit changes a setting of a preceding vehicle following function as the predetermined process when the reception unit receives a touch operation on the image of the host vehicle.

5. The in-vehicle device according to claim 1, wherein the execution unit executes control of acceleration or deceleration of the vehicle as the predetermined processing when the reception unit receives a slide operation of the image of the vehicle in a forward or backward direction.

6. The in-vehicle device according to claim 1, wherein the execution unit executes a lane change assistance function in the right direction or the left direction as the predetermined processing when the reception unit receives a slide operation of the vehicle image in the right direction or the left direction.

7. The in-vehicle device according to claim 1 , wherein the execution unit changes a setting of a lane departure prevention function as the predetermined process when the reception unit receives a touch operation on an image of a lane boundary line.

8. The in-vehicle device according to claim 1 , wherein the execution unit changes a setting of an automatic headlamp control function as the predetermined process when the reception unit receives a touch operation on a front end of the image of the vehicle.

9. The in-vehicle device of claim 1, wherein when the reception unit receives a slide operation to the image of the vehicle itself or a preceding vehicle image that imitates a preceding vehicle in front of the vehicle, or a slide operation to a vehicle-to-vehicle image that represents the vehicle-to-vehicle distance between the vehicle and the preceding vehicle while the preceding vehicle following function is operating, the execution unit adjusts the vehicle-to-vehicle distance as the predetermined processing.

10. 2. The in-vehicle device according to claim 1, wherein when the receiving unit receives a slide operation of a trajectory that imitates a preceding vehicle ahead of the vehicle and overtakes a preceding vehicle image, the execution unit executes overtaking of the preceding vehicle as the predetermined processing.

11. 2. The in-vehicle device according to claim 1, wherein, when the receiving unit receives a pinch operation on the display unit, the executing unit enlarges or reduces the image displayed on the display unit in response to the pinch operation as the predetermined processing.

12. 2. The in-vehicle device according to claim 1, wherein the execution unit enlarges and displays the image displayed on the display unit as the predetermined processing when the reception unit receives a single touch operation on the vehicle image, a touch operation on the display unit for a predetermined period of time or more, or two touch operations within a predetermined period of time.

13. The in-vehicle device according to claim 1 , wherein the execution unit rotates the surroundings monitoring image displayed on the display unit as the predetermined process when a rotation touch operation on the display unit is received by a reception unit.

14. The in-vehicle device according to claim 1 , wherein the execution unit changes an angle of view of the image displayed on the display unit as the predetermined process when a reception unit receives touch operations at a plurality of positions on the display unit.

15. 2. The in-vehicle device according to claim 1, wherein, when the receiving unit receives a touch operation on a surrounding vehicle image representing a surrounding vehicle of the vehicle while the preceding vehicle following function is operating, the execution unit sets the surrounding vehicle corresponding to the touch operation as a preceding vehicle to be followed by the vehicle as the predetermined processing.

16. 2. The in-vehicle device according to claim 1, wherein, when the execution unit receives a touch operation on the image of the vehicle when the shift position of the vehicle is in a parking position, the execution unit displays a customization screen for customizing a predetermined function of the vehicle as the predetermined processing.

17. 2. The in-vehicle device according to claim 1, wherein, when the receiving unit receives a touch operation on the display unit while a parking assistance function of the vehicle is activated, the execution unit sets a position corresponding to the touch operation as a parking position of the vehicle in the parking assistance function as the predetermined processing.

18. On the computer, Based on a detection result of a detection unit that detects targets around the vehicle, a surrounding monitoring image is displayed on a display unit provided in the vehicle together with an image of the vehicle that imitates the vehicle; receiving an operation by an occupant of the vehicle on the display unit; An in-vehicle control program for causing each part of the vehicle to execute predetermined processing related to a function of the vehicle in response to the received operation.

Images