Vehicle-mounted device and computer-readable medium on which vehicle-mounted control program is recorded

Abstract

The invention provides an in-vehicle device and a computer-readable medium on which an in-vehicle control program is recorded. This vehicle-mounted device is provided with: a display control unit that, on the basis of a detection result of a detection unit that detects a target object around a vehicle, causes a peripheral monitoring image to be displayed on a display unit provided in the vehicle together with a host vehicle image that simulates the vehicle; a receiving unit that receives an operation by an occupant of the vehicle with respect to the display unit; and an execution unit that, in accordance with the operation received by the reception unit, executes a predetermined process pertaining to a function of the vehicle for each part of the vehicle.

Description

Technical Field

[0001] The present invention relates to a vehicle-mounted device and a computer-readable medium recording a vehicle-mounted control program. Background Art

[0002] Japanese Patent No. 7048398 proposes a technique in which a first image simulating another vehicle and a second image simulating a target trajectory are superimposed and displayed on a third image simulating a road on which the vehicle is traveling. When the second image is displayed, among a plurality of sections that divide the target trajectory in the longitudinal direction, a first section that is closer to the front of a reference vehicle used in generating the target trajectory when viewed from the vehicle is emphasized over a second section that is farther inward from the reference vehicle when viewed from the vehicle.

[0003] While surrounding objects such as other vehicles are displayed on a perimeter monitoring display, as described in Japanese Patent No. 7048398, it is not possible to operate the vehicle's own functions, such as driving assistance functions, in accordance with the perimeter monitoring display. In particular, operating each of the multiple vehicle functions using different devices or methods is cumbersome, leaving room for improvement in operability. Summary of the Invention

[0004] The present invention provides an in-vehicle device capable of improving the operability of a passenger with respect to a vehicle function and a computer-readable medium recording an in-vehicle control program.

[0005] The vehicle-mounted device involved in the first embodiment comprises: a display control unit, which displays a surrounding monitoring image together with an image of the vehicle simulating the vehicle on a display unit provided in the vehicle based on the detection results of a detection unit that detects object targets around the vehicle; a receiving unit, which receives operations of the vehicle occupants on the display unit; and an execution unit, which executes predetermined processing related to the functions of the vehicle for each part of the vehicle according to the operations received by the receiving unit.

[0006] According to the first aspect, the display control unit displays the surrounding monitoring image together with the own vehicle image simulating the vehicle on the display unit provided in the vehicle based on the detection results of the detection unit that detects the object targets around the vehicle.

[0007] The receiving unit then receives predetermined operations from the vehicle's occupant on the display unit, and the executing unit performs predetermined processing related to the vehicle's functions based on the operations received by the receiving unit. This allows the occupant to operate functions related to the vehicle, such as driving assistance functions, on the surrounding monitoring display, thereby improving the operability of the vehicle's functions.

[0008] The vehicle-mounted device involved in the second embodiment is the vehicle-mounted device involved in the first embodiment, wherein, for the execution unit, a driving assistance function or an automatic driving function that implements part or all of at least one of vehicle operation and operation assistance is executed as the predetermined processing.

[0009] According to the second aspect, the driving assistance function or the automatic driving function can be executed on the surrounding monitoring display.

[0010] The vehicle-mounted device involved in the third embodiment is, in the vehicle-mounted device involved in the first embodiment or the second embodiment, wherein, for the execution unit, as the predetermined processing, the setting of a driving assistance function or an automatic driving function that implements at least one of vehicle operation and operation assistance is changed in part or in whole.

[0011] According to the third aspect, settings such as whether to turn on or off the driving assistance function or the automatic driving function can be changed on the surrounding monitoring display.

[0012] The vehicle-mounted device involved in the fourth embodiment is the vehicle-mounted device involved in any one of the first to third embodiments, wherein, for the execution unit, when the acceptance unit accepts a touch operation on the own vehicle image, the preceding vehicle following function is executed as the predetermined processing.

[0013] According to the fourth aspect, the preceding vehicle following function can be activated on the surrounding monitoring display.

[0014] The vehicle-mounted device involved in the fifth embodiment is a vehicle-mounted device involved in any one of the first to fourth embodiments, wherein for the execution unit, when the receiving unit receives a sliding operation in the moving direction or backward direction of the vehicle image, the acceleration or deceleration control of the vehicle is executed as the predetermined processing.

[0015] According to the fifth aspect, the acceleration and deceleration instructions of the vehicle can be intuitively operated on the periphery monitoring display.

[0016] The vehicle-mounted device involved in the sixth embodiment is a vehicle-mounted device involved in any one of the first to fifth embodiments, wherein for the execution unit, when the receiving unit accepts a sliding operation to the right or left direction of the vehicle image, the lane change assistance function in the right direction or left direction is executed as the predetermined processing.

[0017] According to the sixth aspect, the lane change assist function can be intuitively operated on the surrounding monitoring display.

[0018] The vehicle-mounted device involved in the seventh embodiment is a vehicle-mounted device involved in any one of the first to sixth embodiments, wherein, for the execution unit, when the receiving unit receives a touch operation toward the image of the lane boundary line, the setting of the lane departure prevention function is changed as the predetermined processing.

[0019] According to the seventh aspect, settings such as whether the lane departure prevention function is on or off can be changed on the periphery monitoring display.

[0020] The vehicle-mounted device involved in the eighth embodiment is a vehicle-mounted device involved in any one of the first to seventh embodiments, wherein, for the execution unit, when the receiving unit receives a touch operation toward the front end of the vehicle image, the setting of the automatic headlight control function is changed as the predetermined processing.

[0021] According to the eighth aspect, settings such as on and off of the automatic headlamp control function can be changed on the periphery monitoring display.

[0022] The vehicle-mounted device involved in the ninth embodiment is a vehicle-mounted device involved in any one of the first to eighth embodiments, wherein, for the execution unit, when the leading vehicle following function is working, when the receiving unit receives a sliding operation toward the image of the own vehicle or the leading vehicle image simulating the leading vehicle in front of the vehicle, or a sliding operation toward the inter-vehicle image representing the inter-vehicle distance between the vehicle and the leading vehicle, the inter-vehicle distance is adjusted as the predetermined processing.

[0023] According to the ninth aspect, the inter-vehicle distance when the preceding vehicle following function is activated can be designated on the periphery monitoring display.

[0024] The vehicle-mounted device involved in the tenth embodiment is a vehicle-mounted device involved in any one of the first to ninth embodiments, wherein, for the execution unit, when the receiving unit receives a sliding operation of overtaking the trajectory of the preceding vehicle image that simulates the preceding vehicle in front of the vehicle, the overtaking of the preceding vehicle is executed as the predetermined processing.

[0025] According to the tenth aspect, the overtaking instruction of the preceding vehicle can be intuitively operated on the surrounding monitoring display.

[0026] The vehicle-mounted device involved in the eleventh embodiment is a vehicle-mounted device involved in any one of the first to tenth embodiments, wherein, for the execution unit, when the receiving unit accepts a pinch-out operation on the display unit, the image displayed on the display unit is enlarged or reduced according to the pinch-out operation as the predetermined processing.

[0027] According to the eleventh aspect, it is possible to intuitively operate the enlargement and reduction operations of the area on the periphery monitor display.

[0028] The vehicle-mounted device involved in the twelfth embodiment is a vehicle-mounted device involved in any one of the first to eleventh embodiments, wherein for the execution unit, when the receiving unit receives a touch operation to the vehicle image once, a touch operation on the display unit for more than a predetermined time, or two touch operations within a predetermined time, the image displayed on the display unit is enlarged and displayed as the predetermined processing.

[0029] According to the twelfth aspect, the operation of enlarging the display can be easily performed on the peripheral monitor display.

[0030] The vehicle-mounted device involved in the thirteenth embodiment is a vehicle-mounted device involved in any one of the first to twelfth embodiments, wherein, for the execution unit, when the receiving unit receives a touch operation for rotating the display unit, the peripheral monitoring image displayed on the display unit is rotated as the predetermined processing.

[0031] According to the thirteenth aspect, it is possible to easily instruct the user to rotate the displayed surrounding monitoring image on the surrounding monitoring display.

[0032] The vehicle-mounted device involved in the fourteenth embodiment is a vehicle-mounted device involved in any one of the first to thirteenth embodiments, wherein, for the execution unit, when the receiving unit receives touch operations on multiple parts of the display unit, the viewing angle of the image displayed on the display unit is changed as the predetermined processing.

[0033] According to the fourteenth aspect, the viewing angle of the image displayed on the periphery monitor display can be changed.

[0034] The vehicle-mounted device involved in the fifteenth embodiment is a vehicle-mounted device involved in any one of the first to fourteenth embodiments, wherein, for the execution unit, when the leading vehicle following function is working, when the receiving unit receives a touch operation to the surrounding vehicle image representing the surrounding vehicles of the vehicle, the surrounding vehicle corresponding to the touch operation is set as the leading vehicle to be followed by the vehicle as the predetermined processing.

[0035] According to the fifteenth aspect, the preceding vehicle to be followed can be set on the surrounding monitoring display.

[0036] The vehicle-mounted device involved in the sixteenth embodiment is a vehicle-mounted device involved in any one of the first to fifteenth embodiments, wherein for the execution unit, when the shift position of the vehicle is the parking position, when a touch operation is received on the image of the vehicle, a customized screen for customizing a predetermined function of the vehicle is displayed as the predetermined processing.

[0037] According to the sixteenth aspect, it is possible to issue an instruction to switch to the custom screen on the periphery monitoring display.

[0038] The vehicle-mounted device involved in the seventeenth embodiment is a vehicle-mounted device involved in any one of the first to sixteenth embodiments, wherein, for the execution unit, when the parking assist function of the vehicle is working, when the receiving unit receives a touch operation on the display unit, the position corresponding to the touch operation is set as the parking position of the vehicle in the parking assist function as the predetermined processing.

[0039] According to the seventeenth aspect, the parking position of the vehicle can be designated on the periphery monitoring display in the parking assist function.

[0040] The vehicle-mounted control program involved in the eighteenth method causes the computer to perform the following processing, namely, based on the detection results of the detection unit that detects object targets around the vehicle, a surrounding monitoring image is displayed together with an image of the vehicle simulating the vehicle on a display unit provided in the vehicle, and operations of the vehicle occupants on the display unit are accepted, and according to the accepted operations, predetermined processing related to the functions of the vehicle is executed for each part of the vehicle.

[0041] According to the eighteenth aspect, there are provided an in-vehicle device and an in-vehicle control program that can improve the operability of vehicle functions by the occupant by enabling operation of functions of the vehicle such as a driving assistance function on a periphery monitoring display.

[0042] According to the above-described aspects, the vehicle-mounted device and the computer-readable medium recording the vehicle-mounted control program of the present disclosure can improve the operability of the occupant with respect to the functions of the vehicle. BRIEF DESCRIPTION OF THE DRAWINGS

[0043] Exemplary embodiments will be described in detail based on the following drawings, in which:

[0044] Figure 1 It is a diagram schematically showing the interior of a vehicle equipped with the vehicle-mounted device according to the present embodiment.

[0045] Figure 2 It is a block diagram showing the configuration of a control system of the vehicle-mounted device according to the present embodiment.

[0046] Figure 3 This is a block diagram showing the main configuration of the electrical system of the meter ECU, multimedia ECU, and advanced driving assistance ECU in the vehicle-mounted device according to the present embodiment.

[0047] Figure 4 This figure shows an example of a perimeter monitoring display.

[0048] Figure 5 This figure shows another example of the perimeter monitoring display.

[0049] Figure 6 A functional block diagram showing the functional structure of a multimedia ECU.

[0050] Figure 7 This is a diagram for explaining an example of predetermined processing executed by an execution unit of the multimedia ECU of the vehicle-mounted device according to the present embodiment.

[0051] Figure 8 This is a flowchart showing an example of the flow of processing executed by the multimedia ECU of the vehicle-mounted device according to the present embodiment.

[0052] Figure 9 A diagram showing a sliding operation on an image of a vehicle.

[0053] Figure 10 This figure shows a touch operation on a lane boundary line such as a white line.

[0054] Figure 11 A diagram showing a touch operation performed on the front end of the host vehicle image.

[0055] Figure 12 This is a flowchart showing an example of the flow of a modified example of the process executed by the multimedia ECU of the vehicle-mounted device according to the present embodiment.

[0056] Figure 13 This diagram shows a state of a slide operation on a host vehicle image so as to overtake the trajectory of a preceding vehicle image.

[0057] Figure 14 The diagram shows a state of a slide operation on an inter-vehicle image representing the vehicle interval to a preceding vehicle.

[0058] Figure 15 It is a diagram showing another example of operation accepted on the periphery monitoring display and an example of processing corresponding to the operation in the vehicle-mounted device according to the present embodiment.

[0059] Figure 16 It is a diagram showing an example of conditional operations accepted on the periphery monitoring display and an example of processing corresponding to the operations in the vehicle-mounted device according to the present embodiment. DETAILED DESCRIPTION

[0060] Hereinafter, an example of an embodiment of the present invention will be described in detail with reference to the drawings. Figure 1 , which is a diagram showing an overview of the interior of a vehicle equipped with the vehicle-mounted device according to this embodiment. Figure 1 The arrow UP in FIG. 1 indicates the upper side in the vehicle vertical direction, and the arrow RH indicates the right side in the vehicle width direction. In the following description, the up-down direction and the left-right direction refer to the up-down direction and the left-right direction, respectively.

[0061] like Figure 1 As shown, an instrument panel 70 is provided at the front of the vehicle cabin in the vehicle 10. A windshield 74 is provided at the front end of the instrument panel 70. The windshield 74 extends in the vehicle vertical direction and the vehicle width direction and divides the vehicle cabin interior from the vehicle cabin exterior.

[0062] The right end of the windshield 74 is fixed to a front pillar 76 on the right side of the vehicle. The front pillar 76 extends in the vertical direction of the vehicle, and the windshield 74 is fixed to the inner end of the front pillar 76 in the vehicle width direction. The left end of the windshield 74 is fixed to a front pillar on the left side of the vehicle (not shown).

[0063] The instrument panel 70 extends in the vehicle width direction, and a steering wheel 72 is provided on the vehicle right side of the instrument panel 70. That is, in this embodiment, as an example, a right-hand drive vehicle is assumed in which the steering wheel 72 is provided on the right side, and the driver's seat is provided on the vehicle right side.

[0064] A display 14, as one example of a display unit, is provided in a position on the instrument panel 70 in front of the steering wheel 72. A multimedia display 15, as another example of a display unit, is provided in the center of the instrument panel 70. Display 14 and multimedia display 15 are, for example, touch panels containing liquid crystals, and display the vehicle's driving status, the operating status of driver assistance devices, and the like, and accept touch operations.

[0065] Next, the configuration of the control system of the vehicle-mounted device 12 according to the present embodiment will be described. Figure 2 2 is a block diagram showing the configuration of a control system of the vehicle-mounted device 12 according to the present embodiment.

[0066] The in-vehicle device 12 according to this embodiment includes an instrument ECU (Electronic Control Unit) 16 , a multimedia ECU 17 , a driving state detection sensor 18 , a surrounding condition monitoring device 20 as an example of a detection unit, and an advanced driving assistance ECU 22 , and each of these devices is connected to a vehicle network 24 .

[0067] The instrument ECU 16 is connected to the display 14 and controls it, performing processes such as displaying multiple meters, monitoring results of the vehicle's surroundings, and various vehicle information. Furthermore, if a vehicle abnormality occurs, the instrument ECU 16 notifies the occupants by displaying the abnormality on the display 14. Examples of the various vehicle information displayed on the display 14 include the operating status of driving assistance devices and the like. The display mode of the display 14 can be switched using a switch (not shown), and can be changed to suit the driver's preference.

[0068] The multimedia ECU 17 is connected to the multimedia display 15 and controls the multimedia display 15 to perform processing for displaying information such as monitoring results of the vehicle's periphery, map images, and setting screens for various vehicle functions.

[0069] The running state detection sensor 18 detects the running state of the vehicle 10. The running state detection sensor 18 includes at least one of various sensors such as a vehicle speed sensor, an acceleration sensor, a gyro sensor, an accelerator opening sensor, and a brake sensor.

[0070] The surrounding situation monitoring device 20 detects information indicating the surrounding environment of the vehicle and includes at least one of various devices such as a GPS (Global Positioning System) device, an onboard communicator, a navigation system, a radar device, an ultrasonic sensor, and a camera.

[0071] The advanced driving assistance ECU 22 has the function of acquiring surrounding information detected by the surrounding situation monitoring device 20, providing this information to other ECUs or controlling the steering system or brakes as needed. For example, if the driving state detection sensor 18 detects the accelerator is off and the surrounding situation monitoring device 20 detects a preceding vehicle or an intersection, the advanced driving assistance ECU 22 controls the brakes to assist in deceleration. Specifically, the advanced driving assistance ECU 22 controls various driving assistance functions, including adaptive cruise control (an example of a preceding vehicle following function that controls acceleration and deceleration based on changes in the preceding vehicle's speed); lane following assist (a function that warns of the possibility of departure from a lane or driving path and assists with a portion of steering wheel operation to prevent departure); and lane change assist (an example of a lane change assist function that assists with a portion of steering wheel operation required for lane changes). The preceding vehicle following function is not limited to adaptive cruise control and may also include other preceding vehicle following functions. In addition, the lane change function is not limited to the lane change assist function, and may also be other lane change functions. Further, the driving assistance function is not limited to the above case, and may also be applicable to various other driving assistance functions.

[0072] Figure 3 1 is a block diagram showing the main configuration of the electrical system of the meter ECU 16, multimedia ECU 17, and advanced driver assistance ECU 22 in the in-vehicle device 12 according to the present embodiment. Since the meter ECU 16, multimedia ECU 17, and advanced driver assistance ECU 22 are basically configured as ordinary computers, the meter ECU 16 will be used as a representative example for description.

[0073] The meter ECU 16 is composed of a general microcomputer including a CPU (Central Processing Unit) 16A, a ROM (Read Only Memory) 16B, a RAM (Random Access Memory) 16C, a memory 16D, an interface (I / F) 16E, and a bus 16F.

[0074] The CPU 16A is a central processing unit and controls the entire operation of the device by executing various programs. The ROM 16B stores various control programs such as a vehicle display program or various parameters in advance. The RAM 16C is used as a work area when executing various programs implemented by the CPU 16A. The memory 16D is composed of various storage units such as an HDD (Hard Disk Drive) or an SSD (Solid State Drive), a flash memory, etc., and stores various data or application programs. The I / F 16E is configured to be connected to the vehicle network 24 and to transmit and receive various data with other ECUs such as the meter ECU 16 connected to the vehicle network 24. The above-mentioned parts of the meter ECU 16 are electrically connected to each other via the bus 16F. In addition, although the vehicle display program is described as being stored in the ROM 16B in this embodiment, it can also be stored in the memory 16D.

[0075] In this embodiment, a SA (Situation Awareness) view display (surrounding monitoring display) that displays the vehicle's surrounding conditions is implemented on at least one of the display 14 and the multimedia display 15. The surrounding monitoring display notifies the occupants of the vehicle's surrounding conditions by displaying a vehicle image that simulates the vehicle and images representing objects (e.g., preceding vehicles) detected by the driving state detection sensor 18 or the surrounding condition monitoring device 20.

[0076] Figure 4 , which is a diagram showing an example of a peripheral monitoring display, Figure 5 FIG. 2 is a diagram showing another example of a peripheral monitoring display.

[0077] like Figure 4As shown, as an example of a surrounding monitoring display, a vehicle image 30 and a surrounding monitoring image are displayed. The surrounding monitoring image includes a preceding vehicle image 34, which simulates a preceding vehicle of vehicle 10, and a surrounding vehicle image 36, which simulates surrounding vehicles of vehicle 10, as an example of an object image. Furthermore, white lines 32 representing driving lanes and the like are displayed. The preceding vehicle image 34 and the surrounding vehicle image 36 are displayed based on information from an ultrasonic sensor, such as a clearance sonar, serving as the surrounding situation monitoring device 20.

[0078] In addition, if Figure 5 As shown, as another example of the surrounding monitoring display, an overhead image including an object image showing an object at an actual position during driving may be displayed as a surrounding monitoring image, and the vehicle image 30 may be displayed in the overhead image. As the overhead image, for example, a crosswalk image 38, a signal image 40, a central median image 42, a sign image 44, and surrounding vehicle images 36 such as trucks or two-wheeled vehicles may be displayed. The overhead image is displayed using information from a radar device or a camera serving as the surrounding condition monitoring device 20, for example. In addition, in Figure 5 In the example of the surrounding monitoring display, an example is shown in which a guidance display is performed simultaneously, and an example is shown in which a guidance image 46 and a guidance lane 48 are displayed in the bird's-eye view image.

[0079] Here, the functional structure of at least one of the meter ECU 16 and the multimedia ECU 17, which performs perimeter monitoring and display, is described by executing programs stored in the ROMs 16B and 17B. Since the functional structures of the meter ECU 16 and the multimedia ECU 17 are identical, the multimedia ECU 17 will be used as a representative example for the following description. Figure 6 2 is a functional block diagram showing the functional structure of the multimedia ECU 17 .

[0080] like Figure 6 As shown, the multimedia ECU 17 has the functions of a display control unit 25 , a receiving unit 26 , and an executing unit 28 by the CPU 17A executing a program stored in the ROM 17B.

[0081] The display control unit 25 displays the surrounding monitoring image and the host vehicle image 30 on the multimedia display 15 based on the detection result of the target object around the vehicle 10 detected by the surrounding situation monitoring device 20 .

[0082] The receiving unit 26 receives a predetermined operation on the multimedia display 15 , such as a touch operation on the vehicle image 30 .

[0083] The execution unit 28 executes predetermined processing related to the functions of the vehicle 10 on various components of the vehicle 10 in response to the operation received by the reception unit 26. In the present embodiment, the execution unit 28 controls the advanced driving assistance ECU 22 as the predetermined processing to execute various driving assistance functions.

[0084] For example, Figure 7 As shown, when the multimedia ECU 17 displays the host vehicle image 30 and the surrounding monitoring image on the multimedia display 15 as the surrounding monitoring display, the accepting unit 26 accepts a touch operation on the host vehicle image 30 as a predetermined operation.

[0085] Then, when the receiving unit 26 receives the touch operation on the vehicle image 30, the executing unit 28 controls the advanced driving assistance ECU 22 to operate the adaptive cruise control function as an example of a predetermined process. Figure 7 1 is a diagram illustrating an example of a predetermined process executed by the execution unit 28 of the multimedia ECU 17 of the vehicle-mounted device 12 according to the present embodiment. While the predetermined process is described herein as being executed by the multimedia ECU 17, it may also be executed by the meter ECU 16.

[0086] Next, the processing executed by the multimedia ECU 17 of the vehicle-mounted device 12 according to the present embodiment having the above-described configuration will be described. Figure 8 1 is a flowchart showing an example of the flow of processing performed by the multimedia ECU 17 of the vehicle-mounted device 12 according to the present embodiment. Figure 8 The processing is started, for example, when a predetermined operation of starting the peripheral monitoring display is performed. Figure 8 The processing is described as being executed by the multimedia ECU 17 , but may also be executed by the meter ECU 16 .

[0087] In step 100 , the CPU 17A detects surrounding target objects and proceeds to step 102 . In the present embodiment, the detection results of the driving state detection sensor 18 or the detection results of the surrounding situation monitoring device 20 are acquired to detect surrounding target objects.

[0088] In step 102, the CPU 17A displays the vehicle image 30 and the surrounding monitoring image on the multimedia display 15 and transfers to step 104. Figure 4As shown, the surrounding monitoring display is implemented by displaying the own vehicle image 30 and displaying target images such as the preceding vehicle image 34 and the surrounding vehicle image 36 as the surrounding monitoring image.

[0089] In step 104 , the CPU 17A determines whether an operation has been performed on the vehicle image 30 . This determination determines, for example, whether a touch operation has been performed on the vehicle image 30 . If the determination is negative, the process proceeds to step 108 , and if it is positive, the process proceeds to step 106 .

[0090] In step 106, CPU17A executes a predetermined process and transfers to step 108. The predetermined process can control the advanced driving assistance ECU22 so that a part or all of the driving assistance function or the automatic driving function of at least one of the vehicle operation and operation assistance is executed, and the setting of a part or all of the driving assistance function or the automatic driving function of at least one of the vehicle operation and operation assistance can be changed. For example, the on / off setting of the active cruise control function as an example of the automatic driving function, the lane departure prevention function for preventing lane departure as an example of the driving assistance function (for example, the lane departure alert (LDA: Lane Departure Alert) function for implementing lane departure warning, or the function that not only implements lane departure warning but also implements steering assistance, etc.) can be changed. Alternatively, the lane change assist (LCA: Lane Change Assist) function or the overtaking function as an example of the lane change assist function for assisting lane change can be executed. As an example of a more specific predetermined process, for example, the advanced driving assistance ECU22 can be controlled as described above to change the on / off of the operation of the adaptive cruise control function. In addition, as Figure 9 As shown, in a vehicle capable of automatic driving, a predetermined process may be executed according to a sliding operation on the vehicle image 30. For example, a predetermined process may be executed when a sliding operation on the vehicle image 30 is received. Figure 9 In the case of a sliding operation in the upward direction), the acceleration is performed, and when the sliding operation in the backward direction ( Figure 9 In this way, the acceleration and deceleration instructions of the vehicle 10 can be operated perceptually on the surrounding monitoring display. In addition, the vehicle image 30 can also be decelerated when a sliding operation (downward direction) is performed on the vehicle image 30. Figure 9 When a left-direction sliding operation is performed on the vehicle, the lane change assist function in the left direction is activated, and when a right-direction sliding operation is performed on the vehicle, the lane change assist function in the right direction is activated. In this way, the lane change assist function can be operated intuitively on the surrounding monitoring display. Figure 10 As shown, when a touch operation is received on a lane boundary line such as the white line 32, the setting of the lane departure warning function can be changed as a predetermined process. In this way, the setting such as on or off of the lane departure warning function can be changed on the surrounding monitoring display. Figure 11 As shown, if a touch operation is performed on the front end of the vehicle image 30, the settings of the automatic headlight control function can be changed as a predefined process. This allows the automatic headlight control function to be turned on or off, and other settings to be changed on the surrounding monitoring display. Other automatic headlight control functions include automatically switching between high beam, low beam, and low beam, preventing glare on only one side of the vehicle even when in high beam mode, and automatically switching the headlight's illumination direction. For example, not only can the high beam be turned on or off, but an automated high beam function that automatically switches between high beam, low beam, and low beam can also be used.

[0091] In step 108, CPU 17A determines whether the surrounding monitoring display has been terminated. This determination involves, for example, determining whether an instruction to operate another function, such as air conditioning or audio, has been issued. If this determination is negative, the process returns to step 100 and repeats the above process. If the determination is positive, the series of processes ends and the process of executing the instructed function begins.

[0092] By performing processing in this manner, it is possible to operate functions of the host vehicle, such as driving assistance functions, on the surrounding monitoring display, thereby improving convenience.

[0093] Next, a description will be given of a process according to a modified example executed by the multimedia ECU 17 of the vehicle-mounted device 12 according to the present embodiment. Figure 12 1 is a flowchart showing an example of a modified example of the process performed by the multimedia ECU 17 of the vehicle-mounted device 12 according to the present embodiment. Figure 12 The processing is started, for example, when a predetermined operation for starting the peripheral monitoring display is performed.

[0094] In step 200, the CPU 17A detects surrounding target objects and proceeds to step 202. In the present embodiment, the detection results of the driving state detection sensor 18 or the detection results of the surrounding situation monitoring device 20 are acquired to detect surrounding target objects.

[0095] In step 202, the CPU 17A displays the vehicle image 30 and the surrounding monitoring image on the multimedia display 15 and transfers to step 204. Figure 4As shown, the surrounding monitoring display is implemented by displaying the own vehicle image 30 and displaying target images such as the preceding vehicle image 34 and the surrounding vehicle image 36 as the surrounding monitoring image.

[0096] In step 204 , the CPU 17A determines whether an operation has been performed on the vehicle image 30 . This determination determines, for example, whether a touch operation has been performed on the vehicle image 30 . If the determination is negative, the process proceeds to step 212 , and if it is positive, the process proceeds to step 206 .

[0097] In step 206 , the CPU 17A determines whether active cruise control (ACC) is in operation. If this determination is negative, the process proceeds to step 208 , and if it is positive, the process proceeds to step 210 .

[0098] In step 208 , the CPU 17A activates the adaptive cruise control (ACC) and the process proceeds to step 212 .

[0099] On the other hand, in step 210, the CPU 17A performs processing corresponding to the received operation and transfers to step 212. The processing corresponding to the received operation, for example, when the direction to the own vehicle image 30 or the preceding vehicle image 34 is received, Figure 9 In the case of a sliding operation in the up and down directions of the vehicle image 30, the advanced driving assistance ECU 22 is controlled to adjust the vehicle distance according to the direction of the sliding operation. In this way, the adaptive cruise control function can specify the vehicle distance in operation. Alternatively, after receiving the direction of the vehicle image 30, Figure 9 In the case of a left-right sliding operation, the advanced driving assistance ECU 22 is controlled to change lanes in the direction corresponding to the sliding direction. In this way, the lane change assistance function can be operated intuitively on the surrounding monitoring display. Or, as Figure 13 As shown in FIG. 3 , when a sliding operation is received with respect to the own vehicle image 30 to indicate the trajectory of the overtaking preceding vehicle image 34, the advanced driving assistance ECU 22 is controlled to implement the control of overtaking the preceding vehicle. In this way, the overtaking instruction of the preceding vehicle can be intuitively operated on the surrounding monitoring display. Alternatively, as shown in FIG. Figure 14 As shown, when a sliding operation is received on the vehicle image 50 showing the vehicle interval between the vehicle 10 and the preceding vehicle, a process of adjusting the vehicle interval according to the direction of the sliding operation is performed. Figure 14 As shown in the upper side, when a slide operation is received to move the vehicle image 50 from the front to the side of the vehicle image 30, the vehicle distance is adjusted so as to shorten the vehicle distance. Figure 14As shown below, when a slide operation is performed to move the inter-vehicle image 50 in the forward direction of the vehicle image 30, the inter-vehicle distance is adjusted to increase the inter-vehicle distance. This allows the adaptive cruise control function to specify the inter-vehicle distance in operation on the surrounding monitoring display.

[0100] In step 212, CPU 17A determines whether the surrounding monitoring display has been terminated. This determination involves, for example, determining whether an instruction to operate another function, such as air conditioning or audio, has been issued. If this determination is negative, the process returns to step 200 and repeats the above process. If the determination is positive, the series of processes ends and the process of executing the instructed function begins.

[0101] In this manner, also in the modified example, it is possible to operate functions of the host vehicle, such as the driving assistance function, on the periphery monitoring display, thereby improving convenience.

[0102] Next, other operation examples accepted on the periphery monitoring display in the vehicle-mounted device 12 according to the present embodiment and processing examples corresponding to the operations will be described. Figure 15 2 is a diagram showing another example of operation accepted on the periphery monitoring display and an example of processing corresponding to the operation in the vehicle-mounted device 12 according to the present embodiment.

[0103] On the peripheral monitoring display, when a pinch-out operation is received by pinching two fingers to perform a touch operation, the image displayed according to the pinch-out operation can be displayed in an enlarged or reduced manner. Figure 15 As shown in FIG, when a pinch-out operation is performed by spreading two fingers in the direction of the touch operation, the displayed image can be displayed in a manner that is magnified according to the amount of movement of the two fingers. In this way, the zoom-in operation of the area can be operated sensuously on the peripheral monitoring display, thereby improving operability. Or, as shown in FIG. Figure 15 As shown, in the surrounding monitoring display, a pinch-in operation, where two fingers are moved closer together, can cause the displayed image to zoom out based on the amount of movement of the two fingers. This allows for intuitive zooming out of the surrounding monitoring display, improving operability. Furthermore, pinch-out zooming can be performed centered around the vehicle image 30 or around the location where the fingers were detected.

[0104] In addition, on the perimeter monitoring display, such as Figure 15As shown, the image centered on the vehicle image 30 can be enlarged when a single touch operation on the vehicle image 30, a long touch operation on the vehicle image 30 for a predetermined time or longer, or a double-touch operation (two touch operations within a predetermined time) is received. This makes it easy to perform an enlarged display operation on the surrounding monitoring display. Alternatively, when a touch operation on the vehicle image 30 is received on the surrounding monitoring display, a predetermined menu screen can be displayed as a menu display instruction. This allows the menu screen to be displayed from the surrounding monitoring display, thereby improving operability.

[0105] In addition, on the perimeter monitoring display, such as Figure 15 As shown, when a touch operation of rotating a finger in a circular motion is received, the displayed vehicle image 30 and the surrounding monitoring image are rotated in the direction of the finger rotation and displayed, thereby enabling 360-degree viewing. This makes it easy to instruct the rotation of the displayed image on the surrounding monitoring display, thereby improving operability.

[0106] In addition, on the perimeter monitoring display, such as Figure 15 As shown, the viewing angle of the displayed image can also be changed when a touch operation (multi-touch operation) of multiple locations performed by two fingers or the like is accepted. For example, when a touch operation of sliding in the up and down directions by two fingers is accepted, the viewing angle of the image can be changed to a direction corresponding to the sliding direction and displayed. As a change in the viewing angle, for example, the angle of looking down at the vehicle image 30 can be changed and the vehicle image 30 and the surrounding monitoring image can be displayed. Alternatively, the display range of the displayed surrounding monitoring image can be changed. As a result, the viewing angle of the image displayed in the surrounding monitoring display can be easily changed, thereby improving operability.

[0107] Furthermore, an example of a conditional operation accepted on the perimeter monitoring display and an example of processing corresponding to the operation will be described. Figure 16 3 is a diagram showing an example of conditional operations accepted on the periphery monitoring display and an example of processing corresponding to the operations in the vehicle-mounted device 12 according to the present embodiment.

[0108] For example, on the perimeter monitoring display, Figure 16As shown, when a touch operation is received on the surrounding vehicle image 36 while adaptive cruise control (ACC) is in operation, the surrounding vehicle corresponding to the touch operation can be set as the preceding vehicle to be followed by the vehicle 10 under the active cruise control function. For example, the preceding vehicle setting is implemented by sending an instruction from the instrument ECU 16 or the multimedia ECU 17 to the advanced driver assistance ECU 22 to set the surrounding vehicle corresponding to the touch operation as the preceding vehicle. This allows the preceding vehicle to be set on the surrounding monitoring display, thereby improving operability.

[0109] In addition, on the perimeter monitoring display, such as Figure 16 As shown, when a touch operation is received on the vehicle image 30 while the shift position is in the parking position (P), a custom screen for customizing a predetermined function of the vehicle may be displayed. For example, a custom screen for setting the content displayed on the display 14 or the multimedia display 15 may be displayed. This allows an instruction to transition to the custom screen on the surrounding monitoring display, thereby improving operability.

[0110] In addition, the surrounding monitoring display, such as Figure 16 As shown, when a touch operation is received while the parking assist function is in operation, the touch position corresponding to the received touch operation can be set as the parking position of vehicle 10 in the parking assist function. For example, the parking position setting is implemented by transmitting information from the instrument ECU 16 or the multimedia ECU 17 to the advanced driver assistance ECU 22 designating the touch position corresponding to the touch operation as the parking position. This allows the parking position of vehicle 10 to be designated in the parking assist function on the surrounding monitoring display, improving operability. Furthermore, the parking assist function can be applied to both automated parking near a parking space and automated parking within a parking lot.

[0111] Furthermore, while the above embodiment illustrates an example in which a peripheral monitoring display can be displayed on at least one of the display 14 and the multimedia display 15, the present invention is not limited thereto. For example, a peripheral monitoring display can be displayed on a HUD (Head-Up Display) and operations can be received on the peripheral monitoring display.

[0112] In the above embodiment, the meter ECU 16 controls the display 14 and the multimedia ECU 17 controls the multimedia display 15 , but the present invention is not limited thereto. For example, a single ECU may control the display 14 and the multimedia display 15 .

[0113] Furthermore, while the processing performed by the multimedia ECU 17 in each of the aforementioned embodiments is described as software processing performed by executing a program, this is not limiting. For example, the processing may be performed by hardware such as a GPU (Graphics Processing Unit), an ASIC (Application Specific Integrated Circuit), or an FPGA (Field-Programmable Gate Array). Alternatively, the processing may be a combination of software and hardware. Furthermore, in the case of software processing, the program may be stored in various storage media and distributed.

[0114] Furthermore, the present invention is not limited to the above contents, and it is apparent that various modifications other than the above contents can be made and implemented without departing from the spirit and scope of the present invention.

Claims

1. A vehicle-mounted device comprising: a display control unit that displays a surrounding monitoring image together with a vehicle image simulating the vehicle on a display unit provided in the vehicle based on a detection result of a detection unit that detects an object target around the vehicle; a receiving unit that receives an operation of an occupant of the vehicle directed to the display unit; An execution unit causes each unit of the vehicle to execute a predetermined process related to a function of the vehicle in accordance with the operation received by the reception unit.

2. The vehicle-mounted device according to claim 1, wherein The execution unit causes a driving assistance function or an automatic driving function to execute, as the predetermined process, a driving assistance function or an automatic driving function that performs a part or all of at least one of vehicle operation and operation assistance.

3. The vehicle-mounted device according to claim 1, wherein: The execution unit changes, as the predetermined processing, a setting of a driving assistance function or an automatic driving function that performs a part or all of at least one of vehicle operation and operation assistance.

4. The vehicle-mounted device according to claim 1, wherein The execution unit changes the setting of the preceding vehicle following function as the predetermined processing when the acceptance unit accepts the touch operation on the host vehicle image.

5. The vehicle-mounted device according to claim 1, wherein The execution unit executes control of accelerating or decelerating the vehicle as the predetermined process when the acceptance unit accepts a sliding operation in the advancing direction or the retreating direction of the host vehicle image.

6. The vehicle-mounted device according to claim 1, wherein The execution unit executes a rightward or leftward lane change assistance function as the predetermined process when the acceptance unit accepts the rightward or leftward sliding operation of the host vehicle image.

7. The vehicle-mounted device according to claim 1, wherein: The execution unit changes the setting of the lane departure prevention function as the predetermined processing when the acceptance unit accepts the touch operation on the image of the lane boundary line.

8. The vehicle-mounted device according to claim 1, wherein The execution unit changes the setting of the automatic headlamp control function as the predetermined processing when the acceptance unit accepts the touch operation toward the front end of the host vehicle image.

9. The vehicle-mounted device according to claim 1, wherein: For the execution unit, when the leading vehicle following function is working, when the receiving unit receives a sliding operation toward the image of the own vehicle or the leading vehicle image simulating the leading vehicle in front of the vehicle, or a sliding operation toward the inter-vehicle image showing the inter-vehicle distance between the vehicle and the leading vehicle, the inter-vehicle distance is adjusted as the predetermined processing.

10. The vehicle-mounted device according to claim 1, wherein The executing unit executes overtaking of the preceding vehicle as the predetermined process when the accepting unit accepts the slide operation for overtaking the trajectory of the preceding vehicle image simulating the preceding vehicle ahead of the vehicle.

11. The vehicle-mounted device according to claim 1, wherein: When the receiving unit receives the pinch-out operation on the display unit, the executing unit performs, as the predetermined process, zooming in or out of the image displayed on the display unit according to the pinch-out operation.

12. The vehicle-mounted device according to claim 1, wherein: For the execution unit, when the receiving unit receives a touch operation on the vehicle image once, a touch operation on the display unit for more than a predetermined time, or two touch operations within a predetermined time, the image displayed on the display unit is enlarged and displayed as the predetermined processing.

13. The vehicle-mounted device according to claim 1, wherein: The execution unit rotates the periphery monitoring image displayed on the display unit as the predetermined processing when the acceptance unit accepts the touch operation for rotating the display unit.

14. The vehicle-mounted device according to claim 1, wherein The execution unit changes the viewing angle of the image displayed on the display unit as the predetermined processing when the acceptance unit accepts the touch operations on the plurality of locations on the display unit.

15. The vehicle-mounted device according to claim 1, wherein For the execution unit, when the leading vehicle following function is working, when the receiving unit receives a touch operation on the surrounding vehicle image representing the surrounding vehicles of the vehicle, the surrounding vehicle corresponding to the touch operation is set as the leading vehicle to be followed by the vehicle as the predetermined processing.

16. The vehicle-mounted device according to claim 1, wherein When the shift position of the vehicle is the parking position and a touch operation is received on the host vehicle image, the execution unit displays a customization screen for customizing a predetermined function of the vehicle as the predetermined processing.

17. The vehicle-mounted device according to claim 1, wherein: For the execution unit, when the parking assist function of the vehicle is working, when the receiving unit receives a touch operation on the display unit, the position corresponding to the touch operation is set as the parking position of the vehicle in the parking assist function as the predetermined processing.

18. A computer-readable medium recording a vehicle control program, wherein: The vehicle control program is used to make the computer execute the following processing, namely, Based on the detection result of the detection unit that detects the object mark around the vehicle, a surrounding monitoring image is displayed on a display unit provided in the vehicle together with a vehicle image simulating the vehicle. receiving an operation from a passenger of the vehicle on the display unit, In response to the received operation, predetermined processing related to the function of the vehicle is executed on each component of the vehicle.

Images