Vehicle-side operating device

Abstract

Vehicle-side actuating device (1) mounted on a vehicle, wherein the vehicle-side actuating device (1) comprises: an actuation unit which is configured to detect these coordinates of a touch input; a first display device (4); a second display device (3) which is arranged at a higher position than the actuating unit and further away from a driver's seat of the vehicle compared to the actuating unit; a second display control unit (2) which is configured to control the second display device (3) to display a plurality of second images, each indicating a second predetermined function; a distance calculation unit (112) which is configured to calculate a distance or length of a motion path between a first position and a second position, wherein the first position corresponds to a first coordinate which starts the touch input at the actuating unit, and the second position corresponds to a second coordinate which ends the touch input at the actuating unit; an input acceptance processing unit (114) configured to perform an off trigger including the execution of the second predetermined function associated with the second position when the distance or length of the motion path is less than or equal to a predetermined value; and a first display control unit (110) which is configured to output a first image on the first display device (4), wherein the actuation unit corresponds to a screen keypad (5), the first display control unit (110) has a first mode and a second mode, the first display control unit (110) is configured in the first mode such that it outputs a first-mode image as the first image, wherein the first-mode image displays a first predetermined function that differs from the second predetermined function, and wherein the first-mode image is independent of the second image output on the second display device (3), the first display control unit (110) is configured in the second mode such that it outputs a second-mode image as the first image, wherein the second-mode image has the same appearance as the second image output on the second display device (3), and The input acceptance processing unit (114) in the second mode is configured to perform the off trigger when the distance or length of the movement path is less than or equal to the predetermined value, and is configured to not perform the off trigger when the distance or length of the movement path is greater than the predetermined value.

Description

Background of the invention 1. Field of the invention

[0001] The present disclosure relates to a vehicle-side actuating device. 2. Description of the relevant state of the art

[0002] In connection with a touchpad or keypad located remotely from a display device (hereinafter referred to as a "remote touchpad"), a push-down actuation support type is known. A remote touchpad of the push-down actuation support type has a mechanism that enables the vertical movement of the touchpad itself and a unit (clock switch, pressure-sensitive sensor, etc.) for detecting a push-down actuation on the touchpad (for example, JP 2015 - 172 844 A). Therefore, a remote touchpad of the push-down actuation support type can detect not only the coordinates of a touch input but also the force of a touch input in connection with a push-down actuation (for example, whether the magnitude of the push-down force exceeds a predetermined threshold).

[0003] Furthermore, in connection with a vehicle-side user interface (UI) using two display devices (hereinafter referred to as "vehicle-side UI with two screens"), a technology is known in which each of the two display devices has a screen keypad or touch panel (for example, JP 2016 - 004 482 A)).

[0004] Furthermore, US patent 2009 / 0 256 813 A1 discloses a vehicle interface with a moving image for displaying and repositioning an image at multiple locations in response to a command from a vehicle occupant using a display device mounted on the vehicle. The display device has first and second surface sections, the first surface section displaying the image. The interface further includes a sensor configured to generate a signal in response to an actuating object touching the first surface section and then sliding along the display device toward the second surface section. The interface further includes a controller configured to receive the signal from the sensor to cause the second surface section to display the image and reposition the image on the display device.

[0005] Furthermore, US patent 2014 / 0340335A1 discloses a data selection system and a method for data selection using a touch-sensitive surface. The method includes detecting a first touch position on the touch-sensitive surface and tracking a movement from the first touch position to a second touch position. The method additionally includes calculating at least one geometric parameter from the first touch position, the second touch position, and a reference position, and performing a data selection within a data range depending on the geometric parameter.

[0006] US Patent 2010 / 0 141 589 A1 discloses a method for operating a touch display, comprising interpreting a touch input on the touch display as a first type of gesture if the source of the touch input is of a first type and a parameter of the touch input is below a first threshold. The touch input is interpreted as a second type of gesture if the source is of a first type and the parameter of the touch input is above the first threshold. The touch input is interpreted as a first type of gesture if the source is of a second type and the parameter of the touch input is below a second threshold, where the second threshold differs from the first threshold. The touch input is interpreted as a second type of gesture if the source is of a second type and the parameter of the touch input is above the second threshold.

[0007] US Patent 2013 / 0033448A1 discloses a touch-field input device comprising a touch field and an input controller capable of switching between a right-handed two-point touch input detection mode suitable for the placement of right fingers and a left-handed two-point touch input detection mode suitable for the placement of left fingers, wherein the input controller detects two-point touches on the touch field in each of these input detection modes. Summary of the invention

[0008] Meanwhile, on a remote control panel with push-button support, the user can move a finger across the panel to select a desired function using a cursor or indicator, and then perform a push-button action (i.e., a confirmation action) to execute the selected function. In this way, the push-button remote control allows for two different types of actions for selection and confirmation (setting), ensuring a high level of functionality and usability.

[0009] However, if a remote touchpad of the non-press-action type is used instead of the press-action-assist type, only the coordinates of a touch input can be detected. Therefore, it is difficult to perform the confirmation action, which is performed instead of the press-action, based on a touch input. This also applies to vehicle-side UIs with two screens. In the case of a vehicle-side UI with two screens, the function with respect to image output on one of the two displays can be implemented by an action on the other display.

[0010] In this case, the touchscreen keypad of the other display device essentially performs the same function as a remote keypad. However, if the other display device uses a touchscreen keypad configured to only detect the coordinates of a touch input, it is equally difficult to enable a confirmation action based on a touch input, instead of a "press action" on the remote keypad. Furthermore, with a dual-screen vehicle UI, it is conceivable that the user might view one display device while simultaneously performing an action on the other. In this case, it can be inconvenient or even impossible to perform the action.It can be cumbersome to perform the confirmation action based on a touch input, as there is a low probability that the cursor will be output at a position desired by the user when the first touch input is initiated.

[0011] The present invention makes it possible to perform the confirmation actuation for a function with regard to an image output on a display device while using an actuation unit that is configured to only detect the coordinates of a touch input.

[0012] The aforementioned problems and the resulting task are solved by the subject matter of claim 1. Advantageous embodiments of the invention are the subject matter of the dependent claims that follow.

[0013] According to one aspect of the present invention, a vehicle-side actuation device is provided. A vehicle-side actuation device according to this aspect comprises: an actuation unit configured to detect the coordinates of a touch input; a first display device; a second display device arranged at a higher position than the actuation unit and further away from the driver's seat of the vehicle compared to the actuation unit; a second display control unit configured to control the second display device to display a plurality of second images, each indicating a second predetermined function;a distance calculation unit configured to calculate a distance or length of a trajectory between a first position corresponding to a first coordinate, which starts the touch input at the actuating unit, and a second position corresponding to a second coordinate, which ends the touch input at the actuating unit; and an input acceptance processing unit configured to execute an off trigger, including the execution of the second predetermined function associated with the second position, if the distance or length of the trajectory is less than or equal to a predetermined value.

[0014] In the foregoing aspect of the present invention, the second predetermined function, which is represented by the second image displayed by the second display device, can be selected and confirmed by actuation on the actuating unit which is arranged remotely from the second display device (hereinafter also referred to as "remote touch panel type actuation").

[0015] The input acceptance processing unit, in particular, performs the off-trigger based on a touch input, the distance of which between the coordinates at the start of a touch input and the coordinates at the end of the touch input, or the distance of which follows the path of movement of the coordinates from the start of a touch input to the end of the touch input, is less than or equal to a predetermined value (in the description below, this distance is also referred to as an "on-off trigger distance", without distinguishing between the two distances described above).As described above, according to this aspect, a touch input whose on / off trigger distance is less than or equal to the predetermined value becomes an input that triggers the off trigger, that is, an input that is performed instead of the "press action on the remote control panel" to allow the simultaneous execution of the selection and confirmation actions. Conversely, a touch input whose on / off trigger distance is greater than the predetermined value becomes an input that does not trigger the off trigger. Accordingly, if an action is performed on the control unit while a second image is viewed on the second display device, the user (e.g., the driver) can determine whether to end the touch input by looking at the output position of the predetermined image (e.g., the shape of a license plate) in the second image.For example, if the predetermined image is displayed when a touch input is started at a desired position in the second image, the user can immediately release their finger to end the touch input, thus triggering the off-trigger.

[0016] In the above aspect, the vehicle-side actuating device may include a predetermined image output unit configured to control the second display device to display a predetermined image over the second image from the start to the end of the touch input.

[0017] According to the configuration described above, the operating feel of a remote keypad-type device is approximately the same as that of an existing display device equipped with a single screen keypad, thus providing a familiar user experience. The existing display device, which does not conventionally provide a guide indicator such as a cursor or positioning indicator, allows the user to perform direct operation.

[0018] In the above aspect, the predetermined image may take the form of a label, a cursor, or a positioning indicator.

[0019] According to the configuration described above, the predetermined image can be output in the form of a label or a cursor or a positioning indicator, the position of which is easily understood or recognized by the user.

[0020] In the aforementioned aspect, the predetermined image can take the form of a license plate. If multiple touch inputs are detected simultaneously, the predetermined image output unit can be configured to output the predetermined image at a position corresponding to each of the multiple touch inputs in the second image.

[0021] According to the configuration described above, the user can easily identify the starting position of the second touch input, which can implement a desired second predefined function, based on the output positions of the majority of predefined images. This corresponds to a preferred function when a relatively large number of second images, each representing a second predefined function, are output.

[0022] In the above aspect, the predetermined image output unit can be configured such that, using a predetermined conversion equation based on a relationship between a coordinate system of an actuation unit and a coordinate system of the second image, it calculates a third position according to the first coordinates in the second image and a fourth position according to the second coordinates in the second image.

[0023] According to the configuration described above, the correspondence relationship between absolute coordinate systems allows the user to intuitively determine the starting position of a desired touch input, thus improving usability.

[0024] In the aforementioned aspect, a scaling value in a first direction and a second direction of the actuating unit can be equal to a scaling value in the first direction and the second direction of the second display device. The first direction and the second direction can intersect.

[0025] In the aforementioned aspect, the vehicle-side actuating device comprises a first display control unit, which is configured to output a first image on the first display device. The actuating unit corresponds to a touchscreen keypad.

[0026] According to the configuration described above, operation of the remote keypad type can be carried out via the vehicle-side UI with two screens.

[0027] In the aforementioned aspect, the first display control unit has a first mode and a second mode. In the first mode, the first display control unit is configured to output an image from the first mode, or first-mode image, as the first image. The first-mode image displays a first predetermined function that differs from the second predetermined function. The first-mode image is independent of the second image output on the second display device. In the second mode, the first display control unit is configured to output an image from the second mode, or second-mode image, as the first image. The second-mode image has the same appearance as the second image output on the second display device.In the second mode, the input acceptance processing unit is configured to execute the off trigger if the distance or length of the movement path is less than or equal to the predetermined value, and it is configured to not execute the off trigger if the distance or length of the movement path is greater than the predetermined value.

[0028] In the aforementioned aspect, the input acceptance processing unit in the first mode can be configured to perform the first predetermined function in relation to the second coordinates based on the second coordinates.

[0029] According to the configuration described above, in the first mode, a first-mode image is displayed on the first display independently of any second image displayed on the second display. In the second mode, a second-mode image with the same appearance as a second image displayed on the second display is displayed on the first display. Therefore, the user can perform actions not only in the second mode (remote keypad type operation) but also in the first mode (hereinafter referred to as "independent display operation"). Independent display operation corresponds to an operation performed while directly viewing the first display.In the first mode, the user can implement the first predetermined function (for example, changing a setting value) displayed by the first mode screen by pressing a button on the first display. In this first mode, this capability allows the user to perform the action on the first display, independent of the second screen, while the second screen remains visible on the second display. Therefore, in the first mode, the user can keep the second screen visible on the second display regardless of any actions performed on the first display while driving, thus ensuring good user comfort.

[0030] Regarding the above aspect, the second image can include a navigation image.

[0031] According to the configuration described above, the user can perform the remote keypad type operation with reference to a navigation image while the navigation image is viewed on the second display device.

[0032] Regarding the above aspect, the input acceptance processing unit can be configured such that it does not execute the off trigger if the distance or length of the movement path is greater than the predetermined value.

[0033] If, according to the configuration described above, the predetermined image is displayed at a position other than a desired position in the second image when a touch input is initiated, the user can track the distance greater than or equal to the predetermined value without releasing their finger to end the touch input, thus preventing the touch input from triggering the off-trigger. In this way, by adjusting the on-off trigger distance, the user can prevent the off-trigger from occurring with any touch input. In the description below, such a function is referred to as a "touch input termination function." With remote keypad-type actuation, there is a small probability that the predetermined image will be displayed at a desired position in the second image when the first touch input is initiated.This means that the touch input termination function is useful when the operation is initiated by a remote keypad type. On the other hand, by looking at the predetermined image displayed in the second screen and releasing their finger (i.e., to end the touch input) when the predetermined image reaches a desired position, the user can know the starting position of the second touch input, which implements a desired second predetermined function, while the touch input termination function is active. That is, if the user releases their finger and then starts the second touch input at that position, there is a high probability that the predetermined image will be displayed at the desired position in the second screen.In this way, the touch input termination function becomes a selection support function when the user selects a desired second predefined function, further enhancing usability. By providing this touch input termination function, a touch input that triggers the off function is limited to touch inputs whose on-off trigger duration is less than or equal to the predefined value. A touch input with an on-off trigger duration less than or equal to the predefined value is more likely to strongly express the user's intent than an input with an on-off trigger duration greater than the predefined value. Therefore, such a touch input can be appropriately used to assume a user's confirmation intent.

[0034] The present invention makes it possible to perform the confirmation actuation for a function with reference to an image output by a display device, while using an actuation unit which is configured to only detect the coordinates of a touch input. Brief description of the illustrations

[0035] Features, advantages and the technical and industrial significance of exemplary embodiments of the invention are described below with reference to the accompanying figures, in which the same reference numerals denote the same elements and wherein: Fig. 1 is an illustration showing an example of a vehicle-side actuating device 1 according to one embodiment; Fig. 2 is an illustration showing an example of the assembly state of an upper display device 3 and a lower display device 4; Fig. Figure 3 is a figure which shows an example of functional blocks of a control unit 10; Fig. 4A is an illustration showing an example of an independence display mode image or an image in an independence display mode; Fig. 4B is an illustration which shows an image of a mirror display mode image; Fig. 5 is a state transition mapping that shows an example of a transition condition between an independence display mode and a mirror display mode; Fig. 6 is an illustration which shows an example of a guide display; Fig. 7 is a figure which shows a coordinate relationship (predetermined conversion equation) between a screen keypad 5 and the screen of an upper display device 3; Fig. 8 is a figure which shows a multi-point identifier output function; Fig. 9 is an illustration which shows an example of information from a graphical user interface (GUI); Fig. 10 is a figure which shows different definitions used to describe an example of operation; Fig. 11 is a general flowchart (part 1) which shows an example of processing performed by an input acceptance processing unit 114 of a control unit 10; Fig. 12 is a general flowchart (part 2) showing an example of processing performed by an input acceptance processing unit 114 of a control unit 10; Fig. 13 is an illustration showing a pseudo or sham remote touchpad mode, which is used instead of the mirror display mode; Fig. 14 is an illustration showing an example of the arrangement of a touch panel; and Fig. Figure 15 is an illustration which shows an example of the movement path of coordinates starting from the start to the end of a touch input. Detailed description of embodiments

[0036] One embodiment is described in detail below with reference to the illustrations. In the following description, an "image" corresponds to a concept, including a video. That is, a video corresponds to a type of image.

[0037] Fig. Figure 1 is an illustration showing an example of a vehicle-side actuating device 1 according to one embodiment. Fig. Figure 2 is an illustration showing an example of the assembly state of an upper display device 3 and a lower display device 4.

[0038] The vehicle-side operating device 1 implements a vehicle-side UI with two screens with the following configuration. As shown in Fig. As shown in Figure 1, the vehicle-side actuating device 1 comprises a multimedia device 2, the upper display device 3 (an example of a second display device), the lower display device 4 (an example of a first display device), a screen keypad or touch panel 5 (an example of an actuating unit), mechanical switches (hard switches) 6 and a control unit 10.

[0039] The multimedia device 2 comprises various components of a multimedia system, such as a navigation device and an audio device. The multimedia device 2 includes a computer (not shown) as a hardware component. An example of a "second display control unit" in the claims can be implemented by the computer's processing (program execution processing) within the multimedia device 2.

[0040] Multimedia device 2 outputs a user interface image (hereinafter also referred to as the "top image") to the upper display device 3. Multimedia device 2 outputs an upper image to the upper display device 3 that is selected from a plurality of upper image types. An upper image selected for output from the plurality of types is generally chosen by the user (e.g., the driver). In a specific case, an upper image may be automatically selected as the default.

[0041] In this embodiment, the multimedia device 2 outputs, for example, an upper image to the upper display device 3, selected from the plurality of upper image types prepared for actuating the multimedia device 2. The plurality of upper image types includes, in particular, a navigation image, an image relating to the audio device (an image indicating the track number, etc.), an image relating to a telephone and email, etc. Each of the plurality of upper image types can have a layered structure with images of a lower layer. For example, a navigation image can have a layered structure in which the map image is located in the top layer, and the image for setting the destination and the image for setting the display of the peripheral devices are located in the lower layer.

[0042] The multimedia device 2 generates a video signal with reference to the upper image, which is to be output to the upper display device 3, and sends the video signal to the control unit 10. For example, if a map image corresponding to a navigation image has been output to the upper display device 3, the multimedia device 2 generates a video signal to update the map image according to a change in the current position of the vehicle and sends the generated video signal to the control unit 10.

[0043] The multimedia device 2 receives an actuation signal from the control unit 10. The actuation signal is generated when a switch from the mechanical switches 6 is actuated for an input or when an input action is performed on the screen keypad 5. The multimedia device 2 performs processing according to the actuation signal based on the received actuation signal. For example, the multimedia device 2 performs various processing types, such as a screen transition from one navigation image to another image type (for example, an image related to the audio device), zooming in on a map in a navigation image, and route search. The multimedia device 2 generates a video signal based on the processing result and sends the generated video signal to the control unit 10.

[0044] The upper display device 3 corresponds to a display device such as a liquid crystal display. In this embodiment, a vehicle-type display is used as an example of the upper display device 3. Unlike the lower display device 4, the upper display device 3 in this embodiment does not have a touchscreen. This leads to a cost reduction for the upper display device 3 (the costs associated with the touchscreen) and an increase in the degree of freedom in the arrangement of the upper display device 3 (since there is no need to consider usability). However, in a modification, the upper display device 3 can have a touchscreen.

[0045] The upper display device 3 is arranged remotely from the lower display device 4. In this embodiment, the upper display device 3 is positioned higher than the lower display device 4 and further away from the driver's seat. As shown in Fig. As shown in Figure 2, the upper display device 3 is positioned so that the driver S can easily see it while driving. The distance from the driver's seat can be determined by the distance from the driver S's shoulder point P1 (design value). Conversely, the lower display device 4 is positioned so that the driver S can easily reach it and extend their hand towards it while driving, as shown in Figure 2. Fig. 2 shown. From the point of view of usability while driving, it is more advantageous if the position of the lower display device 4 is lower when the distance (range) from the shoulder point P1 ( Fig. 2) of the driver S is the same, since the muscle strain during the driving time is low. On the other hand, from the point of view of visibility during driving, it is less advantageous if the position of the lower display device 4 is lower. As described later, a navigation image can be displayed on the lower display device 4 as a mirror display mode image (described later). Therefore, to ensure the necessary visibility for the map image, the lower display device 4 is preferably arranged in a position where the depression angle from the driver S's point of view (depression angle in the downward direction with reference to the horizontal plane) is not significantly greater than 30 degrees. Although the upper display device 3 is located in the Fig. As shown in example 2, which is included in the dashboard, it can be located in the upper part of the dashboard.

[0046] As in Fig. As shown in Figure 1, the video signal is sent from the control unit 10 to the upper display device 3. The video signal sent to the upper display device 3 is generated by the control unit 10 based on the video signal received by the multimedia device 2. The upper display device 3 displays an upper image based on the video signal received by the control unit 10.

[0047] The lower display device 4 corresponds to a display device such as a liquid crystal display. In this embodiment, a vehicle-type display is used as an example of the lower display device 4.

[0048] The screen touchpad 5 is provided on the lower display device 4. That is, the lower display device 4 corresponds to a display device with the screen touchpad 5. The screen touchpad 5 is configured such that it only detects the coordinates of a touch input. Several types of screen touchpad 5 exist, such as a screen touchpad that uses an electrostatic method to detect the coordinates of a touch input based on a change in electrostatic capacitance generated by the touch input, or a screen touchpad that uses a low-pressure-sensitive method to detect the intensity of a touch input based on the slight pressure generated by the touch input. The screen touchpad 5 in this embodiment does not use a combination of the electrostatic and pressure-sensitive methods.In other words, the touch panel 5 of this type cannot detect the pressure of a touch input. In contrast, a touch panel that uses a combination of electrostatic and pressure-sensitive methods can detect the coordinates of a touch input using the electrostatic method and simultaneously detect the pressure of the touch input using the pressure-sensitive method. This type of panel allows the user to perform the "selection" action by moving their finger with pressure that does not exceed the threshold and simultaneously perform the "confirmation" action by applying pressure that does exceed the threshold. The touch panel 5 sends the detection signal to the control unit 10, which represents the coordinates of the detected touch input.

[0049] The mechanical switches 6 are, for example, provided in the design panel switch integrated into the dashboard. The mechanical switches 6 are, for example, provided around the lower display device 4 (see Fig. 5) The mechanical switches 6 include, for example, multimedia system switches, vehicle control system switches, and the top switch (a switch for returning to the independence display mode, as described later). The multimedia system switches, which are switches for operating the multimedia device 2, may include, for example, the map switch for calling up a navigation screen, the destination switch for calling up the screen for setting a destination, etc. The vehicle control system switches include the switches for various operations, such as the climate control operation, the driving control mode selection, the driver assistance device (distance sonar) setting, the rear seat operation, the electric rear sunshade operation, etc. The operation signal generated when the user operates the mechanical switches 6 is sent to the control unit 10.Instead of or in addition to the mechanical switches 6, other types of switches may be provided, each having the same individual function as the mechanical switches 6 (contactless switches without a moving element).

[0050] Other switch types may correspond to a pressure-sensitive layer switch or an electrostatic sensing touch-type switch.

[0051] The control unit 10 is a computer. The control unit 10 corresponds, for example, to an electronic control unit (ECU). The control unit 10 is connected to the multimedia device 2, the upper display device 3, the lower display device 4, the touchscreen keypad 5, and the mechanical switches 6, and via a CAN bus network 30 to the various electronic components in the vehicle. The electronic components to which the control unit 10 is connected via CAN bus 30 include an air conditioning ECU (not shown) for controlling an air conditioning system (not shown).

[0052] The control unit 10 comprises a main CPU (central processing unit) 11, a sub-microcomputer 12, a main memory device 13, an auxiliary memory device 14, and representation integrated circuits (ICs) 16 and 18. The main CPU 11 and the sub-microcomputer 12 may be integrated.

[0053] Fig. Figure 3 is a figure showing an example of the functional blocks of a control unit 10.

[0054] The control unit 10 comprises a display control unit 110 (an example of a first display control unit), a guide display output unit 111 (an example of a predetermined image output unit), a path calculation unit 112, and an input acceptance processing unit 114. The display control unit 110 can be implemented by the processing of the display IC 16 and the processing of the main CPU 11 (program execution processing). The guide display output unit 111 can be implemented by the processing of the display IC 18 and the processing of the main CPU 11 (program execution processing). The path calculation unit 112 and the input acceptance processing unit 114 can be implemented by the processing (program execution processing) of the main CPU 11 and the sub-microcomputer 12.

[0055] The display control unit 110 outputs an image (referred to as the "lower image") to the lower display device 4. The lower image comprises a user interface image (hereinafter also referred to as the "lower GUI image").

[0056] One or more functions are associated with the user interface image, such as the upper image and the lower GUI image, as described above. Each of these functions is associated with a predetermined position within the user interface image. A function associated with the user interface image is determined by the image's appearance. In other words, if a specific function is to be associated with an image, the image typically has an appearance related to that function. For example, in this embodiment, the user interface image has definition elements, each associated with an input on the screen keypad 5 and a corresponding function.A definition part corresponds to a part in which an actuation input assumed in the definition part and a function to be implemented in response to the actuation input are defined.

[0057] Typically, an actuation object indicator is displayed within a definition section. That is, a definition section corresponds to the display area of ​​an actuation object indicator, to which the characters and an image indicating the associated function are attached. The user interface screen in which such actuation object indicators are displayed can show the associated functions. An actuation object indicator can take the form of a switch; for example, a setting switch for specifying various settings (volume adjustment, temperature adjustment, etc.) of an actuation target device, such as the multimedia device 2 and an air conditioner (not shown), a switch for performing a specific screen transition, a scroll switch for scrolling the screen or a list, input keys, such as keys for letters and numbers, and a selection switch for selecting from a list.Additionally, an actuation object indicator can take the form of a symbol or a launcher to activate a specific application.

[0058] The actuation input and the function associated with a definition part are for each lower GUI image and for each definition part that is output at the lower display device 4 (see, for example, the one in Fig. GUI information shown in 9, where the information in Fig. (9 GUI information shown is described later) predefined.

[0059] The display control unit 110 has two modes: one corresponds to an independent display mode for outputting an independent display mode image, and the other corresponds to a mirror display mode for outputting a mirror display mode image. In the independent display mode, an independent display mode image corresponds to the lower GUI image. In the mirror display mode, a mirror display mode image corresponds to the lower GUI image. An example of transition conditions between the independent display mode and the mirror display mode will be described later with reference to Fig. 5 described.

[0060] An independence display mode image corresponds to an image that is independent of the upper image displayed on the upper display device 3. Even if the upper image displayed on the upper display device 3 changes, the independence display mode image does not change accordingly during the independence display mode. For example, an independence display mode image corresponds to an image that is not displayed on the upper display device 3. Although only one type of independence display mode image can exist, this embodiment provides for multiple types of independence display mode images. The user can select an independence display mode image to be displayed on the lower display device 4 from among the multiple types of independence display mode images.The various types of independence display mode images include, for example, images for operating the vehicle control system, such as the climate control operating image, the driving control mode selection image, the driver assistance device setting image, and the rear seat and electric rear sunshade operating image. Additionally, an independence display mode image can have a layered structure, in which the menu image corresponds to the home image, and various images, such as the climate control operating image and the driving control mode selection image, are displayed in parallel in the lower layer of the home image. Furthermore, each of these different images, such as the climate control operating image, can have a layered structure with further images in a lower layer.

[0061] Functions that differ from those shown in the image above are associated with an independence indicator mode image. In this embodiment, the functions associated with the definition parts in an independence indicator mode image include various functions of the vehicle control system. For example, the various functions associated with the definition parts of an independence indicator mode image may include various functions that can be implemented by the vehicle control system switches of the mechanical switches 6, and various other functions (various functions of the vehicle control system) that cannot be implemented by the vehicle control system switches. Fig. 4A is a figure showing an example of an independence display mode image. In the Fig. In example 4A, the independence display mode image corresponds to an air conditioning operation image, in which actuation object displays 401 to 410, which indicate various associated functions (functions with reference to the air conditioning operation image), are shown.

[0062] A mirrored display mode image has the same appearance as the upper image that is (currently) output to the upper display device 3. Therefore, if the upper image output to the upper display device 3 changes during mirrored display mode, the mirrored display mode image will change accordingly. It should be noted that a mirrored display mode image, relative to the upper image, may be reduced (or enlarged) by a constant ratio according to the difference in screen size between the upper display device 3 and the lower display device 4.

[0063] The functions relating to the upper image are connected to a mirror display mode image. Since the mirror display mode image and the upper image have the same appearance, the functions relating to the upper image and the functions relating to the mirror display mode image share the same concept. In this embodiment, the functions related to the definition parts in a mirror display mode image comprise various functions that are implemented by the multimedia device 2. For example, the various functions related to the definition parts in a mirror display mode image may include various functions that can be implemented by the multimedia system switches of the mechanical switches 6, and various other functions (multimedia system functions) that cannot be implemented by the multimedia system switches. Fig. 4B is an illustration showing an example of a mirror display mode image according to a navigation image. In the Fig. Example 4B shows the mirror display mode image actuation object displays 501 to 507, which indicate various associated functions (functions relating to the navigation image).

[0064] A mirror display mode image, which has the same appearance as the upper image output to the upper display device 3, can be generated using the video signal that the multimedia device 2 outputs to the upper display device 3. This eliminates the need for, or simplifies, the display control unit 110 to display a mirror display mode image, thereby reducing costs.

[0065] The display control unit 110 switches between the independent display mode and the mirror display mode based on a mode change input entered by the user. The mode change input corresponds to a predefined input which specifies the transition condition (later referred to as...). Fig. 5 described) between the independence display mode and the mirror display mode. The mode change input can include any one or any two from a predetermined input by the mechanical switches 6, a predetermined input on the screen keypad 5, a predetermined input via a voice (a predetermined input which is recognized by a voice recognition machine), and a predetermined input via a gesture using a hand or finger (a predetermined input which is recognized by the gesture recognition machine).

[0066] Fig. Figure 5 is a state transition mapping that shows an example of a transition condition between the independence display mode and the mirror display mode. Fig. Figure 5 shows the upper display device 3, the lower display device 4 and the mechanical switches 6.

[0067] The transition condition from the independence display mode to the mirror display mode is met if any of the following conditions (1) to (2) is met. (1) A drag-down or flick-down action is detected on the screen keypad 5. (2) An action of a multimedia system switch (e.g., map switch or destination switch) or mechanical switch 6 is detected.

[0068] The transition condition (return condition) from the mirror display mode to the independence display mode is met if any of the following conditions (11) to (14) are met. (11) The non-actuation state persists for the predetermined time T1. (12) An actuation of the vehicle control system switch of the mechanical switches 6 is detected. (13) An actuation of the top switch of the mechanical switches 6 is detected. (14) A drag-up or flick-up actuation is detected on the screen keypad 5.

[0069] In this embodiment, the display control unit 110 changes the mode, for example, based on an event (mode change input) that fulfills one of the conditions (1) to (2) in the independence display mode, from the independence display mode to the mirror display mode, as shown in Fig. Figure 5 shows this. Additionally, the display control unit 110 switches the mode from mirror display mode to independence display mode based on an event that fulfills condition (11) in mirror display mode. The display control unit 110 also switches the mode from mirror display mode to independence display mode based on an event (mode change input) that fulfills any of conditions (12) to (14) in mirror display mode.

[0070] Furthermore, the display control unit 110 performs the processing in response to the display change command based on the display change command received by the input acceptance processing unit 114 in the independence display mode. This processing corresponds to the processing for changing the screen transition, screen scrolling, and adjusting the display with respect to the independence display mode image. The display change command to be sent to the display control unit 110 is generated based on the actuation signal of a vehicle control system switch, the mechanical switches 6, or an actuation input associated with a definition element in the independence display mode image.

[0071] The guide display output unit 111 outputs a guide display (an example of a predetermined image) to the position corresponding to the coordinates in the upper image, based on the coordinates of a touch input on the screen keypad 5 (in the following description, this position is referred to as a "touch coordinates correspondence position in the upper image"). A touch input corresponds to an input detected by the screen keypad 5. The coordinates of a touch input can be calculated based on the detection signal received by the screen keypad 5. The guide display, a marker or cursor, or a positioning indicator, corresponds to a display that indicates the position according to the coordinates of a touch input. Outputting the guide display can improve the feasibility of remote keypad-type operation.This means that if an actuation is performed on the lower display device 4 while the upper image is viewed on the upper display device 3 (i.e., during an actuation of the remote touchpad type), the user can recognize the coordinates of the current touch input on the screen touchpad 5 based on the position of the guide indicator output to the upper display device 3.

[0072] In this embodiment, the guide indicator includes, for example, a marker 70 and a cursor or a positioning indicator 72, as shown in Fig. Figure 6 is shown. In many cases, the license plate number 70 essentially has the shape of a circle, a polygon, or an arrow. In the case of the one shown in Fig. In the example shown in Figure 6, the indicator 70 has the shape of the sun. The positioning indicator 72 is used to highlight (emphasize) the actuator display at the position according to the coordinates of a touch input. When the indicator 70 is output, the guide display output unit 111 generates a new video signal by superimposing the indicator 70 onto the upper image based on the video signal captured by the multimedia device 2, and then sends the generated video signal to the upper display device 3. When the positioning indicator 72 is output, the guide display output unit 111 generates a new video signal by highlighting the corresponding actuator display in the upper image based on the video signal captured by the multimedia device 2, and then sends the generated image signal to the upper display device 3.

[0073] The guide display output unit 111 calculates the touch coordinate correspondence position in the upper image using a predetermined conversion equation based on the relationship between the coordinate system of the screen keypad 5 and the coordinate system of the upper image. The relationship between the coordinate system of the screen keypad 5 (= the coordinate system of the lower image) and the coordinate system of the upper image is a fixed relationship, and the predetermined conversion equation (matrix) for converting from the coordinate system of the screen keypad 5 to the coordinate system of the upper image can be derived in advance. Fig. Figure 7 shows two coordinate systems, one corresponding to the coordinate system of the upper image, in which the origin is located at the upper left corner of the screen of the upper display device 3, and the other corresponding to the coordinate system of the screen keypad 5, in which the origin is located at the upper left corner of the actuation surface of the screen keypad 5. In this example, the coordinates (X1, Y1) and the coordinates (x1, y1) are in a correspondence relationship, and the coordinates (x1, y1) are converted to the coordinates (X1, Y1) by the predetermined conversion equation. Operation of the remote keypad becomes more intuitive when the correspondence relationship between the absolute coordinate systems is used in this way, compared to when the so-called relative coordinate system correspondence is used, thus improving usability.

[0074] At the in Fig. In the example shown, indicator 70 is output at the touch coordinate correspondence position (X1, Y1) according to the touch input coordinates (X1, Y1), and simultaneously, the positioning indicator 72 for the actuator display is output at the position of the touch coordinate correspondence position (X1, Y1). If the coordinates of the touch input change, the touch coordinate correspondence position (X1, Y1) changes, and at the same time, the output position of indicator 70 also changes in the image above. When the coordinates of the touch input change, the output state is modified such that the positioning indicator 72 is output if indicator 70 is located on an actuator display, but not output if indicator 70 is not located on an actuator display.

[0075] The guide display output unit 111 ends the display of the indicator 70 and the positioning indicator 72 when the user ends a touch input.

[0076] This means that when the user ends the touch input on the screen keypad 5, the guide display output unit 111 stops displaying the identifiers 70 and the positioning indicator 72 that were displayed up to that point. This makes the operating sensation at the time of actuation of the remote keypad type approximately the same as that of the actuation time of the "existing display device equipped with a single screen keypad", thus providing operability that is familiar to the user who is familiar with the "existing display device equipped with a single screen keypad".Furthermore, ending the display in this way prevents the inconvenience that can arise if the indicator 70 or the positioning indicator 72 continues to be displayed after the touch input has been completed (prevents the user from misunderstanding that the indicator 70 and the positioning indicator 72 can be moved based on the correspondence relationship in the so-called relative coordinate system).

[0077] When a touch input occurs in such a way that the coordinates simultaneously become a plurality of points, the guide display output unit 111 additionally outputs the identifier 70 at the position corresponding to each of the plurality of coordinates in the image above. In the description below, this function is referred to as the "multi-point identifier output function". A touch input that generates the coordinates in such a way that the coordinates simultaneously become a plurality of points typically occurs when the user touches the screen keypad 5 with a plurality of fingers. Fig. Figure 8 is an illustration showing the multi-point identifier output function. Fig. Figure 8 shows the case in which, when a touch input occurs in such a way that five coordinates are generated simultaneously (that is, a touch input occurs when the user touches the screen keypad 5 with five fingers of their open hands), five markers 70 are output, one for each touch coordinate correspondence position in the upper image. Consequently, based on the plurality of markers 70, the user can easily identify which finger is closest to or touching the desired actuation object display. Accordingly, the multi-point marker output function is suitable when a mirror display mode image with a relatively large number of definition parts (and consequently a relatively large number of actuation object displays) is output.

[0078] The distance calculation unit 112 calculates the distance between the coordinates at the start of a touch input and the coordinates at the end of the touch input. In the following description, the coordinates at the start of a touch input are referred to as the "on-trigger coordinates," the coordinates at the end of a touch input are referred to as the "off-trigger coordinates," and the distance between the coordinates at the start of a touch input and the coordinates at the end of the touch input is referred to as the "on-off-trigger distance dd." The on-off-trigger distance dd can be expressed by the following equation, where the on-trigger coordinates are (x0, y0) and the off-trigger coordinates are (x1, y1). dd=√{(x1−x0)2+(y1−y0)2}. In this case, the on-off trigger path dd corresponds to a linear path between the two points.

[0079] The input acceptance processing unit 114 performs off-trigger functional processing in mirror display mode based on the off-trigger coordinates of a touch input. Off-trigger functional processing corresponds to processing to execute the function associated with the off-trigger coordinates. In this embodiment, off-trigger functional processing in mirror display mode is performed for a definition element associated with an off-trigger input (a type of actuation input) in a mirror display mode image.

[0080] An off-trigger input corresponds to a type of actuation input where the coordinates at the end of a touch input (off-trigger coordinates) are used as individual input coordinates with reference to the touch input. Accordingly, an actuation input type such as "a tap" can correspond to an off-trigger input. Conversely, an actuation input type such as a drag, a pinch-in / pinch-out movement, and a flick does not correspond to an off-trigger input.

[0081] Additionally, the input acceptance processing unit 114 performs the off-trigger type functional processing in the independence display mode based on the off-trigger coordinates of a touch input. In this embodiment, the off-trigger type functional processing in the independence display mode is performed similarly for a definition part associated with an off-trigger type input in an independence display mode image.

[0082] If an independence display mode image or a mirror display mode image output to the lower display device 4 has a definition part associated with a non-off trigger type input (e.g., a drag, a pinch-in / pinch-out, a flick, etc.), the input acceptance processing unit 114 performs the function associated with the definition part based on a non-off trigger type input (e.g., a drag, a pinch-in / pinch-out, a flick, etc.) associated with the definition part (in the following description, this processing is referred to as "non-off trigger type functional processing").

[0083] As described above, in mirror display mode, a mirror display mode image together with the upper image can serve as a GUI with respect to the multimedia device 2, and the screen keypad 5 can serve as an actuating device for operating the multimedia device 2. Likewise, in independence display mode, an independence display mode image can serve as a GUI of the vehicle control system, and the screen keypad 5 can serve as an actuating device for operating the vehicle control system.

[0084] A specific example of the processing by the input acceptance processing unit 114 is given below with reference to Fig. 9 described. The input acceptance processing unit 114 performs off-trigger functional processing or non-off-trigger functional processing based on the GUI information prepared for each independence display mode image and each mirror display mode image. As described in Fig. As shown in Figure 9, the GUI information includes, for example, an image ID to identify each independence display mode image and each mirror display mode image, and for each image ID, the definition part IDs that identify one or more definition parts. The GUI information further includes, for each definition part ID, the position (area) of the definition part, an actuation input (actuation input type) associated with the definition part, an actuation signal associated with the definition part (that is, the actuation signal for implementing the function associated with the definition part), and the output destination of the actuation signal. In this embodiment, for example, an off-trigger type input is associated with each definition part for which an actuation object indicator, such as actuation object indicators 501 to 507 (see Figure 9), is displayed. Fig. 4B). Regarding the GUI information, it should be noted that the multimedia device 2 is not defined for the output destination of the actuation signal with respect to an independent display mode image, and that the display control unit 110 is not defined for the output destination of the actuation signal with respect to a mirror display mode image. The GUI information is, for example, pre-stored in the main memory device 13.

[0085] In Fig. For example, image ID 00001 is associated with a mirror display mode image according to a navigation image. The definition part ID 00001, with reference to image ID 00001, corresponds to the ID of a definition part (xx10 to xx11, yy10 to yy11) associated with an input of the off-trigger type. This definition part corresponds to a rectangular area defined by the X-coordinates xx10 to xx11 and the Y-coordinates yy10 to yy11 of the screen. The display change command A is associated with the definition part ID 00001 as the function. The display change command A is output to the multimedia device 2. Similarly, for a definition part (xx30 to xx31, yy30 to yy31) with the definition part ID 00003, a flick or wipe is assumed, and in response to the flick, the command B to push or scroll down to the multimedia device 2 is issued.Image ID = 00001 has a different definition part, which is not shown, and is associated with an input of the off-trigger type. Image ID = 00002 is associated with an independence display mode image. The definition part ID 00002, with reference to image ID = 00002, corresponds to the ID of a definition part (xx20 to xx21, yy20 to yy21) associated with an input of the off-trigger type, and the setting value increase command B and the display change command B are related functions. The setting value increase command B is output to CAN 30, and the display change command B is output to the display control unit 110.As described above, the input acceptance processing unit 114 does not perform functional processing of the off-trigger type for all of the definition part IDs defined by the GUI information, but only for one definition part ID for which an "off-trigger type input" is defined as the actuation input type. The following describes the processing with emphasis on the functional processing of the off-trigger type.

[0086] The input acceptance processing unit 114 performs off-trigger functional processing in mirror display mode based on a touch input where the on-off trigger distance dd is less than or equal to the predetermined value dth. Therefore, in mirror display mode, the user can implement the function related to the mirror display image by performing a touch input whose on-off trigger distance dd is less than or equal to the predetermined value dth.

[0087] The predetermined value dth, which is essentially 0, is greater than an error in the detection signal that can occur when the user touches the same position on the screen keypad 5, or greater than a minor, unintended deviation of a touch position. For example, the predetermined value dth corresponds to the maximum distance between the off-trigger coordinates of two or more taps, which are assumed to be taps at the same position on the screen keypad 5. The predetermined value dth can be set differently for the image IDs depending on the size and density of each definition part.

[0088] In mirror display mode, the input acceptance processing unit 114 does not perform the off-trigger functional processing for a touch input whose on-off trigger path dd is greater than the predetermined value dth. Therefore, in mirror display mode, the input acceptance processing unit 114 does not perform the function associated with a definition part for a touch input whose on-off trigger path dd is greater than the predetermined value dth, even if the off-trigger coordinates are located in the definition part; instead, the auxiliary storage device 14 essentially overrides the touch input itself (that is, it does not perform any processing in the same way as in the non-operating state). This means that the user can prevent off-trigger functional processing from being performed for any touch input by adjusting the on-off trigger path dd.If, for example, the indicator 70 or the positioning indicator 72 is displayed at the start of a touch input at a position that differs from a desired position in the upper image, the user can track the distance greater than the predetermined value dth without removing their finger from the screen keypad to terminate the touch input, thus preventing the touch input from triggering off-trigger functional processing. In the description below, such a function is referred to as a "touch input termination function." If the user initiates an actuation without looking at the lower display device 4, there is a small probability that the indicator 70 or the positioning indicator 72 will be displayed at the start of the first touch input at a desired position in the upper image.Therefore, this touch input termination function is useful when an action is initiated without looking at the lower display device 4. Alternatively, the user can look at the indicator 70 or the positioning indicator 72, which is displayed in the upper image, and release their finger (i.e., end the touch input) when the indicator 70 or the positioning indicator 72 reaches a desired position. This allows the user to easily know the starting position of the second touch input, which can implement the desired function while using the touch input termination function. That is, if the user moves their finger on the screen keypad 5 and knows a desired finger position, they can release their finger from the screen keypad 5 and then initiate the second touch input at that position.In this case, there is a high probability that the identifier 70 or the positioning indicator 72 will be displayed at a desired position in the upper image, and if the user releases their finger from the screen keypad 5, the desired function can be implemented. In this way, the touch input termination function, which can also be used as a selection support function for choosing a desired definition element, further enhances usability. By providing such a touch input termination function, a touch input that triggers the functional processing of the off-trigger type in the mirror display mode image is limited to a touch input whose on-off trigger path dd is less than or equal to the predetermined value dth.A touch input whose on-off trigger distance dd is less than or equal to the predetermined value dth, which is more likely to accurately express the user's actuation intention than a touch input whose on-off trigger distance dd is greater than the predetermined value dth, can be suitable as an input to assume the user's confirmation intention at the time of an actuation of the remote keypad type.

[0089] In independence display mode, the input acceptance processing unit 114 performs off-trigger functional processing independently of the on-off trigger path dd. Therefore, the user can implement the function associated with an independence display mode image even if the on-off trigger path dd becomes greater than the predetermined value dth in independence display mode. This means that even if the starting position of a touch input cannot be aligned with the position of a desired definition element in an independence display mode image, for example due to vibration in the vehicle, the user can implement the function associated with the desired definition element without repeating the touch input by aligning the end position of the touch input with the position of the desired definition element and then releasing the finger.In the independence display mode, the user performs the operation while viewing the lower display device 4, and therefore the indicator 70 and the positioning indicator 72, as described above, are not necessary.

[0090] Additionally, the input acceptance processing unit 114 performs processing according to an actuation signal received from the mechanical switches 6. Specifically, after receiving an actuation signal related to the multimedia system switch, the input acceptance processing unit 114 sends the actuation signal to the multimedia device 2. After receiving an actuation signal related to the vehicle control system switch, the input acceptance processing unit 114 sends the control command according to the actuation signal to CAN 30, and simultaneously, CAN 30 sends the display change command according to the actuation signal to the display control unit 110. The display change command sent to the display control unit 110 specifies a change to be applied to the screen transition, screen scrolling, and a settings screen related to the independence display mode image.Additionally, the input acceptance processing unit 114 generates the display change command, which instructs a screen transition to the home screen of the independence display mode screen when the activation signal with respect to the top switch is received. When the display change command is generated with respect to the top switch, the input acceptance processing unit 114 sends the generated display change command to the display control unit 110.

[0091] According to the vehicle-side actuating device in the embodiment described above, the following outstanding effects are achieved.

[0092] First, according to this embodiment, the vehicle-side actuating device allows, in mirror display mode, while the appearance of the image on the lower display device 4 and the image on the upper display device 3 (the mirror display mode image and the upper image) are maintained in the same state, the functions relating to the image can be implemented by actuating the lower display device 4. Therefore, in mirror display mode, the user can perform remote control-type actuation, whereby the user can realize the functions (e.g., changing the setting values, etc.) related to the mirror display mode image, which has the same appearance as the upper image, by actuating the lower display device 4, while the upper image displayed on the upper display device 3 is being viewed.

[0093] Additionally, in mirror display mode, the user can perform operation with reference to the mirror display mode image (= operation with reference to the upper image) via the lower display device 4 while viewing the mirror display mode image, which has the same appearance as the upper image on the upper display device 3. Since the lower display device 4 is positioned lower than the upper display device 3 and closer to the driver's seat, usability is improved compared to a case where a touchscreen keypad is provided at the upper display device 3 and operation is performed with reference to the upper image on the upper display device 3.

[0094] Additionally, in mirror display mode, the input acceptance processing unit 114 performs the function related to off-trigger coordinates in the mirror display mode image based on the off-trigger coordinates (functional processing of the off-trigger type). At this time, the input acceptance processing unit 114 performs the functional processing of the off-trigger type based on a touch input whose on-off trigger path dd is less than or equal to the predetermined value dth. Accordingly, if an action is performed on the lower display device 4 while an upper image is viewed on the upper display device 3, the user can determine whether to end the touch input by looking at the indicator 70 or the positioning indicator 72 displayed in the upper image.For example, if the indicator 70 or the positioning indicator 72 is displayed at a desired position in the upper image when a touch input is initiated, the user can immediately release their finger to end the touch input, thus performing off-trigger type functional processing. Therefore, a touch input whose on-off trigger path dd is less than or equal to the predetermined value dth is equivalent to an input that can be used instead of the "press-down actuation on the remote keypad" to enable selection and confirmation actuation at the same time. Therefore, according to this embodiment, it is possible to improve the feasibility of remote keypad-type actuation while using the screen keypad 5, which is configured to capture only the coordinates of a touch input.

[0095] Since the upper image displayed on the upper display device 3 corresponds to a navigation image, etc., it is also possible to use GUI-based software, for example, on the "existing display device equipped with a single screen keypad". Since the mirror display mode image has the same appearance as the upper image, the mirror display mode image can also be generated using the video signal sent to the upper display device 3, as shown in Fig. Figure 1 shows that this makes it possible to reduce the development effort of the software relating to the generation of a mirror display mode image in the display control unit 110 and of the software relating to the multimedia device 2.

[0096] Additionally, in Independence Display mode, the user can implement a function related to an Independence Display mode image by pressing the lower display device 4. Therefore, the user can implement a function (an operation of the vehicle control system) by pressing the lower display device 4, which is not possible in Mirror Display mode. In this way, in Independence Display mode, the user can perform an operation on the lower display device 4 related to an Independence Display mode image that is independent of the upper image, while the upper image remains visible on the clearly visible upper display device 3.Therefore, in Independence Display mode, the user can keep a navigation image visible on the upper display device 3, which has better visibility compared to the lower display device 4, even if any operation is performed on the lower display device 4 while driving.

[0097] As described above, the lower GUI image output to the lower display device 4 selectively includes one of the following two images: an independent display mode image, independent of the upper image output to the upper display device 3, and a mirror display mode image with the same appearance as the upper image displayed on the upper display device 3. Therefore, the user can perform a mode change input to switch the lower GUI image output to the lower display device 4 from the independent display mode image to the mirror display mode image, thereby improving usability.

[0098] In both independence display mode and mirror display mode, the user can implement various functions by pressing the screen keypad 5 of the lower display device 4. Therefore, the upper display device 3 can be used solely for display purposes, thus reducing its cost (in particular, the cost associated with the screen keypad is unnecessary). Furthermore, when used solely for display, the upper display device 3 can be positioned away from the driver's hand. This arrangement minimizes the difference between the direction of the line of sight and the driver's hand.the driver's direction of gaze towards the upper display device 3 and the driver's direction of gaze towards the road ahead during the journey (the amount of change in the direction of gaze from the direction in which the driver is looking at the road ahead to the direction in which the driver is looking at the upper image on the upper display device 3).

[0099] The following is an example of how to operate control unit 10 with reference to Fig. 10 to Fig. 12 described.

[0100] Fig. Figure 10 is a diagram showing the different definitions used to describe an example of operation, and the Fig. 11 and Fig. 12 correspond to general flowcharts that show an example of processing performed by the input acceptance processing unit 114 of the control unit 10.

[0101] The x and y coordinates with reference to the screen of the lower display device 4 and their positive directions are defined as in Fig. 10 is shown. Fig. Figure 10 schematically shows the user's hand moving downwards with one finger on the screen keypad 5. In the description below, it is assumed that the coordinates of the current touch position are (x, y), the touch start (on-trigger) position is (x0, y0), and the touch end (off-trigger) position is (x1, y1), as shown in Fig. 10 shown.

[0102] The in Fig. The processing shown in Figure 11 is carried out, for example, at predetermined periodic intervals while the ignition switch remains on. The processing shown in Fig. The processing shown in Figure 11 comprises a loop that is executed at predetermined periodic intervals. In this embodiment, the predetermined phase corresponds, for example, to the frame phase on the lower display device 4.

[0103] In step S1100, the input acceptance processing unit 114 determines whether a touch input has been initiated on the screen keypad 5. The presence or absence of a touch on the screen keypad 5 can be determined based on the presence or absence of the detection signal received by the screen keypad 5. If the determination result is "Yes", processing proceeds to step S1102; otherwise, the current processing cycle ends.

[0104] In step S1102, the input acceptance processing unit 114 determines whether the coordinates of the touch input correspond to a plurality of points. If the result of the determination is "Yes", processing proceeds to step S1110; otherwise, processing proceeds to step S1119.

[0105] In step S1110, the guide display output unit 111 outputs the identifier 70 in the upper image at each position according to the touch coordinate or at each touch coordinate correspondence position, based on the coordinates of two or more points with reference to the touch input (see Fig. 8) As long as step S1111 returns a positive result and processing proceeds to step S1118, steps S1110, S1112, and S1114 are executed based on each of the coordinates of two or more points obtained at that time, until the touch input ends, even if the number of points of the coordinates with respect to the touch input changes during the continuation of the touch input (for example, if the number of points changes to one). If, during the continuation of the touch input, it is determined that the current touch input corresponds to a pinch-in or pinch-out for a definition part with which a pinch-in or pinch-out is associated ("Yes" at step S1111), the input acceptance processing unit 114 performs the non-out trigger functional processing with respect to the definition part (step S1118).

[0106] In step S1112, the input acceptance processing unit 114 determines for each touch coordinate correspondence position in the upper image whether a definition part exists at the touch coordinate correspondence position, based on the coordinates of two or more points with reference to the touch input and the GUI information (see Fig. 9) with reference to the image ID of the currently output image. If the result of the determination is "Yes", processing proceeds to step S1114; otherwise, processing proceeds to step S1116.

[0107] At step S1114, the guide display output unit 111 outputs the positioning display 72 for the definition part at the contact coordinates correspondence position.

[0108] In step S1116, the input acceptance processing unit 114 determines whether the touch input on the screen keypad 5 is ongoing. If the result of the determination is "Yes", the loop returns to step S1110; otherwise, the processing exits the loop and proceeds to step S1117.

[0109] In step S1117, the guide display output unit 111 clears the indicator 70. Furthermore, the guide display output unit 111 also clears the positioning indicator 72 if it is displayed. After the completion of step S1117, the current processing cycle is immediately terminated.

[0110] At step S1119, the input acceptance processing unit stores 114 coordinates of the current touch input as the on-trigger coordinates with reference to the current touch input.

[0111] In step S1120, the guide display output unit 111 outputs the identifier 70 at the position corresponding to the touch coordinate or the touch coordinate correspondence position (one point) in the upper image based on the coordinates of the touch input (one point) (see Fig. 7) As long as step S1121 returns a positive result and processing proceeds to step S1118, steps S1120, S1122, and S1124 are executed based on the coordinates (last coordinates) with respect to a point at the start of the touch input until the touch input ends, even if the number of points of the coordinates with respect to the touch input changes during the continuation of the touch input (for example, if the number of points changes to two or more points). If, during the continuation of the touch input, it is determined that the current touch input corresponds to a drag or flick for a definition part with which a drag or flick is associated ("Yes" at step S1121), the input acceptance processing unit 114 performs the non-off-trigger functional processing associated with the definition part (step S1118).

[0112] In step S1122, the input acceptance processing unit 114 determines the coordinates of the touch input and the GUI information (see Fig. 9) With reference to the image ID of the currently displayed image, check whether a definition part is present at the contact coordinates correspondence position in the upper image. If the result of the determination is "Yes", processing proceeds to step S1124; otherwise, processing proceeds to step S1126.

[0113] At step S1124, the guide display output unit 111 outputs the positioning display 72 for the definition part at the contact coordinates correspondence position (see Fig. 7).

[0114] In step S1126, the input acceptance processing unit 114 determines whether the touch input on the screen keypad 5 is ongoing. If the result of the determination is "Yes", the loop returns to step S1120; otherwise, the processing exits the loop and proceeds to step S1128.

[0115] At step S1128, the guide display output unit 111 clears the indicator 70. If the positioning indicator 72 is displayed, the guide display output unit 111 also clears the positioning indicator 72.

[0116] In step S1130, the input acceptance processing unit stores 114 coordinates of the current touch input as the off-trigger coordinates with respect to the current touch input. After completion of step S1130, processing proceeds to step S1200. Fig. 12 ahead.

[0117] With reference to Fig. At step S1200, input acceptance processing unit 114 determines whether the current display mode corresponds to the mirror display mode. If the result of the determination is "Yes", processing proceeds to step S1202; otherwise (that is, if the current display mode corresponds to the independence display mode), processing proceeds to step S1206.

[0118] In step S1202, the distance calculation unit 112 calculates the on-off trigger distance dd for the current touch input based on the on-trigger coordinates and the off-trigger coordinates, which are stored accordingly in steps S1119 and S1130. The calculation method for the on-off trigger distance dd is described above.

[0119] In step S1204, the input acceptance processing unit 114 determines, based on the on-off trigger distance dd calculated in step S1202, whether the on-off trigger distance dd is less than or equal to the predetermined value dth. If the result of the determination is "Yes", processing proceeds to step S1206; otherwise, the current processing cycle is terminated immediately.

[0120] In step S1206, the input acceptance processing unit 114 determines the output trigger coordinates stored in step S1130 and the GUI information (see Fig. 9) With reference to the image ID of the currently displayed image, check whether a definition part (hereinafter referred to as the "selection definition part") is located at the off-trigger coordinates. If the result of the determination is "Yes", processing proceeds to step S1208; otherwise, the current processing cycle is terminated immediately.

[0121] In step S1208, the input acceptance processing unit 114 executes the function associated with the selected definition part. At this time, the input acceptance processing unit 114 can immediately highlight the actuation object display according to the selected definition part or generate a vibration (a vibration produced by a haptic mechanism not shown) on the screen keypad 5 to output information to the user to indicate that the selected definition part has been selected and confirmed.

[0122] According to the in Fig. 11 and Fig. In the processing shown in Figure 12, functional processing of the off-trigger type is performed during mirror display mode based on a touch input whose on-off trigger range dd is less than or equal to the predetermined value dth. Conversely, during independent display mode, functional processing of the off-trigger type is performed regardless of the on-off trigger range dd. Additionally, the multi-point label output function is implemented. If the coordinates of a touch input correspond to a plurality of points, functional processing of the off-trigger type is not performed. This prevents functional processing of the off-trigger type from being performed based on an unwanted actuation.

[0123] In the embodiment described above, an “independence display mode image” corresponds to an example of a “first image” and a “first mode image” in the claims. A function relating to a definition part included in the independence display mode image and associated with an “off-trigger input” corresponds to an example of a “first predetermined function” in the claims. An upper image representing a second predetermined function corresponds to an example of a “second image” in the claims, and the second predetermined function corresponds to the function relating to a definition part included in a mirror display mode image and associated with an “off-trigger input.” Furthermore, off-trigger functional processing performed in a mirror display mode corresponds to an example of an “off trigger” in the claims.A mirror display mode image with the same appearance as an upper image representing the second predetermined function corresponds to another example of the “first image” in the claims and an example of the “second mode image” in the claims.

[0124] Although the embodiment has been described in detail, the present invention is not limited to a specific embodiment and various modifications and changes can be added to the scope of protection described in this specification. It is also possible to combine all or a majority of the components of the embodiment described above.

[0125] For example, although in the embodiment described above both the identifier 70 and the positioning indicator 72 are output, the output of one of them can be omitted.

[0126] Although in the embodiment described above the input acceptance processing unit 114 performs off-trigger-type functional processing for a touch input whose on-off trigger distance dd is greater than the predetermined value dth in the independence display mode, the present invention is not limited thereto. That is, in the independence display mode, as in the mirror display mode, it is also possible for the input acceptance processing unit 114 not to perform off-trigger-type functional processing for a touch input whose on-off trigger distance dd is greater than the predetermined value dth. With such a modification, the same operability can be achieved in both the independence display mode and the mirror display mode.

[0127] Furthermore, in the embodiment described above, the multi-point identifier output function described above can be omitted. For example, if the coordinates of a touch input correspond to a plurality of points, it is also possible that identifier 70 is not output at all, or that only the coordinates of a predetermined single point are allowed and identifier 70 is output at that point.

[0128] Although the mirror display mode and the independence display mode are provided in the embodiment described above, a configuration is also possible in which the independence display mode is not provided.

[0129] In the embodiment described above, the pseudo- or sham remote touchpad mode can be used instead of the mirror display mode. In the sham remote touchpad mode, a background image (background image not for the GUI) (another example of the first image), which does not serve as a GUI image, is displayed instead of the mirror display mode image. The background image corresponds, for example, to an image that only has the background color (for example, an image containing only information that is not essentially related to the operation, such as an image with only black). For example, in the Fig. In the example shown in Figure 13, a background image 900 with only black is displayed on the lower display device 4. Even in such a case, the sham remote touchpad mode allows the user to perform remote touchpad-type operation, although operation while looking directly at the lower display device 4 is essentially impossible, thus achieving the effect described above for remote touchpad-type operation. Although this modification has two modes, the sham remote touchpad mode and the independent display mode, a configuration without the independent display mode is also possible.

[0130] In the embodiment described above, a touchpad or keypad (another example of the actuation unit) can be used instead of the screen keypad 5. This touchpad is configured to detect only the coordinates of a touch input. A touchpad configured to detect only the coordinates of a touch input is not, for example, a push-down type touchpad. A push-down non-support type touchpad is a type of touchpad where the touchpad itself is not moved up and down but is fixed relative to the surrounding components. Therefore, a push-down non-support type touchpad has no mechanism that allows the touchpad to move up and down, and no unit (clock switch, pressure sensor, etc.) for detecting a press on the touchpad.In a modification where a touchpad is used instead of the screen keypad 5, and is configured to detect only the coordinates of a touch input, a touch input corresponds to an input detected by the touchpad. In such a modification, the detection signal received by the touchpad can be used in the same way as the detection signal received by the screen keypad 5 described above. In this modification, the touchpad eliminates the need for the lower display device 4, the display IC 16, and the display control unit 110, thus allowing the touchpad to be positioned in a more convenient location. Fig. Figure 14 shows, for example, an example of a touchpad 9, which is provided on the console box or console housing. With such a modification, the touchpad also allows the user to perform the remote keypad-type operation shown in the upper image via the touchpad, thus achieving the effect described above regarding remote keypad-type operation.

[0131] In the embodiment described above, the on-off trigger path dd corresponds to the path between the coordinates at the start of a touch input and the coordinates at the end of the touch input (linear path between two points). However, the present invention is not limited to this. The on-off trigger path dd can, for example, be calculated as a path that follows the movement of the coordinates from the start of a touch input to the end of the touch input (that is, the length of the movement path). Fig. Figure 15, for example, shows a motion path L as an example of the motion path of the coordinates from the start to the end of a touch input. In this case, the distance that follows the motion path L of the coordinates from the start to the end of a touch input can be calculated by accumulating a very short distance per very short time interval (linear distance between two points at each short time interval) from the start to the end of the touch input.

[0132] In the embodiment described above, the upper image comprises various image types for use in operating the multimedia device 2; however, the present invention is not limited thereto. For example, the upper image may simply comprise a navigation image. In this case, images relating to the audio device, one of the various image types for operating the multimedia device 2, may be included in the independence display mode image. Additionally, the upper image may further comprise images for operating a device other than the multimedia device 2.

[0133] Although the upper display device 3 and the lower display device 4 correspond to vehicle-side displays in the embodiment described above, one or both of the upper display device 3 and the lower display device 4 can be implemented as the display device of a user terminal device (for example, a smartphone, a tablet, etc.) that is brought into and installed in the vehicle. In this case, communication between the display device of the terminal device brought into the vehicle (upper display device 3 and / or the lower display device 4) and the control unit 10 can be carried out by a wireless transmitter / receiver unit (Bluetooth communication unit) which is additionally provided in the control unit 10, or it can be carried out by a wireless connection.The upper display device 3 is attached to the upper part of the dashboard via a mounting bracket when it is installed in the vehicle. When the lower display device 4 is installed in the vehicle, it is held, for example, by a mounting bracket installed on the front of the dashboard. In this case, the mounting bracket and the mounting bracket are positioned such that the upper display device 3 is higher than the lower display device 4 and is located away from the driver's seat.

[0134] Although the multimedia device 2 and the control unit 10 are provided separately, and the display control unit 110, the guide display output unit 111, the distance calculation unit 112, and the input acceptance processing unit 114 are implemented by the control unit 10 in the embodiment described above, the present invention is not limited thereto. For example, the functions described in Fig.The GUI information shown in Figure 9 included information about a mirror display mode image stored in the multimedia device 2; additionally, off-trigger functional processing with respect to a mirror display mode image, which corresponds to one of the functions of the input acceptance processing unit 114, can be implemented by computer processing in the multimedia device 2. In this case, the computer in the multimedia device 2 performs off-trigger functional processing with respect to a mirror display mode image in mirror display mode based on the capture signal received from the screen keypad 5 and the information about a mirror display mode image, as included in the GUI information.

Claims

[1] Vehicle-side actuating device (1) mounted on a vehicle, the vehicle-side actuating device (1) comprising: an operating unit configured to detect coordinates of a touch input; a first display device (4); a second display device (3) arranged at a higher position than the operating unit and remote from a driver's seat of the vehicle compared to the operating unit; a second display control unit (2) configured to control the second display device (3) to display a plurality of second images, each indicating a second predetermined function; a distance calculation unit (112) configured to calculate a distance or a length of a trajectory between a first position and a second position, wherein the first position corresponds to a first coordinate that starts the touch input at the operation unit, and the second position corresponds to a second coordinate that ends the touch input at the operation unit; an input acceptance processing unit (114) configured to perform an off-trigger including the execution of the second predetermined function in association with the second position when the distance or length of the trajectory is less than or equal to a predetermined value; and a first display control unit (110) configured to output a first image on the first display device (4), wherein the operating unit corresponds to a screen touch panel (5), the first display control unit (110) has a first mode and a second mode, the first display control unit (110) is configured in the first mode to output a first mode image as the first image, wherein the first mode image displays a first predetermined function different from the second predetermined function, and wherein the first mode image is independent of the second image output on the second display device (3), the first display control unit (110) is configured in the second mode to output a second mode image as the first image, the second mode image having the same appearance as the second image output on the second display device (3), and the input acceptance processing unit (114) in the second mode is configured to perform the off-trigger when the distance or the length of the trajectory is less than or equal to the predetermined value, and is configured not to perform the off-trigger when the distance or the length of the trajectory is greater than the predetermined value. [2] The vehicle-side operating device (1) according to claim 1, further comprising a predetermined image output unit (111) configured to control the second display device (3) to display a predetermined image from the start to the end of the touch input over the second image. [3] The vehicle-side operating device (1) according to claim 2, wherein the predetermined image is in the form of a license plate or a positioning indicator. [4] The vehicle-side operating device (1) according to claim 2, wherein the predetermined image has the shape of a license plate, and the predetermined image output unit (111) is configured such that, when a plurality of touch inputs are simultaneously detected, the predetermined image output unit (111) outputs the predetermined image at a position corresponding to each of the plurality of touch inputs in the second image. [5] The vehicle-side operating device (1) according to claim 2, wherein the predetermined image output unit (111) is configured to calculate a third position according to the first coordinates in the second image and a fourth position according to the second coordinates in the second image using a predetermined conversion equation based on a relationship between a coordinate system of the operating unit and a coordinate system of the second image. [6] The vehicle-side operating device (1) according to claim 5, wherein a scaling amount in a first direction and a second direction of the operating unit is equal to a scaling amount in the first direction and the second direction of the second display device, the first direction and the second direction crossing each other. [7] The vehicle-side operating device (1) according to any one of claims 1 to 6, wherein the input acceptance processing unit (114) in the first mode is configured to perform the first predetermined function in association with the second coordinates based on the second coordinates. [8] Vehicle-side operating device (1) according to one of claims 1 to 7, wherein the second image comprises a navigation image.

Images