Operation device for on-vehicle device

The operating device addresses the need for visual confirmation of in-vehicle equipment operations by transmitting signals to control units for synchronized image display, allowing occupants to confirm operations without direct observation, enhancing visibility and realism.

JP2024158817APending Publication Date: 2024-11-08TOYOTA SHATAI KK
View PDF 7 Cites 0 Cited by

Patent Information

Application Number
JP2023074369
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2023-04-28
Publication Date
2024-11-08

AI Technical Summary

Technical Problem

Existing in-vehicle equipment control systems require direct visual confirmation of movable parts' operations, lacking a way to indicate changes in operation through display interfaces.

Method used

An operating device that transmits operation signals to a control unit, displaying operation direction and range images, and detecting touch operations to move and display movable part images in synchronization with actual movements, allowing occupants to confirm operations visually without direct observation.

Benefits of technology

Enables occupants to confirm the operation of in-vehicle movable parts through a display, providing a realistic operational feel and enhancing visibility, especially when the parts are out of sight.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2024158817000001_ABST
    Figure 2024158817000001_ABST
Patent Text Reader

Abstract

To provide an operation device for an on-vehicle device that enables an occupant on a vehicle to check the operation of an on-vehicle device being operated without directly seeing a movable part of the on-vehicle device.SOLUTION: On an on-vehicle device, a touch operation on an operation part 27 of a portable terminal 20 and an operation direction image displayed on a display 26 is detected, or an amount of movement based on a change of a touch position on an operation range image is detected. A controller 22 generates an operation signal on the basis of the detection of the touch operation or the detection of the amount of movement in the operation direction image. A communication module 29 transmits the operation signal to a control device of the on-vehicle device. The controller 22 moves and displays the operation direction image which has been touch-operated or a movable part image in the on-vehicle device associated with the operation range image on the basis of the touch operation in the operation direction image or the detection of the amount of movement.SELECTED DRAWING: Figure 3
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to an operating device for in-vehicle equipment. [Background technology]

[0002] Conventionally, when moving an in-vehicle device to adjust its position, etc., the driver operates an operating device for the in-vehicle device. For example, in Patent Document 1, the in-vehicle device to be operated, for example, a shade, is displayed on the display of a display control device, and a "CLOSE" button and an "OPEN" button are displayed below the display area of ​​the shade. In the display control device of Patent Document 1, it is suggested that when the "CLOSE" button is touched, the shade is closed, and when the "OPEN" button is touched, the shade is opened. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2019-66605 A Summary of the Invention [Problem to be solved by the invention]

[0004] In Patent Document 1, the shade shown on the display is intended simply to indicate the positional relationship of the in-vehicle device to be operated within the vehicle cabin. Therefore, even if the "CLOSE" button or the "OPEN" button is operated, the result of the operation of the button is not displayed on the display as a change in the image of the shade. Therefore, if a passenger wants to check the operation of the shade, he or she needs to look directly at the actual shade itself.

[0005] In an operating device for in-vehicle equipment having a movable part such as the above-mentioned shade, when an occupant wants to check the operation of the movable part of the in-vehicle equipment to be operated, it is desirable to be able to check the operation without directly looking at the moving part of the in-vehicle equipment to be operated.

[0006] An object of the present invention is to provide an operating device for an in-vehicle device that enables an occupant to confirm the operation of the in-vehicle device to be operated without directly looking at a moving part of the device. [Means for solving the problem]

[0007] In order to solve the above problems, the operating device for in-vehicle equipment of the present invention is an operating device for in-vehicle equipment that transmits an operation signal to a control device that controls a movable part of the in-vehicle equipment, and is equipped with a display unit that displays an image of the movable part of the in-vehicle equipment and at least one of an operation direction image of the movable part of the in-vehicle equipment and an operation range image of the movable part, a touch detection unit that performs one of a touch operation in the operation direction image displayed on the display unit and detection of an amount of movement based on a change in the touch position in the operation range image, an operation signal generation unit that generates the operation signal based on the detection of the touch operation in the operation direction image or the detection of the amount of movement, a transmission unit that transmits the operation signal to the control device of the in-vehicle equipment, and a display control unit that moves and displays the image of the movable part of the in-vehicle equipment associated with the operation direction image and the operation range image that have been touched based on the detection of the touch operation in the operation direction image and the amount of movement.

[0008] As a result, the touch detection unit detects either a touch operation on the operation direction image or a movement amount based on a change in the touch position on the operation range image. Then, the transmission unit transmits the operation signal based on the detection of the touch operation on the operation direction image or the detection of the movement amount to the control device. Also, the display control unit moves and displays the movable part image on the display unit based on the detection of the touch operation on the operation direction image or the movement amount. Therefore, when an occupant wants to check the operation of a movable part of an in-vehicle device to be operated, the occupant can check the operation by looking at the display unit without directly looking at the movable part to be operated.

[0009] The display control unit may also move and display the movable part image in synchronization with a movement of the movable part controlled by a control device of the in-vehicle device. This allows the moving part image to be displayed in synchronization with the in-vehicle device to be operated, so that the occupant can get a realistic feeling of operation from the moving moving part image. This effect is particularly significant when the in-vehicle device to be operated is not within the occupant's field of vision.

[0010] Furthermore, when moving and displaying the movable part image, the display control section may display the movable part image in a display mode different from a display mode of the image of the movable part before being moved and displayed. As a result, the movable part image differs from the display state before the movement and display, so that the movable part image of the movable part of the in-vehicle device to be operated stands out, making it easier for the occupant to visually recognize it.

[0011] In addition, the display unit may display a selection image for selecting all or any of the multiple in-vehicle devices, the touch detection unit may be capable of detecting a touch operation on the selection image, and the display control unit may be configured to display one or more images of movable parts of the in-vehicle devices as images of candidate objects to be operated on the display unit when a touch operation is performed on the selection image.

[0012] As a result, when an occupant touches any of the in-vehicle devices to the selection image, the touch detection unit displays one or more in-vehicle devices having movable part images as candidates for operation based on the touch detection, thereby narrowing down the candidates for operation.

[0013] In addition, when the display unit is caused to display a plurality of images of the in-vehicle devices as images of candidate operation targets, the display unit further displays at least a third selection area out of a first selection area for selecting an in-vehicle device located on the left side of the vehicle and detected by a touch detection unit, a second selection area for selecting an in-vehicle device located on the right side and detected by a touch detection unit, and a third selection area for simultaneously selecting both in-vehicle devices located on the left and right sides and detected by a touch detection unit, and when any one of the first to third selection areas is touched, displays an image specifying the operation content of the movable part of the in-vehicle device associated with the touched selection area as an operation specific image, and the operation signal generation unit generates an operation signal including control target information for setting the in-vehicle device corresponding to the selection area touched and detected by the touch detection unit as a control target, and operation information previously associated with the operation specific image, and the transmission unit transmits the operation signal to the control device.

[0014] As a result, when an occupant wants to check the operation of a moving part of a pair of on-board devices arranged on the left and right sides of the vehicle, the occupant can check the operation by looking at the display unit without directly looking at the moving part of the on-board device to be operated. Effect of the Invention

[0015] According to the present invention, an occupant can confirm the operation of the in-vehicle device to be operated without directly looking at the moving part of the device. [Brief description of the drawings]

[0016] [Figure 1] 1 is a schematic configuration diagram of an in-vehicle device control system according to an embodiment; [Diagram 2]1 is a conceptual diagram of a main part of an in-vehicle device control system according to an embodiment; [Diagram 3] FIG. 2 is an electrical block diagram of the mobile terminal 20. [Figure 4] FIG. 2 is an electrical block diagram of the MM device 70. [Diagram 5] FIG. 1 is an explanatory diagram illustrating an overview of a vehicle according to an embodiment. [Figure 6] FIG. 2 is a schematic perspective view of a rear seat according to an embodiment. [Figure 7] FIG. 1 is a schematic perspective view of a sunroof according to an embodiment. [Figure 8] (a) is an explanatory diagram of the operation screen when moving the seat back and forth, (b) is an explanatory diagram of the operation screen when operating the seat back angle, and (c) is an explanatory diagram of the operation screen when operating the seat cushion. [Figure 9] FIG. 13A is an explanatory diagram of an operation screen when operating an ottoman, and FIG. 13B is an explanatory diagram of an operation screen when operating a lumbar support. [Figure 10] FIG. 10(a) is an explanatory diagram of an operation screen (selection screen) for a side shade, and FIG. 10(b) is an explanatory diagram of an operation screen (selection screen) for a roof sunshade. [Figure 11] 13A and 13B are explanatory diagrams of an operation screen when individually operating the left side shade. [Figure 12] 13A and 13B are explanatory diagrams of an operation screen when individually operating the right side shade. [Figure 13] 13A is an explanatory diagram of the operation screen when operating the left side shade collectively, and FIG. 13B is an explanatory diagram of the operation screen when operating all side shades collectively. [Figure 14] (a) is an explanatory diagram of the operation screen when operating the right side shades all at once, and (b) is an explanatory diagram of the operation screen when the left selection button 318 is touched to operate the left side shades all at once. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0017] (Embodiment) 1 to 9, a case in which an operating device for in-vehicle equipment of the present invention is embodied in a mobile terminal 20 incorporated in an in-vehicle equipment control system will be described below. A vehicle equipped with an in-vehicle equipment control system 100 will be outlined.

[0018] <1. Overview of vehicle configuration> 5, the vehicle has an A pillar 10a, a B pillar 10b, a C pillar 10c, and a D pillar 10d on the left and right sides. A pair of right and left rear doors 15R and 15L are provided between the B pillar 10b and the C pillar 10c corresponding to the second row seats.

[0019] As shown in Fig. 5, a driver's seat 12 and a passenger seat 14 are disposed at the front of the passenger compartment, and a right rear seat 16 and a left rear seat 18, which form the second row seats, are disposed behind them. A second row console box 37 is provided between the right rear seat 16 and the left rear seat 18. The right rear seat 16 and the left rear seat 18 are independent captain seats.

[0020] <2. Shade-related items> <2.1.Side shade> As shown in Fig. 5, the right rear door 15R and the left rear door 15L have door window glass 51, 61. Also, between the left and right C pillars 10c and D pillars 10d, window glass 52, 62 is provided. The right rear door 15R and the left rear door 15L are provided with side shades 17R, 17L for sun protection and heat / light protection corresponding to the inner surfaces of the door window glass 51, 61. Also, the vehicle is provided with side shades 19R, 19L for sun protection and heat / light protection corresponding to the inner surfaces of the window glass 52, 62 provided between the left and right C pillars 10c and D pillars 10d.

[0021] The side shades 17R, 17L, 19R, and 19L are operatively connected to side shade parts 210a to 210d, which are in-vehicle devices, as shown in FIG. 1. The side shade parts 210a to 210d each have an electric motor (not shown) and an operating mechanism (not shown). The side shade parts 210a and 210b are capable of vertical movement between a fully closed position covering the door window glasses 51 and 61 and a fully open position via the operating mechanism, with the electric motor being controlled by a body electronic control unit (hereinafter referred to as body ECU 120). The side shade parts 210c and 210d are capable of vertical movement between a fully closed position covering the window glasses 52 and 62 and a fully open position via the operating mechanism, with the electric motor being controlled by the body ECU 120, which will be described later.

[0022] Each electric motor of the side shade portions 210a to 210d is provided with an encoder (not shown) that detects the current open / closed position of each side shade. The control unit 122 of the body ECU 120 stores the current open / closed positions of the side shades 17R, 17L, 19R, and 19L in a storage unit (not shown) based on the open / closed position detection signals from the respective encoders. The control unit 122 also transmits the current open / closed positions (including, for example, the fully open position, the fully closed position, and the like) to the mobile terminal 20 via the MM device 70. The side shades 17R, 17L, 19R, and 19L correspond to the movable parts of the side shade parts 210a to 210d, respectively.

[0023] <2.2. Roof shade> As shown in FIG. 7, a pair of roof window glasses 42R, 42L are provided on the left and right sides of the roof 40, and roof shades 44R, 44L for blocking sun and preventing heat and light are also provided.

[0024] The roof shades 44R, 44L are operatively connected to roof shade units 220a, 220b, respectively, as in-vehicle devices, as shown in Fig. 1. The roof shade units 220a, 220b each have an electric motor and an operating mechanism, both not shown. The roof shade units 220a, 220b can move between a fully closed position covering the roof window glass and a fully open position via the operating mechanism, with the electric motor being controlled by the body ECU 120, which will be described later.

[0025] Each electric motor of the roof shade parts 220a, 220b is provided with an encoder (not shown) that detects the current open / closed position of each roof shade. The control unit 122 of the body ECU 120 stores the current open / closed position of the roof shade based on the open / closed position detection signal from the encoder in a storage unit (not shown). In addition, the control unit 132 transmits the current open / closed position to the mobile terminal 20 via the MM device 70. The roof shades 44R, 44L correspond to the movable parts of the roof shade parts 220a, 220b.

[0026] <3. Rear seat related> <3.1. Left rear seat 18> The left rear seat 18 shown in FIG. 6 will be described.

[0027] As shown in FIG. 6, the left rear seat 18 has a seat portion 32, a seat back 33, a seat body 34, and an ottoman 35 operatively connected to the seat portion 32. (3.1.1. Seat body 34) The seat body 34 has a seat slide portion 18a as an in-vehicle device as shown in Fig. 1. The seat slide portion 18a includes a slide drive motor and a slide mechanism (both not shown). The position of the seat body 34 in the front-rear direction of the vehicle interior is adjusted via the slide mechanism by the slide drive motor being rotationally controlled by a control unit 132 (see Fig. 2) of a seat electronic control unit (hereinafter, seat ECU 130).

[0028] That is, the seat body 34 can be moved between the frontmost position and the rearmost position by the slide mechanism. The frontmost position and the rearmost position may be hereinafter referred to as "limit positions of the seat body." The slide drive motor or the slide mechanism is provided with an encoder (not shown) that detects the current position of the seat body 34. The control unit 132 of the seat ECU 130 stores the current position of the seat body 34 based on a position detection signal from the encoder in a storage unit (not shown). The control unit 132 also transmits the current position to the mobile terminal 20 via the MM device 70. The seat body 34 corresponds to a movable part of an in-vehicle device.

[0029] (3.1.2. Seat back 33) The seat back 33 has a seat back section 18b as an in-vehicle device that changes the seat back angle relative to the seat cushion 32. The seat back section 18b includes a seat back drive motor and a seat back angle operating mechanism (both not shown). The seat back angle of the seat back section 18b is changed within a range between a maximum tilt angle and a minimum tilt angle via the seat back angle operating mechanism by the control section 132 of the seat ECU 130 controlling the rotation of the seat back drive motor. Hereinafter, the maximum tilt angle and the minimum tilt angle may be referred to as the "seat back limit tilt angle."

[0030] The seat back drive motor has an angle sensor (not shown) that detects the current tilt angle of the seat back 33. The control unit 132 of the seat ECU 130 stores the current tilt angle of the seat back 33 based on the angle detection signal from the angle sensor in a storage unit (not shown). The control unit 132 also transmits the current tilt angle to the mobile terminal 20 via the MM device 70. The seat back 33 corresponds to a movable part of the in-vehicle device.

[0031] (3.1.3. Seat 32) The seat 32 includes a seat cushion portion 18c as an in-vehicle device for changing the vertical position of the seat cushion. The seat cushion portion 18c includes a seat cushion drive motor and a seat cushion operating mechanism (both not shown). The control unit 132 of the seat ECU 130 controls the rotation of the seat cushion drive motor, so that the seat cushion portion 18c can change the vertical position of the seat cushion via the seat cushion operating mechanism.

[0032] That is, the seat cushion portion 18c can be raised and lowered between the uppermost position and the lowermost position by the seat cushion operating mechanism. Hereinafter, the uppermost position and the lowermost position of the seat cushion portion may be referred to as the "limit positions of the seat cushion portion." The seat cushion driving motor or the seat cushion operating mechanism is provided with an encoder (not shown) that detects the current position of the seat cushion portion 18c. The control unit 132 of the seat ECU 130 stores the current position of the seat cushion portion 18c based on the position detection signal from the encoder in a storage unit (not shown). The control unit 132 also transmits the current position to the mobile terminal 20 via the MM device 70. The seat portion 32 corresponds to a movable part of the in-vehicle device.

[0033] (3.1.4. Ottoman 35) The ottoman 35 includes an ottoman section 18d as an in-vehicle device. The ottoman section 18d includes a first drive motor and a first operating mechanism (both not shown), and a second drive motor and a second operating mechanism (both not shown). The ottoman 35 is configured such that the rotation of the first drive motor is controlled by the control section 132 of the seat ECU 130. This allows the angle of the ottoman 35 to be adjusted between an angle at which it is nearly horizontal and an angle at which it is in a stored state via the first operating mechanism.

[0034] Further, the second drive motor of the ottoman 35 is controlled to rotate by the control unit 132 of the seat ECU 130. This allows the position of the ottoman 35 to be adjusted between the frontmost position and the rearmost position via the second operating mechanism.

[0035] The first operating mechanism has an angle sensor (not shown) that detects the current angle of the ottoman 35. In addition, the second operating mechanism has a position sensor (not shown) that detects the current position between the frontmost position and the rearmost position.

[0036] In the following, the angle at which the ottoman is nearly horizontal and the angle at which it is in the stored state may be referred to as the "ottoman's limit angle." Additionally, the forward-most and rearmost positions of the ottoman may be referred to as the "ottoman's limit position."

[0037] The control unit 132 of the seat ECU 130 stores the current angle and current position of the ottoman 35 based on the detection signals of the angle sensor and position sensor in a storage unit (not shown). The control unit 132 also transmits the current angle and current position to the mobile terminal 20 via the MM device 70. The ottoman 35 corresponds to a movable part of the in-vehicle device.

[0038] (3.1.5. Lumbar Support36) As shown in Fig. 6, the seat back 33 has a built-in lumbar support 36. The lumbar support 36 is operatively connected to the lumbar support portion 18e shown in Fig. 1. The lumbar support portion 18e includes a vertical drive motor and a vertical operation mechanism, both of which are not shown.

[0039] The lumbar support unit 18e includes a front-rear drive motor and a front-rear actuation mechanism, both of which are not shown. The lumbar support unit 18e adjusts the vertical position of the lumbar support 36 via the vertical actuation mechanism under the rotation control of the vertical drive motor by the control unit 132 of the seat ECU 130. The lumbar support unit 18e adjusts the front-rear position of the lumbar support 36 via the front-rear actuation mechanism under the rotation control of the front-rear drive motor by the control unit 132 of the seat ECU 130.

[0040] That is, the lumbar support 36 can be moved between the uppermost position and the lowermost position by the up-down operation mechanism. Also, the lumbar support 36 can be moved between the frontmost position and the rearmost position by the front-rear operation mechanism.

[0041] Hereinafter, the uppermost position and the lowermost position of the lumbar support 36 may be referred to as the "vertical limit positions of the lumbar support." Also, the frontmost position and the rearmost position of the lumbar support 36 may be referred to as the "front-rear limit positions of the lumbar support."

[0042] The up-down operation mechanism has a up-down position sensor (not shown) that detects the current up-down position of the lumbar support 36. Moreover, the front-rear operation mechanism has a front-rear position sensor (not shown) that detects the current front-rear position of the lumbar support 36. The control unit 132 of the seat ECU 130 stores the current up-down position and front-rear position of the lumbar support 36 based on the detection signals of each position sensor in a storage unit (not shown). Moreover, the control unit 132 transmits these current positions to the mobile terminal 20 via the MM device 70.

[0043] The lumbar support portion 18e corresponds to an in-vehicle device, and the lumbar support 36 corresponds to a movable portion of the in-vehicle device. <3.2.Right rear seat 16> The right rear seat 16 shown in FIG. 5 will be described.

[0044] The right rear seat 16 has a similar configuration to the left rear seat 18. For this reason, the seat body having a seat portion, a seat back, and a pair of left and right armrests, and the ottoman are given the same reference numerals as those given to the configuration of the left rear seat 18, and their detailed description will be omitted. Also, the right rear seat 16 has various parts as in-vehicle devices controlled by a control unit 132 of the seat ECU 130, similar to the left rear seat 18. For this reason, the various parts of the right rear seat 16 are given the reference numerals 16a to 16e as shown in FIG. 1, instead of 18a to 18e given to the various parts of the left rear seat 18, and their detailed description will be omitted.

[0045] <4.1. Vehicle-mounted device control system 100> 1, the in-vehicle device control system 100 includes a mobile terminal 20, a multimedia device (MM device) 70, a body ECU 120, a seat ECU 130, an RSE 150, etc. The in-vehicle device control system 100 also includes each of the parts 16a to 16e, 18a to 18e, etc. of the right rear seat 16 and the left rear seat 18, which are controlled by a control unit 132 of the seat ECU 130. The in-vehicle device control system 100 also includes the roof shade parts 220a, 220b and the side shade parts 210a to 210d, which are controlled by the body ECU 120.

[0046] <4.2. Mobile terminal 20> As shown in Fig. 5, the portable terminal 20 can be detachably set in the second-row console box 37. As shown in Fig. 3, the portable terminal 20 includes a controller 22 consisting of a CPU (Central Processing Unit), a ROM 23 that stores control programs and the like, and a RAM 24 that serves as a working memory. The portable terminal 20 also includes a storage 25, a display 26 consisting of a touch display, an operation unit 27, and a communication module 29. The display 26 corresponds to the display unit. The communication module 29 corresponds to the communication unit.

[0047] The storage 25 stores a display program, display data, and the like. The display program is a program that displays images such as an image of a device having an operation target, an image of a movable part of an in-vehicle device, an image of the operation direction of the movable part, an image of the operation range of the movable part, an operation specification image, and a selection button on the operation screen of the display 26 based on the display data.

[0048] The device images having the operation target include images of the entire seat, the entire side shade, and the entire roof shade. Further, the controller 22 displays various images on the operation screen on the display 26 based on the display data, and generates various operation signals (described later) based on the detection results of the operation unit 27. The controller 22 corresponds to an operation signal generating unit and a display control unit.

[0049] The operation unit 27 is configured with a transparent touch sensor panel provided on the display surface of the display 26. The operation unit 27 corresponds to a touch detection unit that detects a touch operation by an occupant.

[0050] The operation unit 27 detects a touch position operated by a touch operation on an operation screen described later, a movement amount based on a change in the touch position, etc. This movement amount also includes a direction in which the touch position changes. For example, on a line, one direction is defined as the + direction and the opposite direction is defined as the - direction. If the touch position changes in the + direction, the amount of movement in the + direction is detected based on the position before the change, and if the touch position changes in the - direction, the amount of movement in the - direction is detected based on the position before the change.

[0051] Then, based on the detection results, the controller 22 generates various operation signals, which will be described later, and transmits them to the body ECU 120 or the seat ECU 130 via the communication module 29, using the MM device 70 as a repeater. The communication module 29 corresponds to a transmitting unit.

[0052] The communication module 29 is capable of short-distance wireless communication with the MM device 70. The communication module 29 executes the short-distance wireless communication by, for example, a communication method based on BLE (Bluetooth (registered trademark) Low Energy), but may use other communication methods, for example, ZigBee (registered trademark).

[0053] <4.3.MM equipment 70> 5, the MM device 70 is provided in the center in the vehicle width direction of the instrument panel 13. Due to this arrangement, an operation switch unit 79 (described later) provided in the MM device 70 can be operated by a front seat passenger such as the driver.

[0054] The MM device 70 is for providing driving guidance using images and audio, and for outputting video and audio from each section. As shown in Fig. 9, the MM device 70 includes a car navigation section 72, an MM device control section 73, a television and radio receiving section 74, a short-range wireless communication section 75, a communication interface 85, and an MM device system control section 78.

[0055] In addition, although not shown, the MM device 70 is connected to a semiconductor memory such as an SD memory, a media drive device such as a hard disk, a DVD, or a CD, and an RSE (Rear Seat Entertainment) 150. The RSE 150 is disposed on the roof 40 or the like, and is a display that provides television broadcasts (to be described later) and DVD images played by a media drive device to passengers seated in the second row seats.

[0056] The car navigation unit 72 is for controlling driving guidance and audio output. The MM device control unit 73 is for controlling each unit. The short-range wireless communication unit 75 is connected to an antenna 76 mounted on the vehicle and for wireless communication with the mobile terminal 20 using a communication method based on BLE or ZigBee. The MM device system control unit 78 is also connected to an operation switch unit 79 through which the user inputs various commands, a display 80 for displaying images for driving guidance and television broadcast images, a speaker 81, and the like. The MM device system control unit 78 operates the above-mentioned units 72, 73, and 74 according to commands input from the operation switch unit 79 and the touch sensor panel of the display 80.

[0057] The MM device 70 is connected to the RSE 150, the body ECU 120, the seat ECU 130, and the RSE 150 via a communication interface 85, that is, via an in-vehicle communication network.

[0058] The in-vehicle communication network may be, for example, a Controller Area Network (CAN), a Local Interconnect Network (LIN), a Media Oriented Systems Transport (MOST, a registered trademark), or a Clock Extension Peripheral Interface (CXPI). For example, the MM device 70 and the RSE 150 are connected by MOST, and the RSE 150, the body ECU 120, and the seat ECU 130 are connected by CAN.

[0059] When communication is required, the in-vehicle devices built into the RSE 150, the body ECU 120, and the seat ECU 130 are also connected via the in-vehicle communication network. When the MM device system control unit 78 receives various operation signals from the mobile terminal 20 via the short-range wireless communication unit 75, it relays and transmits the various operation signals to the body ECU 120 or the seat ECU 130 via the communication interface 85.

[0060] <4.4. Body ECU120> 1 and 2, the body ECU 120 is configured with a microcomputer. The microcomputer has a control unit 122, a ROM (not shown) for storing control programs and the like, a RAM (not shown), a control storage unit 124 consisting of a non-volatile rewritable storage medium, and input / output interfaces 126 and 128. The control unit 122 is connected to the MM device 70 via the input / output interface 126 so as to be able to communicate with the MM device 70.

[0061] Further, the control unit 122 is electrically connected to the roof shade parts 220a, 220b and the side shade parts 210a, 210b via an input / output interface 128. A database 125 is stored in the control storage unit 124. The database 125 records input operation signals and control information for on-vehicle devices under the control of the body ECU 120 in association with each other.

[0062] The body ECU 120 corresponds to a control device that controls the roof shade portions 220a and 220b and the side shade portions 210a to 210d as in-vehicle devices. <4.5. Seat ECU 130> 1 and 2, the seat ECU 130 is configured with a microcomputer. The microcomputer has a control unit 132, a ROM (not shown) for storing control programs and the like, a RAM (not shown), a control storage unit (not shown) made of a non-volatile rewritable storage medium, and an input / output interface (not shown).

[0063] The control unit 132 is communicably connected to the MM device 70 via an input / output interface (not shown). The control unit 132 is also electrically connected to the respective components 16a-16e, 18a-18e of the right rear seat 16 and the left rear seat 18 via an input / output interface (not shown). A control database (not shown) is stored in the control storage unit (not shown). The control database (not shown) records input operation signals and control information of in-vehicle devices under the jurisdiction of the seat ECU 130 in association with each other.

[0064] In addition, the operation signal from the mobile terminal 20 to operate the in-vehicle equipment of the rear seat may be transmitted directly from the MM device 70 to the seat ECU 130, or may be received by the body ECU 120 and then transmitted from the body ECU 120 to the seat ECU 130.

[0065] The seat ECU 130 corresponds to a control device that controls the respective units 16a to 16e and 18a to 18e as in-vehicle devices. <5. Operation of the embodiment> The case where the mobile terminal 20 is used to adjust various movable parts of the seat and to open and close the shade (movable part) will be described.

[0066] Operation screens 26a to 26c in FIGS. 8(a), 8(b), 8(c) to 14(a) and (b) are shown as seen through operation unit 27, which is a touch sensor panel. To explain briefly, when a touch operation is performed on a portion of a touch sensor panel on an operation button (image) described later on operation screens 26a to 26c, an operation direction image of a movable part of an in-vehicle device, an operation range image of the movable part, or an operation specific image, operation unit 27 detects the touch operation.

[0067] It should be noted that touch operations on the operation buttons, the operation direction images of the movable parts of the in-vehicle device, and the operation specific images include operations such as tapping, double tapping, and flicking, but are not limited to these.

[0068] In addition, in the case of a shade described later, the operation unit 27 detects a change in the touch position in the operation range image, and the controller 22 regards the change in the touch position as a movement amount. The operation of changing the touch position in the operation range image is generated by, for example, swiping, flicking, or dragging.

[0069] For ease of explanation, hereinafter, a touch operation on a touch sensor panel may be referred to as a touch operation on an image. The controller 22 generates various operation signals based on the detection of a touch operation on the above-mentioned portion of the touch sensor panel, and transmits the signals to the MM device 70 via the communication module 29 .

[0070] Here, the operation signal generated by the controller 22 when adjusting the seat includes information on "seat ECU that controls the seat," "adjustment button on," "identification of left or right rear seat," "identification of in-vehicle equipment," and "adjustment direction (movement direction)."

[0071] The "sheet" is acquired by the controller 22 when the sheet of the content bar 90 on the operation screen 26a is displayed. The "adjustment button on" is acquired by the controller 22 when the adjustment button 92 is touched.

[0072] “Specifying the left or right rear seat” is information associated with the left seat button 94a or the right seat button 94b when the button is touched, and is acquired by the controller 22.

[0073] The “identification of in-vehicle device” is identification information of the in-vehicle device associated with a designated point, which will be described later, when the designated point of the in-vehicle device is touch-operated.

[0074] The "adjustment direction (movement direction)" is operation direction information associated with an operation direction image of a movable part of an in-vehicle device, which will be described later, when the operation direction image is touch-operated, and is acquired by the controller 22.

[0075] <5.1. Operation of in-vehicle devices on the seat> The case of a sheet will be described in detail below. Here, it is assumed that an occupant operates the mobile terminal 20 to adjust movable parts of the in-vehicle devices related to the left rear seat 18. For this reason, all operation signals described below are operation signals related to the left rear seat and are transmitted from the mobile terminal 20 to the seat ECU 130 via the MM device 70, or to the seat ECU 130 via the MM device 70 and the body ECU 120.

[0076] In addition, the adjustment operation of the in-vehicle devices related to the right rear seat 16 is omitted because it is explained simply by interpreting "left" as "right" in the following explanation. <5.1.1. Operation for adjusting the position of the seat body 34> When the occupant performs a touch operation on the operation unit 27 while the home screen (not shown) of the mobile terminal 20 is displayed, the controller 22 displays "Seat" in the content bar 90 of the operation screen 26a, as shown in FIG. 8(a).

[0077] Additionally, the controller 22 displays selection buttons such as an adjustment button 92 on a selection item bar 91 on the operation screen 26a. Also, a field 93 having a left seat button 94a and a right seat button 94b, which are selection buttons, is displayed below the selection item bar 91. Furthermore, in the content area below the field 93, a left rear seat image 218 of the device having the operation target is displayed.

[0078] This left rear seat image 218 is displayed based on the current positions of the seat body, seat cushion, and ottoman, the current up-down position and current front-to-back position of the lumbar support, the current tilt angle of the seat back, and the current angle of the ottoman transmitted from the control unit 132.

[0079] The adjustment button 92, the left seat button 94a, and the right seat button 94b correspond to the operation buttons. 8(a), the adjustment button 92 has already been touched, and the brightness or color of its lower region has changed to be different from the lower regions of the other selection buttons. The left seat button 94a has already been touched, and the activated state is indicated by a solid line, indicating that it is "enabled." On the other hand, the right seat button 94b is in an inactivated state, and the two-dot chain line indicates that it is "disabled."

[0080] Here, the images of the respective parts of the left rear seat are given reference numerals obtained by adding "200" to the respective parts 32 to 36 of the left rear seat in Fig. 6. Also, the image of the second row console is given reference numeral 237. Also, as shown in Fig. 8(a), designated points for designating an operation target are displayed on the image of each part. That is, designated points A to E in the form of circles are displayed on the seat image 232, the seat back image 233, the seat body image 234, the ottoman image 235, and the lumbar support image 236. These images correspond to movable part images. Note that the designated points A to E are not limited to the circles, and may be in other shapes.

[0081] (Selection (specification) of the operation target) In the state displayed as above, when an occupant wishes to adjust the fore-aft position of the seat main body 34, the occupant touches the designated point C. In response to this touch operation, the controller 22 displays a forward arrow 234a and a rearward arrow 234b near the seat back image 233 as shown in Fig. 8(a). The forward arrow 234a and the rearward arrow 234b correspond to an operation direction image.

[0082] In the example of Fig. 8(a), both the forward arrow 234a and the backward arrow 234b are indicated by solid lines. This indication is made when there is no detection signal indicating that the "seat body is at its limit position" from the position sensor (not shown) of the slide mechanism (not shown).

[0083] If there is a detection signal indicating the forward-most position or the rearmost position, the arrow corresponding to the detection signal is displayed as inactive, indicating "invalid," for example, by being less bright than when it indicates "valid," or by being made semi-transparent.

[0084] In addition, the controller 22 displays a seat back image 233 and an ottoman image 235 in a color or brightness different from that of the seat image 232 and the seat back image 233, as shown in FIG. 8(a), thereby clearly indicating the movable parts of the in-vehicle equipment.

[0085] (Generation of operation signals by operation) When the passenger performs a touch operation on the forward arrow 234a or the backward arrow 234b, the controller 22 generates an operation signal based on detection of the touch operation on a portion of the operation unit 27.

[0086] The operation signal generated by the controller 22 when adjusting the seat includes information on "seat ECU that controls the seat," "adjustment button on," "identification of the left rear seat," "identification of the in-vehicle equipment," and "adjustment direction (movement direction)."

[0087] The "identification of in-vehicle device" is identification information for specifying the seat sliding portion 18a by the touch operation of the specified point C. Also, the "adjustment direction (movement direction)" is identification information for the forward arrow 234a or the backward arrow 234b that is being touched.

[0088] (Transmission and display) As described above, when the controller 22 generates an operation signal, the controller 22 transmits the operation signal to the seat ECU 130 via the MM device 70, or to the seat ECU 130 via the MM device 70 and the body ECU 120.

[0089] Based on the transmitted operation signal, the control unit 132 performs rotation control of a slide drive motor (not shown) of the seat slide portion 18a of the left rear seat 18, thereby adjusting the position in the front-rear direction of the seat main body 34 via a slide mechanism (not shown). Then, the control unit 132 of the seat ECU 130 stores the position (current position) at the time of position adjustment based on a position detection signal by an encoder (not shown) in a storage unit (not shown). Also, the control unit 132 transmits the current position to the mobile terminal 20 via the MM device 70.

[0090] Based on this transmitted current position, the controller 22 moves and displays the left rear seat image 218 including the seat back image 233, etc. In other words, the left rear seat image 218 including the seat back image 233, etc. is moved and displayed in synchronization with the forward and backward movement of the left rear seat 18 including the seat main body 34.

[0091] The operation signal for the seat main body 34 (movable portion) is generated and transmitted to the MM device 70 while the forward arrow 234a or the backward arrow 234b (operation direction image) is being touched.

[0092] <5.1.2. Seat back 33 position adjustment operation> (Selection (specification) of the operation target) When an occupant wishes to adjust the forward / rearward position of the seat back 33, the occupant touches the designated point B. In response to this touch operation, the controller 22 displays a forward arrow 233a and a rearward arrow 233b near the seat back image 233, as shown in Fig. 8(b). The forward arrow 233a and the rearward arrow 233b correspond to an operation direction image.

[0093] In the example of Fig. 8(b), both the forward arrow 233a and the backward arrow 233b are shown in solid lines. This display is the display when there is no detection signal indicating that the current tilt angle of the seat back 33 is the "seat back's limit tilt angle". If there is a detection signal indicating the "seat back's limit tilt angle", the arrow corresponding to the one with the detection signal is displayed as inactive, indicating "invalid", for example, by lowering the brightness or making it semi-transparent compared to when it indicates "valid".

[0094] In addition, as shown in FIG. 8(b), the controller 22 displays the seat back image 233 in a color or brightness different from the images of other in-vehicle devices that are not the target of operation, thereby clearly indicating the movable parts of the in-vehicle device that is the target of operation.

[0095] (Generation of operation signals by operation) When the passenger performs a touch operation on the forward arrow 233a or the backward arrow 233b, the controller 22 generates an operation signal based on detection of the touch operation on a portion of the operation unit 27.

[0096] The operation signal generated by the controller 22 when adjusting the seat includes information on "seat ECU that controls the seat," "adjustment button on," "identification of the left rear seat," "identification of the in-vehicle device," and "adjustment direction (movement direction)." The "identification of the in-vehicle device" is specific information that specifies the seat sliding portion 18a by the touch operation of the specified point B. Moreover, the "adjustment direction (movement direction)" is specific information of the forward arrow 233a or the backward arrow 233b that is being touched.

[0097] (Transmission and display) As described above, when the controller 22 generates an operation signal, it transmits the signal to the seat ECU 130 via the MM device 70, or to the seat ECU 130 via the MM device 70 and the body ECU 120. Based on the transmitted operation signal, the control unit 132 of the seat ECU 130 controls the rotation of a seat back drive motor (not shown) to change the seat back angle within the range between the maximum inclination angle and the minimum inclination angle via a seat back angle operating mechanism (not shown). This allows the inclination angle of the seat back 33 to be adjusted.

[0098] Then, the control unit 132 stores the current tilt angle at the time of adjustment based on the angle detection signal from the angle sensor (not shown) in a storage unit (not shown). The control unit 132 also transmits the current tilt angle to the mobile terminal 20 via the MM device 70.

[0099] Based on this transmitted current tilt angle, the controller 22 changes (moves) and displays the tilt angle of the seat back image 233. That is, the seat back image 233 is moved and displayed so that the angle of the seat back image 233 is changed in synchronization with the change (movement) of the tilt angle of the seat back 33 during adjustment.

[0100] The operation signal for the seat back 33 (movable portion) is generated and transmitted to the MM device 70 while the forward arrow 233a or the backward arrow 233b (operation direction image) is being touched.

[0101] <5.1.3. Operation for adjusting the position of the seat 32> (Selection (specification) of the operation target) When an occupant wishes to adjust the front-rear position of the seat 32, the occupant touches the designated point A. In response to this touch operation, the controller 22 displays an upward arrow 232a and a downward arrow 232b near the seat image 232, as shown in Fig. 8(c). The upward arrow 232a and the downward arrow 232b correspond to an operation direction image.

[0102] In the example of Fig. 8(c), both the upward arrow 232a and the downward arrow 232b are shown in solid lines. This display is the display when there is no detection signal indicating that the current position of the seat 32 is the "limit position of the seat cushion". If there is a detection signal indicating the "limit position of the seat cushion", the arrow corresponding to the side where the detection signal is present is displayed as inactive, indicating "invalid", for example, by lowering the brightness or making it semi-transparent compared to when it indicates "valid".

[0103] In addition, as shown in FIG. 8(c), the controller 22 displays the seat image 232 in a color or brightness different from the images of other in-vehicle devices that are not the target of operation, thereby clearly indicating the movable parts of the in-vehicle device that is the target of operation.

[0104] (Generation of operation signals by operation) When the passenger performs a touch operation on the upward arrow 232a or the downward arrow 232b, the controller 22 generates an operation signal based on detection of the touch operation on a portion of the operation unit 27.

[0105] The operation signal generated by the controller 22 when adjusting the seat includes information on "seat ECU that controls the seat," "adjustment button on," "identification of the left rear seat," "identification of the in-vehicle device," and "adjustment direction (movement direction)." The "identification of the in-vehicle device" is specific information that specifies the seat cushion portion 18c by touching the specified point A. The "adjustment direction (movement direction)" is specific information of the upward arrow 232a or downward arrow 232b that is being touched.

[0106] (Transmission and display) As described above, when the controller 22 generates an operation signal, the controller 22 transmits the operation signal to the seat ECU 130 via the MM device 70, or to the seat ECU 130 via the MM device 70 and the body ECU 120.

[0107] The control unit 132 of the seat ECU 130 changes the vertical position within the range of the uppermost position and the lowermost position via a seat cushion operating mechanism (not shown) by controlling the rotation of a seat cushion drive motor (not shown) based on the transmitted operation signal. This adjusts the vertical position of the seat cushion of the seat 32. The control unit 132 then stores the current position at the time of adjustment based on a position detection signal from an encoder (not shown) in a storage unit (not shown). The control unit 132 also transmits the current position to the mobile terminal 20 via the MM device 70.

[0108] Based on this transmitted current position, the controller 22 changes (moves) the position of the seat image 232 and displays it. That is, in synchronization with the change (movement) of the up-down position of the seat 32 during adjustment, the seat image 232 is displayed moving upward or downward.

[0109] The generation of an operation signal for the seat 32 (movable part) and the transmission to the MM device 70 are executed while the upward arrow 232a or the downward arrow 232b (operation direction image) is being touched.

[0110] <5.1.4. Adjusting the position of the Ottoman 35> (Selection (specification) of the operation target) When an occupant wishes to adjust the angle and / or the vertical position of ottoman 35, he or she touches designated point D. In response to this touch operation, controller 22 displays upward arrow 235a, downward arrow 235b, forward arrow 235c, and rearward arrow 235d in the vicinity of ottoman image 235, as shown in Fig. 9(a). Upward arrow 235a, downward arrow 235b, forward arrow 235c, and rearward arrow 235d correspond to operation direction images.

[0111] In the example of Fig. 9(a), the upward arrow 235a, the downward arrow 235b, the forward arrow 235c, and the backward arrow 235d are all shown in solid lines. This display is the display when there is no detection signal indicating that the current angle and current position of the ottoman 35 are the "ottoman's limit angle" and the "ottoman's limit position". If there is a detection signal indicating the "ottoman's limit angle" or the "ottoman's limit position", the arrow corresponding to the one with the detection signal is displayed as inactive, indicating "invalid". For example, it is displayed with a lower brightness than when it indicates "valid", or it is made semi-transparent.

[0112] In addition, as shown in FIG. 9(a), the controller 22 displays the ottoman image 235 in a color or brightness different from the images of other in-vehicle devices that are not the target of operation, thereby clearly indicating the movable parts of the in-vehicle device that is the target of operation.

[0113] (Generation of operation signals by operation) When the occupant performs a touch operation on the upward arrow 235a, the downward arrow 235b, the forward arrow 235c, or the backward arrow 235d, the controller 22 generates an operation signal based on detection of the touch operation on a portion of the operation unit 27.

[0114] The operation signal generated by the controller 22 when adjusting the seat includes information on "seat ECU that controls the seat," "adjustment button on," "identification of the left rear seat," "identification of the in-vehicle device," and "adjustment direction (movement direction)." The "identification of the in-vehicle device" is specific information that specifies the ottoman portion 16d by the touch operation of the specified point D. The "adjustment direction (movement direction)" is specific information of the upward arrow 235a, downward arrow 235b, forward arrow 235c, or backward arrow 235d that is being touched.

[0115] (Transmission and display) As described above, when the controller 22 generates an operation signal, the controller 22 transmits the operation signal to the seat ECU 130 via the MM device 70, or to the seat ECU 130 via the MM device 70 and the body ECU 120.

[0116] When the transmitted operation signal includes specific information of the upward arrow 235a or the downward arrow 235b, the control unit 132 of the seat ECU 130 controls the rotation of the first drive motor (not shown). This changes (adjusts) the angle of the ottoman 35 via the first actuation mechanism (not shown) within a range between an angle that is close to the horizontal state and an angle that is in the stored state.

[0117] When the transmitted operation signal includes specific information of the forward arrow 235c or the rearward arrow 235d, the control unit 132 of the seat ECU 130 controls the rotation of the second drive motor (not shown). This causes the position of the ottoman 35 to be changed (adjusted) within the range of the foremost position and the rearmost position via the second actuation mechanism (not shown).

[0118] The control unit 132 then stores the current angle based on an angle detection signal from an angle sensor (not shown) and the current position based on a position detection signal from a position sensor in a storage unit (not shown). The control unit 132 also transmits the current angle and the current position to the mobile terminal 20 via the MM device 70.

[0119] Based on the transmitted current angle and current position, the controller 22 changes (moves) and displays the position of the ottoman image 235. That is, the movement of the angle change of the ottoman image 235 is displayed in synchronization with the change (movement) of the angle and position of the ottoman 35 during adjustment.

[0120] The generation of an operation signal for the ottoman 35 (movable part) and the transmission to the MM device 70 are executed while the upward arrow 235a, the downward arrow 235b, the forward arrow 235c, or the backward arrow 235d (operation direction image) is being touched.

[0121] <5.1.5. Adjustment of the lumbar support 36 position> (Selection (specification) of the operation target) When the occupant wishes to adjust the up-down position and / or the front-rear position of the lumbar support 36, the occupant touches the designated point E. In response to this touch operation, the controller 22 displays an upward arrow 236a, a downward arrow 236b, a forward arrow 236c, and a rearward arrow 236d in the vicinity of the lumbar support image 236, as shown in Fig. 9(b). The upward arrow 236a, the downward arrow 236b, the forward arrow 236c, and the rearward arrow 236d correspond to an operation direction image.

[0122] In the example of FIG. 9(b), the upward arrow 236a, the downward arrow 236b, the forward arrow 236c, and the backward arrow 236d are all shown in solid lines. This display is a display when there is no detection signal indicating that the current up-down position and the current front-back position of the lumbar support 36 are the "vertical limit position of the lumbar support" and the "front-back limit position of the lumbar support". If there is a detection signal indicating the "vertical limit position of the lumbar support" or the "front-back limit position of the lumbar support", the arrow corresponding to the one where the detection signal was received is displayed as inactive, indicating "invalid". For example, it is displayed with a lower brightness or semi-transparent, as compared to the case of indicating "valid".

[0123] In addition, as shown in FIG. 9(b), the controller 22 displays the lumbar support image 236 in a color or brightness different from the images of other in-vehicle devices that are not the target of operation, thereby clearly indicating the movable parts of the in-vehicle device that is the target of operation.

[0124] (Generation of operation signals by operation) When the occupant performs a touch operation on the upward arrow 236a, the downward arrow 236b, the forward arrow 236c, or the backward arrow 236d, the controller 22 generates an operation signal based on detection of the touch operation on a portion of the operation unit 27.

[0125] The operation signal generated by the controller 22 when adjusting the seat includes information on "seat ECU that controls the seat," "adjustment button on," "identification of the left rear seat," "identification of the in-vehicle device," and "adjustment direction (movement direction)." The "identification of the in-vehicle device" is specific information that specifies the lumbar support section 18e by touching the specified point E. The "adjustment direction (movement direction)" is specific information of the upward arrow 236a, downward arrow 236b, forward arrow 236c, or backward arrow 236d that is being touched.

[0126] (Transmission and display) As described above, when the controller 22 generates an operation signal, it transmits the signal to the seat ECU 130 via the MM device 70, or to the seat ECU 130 via the MM device 70 and the body ECU 120. If the transmitted operation signal contains specific information of an upward arrow 236a or a downward arrow 236b, the control unit 132 of the seat ECU 130 controls the rotation of a vertical drive motor (not shown). This causes the vertical position of the lumbar support 36 to be changed (adjusted) between the most raised position and the most lowered position via a vertical operation mechanism (not shown).

[0127] Furthermore, when the transmitted operation signal includes specific information of the forward arrow 236c or the rearward arrow 236d, the control unit 132 of the seat ECU 130 controls the rotation of the front-rear drive motor (not shown). This causes the front-rear position of the lumbar support 36 to be changed (adjusted) within the range between the most forward position and the rearmost position via the front-rear operating mechanism (not shown).

[0128] The control unit 132 then stores the current up-down position and the current front-back position based on the position detection signals from the up-down position sensor and the front-back position sensor (not shown) in a storage unit (not shown). The control unit 132 also transmits the current up-down position and the current front-back position to the mobile terminal 20 via the MM device 70.

[0129] Based on the transmitted current up-down position and current front-rear position, the controller 22 changes (moves) the position of the lumbar support image 236 and displays it. That is, in synchronization with the change (movement) of the up-down position and front-rear position of the lumbar support 36 during adjustment, the up-down position or front-rear position of the lumbar support image 236 is moved and displayed.

[0130] The generation of an operation signal for the lumbar support 36 (movable part) and the transmission to the MM device 70 are executed while the upward arrow 236a, the downward arrow 236b, the forward arrow 236c, or the backward arrow 236d (operation direction image) is being touched.

[0131] Next, the case of the shade will be described. <5.2.1. Side shade operation> (Initial operation screen 26b) When the home screen (not shown) of the mobile terminal 20 is displayed, when the occupant performs a touch operation on the content bar 90, “Sunshade” is displayed on the content bar 90 by control of the controller 22, as shown in FIG. 10(a).

[0132] Additionally, the controller 22 displays a side selection button 95 and a roof selection button 96 in the selection item bar below the content bar 90. The side selection button 95 and the roof selection button 96 correspond to a selection image.

[0133] For ease of explanation, in this embodiment, it is assumed that the side selection button 95 is pre-selected as the initial value of the display program when "Sunshade" is displayed on the content bar 90. The initial value is not limited to the side selection button 95 being selected, and the roof selection button 96 may be selected.

[0134] 10(a), because the side selection button 95 has been selected as described above, the brightness or color of the area below it is different from that of the area below the roof selection button 96. Also, as shown in FIG. 10(a), door window glass images 351, 361 and window glass images 352, 361 are displayed in the content area below the side selection button 95 and the roof selection button 96 on the operation screen 26b.

[0135] For ease of explanation, it is assumed in Fig. 10(a) that the current opening / closing positions of the side shades 17R, 17L, 19R, and 19L are to be fully open positions, transmitted from the body ECU 120 to the controller 22. For this reason, the side shade images of the side shades 17R, 17L, 19R, and 19L are not displayed in Fig. 10(a).

[0136] As will be described later, when the current opening / closing positions of the side shades 17R, 17L, 19R, and 19L are not the fully open positions, an image of the side shade located at a position corresponding to the opening / closing position at that time is displayed. Here, the door window glass image and the window glass image are given reference numerals obtained by adding "300" to the reference numerals of the door window glasses 51 and 61 and the window glasses 52 and 62 in FIG. 5.

[0137] Also displayed are images 312, 314 of the driver's seat 12 and the passenger's seat 14. The reference numbers for these images are the same as those for the driver's seat 12 and the passenger's seat 14, but with "300" added to them.

[0138] As shown in FIG. 10(a), designation points F to I marked with circles for designating operation targets are displayed on a door window glass image 351, a window glass image 352, a door window glass image 361, and a window glass image 362.

[0139] It should be noted that the designated points F to I are not limited to circles, and may be other shapes. 10(a), a stop button 315, a right side selection button 316, a both side selection button 317, and a left side selection button 318 are displayed below the content area. The left side selection button 318 corresponds to the first selection area. The right side selection button 316 corresponds to the second selection area. The both side selection button 317 corresponds to the third selection area.

[0140] The right side selection button 316 is for collectively opening and closing the multiple side shades, i.e., the side shade portions 210a and 210c of the side shades 17R and 19R. The both side selection button 317 is for collectively opening and closing all of the multiple side shades, i.e., the side shade portions 210a to 210d of the side shades 17R, 17L, 19R, and 19L. The left side selection button 318 is for collectively opening and closing the multiple side shades, i.e., the side shade portions 210b and 210d of the side shades 17L and 19L.

[0141] <5.2.2. Individual operation of side shades> The individual operation of the side shades will be described with reference to Figs. 11(a), 11(b), 12(a) and 12(b).

[0142] <5.2.3. Display on operation screen 26b> (Individual operation tools) When the occupant touches any one of the designated points F to I on the operation screen 26b shown in Fig. 10(a), the controller 22 displays an individual operation tool. As a result, the controller 22 displays a slide knob 321 and an operation range 320 of the slide knob 321 on and near the window glass image in place of the touch-operated designated point, as shown in Fig. 11(a). The operation range 320 is displayed as a straight line extending in the vertical direction.

[0143] The operation range 320 corresponds to an operation range image. The operation range 320, the slide knob 321, the open button 324, and the close button 325 correspond to individual operation tools. The open button 324 and the close button 325 correspond to an operation direction image.

[0144] (Display of the open button 324 and the close button 325) Furthermore, the controller 22 displays an open button 324 and a close button 325 above and below the operation range 320. Here, when the side shade is located in the fully open position, the controller 22 displays the open button 324 as "inactive" by reducing the brightness or making it semi-transparent as compared to when it is displayed as "active" (see Fig. 11(a) and Fig. 11(b)).

[0145] 11(a) and 11(b), for ease of explanation, the outline of the open button 324 is shown with a two-dot chain line to indicate the "invalid" display. On the other hand, the controller 22 displays the close button 325 as "valid" by displaying it as an active button, such as by increasing the brightness or making it opaque compared to the "invalid" display. In FIG. 11(a) and 11(b), for ease of explanation, the outline of the close button 325 is shown with a solid line to indicate the "valid" display.

[0146] Furthermore, when the side shade is not in either the fully open position or the fully closed position, but is in between the two positions, the controller 22 displays the open button 324 and the close button 325 as "enabled" (see FIG. 12(a)).

[0147] When the side shade is in the fully closed position, the controller 22 displays the close button 325 as "invalid" and displays the open button 324 as "valid" (see FIG. 12(b)). (About the display of slide knob 321) When a change in the touch position of the slide knob 321 is detected by the operation unit 27, the display position of the slide knob 321 is changed in accordance with the change in the touch position by the display control of the controller 22.

[0148] In addition, when the current opening / closing position of the side shade is the fully open position, the slide knob 321 is displayed to be located at the upper end position of the operation range 320 so as to be linked to the current opening / closing position of the side shade (see Figures 11(a) and 11(b)).

[0149] 11(a) and 11(b), when the slide knob 321 is located at the upper end position of the operation range 320, the slide knob 321 cannot be touched in the operation direction further upward (opening direction) from this position. In this case, the slide knob 321 is allowed to be touched in the downward direction (closing direction).

[0150] 12(a), when the current open / closed position of the side shade 17R (see FIG. 5) is between the fully open position and the fully closed position, the slide knob 321 is displayed as being located between the upper end position and the lower end position in the operation range 320. When the slide knob 321 is located between the upper end position and the lower end position, touch operations in both operation directions including the up and down directions (open direction and close direction) are permitted.

[0151] 12(b), when the current open / close position of the side shade 19R (see FIG. 5) is the fully closed position, the slide knob 321 is displayed as being located at the bottom end position of the operation range 320 so as to be linked to the current open / close position of the side shade. When the slide knob 321 is located at the bottom end position, touch operation further downward (closing direction) from this position is disabled, but touch operation upward (opening direction) is permitted.

[0152] Furthermore, when the slide knob 321 is touched in a direction in which touch operation is permitted, the controller 22 is displayed to move in accordance with the direction of the touch operation. (About the moving part images) The display of the movable part image will be described.

[0153] Specific examples are shown in Figures 11(a), 11(b), 12(a) and 12(b). (When side shade is in fully open position) When the current opening / closing position of the side shade is the fully open position, the controller 22 does not display an image of the side shade.

[0154] For example, in Fig. 11(a) and Fig. 11(b), the side shades 19L, 17L, 17R, and 19R (see Fig. 5) are in the fully open position, so the images of the movable parts of the side shades are not displayed. In Fig. 12(a), the side shades 19L, 17L, and 19R (see Fig. 5) are in the fully open position, so the images of the movable parts of the side shades are not displayed. In Fig. 12(b), the side shades 19L, 17L, and 17R (see Fig. 5) are in the fully open position, so the images of the side shades (movable parts) are not displayed.

[0155] (When the side shade is between the fully open and fully closed positions) When the current open / closed position of the side shade is between the fully open position and the fully closed position, the controller 22 displays an image of the side shade on the operation screen 26b at a position corresponding to the current open / closed position.

[0156] 12(a), the current open / closed position of the side shade 17R is a half-open position between the fully closed position and the fully open position, so the controller 22 displays the side shade image 322 at a position corresponding to the current open / closed position. The side shade image 322 corresponds to a movable part image.

[0157] (When the side shade is in the fully closed position) When the current open / closed position of the side shade is the fully closed position, the controller 22 displays the image of the side shade in the fully closed state. For example, in Fig. 12(b), the current open / closed position of the side shade 19R is the fully closed position. Therefore, the controller 22 displays the side shade image 323 in a position corresponding to the current open / closed position, i.e., a position that completely covers the window glass image 352. The side shade image 323 corresponds to a movable part image.

[0158] <5.2.4. Generation of operation signals by individual operations> The passenger moves the slide knob 321 upward (opening direction) or downward (closing direction) by touching the slide knob 321 in a direction that allows operation. The operation unit 27 detects the amount of movement of the operation unit 27 in the opening direction (for example, the + direction) or the closing direction (the - direction) based on the position before the change. This amount of movement is the amount of movement in the opening direction or the closing direction.

[0159] Based on this detection, the controller 22 moves and displays the slide knob 321 in the touch-operated direction of the slide knob 321, and generates an operation signal. The operation signal generated by the controller 22 when adjusting the side shade includes information on "identification of the body ECU 120", "identification of the in-vehicle device", and "adjustment direction (movement direction)".

[0160] The "identification of in-vehicle device" is specific information that specifies an in-vehicle operation associated with a specified point. Here, it is specific information that specifies the side shade parts 210a to 210d associated with the specified points F, G, H, and I. Also, the "adjustment direction (movement direction)" is specific information that specifies the direction in which the slide knob 321 moves by a touch operation, that is, either the open direction or the close direction.

[0161] When the open button 324 or the close button 325 is touched while being displayed as “enabled,” the “adjustment direction (movement direction)” is specific information of the open direction or close direction indicated by the touched button.

[0162] <5.2.5. Transmission and Display> As described above, when the controller 22 generates an operation signal, it transmits the operation signal to the body ECU 120 (see FIG. 2) via the MM device 70. Based on the transmitted operation signal, the control unit 122 controls the rotation of an electric motor (not shown) of the side shade portion of the side shade that matches the "identification of in-vehicle device" information, thereby moving the side shade in the closing or opening direction via an operating mechanism (not shown).

[0163] The control unit 122 of the body ECU 120 then stores the current position based on the open / close position detection signal from an encoder (not shown) in a storage unit (not shown). The control unit 122 also transmits the current position to the mobile terminal 20 via the MM device 70.

[0164] Based on this transmitted current position, the controller 22 moves and displays a shade image (movable part image) (not shown) in the closing direction. That is, the shade image (movable part image) is displayed and moved in synchronization with the change (movement) in the opening / closing position of the side shade.

[0165] When the open button 324 or the close button 325 is touched while being displayed as "enabled," the controller 22 also moves and displays the slide knob 321 in synchronization with the change (movement) in the open / closed position of the side shade 19L based on the transmitted current position.

[0166] When the side shades (movable parts) are opened and closed individually, the generation of the operation signal and the transmission to the MM device 70 are executed while the touch position on the operation range image of the movable part of the in-vehicle device is being changed.

[0167] <5.2.6. Bulk operation of side shades> The collective operation of the side shades will now be described with reference to Figs. 10(a), 13(a), 13(b), 14(a) and 14(b).

[0168] <5.2.7. Display on operation screen 26b> (About bulk operation tools) When the occupant touches any one of the right side selection button 316, the both side selection button 317, and the left side selection button 318 in the state of the operation screen 26b shown in FIG. 10(a), the controller 22 displays the following collective operation mode.

[0169] The display of the collective operation mode indicates that the selected button that has been touched is more noticeable than the non-selected selected buttons. This indication method may be a highlighted display with a higher brightness, a change in color display, or a blinking display, and is not limited thereto. When the left selection button 318 in Fig. 13(a) and Fig. 14(b), the both side selection button 317 in Fig. 13(b), and the right selection button 316 in Fig. 14(a) are touched, they are displayed as dots to indicate that they have been selected by touch.

[0170] In the collective operation mode, the controller 22 displays an open button 328 and a close button 329 as collective operation tools in the area below the selection buttons, and also clearly indicates the outlines of the window glasses to be collectively opened or closed by the touch-operated selection button. The method of indication is not limited to a highlighted display with high brightness, or a changed color display, or a blinking display. The "invalid" display and "valid" display of the open button 328 and the close button 329 will be described later. The open button 328 and the close button 329 correspond to operation specific images.

[0171] The example of Fig. 14(b) shows a case where the left selection button 318 is touched. In this case, as shown in the figure, the outlines of the window glass images 361 and 362 are clearly displayed so as to stand out more than the outlines of the unselected window glass images 351, etc. In Fig. 14(b) , for convenience of explanation, the outlines of the window glass images 361 and 362 are shown with a thicker line than the outlines of the unselected window glass images 351, etc.

[0172] In Fig. 14(b), the side shade 17R (see Fig. 5) is currently in the half-open position, so the side shade image 322 is displayed in the half-open position. Also, in Fig. 14(b), the side shade 19R (see Fig. 5) is currently in the fully closed position, so the side shade image 323 is displayed in the fully closed position.

[0173] (Display of the open button 328 and the close button 329) Furthermore, when one of the selection buttons 316 to 318 is touched, the controller 22 performs a display according to the current open / closed position of the side shade portion of the plurality of side shades selected by the touch operation.

[0174] That is, when the current opening / closing positions of all of the side shade portions of the selected side shades are the fully open positions, the controller 22 displays the open button 328 as "invalid" and displays the close button 329 as "valid."

[0175] Furthermore, when the current opening / closing positions of all of the side shade portions of the selected plurality of side shades are the fully closed positions, the controller 22 displays the open button 328 as "enabled" and displays the close button 329 as "disabled."

[0176] If the current opening / closing position of any one of the side shade parts of the selected multiple side shades is between the fully open position and the fully closed position, the controller 22 displays both the open button 328 and the close button 329 as "enabled."

[0177] Let me explain with a concrete example. 13(a) and 14(b) show the case where the left selection button 318 is touched. In this case, the current opening / closing positions of all of the side shade portions 210b, 210d of the selected side shades 17L, 19L are in the fully open position. Therefore, the controller 22 displays the open button 328 as "invalid" and displays the close button 329 as "valid."

[0178] 13(b) shows a case where the both side selection button 317 is touched. In this case, the current opening / closing positions of the side shade portions 210b, 210d, and 210c of the selected side shades 17L, 19L, and 19R are set to the fully open position. However, since the current opening / closing position of the side shade portion 210a of the side shade 17R is between the fully open position and the fully closed position, the controller 22 displays both the open button 328 and the close button 329 as "enabled."

[0179] 14(a) shows a case where the right selection button 316 is touched. In this case, the current open / close positions of the side shade portions 210b, 210d of the selected side shades 17L, 19L are set to the fully open position. Also, the current open / close position of the side shade portion 210c of the side shade 19R is set to the fully closed position. However, since the current open / close position of the side shade portion 210a of the side shade 17R is between the fully open position and the fully closed position, the controller 22 displays both the open button 328 and the close button 329 as "enabled."

[0180] <5.2.8. Generation of operation signals by operation> The occupant touches the open button 328 or the close button 329, which is displayed as "enabled." This causes the controller 22 to cancel the display of the window glass outline to be opened or closed, and control the display in the same way as the other window glass outlines, and generate an operation signal. The operation signal generated by the controller 22 includes information on "identification of the body ECU 120," "identification of the in-vehicle device," and "adjustment direction (movement direction)."

[0181] The "identification of in-vehicle device" is identification information of the in-vehicle device under the jurisdiction of the selection button displaying "valid", and is a candidate for control. For example, as shown in Fig. 14(a), when the selection button displaying "Valid" is the right side selection button 316, the in-vehicle devices are the side shade sections 210a and 210c. As shown in Fig. 13(b), when the selection button displaying "Valid" is the both side selection button 317, the in-vehicle devices are the side shade sections 210a to 210d. As shown in Figs. 13(a) and 14(b), when the selection button displaying "Valid" is the left side selection button 318, the in-vehicle devices are the side shade sections 210b and 210d. In addition, the "adjustment direction (movement direction)" is specific information of the opening direction or closing direction indicated by the open button 328 or close button 329 that has been touched.

[0182] <5.2.9. Transmission and Display> As described above, when the controller 22 generates an operation signal, it transmits it to the body ECU 120 (see FIG. 2) via the MM device 70. Based on the transmitted operation signal, the control unit 122 controls the rotation of electric motors (not shown) of the side shade parts of the multiple side shades that match the "identification of the in-vehicle device" information. As a result, the control unit 122 moves the side shades in the closing direction or the opening direction via an operating mechanism (not shown).

[0183] The control unit 122 of the body ECU 120 then stores the current position based on the open / close position detection signal from an encoder (not shown) in a storage unit (not shown). The control unit 122 also transmits the current position to the mobile terminal 20 via the MM device 70.

[0184] Based on this transmitted current position, the controller 22 moves and displays a shade image (movable part image) (not shown) in the open or close direction. That is, the shade image (movable part image) is displayed and moved in synchronization with the change (movement) in the open / closed position of the side shade. Note that the display of the side shade image of a side shade that is not being operated does not change.

[0185] In the collective operation mode, the generation of the operation signal by the controller 22 and the transmission to the MM device 70 are configured to continue after the open button 328 or the close button 329 is touched once, even if the touch is released.

[0186] When the controller 22 is notified by the operation unit 27 that a touch operation on the stop button 315 has been detected, the controller 22 stops generating the operation signal and transmitting it to the MM device 70 . In addition, when the "adjustment direction (movement direction)" is the open direction, the controller 22 stops generating the operation signal and transmitting it to the MM device 70 when all of the current opening / closing positions of the multiple side shade sections that are the subject of collective operation become fully open positions.

[0187] In addition, when the "adjustment direction (movement direction)" is the closing direction, the controller 22 stops generating the operation signal and transmitting it to the MM device 70 when all of the current opening / closing positions of the multiple side shade sections that are the subject of collective operation become fully closed positions.

[0188] <5.3.1. Roof shade operation> Next, the case of a roof shade will be described. (Operation screen 26c) When the roof selection button 96 is touched on the initial operation screen 26b shown in Fig. 10(a), the controller 22 changes the display 26 to an operation screen 26c shown in Fig. 10(b). As shown in Fig. 10(b), the selection of the roof selection button 96 indicates that the brightness or color of the area below it is different from that of the area below the side selection button 95.

[0189] 10(b), roof window glass images 330, 331 and images 312, 314 of the driver seat 12 and the passenger seat 14 are also displayed in the content area below the side selection button 95 and the roof selection button 96. The roof window glass image 330 is an image corresponding to the roof window glass 42R. The roof window glass image 331 is an image corresponding to the roof window glass 42L.

[0190] For ease of explanation, in Fig. 10(b), it is assumed that the body ECU 120 has transmitted to the controller 22 a command to set the current opening / closing positions of the roof shades 44R, 44L to the fully open position. For this reason, it is assumed that the roof shade images 332, 333 of the roof shades 44R, 44L are not displayed in Fig. 10(b).

[0191] If the current positions of the roof shades 44R, 44L are not the fully open positions, roof shade images 332, 333 positioned at positions corresponding to the current positions are displayed. For example, if the current positions of the roof shades 44R, 44L are between the fully open and fully closed positions, the roof shade images 332, 333 are shown by two-dot chain lines in Fig. 10(b). The roof shade images 332, 333 correspond to movable part images.

[0192] 10(b), designated points J and K in the form of circles for designating operation targets are displayed on the roof window glass images 330 and 331. Note that the designated points J and K are not limited to circles and may have other shapes.

[0193] As shown in FIG. 10(b), a stop button 315 and a both-side selection button 317 are displayed below the content area. The both side selection button 317 here is for opening and closing all of the plurality of roof shades, that is, the roof shade portions 220a and 220b of the roof shades, all at once.

[0194] <5.3.2. Individual operation of roof shades> (Individual operation tools) As for the individual operation tools for the roof shade, similarly to the case of the side shade described above, when the occupant touches each designated point, the controller 22 displays the individual operation tools (slide knob, operation range of the slide knob, open button, and close button). The function and display method of these individual operation tools are the same as those of the individual operation tools for the roof shade, so a description thereof will be omitted.

[0195] <5.3.3. Generation of operation signals by individual operations> When an occupant touches the slide knob, open button, or close button of the roof shade, the controller 22 generates an operation signal based on the touch detection of the operation unit 27. This operation signal includes information on "identification of the body ECU 120," "identification of the in-vehicle device," and "adjustment direction (movement direction)."

[0196] The "identification of in-vehicle device" is specific information that specifies an in-vehicle operation associated with the specified points J and K. Also, the "adjustment direction (movement direction)" is specific information that specifies either the open direction or the close direction that is specified by the movement direction of the slide knob, or the operation of the open button or the close button, and is the same as in the case of the side shade.

[0197] <5.3.4. Transmission and Display> The explanation of "transmission and display" here is omitted by replacing "side shade" or "shade" in the description of <5.2.5. Transmission and Display> above with "roof shade".

[0198] <5.3.5. Bulk operation of roof shades> The collective operation of the roof shades will now be described. (About bulk operation tools) When the occupant touches the both-side selection button 317 in the state of the operation screen 26c shown in FIG. 10(b), the controller 22 displays the collective operation mode described below.

[0199] That is, the touched selection button is displayed more conspicuously than before the touch operation. The display method may be a highlighted display with a higher luminance, a changed color display, or a blinking display, and is not limited thereto.

[0200] In the collective operation mode, the controller 22 displays an open button and a close button (both not shown) as collective operation tools in the area below the selection buttons. Furthermore, the controller 22 clearly displays the contour of the roof window glass that is to be collectively opened or closed by touching the selection button. The method of displaying is the same as in the case of the side shade. Also, the "enabled" and "disabled" displays of the open button and the close button (both not shown) are the same as in the case of the side shade.

[0201] <5.3.6. Generation of operation signals by operation> The occupant touches the open button or close button (both not shown) that is displayed as "enabled." This causes the controller 22 to cancel the display of the roof window glass outline to be opened or closed, and controls the display in the same manner as before it was displayed, while generating an operation signal. The operation signal generated by the controller 22 includes information on "identification of the body ECU 120," "identification of the in-vehicle device," and "adjustment direction (movement direction)."

[0202] The "identification of in-vehicle device" is identification information of the in-vehicle device under the jurisdiction of the selection button displaying "enabled", and is information to be controlled. In this embodiment, since the selection button displaying "enabled" is the both-side selection button 317, the in-vehicle device is the roof shade parts 220a, 220b. Also, the "adjustment direction (movement direction)" is identification information of the opening direction or closing direction indicated by the touch-operated open button or close button (both not shown).

[0203] <5.3.7. Transmission and Display> The explanation of "transmission and display" here is omitted by replacing "side shade" or "shade" in the description of <5.2.9. Transmission and Display> above with "roof shade".

[0204] This embodiment has the following features. (1) The mobile terminal 20 of this embodiment includes a display 26 (display unit), an operation unit 27 (touch detection unit), a controller 22 (operation signal generation unit, display control unit), and a communication module 29 (transmission unit).

[0205] When operating the in-vehicle devices of the right rear seat 16, the display 26 displays a seat body image 234, a seat back image 233, a seat portion image 232, an ottoman image 235, and a lumbar support image 236, which are images of the movable parts of the in-vehicle devices, each of the parts 16a to 16e.

[0206] When operating the in-vehicle device of the left rear seat 18, the display 26 displays images of movable parts of the in-vehicle devices, that is, a seat body image 234, a seat back image 233, a seat part image 232, an ottoman image 235, and a lumbar support image 236. When operating the in-vehicle device of the right rear seat 16 or the left rear seat 18, the display 26 displays images of the operation directions of these movable parts.

[0207] When operating an in-vehicle device related to the side shades, the display 26 displays side shade images 322, 323 which are images of the movable parts of the side shade sections 210a-210d which are the in-vehicle devices. When operating an in-vehicle device related to the roof shade, the display 26 displays roof shade images 332, 333 which are images of the movable parts of the roof shade sections 220a, 220b which are the in-vehicle devices.

[0208] When operating the in-vehicle devices of the side shade and roof shade, the display 26 displays an open button 324 and a close button 325 (operation direction images), or an open button 328 and a close button 329 (operation direction images) of the movable parts. Alternatively, when operating the in-vehicle devices of the side shade and roof shade, the display 26 displays an operation range 320 (operation range image) of the movable parts.

[0209] The operation unit 27 (touch detection unit) detects a touch operation on an operation direction image displayed on the display 26, or detects a movement amount based on a change in a touch position on an operation range image. The controller 22 (operation signal generation unit) generates an operation signal based on the detection of the touch operation on the operation direction image, or the detection of the movement amount.

[0210] The communication module 29 (transmitter) transmits the operation signal to the seat ECU 130 (a control device for an in-vehicle device). The controller 22 (display controller) moves and displays the touched operation direction image or the movable part image of the in-vehicle device associated with the operation range image, based on the detection of the touch operation or the amount of movement on the operation direction image.

[0211] With the above configuration, when an occupant wants to check the operation of a moving part of an in-vehicle device to be operated, the occupant can check the operation by looking at the display unit without directly looking at the moving part to be operated. (2) The controller 22 (display control unit) of this embodiment moves and displays the movable part image in synchronization with the movement of the movable part controlled by the seat ECU 130 (controller for in-vehicle equipment). As a result, the movable part image is displayed and moved in synchronization with the in-vehicle equipment to be operated, so that the occupant can get a realistic sense of operation from the movable part image that is displayed and moved. This effect is particularly significant when the in-vehicle equipment to be operated is not within the occupant's field of vision.

[0212] (3) When operating an in-vehicle device on a rear seat, the controller 22 (display control unit) of this embodiment displays the movable part image of the in-vehicle device in a display mode different from the display mode of the movable part image before the movable part image is moved and displayed when moving and displaying the movable part image of the in-vehicle device. As a result, since the movable part image differs from the display mode before the movable part image is moved and displayed, the movable part image of the movable part of the in-vehicle device to be operated stands out, making it easier for the occupant to see it.

[0213] (4) In this embodiment, the display 26 (display unit) displays a side selection button 95 for selecting all or any of the multiple in-vehicle devices, and a roof selection button 96 (selection image). The operation unit 27 (touch detection unit) is capable of detecting a touch operation on the side selection button 95 and the roof selection button 96 (selection image). When a touch operation is performed on the side selection button 95 and the roof selection button 96 (selection image), the controller 22 (display control unit) causes the display 26 to display one or more images of the movable parts of the in-vehicle devices of the side shade or roof shade. Here, the displayed images of the movable parts of the in-vehicle devices are operation target candidates. As a result, the occupant can narrow down the operation target candidates because one or more in-vehicle device selections having movable part images are displayed as operation target candidates.

[0214] (5) In this embodiment, when multiple images of in-vehicle devices are displayed as images of candidate objects for operating the side shade, the display 26 displays a left selection button 318 (first selection area) that is detected by touch on the operation unit 27 and is used to select an in-vehicle device located on the left side of the vehicle.

[0215] In addition, when display 26 displays multiple images of in-vehicle devices as images of candidate objects to be operated on the side shade, display 26 displays right selection button 316 (second selection area) which is used to select the in-vehicle device located on the right side and is detected by touch by operation unit 27.

[0216] In addition, when multiple images of in-vehicle devices are displayed as images of candidate objects to be operated on the side shade, the display 26 displays a both side selection button 317 (third selection area) that is detected by touching the operation unit 27 and is used for simultaneously selecting both the in-vehicle devices located on the left and right sides.

[0217] Alternatively, when display 26 displays multiple images of in-vehicle devices as candidate images of operation targets for the roof shade, display 26 displays a both side selection button 317 (third selection area) that is detected by touching operation unit 27 and is used for simultaneous selection of both in-vehicle devices located on the left and right sides.

[0218] When any one of the selection areas is selected by a touch operation, display 26 displays an image specifying the operation content of the movable part of the in-vehicle device associated with that selection area as an open button 328 and a close button 329 (operation specification image).

[0219] The controller 22 (operation signal generating unit) generates an operation signal including control object information for controlling an in-vehicle device corresponding to the selection area touch-detected by the operation unit 27, and operation information previously associated with the open button 328 and the close button 329 (operation specific image).

[0220] Furthermore, the communication module 29 (transmitter) transmits the operation signal to the seat ECU 130. As a result, when an occupant wants to check the operation of a movable part of a pair of in-vehicle devices disposed on the left and right sides of the vehicle, the occupant can check the operation by looking at the display unit without directly looking at the movable part of the in-vehicle device to be operated.

[0221] This embodiment can be modified and implemented as follows. The present embodiment and the following modified examples can be implemented in combination with each other to the extent that no technical contradiction occurs.

[0222] In the above embodiment, the mobile terminal 20 is attached to the second row console box 37. Alternatively, the mobile terminal 20 may be attached to the arm rests of the left and right independent captain seats so that the left and right passengers can operate the mobile terminals independently. In the above embodiment, the controller 22 (display control unit) moves and displays the movable part image in synchronization with the movement of the movable part controlled by the seat ECU 130 (controller for in-vehicle equipment). Alternatively, the movable part image may be displayed with a delay in units of seconds.

[0223] In the above embodiment, the in-vehicle devices of the rear seat are the seat slide unit, the seat back unit, the seat cushion unit, the ottoman unit, and the lumbar support unit. At least one of these in-vehicle devices may be omitted. Alternatively, other in-vehicle devices may be added.

[0224] In the above embodiment, the pair of roof shades 44R, 44L are used as the on-vehicle device, but the present invention may be applied to a single roof shade, or three or more roof shades. In the above embodiment, the rear seat and the shade are taken as examples and the movable parts of the in-vehicle device are displayed on the operation screen of the mobile terminal 20. However, the present invention may be applied to other in-vehicle devices.

[0225] In the above embodiment, wireless communication is performed between the operation device for the in-vehicle equipment and the seat ECU 130. However, communication between the operation device and the control device for the in-vehicle equipment may be performed by wire. [Explanation of symbols]

[0226] 10a…A-pillar 10b…B pillar 10c…C-pillar 10d…D pillar 12…Driver seat 13…Instrument panel 14…Passenger seat 15R…Right rear door 15L…Left rear door 16…Rear right seat 16a…Seat slide section (vehicle equipment) 16b…Seat back section (vehicle equipment) 16c…Seat bearing surface (vehicle equipment) 16d…Ottoman section (vehicle equipment) 16e…Lumbar support section (vehicle equipment) 17R, 17L...Side shade (movable part) 18…Left rear seat 18a…Seat slide section (vehicle equipment) 18b…Seat back section (vehicle equipment) 18c…Seat bearing surface (vehicle equipment) 18d…Ottoman section (vehicle equipment) 18e…Lumbar support section (vehicle equipment) 19R, 19L...Side shade (movable part) 20...Mobile terminal (operating device) 21...Rear window glass 22...Controller (operation signal generating unit) 23...ROM 24…RAM 25…Storage 26…Display (display unit) 27...Operation section (touch detection section) 29...Communication module (transmitter) 32... Seat part (movable part) 33…Seat back (movable part) 34…Seat body (movable part) 35…Ottoman (movable part) 36…Lumbar support (movable part) 37…2nd row console box 40…Roof 42R, 42L...Roof window glass 44R, 44L...Roof shade (movable part) 51…Door window glass 52…Window glass 61…Door window glass 62…Window glass 70...Multimedia equipment 72…Car navigation section 73...Multimedia device control section 74…Digital TV receiver 75…Near field communication department 76…Antenna 78…MM equipment system control section 79...Operation switch section 80…Display 81…Speaker 85…Communication interface 90…Content bar 91...Selection bar 92…Adjustment button Column 93 94a…Left seat button 94b…Right seat button 95...Side selection button (selection image) 96…Roof selection button (selection image) 100...In-vehicle device control system 120…Body ECU 122...Control unit 124...Control mode memory section 130…Seat ECU 132...Control unit 210a, 210b, 210c, 210d...Side shade section (vehicle-mounted equipment) 220a, 220b...Roof shade section (vehicle equipment) 232...Seat image (movable part image) 232a…Upward arrow (operation direction image) 232b…Downward arrow (operation direction image) 233…Seat back image (movable part image) 233a…Forward arrow (operation direction image) 233b...Backward arrow (operation direction image) 234…Seat body image (movable part image) 234a…Forward arrow (operation direction image) 234b…Backward arrow (operation direction image) 235...Ottoman image (movable part image) 235a…Upward arrow (operation direction image) 235b…Downward arrow (operation direction image) 235c…Forward arrow (operation direction image) 235d…Backward arrow (operation direction image) 236…Lumbar support image (movable part image) 236a…Upward arrow (operation direction image) 236b…Downward arrow (operation direction image) 236c…Forward arrow (operation direction image) 236d…Backward arrow (operation direction image) 237...Image of second row console box 312...Driver seat image 314...Passenger seat image 315...Stop button 316…Right selection button (second selection area) 317…Both side selection button (third selection area) 318…Left selection button (first selection area) 320...Operation range (operation range image) 321...Slide knob 322...Side shade image (movable part image) 323...Side shade image (movable part image) 324…Open button 325…Close button 328...Open button (operation specific image) 329…Close button (operation specific image) 330…Roof window glass image (right side) 331…Roof window glass image (left side) 332...Roof shade image (right side) (movable part image) 333…Roof shade image (left side) (movable part image) 351...Door window glass image 352…Window glass image 361...Door window glass image 362…Window glass image A~K: Designated points

Claims

1. An operation device for an in-vehicle device that transmits an operation signal to a control device that controls a movable part of the in-vehicle device, An operation device for an in-vehicle device comprising: a display unit that displays an image of a movable part of the in-vehicle device, and at least one of an operation direction image of the movable part of the in-vehicle device and an operation range image of the movable part; a touch detection unit that performs one of a touch operation on the operation direction image displayed on the display unit and detection of an amount of movement based on a change in the touch position on the operation range image; an operation signal generation unit that generates the operation signal based on the detection of the touch operation on the operation direction image or the detection of the amount of movement; a transmission unit that transmits the operation signal to a control device of the in-vehicle device; and a display control unit that moves and displays the movable part image of the in-vehicle device associated with the operation direction image that has been touched and the operation range image based on the detection of the touch operation on the operation direction image and the amount of movement.

2. The operating device for an in-vehicle device according to claim 1 , wherein the display control unit moves and displays the image of the movable part in synchronization with a movement of the movable part controlled by a control device of the in-vehicle device.

3. The operating device for in-vehicle equipment according to claim 2 , wherein, when the movable part image is displayed and moved, the display control unit displays the movable part image in a display mode different from a display mode of the movable part image before the movable part image is displayed and moved.

4. the display unit displays a selection image for selecting all or any of the plurality of in-vehicle devices; The touch detection unit is configured to detect a touch operation on the selected image, The operating device for an in-vehicle device according to claim 2 or claim 3, wherein the display control unit, when a touch operation is performed on the selected image, causes one or more images of movable parts of the in-vehicle device to be displayed on the display unit as images of candidate operation targets.

5. 5. The operation device for an in-vehicle device according to claim 4, wherein, in the case where the display unit displays a plurality of images of the in-vehicle devices as images of candidate operation targets, the display unit further displays at least a third selection area out of a first selection area for selecting an in-vehicle device located on the left side of the vehicle and detected by a touch by the touch detection unit, a second selection area for selecting an in-vehicle device located on the right side and detected by a touch by the touch detection unit, and a third selection area for simultaneously selecting both in-vehicle devices located on the left and right sides and detected by a touch by the touch detection unit, and when any one of the first to third selection areas is touched, displays an image specifying the operation content of a movable part of the in-vehicle device associated with the touched selection area as an operation specific image, and the operation signal generation unit generates an operation signal including control target information for setting the in-vehicle device corresponding to the selection area touched and detected by the touch detection unit as a control target, and operation information previously associated with the operation specific image, and the transmission unit transmits the operation signal to the control device.

Citation Information

Patent Citations

  • On-vehicle operating device

    JP2005146766A

  • Operation device

    JP2009023390A

  • Input display device

    JP2010072717A

  • Vehicle controller, and computer program for portable information terminal

    JP2013049952A

  • User Interface For An Aircraft

    US20160004374A1