Vehicle-mounted system and information processing device

Abstract

The present disclosure relates to an in-vehicle system and an information processing apparatus. An in-vehicle system includes a display apparatus and an information processing apparatus, wherein the display apparatus is provided in a front portion of a driver seat in a vehicle cabin, the display apparatus includes a pair of display portions that protrude to a rear side of the vehicle than an instrument portion provided on a front surface of a steering wheel and are disposed at positions on both sides of the steering wheel, and has a touch panel, and the information processing apparatus has a control portion configured to perform an action of outputting a command that causes the pair of display portions to display an operation screen of an electric power window to the display apparatus, wherein the electric power window is an apparatus that electrically opens and closes a window glass of the vehicle.

Description

Technical Field

[0001] This disclosure relates to in-vehicle systems and information processing devices. Background Technology

[0002] It is known that a vehicle door handle has a touch panel, wherein the touch panel has the function of operating the power window switch (for example, see Japanese Patent Application Publication No. 2020-175763). Summary of the Invention

[0003] This disclosure provides an in-vehicle system and information processing device that improve the operability of power windows.

[0004] The first embodiment of this disclosure includes an in-vehicle system comprising: a display device; a power window configured to electrically open and close the vehicle window glass; and an information processing device configured to output information via the display device. The display device is located in front of the driver's seat within the vehicle compartment. The display device includes a pair of display units, wherein the pair of display units protrude towards the rear of the vehicle from the instrument panel located on the front of the steering wheel and are positioned on both sides of the steering wheel, and have a touch panel. The information processing device includes a control unit and a storage unit. The control unit is configured to perform the following actions: outputting a command to the display device to display an operation screen of the power window on the pair of display units based on a signal received from the touch panel and information stored in the storage unit; determining a touch operation on the operation screen of the power window based on a signal from the touch panel; and outputting a command to open or close the window glass to the power window based on the determined touch operation.

[0005] The second embodiment of the present disclosure includes an in-vehicle system comprising: a display device; and an information processing device configured to output information via the display device. The display device is located in front of the driver's seat within the vehicle compartment. The display device includes a pair of display sections, wherein the pair of display sections protrude toward the rear of the vehicle from the instrument panel located on the front of the steering wheel and are positioned on both sides of the steering wheel, and have touch panels. The information processing device includes a control unit, wherein the control unit is configured to perform the following action: outputting a command to the display device to cause the pair of display sections to display an operation screen for a power window, wherein the power window is a device for electrically opening and closing the vehicle window glass.

[0006] Alternatively, the pair of display units may be positioned in the longitudinal direction of the vehicle at a position closer to the front of the vehicle than the gripping portion of the steering wheel.

[0007] Alternatively, the control unit may be configured to: receive touch signals from the display device related to touch operations on the touch panel; and output commands to open or close the window glass to the power window based on the touch signals.

[0008] Alternatively, the control unit may be configured to: acquire information related to the opening degree of the vehicle window glass; and output the command to the display device to display information related to the opening degree of the vehicle window glass on the operation screen of the electric window.

[0009] Alternatively, the control unit may be configured to output the command to the display device to change the display scheme between an interface in the operation screen of the power window that allows operation of the window glass and an interface that does not allow operation of the window glass.

[0010] Alternatively, the pair of displays may be configured to include: an inner display disposed on the inner side of the vehicle; and an outer display disposed on the outer side of the vehicle, wherein the control unit is configured to output the command to the display device to cause the outer display to display the operation screen of the power window.

[0011] Alternatively, the control unit may be configured to: receive touch signals from the display device related to touch operations on the touch panel; if, based on the touch signals, it is determined that the interface corresponding to the operation of opening the window has been touched for a predetermined time or more, output a command to automatically fully open the window to the power window; and if, based on the touch signals, it is determined that the interface corresponding to the operation of closing the window has been touched for a predetermined time or more, output a command to automatically fully close the window to the power window.

[0012] The third embodiment of this disclosure is an information processing device that outputs information via a display device. The information processing device includes a control unit, and the display device is located in front of the driver's seat inside the vehicle. The display device includes a pair of display units, which protrude from the instrument panel located on the front of the steering wheel towards the rear of the vehicle and are positioned on both sides of the steering wheel, and have touch panels. The control unit is configured to output a command to the display device to display an operation screen for the electric window on the pair of display units, wherein the electric window is a device that electrically opens and closes the vehicle's window glass.

[0013] In the information processing device of the third embodiment of this disclosure, the pair of display units may also be arranged in the longitudinal direction of the vehicle at a position closer to the front of the vehicle than the gripping part of the steering wheel.

[0014] In the information processing apparatus of the third embodiment of this disclosure, the control unit may also be configured to: receive a touch signal from the display device related to a touch operation on the touch panel; and output a command to open or close the window glass to the electric window based on the touch signal.

[0015] In the information processing apparatus of the third embodiment of this disclosure, the control unit may also be configured to: acquire information related to the opening degree of the vehicle window glass; and output the command to the display device to display the information related to the opening degree of the vehicle window glass on the operation screen of the electric window.

[0016] In the information processing apparatus of the third embodiment of this disclosure, the control unit may also be configured to output the command to the display device to change the display scheme between an interface in the operation screen of the electric window that allows operation of the window glass and an interface that does not allow operation of the window glass.

[0017] In the information processing apparatus of the third embodiment of this disclosure, the pair of display units may also be configured to include: an inner display, disposed on the inner side of the vehicle; and an outer display, disposed on the outer side of the vehicle, wherein the control unit is configured to output the command to the display device to cause the outer display to display the operation screen of the electric window.

[0018] In the information processing apparatus of the third embodiment of this disclosure, the control unit may also be configured to: receive a touch signal related to a touch operation on the touch panel from the display device; if it is determined from the touch signal that the interface corresponding to the operation of opening the window has been touched for a predetermined time or more, output a command to automatically fully open the window to the power window; and if it is determined from the touch signal that the interface corresponding to the operation of closing the window has been touched for a predetermined time or more, output a command to automatically fully close the window to the power window.

[0019] In addition, other embodiments of this disclosure include vehicles equipped with the aforementioned vehicle-mounted system, information processing methods executed by the aforementioned information processing apparatus, programs for causing computers to execute the information processing methods, or computer-readable storage media that non-temporarily stores the programs.

[0020] According to this disclosure, the operability of electric windows can be improved. Attached Figure Description

[0021] Hereinafter, with reference to the accompanying drawings, the features, advantages, and technical and industrial significance of exemplary embodiments of the present invention will be described, wherein the same reference numerals denote the same elements, wherein:

[0022] Figure 1 It is a diagram showing the interior of a vehicle's passenger compartment.

[0023] Figure 2 It's a magnified view of the area around the steering wheel.

[0024] Figure 3 This is a diagram that schematically illustrates an example of the hardware configuration of a vehicle.

[0025] Figure 4 This is a top view of the vehicle.

[0026] Figure 5 This is a diagram illustrating the functional structure of an ECU.

[0027] Figure 6 This is an example of a power window operation screen displayed on an external monitor.

[0028] Figure 7 This is an example of the power window operation screen displayed on the external monitor when a user touches the window lock button.

[0029] Figure 8 This is an example of a power window operation screen displayed on an external monitor when the GUI component used to operate the right front power window is not displayed.

[0030] Figure 9 This is a flowchart of the processing in the ECU when operating the electric window via the electric window operation screen of the first embodiment.

[0031] Figure 10 This is a diagram illustrating an example of the power window operation screen displayed on an external display according to the second embodiment.

[0032] Figure 11 This is a flowchart of the processing in the ECU when operating the electric window via the electric window operation screen of the second embodiment.

[0033] Figure 12 This is a diagram illustrating an example of the power window operation screen displayed on an external display according to the third embodiment. Detailed Implementation

[0034] Electric windows, which open and close vehicle doors using electric motors, are known. These windows can be operated, for example, via a switch located on the door. Furthermore, sometimes multiple switches are provided so that all windows can be opened and closed from the driver's seat. When the driver operates such switches while the vehicle is in motion, their gaze shifts significantly forward when they look at the switches. Preferably, this shift in the driver's gaze should be minimized.

[0035] In this regard, one of the solutions disclosed herein is an in-vehicle system including a display device and an information processing device that outputs information via the display device. The display device is located in front of the driver's seat in the vehicle compartment. The display device includes a pair of display units, which protrude toward the rear of the vehicle from the instrument panel located on the front of the steering wheel and are positioned on both sides of the steering wheel, and have touch panels.

[0036] The display device has a pair of display sections positioned on either side of the steering wheel. Furthermore, the pair of display sections are configured to enable touch operation via a touch panel. Preferably, the pair of display sections are positioned in the longitudinal direction of the vehicle, protruding towards the rear of the vehicle than the instrument panel (typically a speedometer-equipped instrument panel) located on the front of the steering wheel, i.e., closer to the driver. By positioning the pair of display sections in this way, the touch panel can be placed near the portion of the steering wheel that the driver grips. That is, during operation, the time the driver takes their hands off the steering wheel is minimized. It should be noted that the steering wheel does not necessarily need to be circular; it only needs to have a gripping portion and be rotated for steering operation.

[0037] A pair of displays may present information to the user that is related to vehicle control or to the convenience of vehicle occupants. Information related to occupant convenience may include information for providing entertainment or information related to occupant comfort. This information may include interfaces for operating audio, navigation, air conditioning, telephone, clock, or voice assistants, and information related to the operational status of these devices. Furthermore, information related to vehicle control may include information related to vehicle operation. This information may include interfaces for operating headlights, wipers, side mirrors, ADAS (Advanced Driver Assistance System), driving modes, vehicle height, steering wheel position, or seat position, and information related to the operational status of these devices.

[0038] Here, the information processing device includes a control unit configured to perform the following action: outputting a command to the display device to cause the pair of display units to display the operation screen of the power window, wherein the power window is a device for electrically opening and closing the vehicle window glass. The command displays the operation screen of the power window on the display device. The driver can operate the power window by touching the operation screen, allowing operation without significant eye movement.

[0039] Hereinafter, embodiments of the present disclosure will be described based on the accompanying drawings. The configurations of the following embodiments are illustrative, and the present disclosure is not limited to the configuration of the embodiments. Furthermore, the following embodiments can be combined as much as possible.

[0040] First Implementation Method

[0041] Figure 1 This diagram shows the interior of the passenger compartment of vehicle 1. As shown, a driver's seat 2 and a front passenger seat 3 are provided inside the passenger compartment of vehicle 1. It should be noted that vehicle 1 in this embodiment is a right-hand drive vehicle, and the driver's seat 2 is located on the right side of the vehicle. A steering wheel 4 is provided in front of the driver's seat 2. It should be noted that the steering wheel 4 can be either a round steering wheel or a U-shaped steering wheel (a so-called irregular steering wheel) as shown in the diagram. The steering wheel 4 is connected to the steering system of vehicle 1 via a steering column. The steering column is covered by a column cover.

[0042] The front passenger seat 3 is located to the left of the driver's seat 2, and a central display screen 24 is located at the front of the vehicle, between the driver's seat 2 and the front passenger seat 3. The central display screen 24 displays auxiliary information such as vehicle navigation, or entertainment-related content such as audio and television.

[0043] An instrument display 21 is provided on the side in front of the steering wheel 4. Located in front of the driver's seat 2, the instrument display 21 is a full-screen display that provides various information to the driver of the vehicle 1. The instrument display 21 displays, for example, information necessary for vehicle operation such as vehicle speed, engine speed (if the vehicle 1 has an engine), charging / discharging status (if the vehicle 1 has a drive battery), and distance traveled. The instrument display 21 is an example of the "instrument section" in this disclosure.

[0044] A pair of displays 27 are provided in front of the driver's seat 2 inside the vehicle compartment. The pair of displays 27 includes touch panel displays respectively disposed on both sides of the steering wheel 4. The pair of displays 27 is an example of a "pair of displays" in this disclosure. The pair of displays 27 is configured to include an inner display 22 and an outer display 23. In this embodiment, the display 22 disposed on the inner side of the vehicle is referred to as the inner display 22, and the display 23 disposed on the outer side of the vehicle is referred to as the outer display 23. The inner display 22 and the outer display 23 are connected to the dashboard of the vehicle 1.

[0045] Reference Figure 2 The detailed construction of the internal display 22 and the external display 23 will be described. Figure 2 This is an enlarged view of the area around the steering wheel 4. The inner display 22 and the outer display 23 are elongated displays connected to a support portion 5, which serves as a support for each display. The support portion 5 has a shape that protrudes to the left and right of the steering wheel. The outer display 23 is connected to the right end of the support portion 5 when facing forward of the vehicle, and the inner display 22 is connected to the left end of the support portion 5 when facing forward of the vehicle. As a result, the display surface can be positioned near the gripping area of ​​the steering wheel 4.

[0046] It should be noted that the above description is an example of the case where vehicle 1 is a right-hand drive vehicle. In the case where vehicle 1 is a left-hand drive vehicle, the left and right are reversed. That is, it becomes the following configuration: the left end of the support 5 when facing forward of the vehicle is connected to the external display 23, and the right end of the support 5 when facing forward of the vehicle is connected to the internal display 22.

[0047] The support portion 5 can also serve as a pillar cover for the steering column. The support portion 5 is shaped as follows: it extends from the portion through which the steering column passes in both the left and right directions (vehicle width direction) and both towards the rear of the vehicle, and bends midway in such a manner that the angle relative to the left and right directions of the steering wheel 4 decreases.

[0048] Furthermore, the inner display 22 and the outer display 23 are angled relative to the left and right direction of the steering wheel and are configured to tilt towards the steering wheel side, respectively. That is, the inner display 22 is configured to protrude further towards the rear of the vehicle 1 as it moves inwards, while the outer display 23 is configured to protrude further towards the rear of the vehicle 1 as it moves outwards. Thus, the inner display 22 and the outer display 23 are configured to face the driver, respectively.

[0049] Figure 2 The area 4R, indicated by the dashed line, is the part of the steering wheel that the right hand grips (grip). Figure 2The area 4L, indicated by the dashed line, is the part of the steering wheel 4 that the left hand grips (grip). The internal display 22 and the external display 23 are positioned in the longitudinal direction of the vehicle 1 at a position closer to the front of the vehicle than the grip of the steering wheel 4. By arranging the support 5 in the shape described above, the positions of the internal display 22 and the external display 23 in the longitudinal direction of the vehicle can be made closer to the grip of the steering wheel 4. Therefore, the amount of hand movement required when the driver touches the internal display 22 or the external display 23 while driving can be further reduced.

[0050] The instrument display 21, internal display 22, and external display 23 are all displays with touch panels. It should be noted that at least the internal display 22 and external display 23 need to have touch panels. For example, the touch panel can be a pressure-sensitive type that detects the pressure applied by the user when pressing the panel, or a capacitive type that detects changes in electrostatic capacitance when the user presses the panel. The display itself can be, for example, an LCD (Liquid Crystal Display) or an EL (Electroluminescence) panel.

[0051] The internal display 22 displays, for example, information related to the convenience of the occupants of vehicle 1. This information includes information for providing entertainment to the occupants of vehicle 1. It may also include information related to occupant comfort. For example, the information related to occupant comfort and convenience includes information related to switches and buttons for operating audio, navigation devices, air conditioning, telephones, clocks, voice assistants, etc., and information related to the operational status of these devices.

[0052] The external display 23 displays, for example, information related to the control of vehicle 1. This information includes information related to the driving of vehicle 1. It includes, for example, information related to switches and buttons used for operating power windows, headlights, wipers, side mirrors, ADAS, driving modes, suspension, steering wheel position, and seat position, as well as information related to the operational status of these devices. By displaying this information on the external display 23, it is possible to prevent passengers other than the driver from operating this information.

[0053] It should be noted that the information displayed on the internal display 22 and the external display 23 is not limited to the above-mentioned content. Alternatively, the internal display 22 may display information related to the control of the vehicle 1, and the external display 23 may display information related to the convenience of the occupants of the vehicle 1. Furthermore, the information displayed on the internal display 22 and the external display 23 can be arbitrarily determined.

[0054] Figure 3 This diagram schematically illustrates an example of the hardware configuration of vehicle 1. Vehicle 1 includes an ECU (Electronic Control Unit) 10, a display device 20, a central display 24, a sensor group 31, and an electrical equipment group 32. The ECU 10 can be configured as a computer with a processor (CPU (Central Processing Unit), GPU (Graphics Processing Unit), etc.), main storage (RAM (Random Access Memory), ROM (Read Only Memory), etc.) and auxiliary storage (EPROM (Erasable Programmable Read Only Memory), hard disk drive, removable media, etc.). The auxiliary storage stores an operating system (OS), various programs, various tables, etc. By executing the programs stored in the auxiliary storage, various functions (software modules) that meet the specified purposes can be achieved, as described later. However, some or all of the functions can also be implemented as hardware modules using hardware circuits such as ASICs (Application Specific Integrated Circuits) and FPGAs (Field Programmable Gate Arrays). The display device 20, central display 24, sensor group 31, and electrical equipment group 32 are connected to the ECU 10. The ECU 10 is an example of an information processing device.

[0055] The display device 20 includes an instrument display 21, an internal display 22, an external display 23, and a touch panel 25. The touch panel 25 is a unit for detecting touch operations performed on the instrument display 21, the internal display 22, and the external display 23. Touch panels 25 are respectively provided on the instrument display 21, the internal display 22, and the external display 23, and these touch panels 25 enable operations performed by touch.

[0056] Sensor group 31 is a collection of multiple sensors used to acquire sensor data during the operation of vehicle 1. These sensors can be sensors that acquire physical quantities or sensors that acquire image data, etc. Sensor group 31 may include, for example, sensors that detect the state of vehicle 1 and sensors that detect the driver's actions. Sensor group 31 includes, for example, a speed sensor, an acceleration sensor, an accelerator pedal position sensor, a brake pedal position sensor, a steering wheel angle sensor, an engine speed sensor, an engine speed sensor, a coolant temperature sensor, an oil temperature sensor, an oil pressure sensor, a hydraulic pressure sensor, an intake air pressure sensor, a yaw rate sensor, a turn indicator switch sensor (sensor that detects the on / off state of the turn indicator), a shift position sensor, a GPS (Global Positioning System) sensor, a sensor that detects position information, a sensor that detects the interior temperature, a sensor that detects the exterior temperature, and a radar that measures the distance to an object.

[0057] Electrical equipment group 32 is a collection of electrical devices used in vehicle 1. Electrical equipment group 32 includes power windows 33. It should be noted that electrical equipment group 32 may also include air conditioning, suspension, massage seats, navigation devices, audio devices, telephones, windshield wipers, headlights, side mirrors, and voice assistants.

[0058] Here, Figure 4This is a top view of vehicle 1. Vehicle 1 has a right front window 41 located on the right front door, a left front window 42 located on the left front door, a right rear window 43 located on the right rear door, and a left rear window 44 located on the left rear door. It should be noted that, without distinguishing between the right front window 41, left front window 42, right rear window 43, and left rear window 44, they are simply referred to as window 40. The power windows 33 are devices that automatically open and close the window 40 through user operation. The power windows 33 include a right front power window 331 for opening and closing the right front window 41, a left front power window 332 for opening and closing the left front window 42, a right rear power window 333 for opening and closing the right rear window 43, and a left rear power window 334 for opening and closing the left rear window 44. The front right door is the driver's side door, and the front left door is the passenger side door. It should be noted that this embodiment describes a vehicle 1 with four windows, but it is not limited to this. For example, in a vehicle with two windows, the right rear power window 333 and the left rear power window 334 can be omitted. Each door has an operating switch for opening and closing the window glass. This operating switch is a physical switch; when the user presses the operating switch downwards, the window glass 40 lowers; when the user pulls the operating switch upwards, the window glass 40 rises.

[0059] Figure 5 This diagram illustrates the functional configuration of ECU 10. ECU 10 includes a control unit 100 and a storage unit 110 as functional components. The control unit 100 is, for example, a functional component provided by a processor by executing various programs stored in an auxiliary storage unit. The control unit 100 includes an input unit 101 and an output unit 102. The storage unit 110 is a unit for storing information and is configured to include a main storage unit and an auxiliary storage unit.

[0060] The input unit 101 receives touch signals from the touch panel 25, determines the user's input operation via the touch panel 25, and performs information processing corresponding to the determined input operation. In this embodiment, the touch signal sent from the touch panel 25 to the control unit 100 includes at least information indicating the touch position (the position touched by the user's finger) on the screen of the external display 23. The output unit 102 generates a screen displayed on the internal display 22 and the external display 23. For example, the output unit 102 generates a main screen during normal driving.

[0061] Here, when a GUI (Graphical User Interface) component that invokes the operation screen of the power window 33 is touched on the main screen or menu screen displayed on the external display 23, the input unit 101 determines the touch location as the display location of the GUI component based on the touch signal received from the touch panel 25. It should be noted that information related to the display location of the GUI component corresponding to each item included in the menu screen is pre-stored in the storage unit 110.

[0062] Furthermore, in response to a user touching a GUI component used to navigate to the operation screen of the power window 33, the output unit 102 generates the operation screen of the power window 33. Then, the output unit 102 outputs a command to the display device 20 to display the operation screen of the power window. At this time, the output unit 102 can output a command to the display device 20 to display the operation screen of the power window 33 on the external display 23.

[0063] Figure 6 This diagram illustrates an example of a power window operation screen 50 displayed on the external display 23. The power window operation screen 50 includes a GUI component 51 for operating the right front power window 331, a GUI component 52 for operating the left front power window 332, a GUI component 53 for operating the right rear power window 333, a GUI component 54 for operating the left rear power window 334, a GUI component 55 (hereinafter also referred to as the window lock button 55) for locking the power windows 33, and a GUI component 56 (hereinafter also referred to as the end button 56) for returning to the main screen or menu screen.

[0064] The GUI component 51 for operating the right front power window 331 includes a GUI component 511 for raising the right front window glass 41 and a GUI component 512 for lowering the right front window glass 41. Similarly, the GUI component 52 for operating the left front power window 332 includes a GUI component 521 for raising the left front window glass 42 and a GUI component 522 for lowering the left front window glass 42. Likewise, the GUI component 53 for operating the right rear power window 333 includes a GUI component 531 for raising the right rear window glass 43 and a GUI component 532 for lowering the right rear window glass 43. Finally, the GUI component 54 for operating the left rear power window 334 includes a GUI component 541 for raising the left rear window glass 44 and a GUI component 542 for lowering the left rear window glass 44.

[0065] The GUI component 55 for disabling the operation of the power window 33 is a GUI component for locking the windows. It is a GUI component that disables operations performed via the operating switches of the power window 33 located on each door, as well as touch operations performed on the GUI components displayed on the power window operation screen 50. It should be noted that even when the operation of the power window 33 is disabled (when the windows are locked), the opening and closing of the driver's side window, i.e., the right front window 41, can still be performed.

[0066] exist Figure 6 When the power window operation screen 50, as illustrated in the example, is displayed on the external display 23, and any of the aforementioned GUI components 51-56 is touched, a touch signal containing information indicating the touch position on the external display 23 is sent from the touch panel 25 to the control unit 100. The input unit 101 determines, based on the touch signal, which of the GUI components 51-56 was touched. At this time, information related to the display positions of the GUI components 51-56 is pre-stored in the storage unit 110.

[0067] Furthermore, the output unit 102 sends commands to the power windows 33 based on the GUI components touched by the user in the power window operation screen 50. When the GUI component 511 for raising the right front window 41 is touched, the output unit 102 sends a command to the right front power window 331 to raise the right front window 41. When the GUI component 512 for lowering the right front window 41 is touched, the output unit 102 sends a command to the right front power window 331 to lower the right front window 41. When the GUI component 521 for raising the left front window 42 is touched, the output unit 102 sends a command to the left front power window 332 to raise the left front window 42. When the GUI component 522 for lowering the left front window 42 is touched, the output unit 102 sends a command to the left front power window 332 to lower the left front window 42. When the GUI component 531 for raising the right rear window 43 is touched, the output unit 102 sends a command to the right rear power window 333 to raise the right rear window 43. When the GUI component 532 for lowering the right rear window 43 is touched, the output unit 102 sends a command to the right rear power window 333 to lower the right rear window 43. When the GUI component 541 for raising the left rear window 44 is touched, the output unit 102 sends a command to the left rear power window 334 to raise the left rear window 44. When the GUI component 542 for lowering the left rear window 44 is touched, the output unit 102 sends a command to the left rear power window 334 to lower the left rear window 44. When the window lock button 55 is touched, the output unit 102 sends a command to the power window 33 to prohibit the raising and lowering of the left front window 42, the right rear window 43, and the left rear window 44.

[0068] also, Figure 7This diagram illustrates an example of the power window operation screen 50 displayed on the external display 23 when a user touches the window lock button 55. When the input unit 101 determines that the user has touched the window lock button 55, the output unit 102 grays out the GUI components 52-54 corresponding to the left front window 42, right rear window 43, and left rear window 44, which are prohibited from operation. That is, the output unit 102 changes the display scheme between operable and inoperable GUI components. In addition, the output unit 102 sends a command to lock the windows to the power window 33. Afterwards, even if the passenger touches the GUI components 52-54 or operates the operation switches provided on each door, the output unit 102 and the power window 33 will not accept any operation of the left front window 42, right rear window 43, and left rear window 44. Furthermore, the text displayed on the window lock button 55 by the output unit 102 changes from "Window Locked" to "Window Lock Released". When the user touches the window lock button 55 again, the output unit 102 sends a command to unlock the window to the power window 33. Furthermore, the output unit 102 restores the grayed-out GUI components 52 and 54 to their normal display. Also, the text displayed on the window lock button 55 by the output unit 102 changes from "Window Lock Released" to "Window Locked".

[0069] It should be noted that the raising and lowering of the car window 40 can also occur only while any one of the GUI components 51-54 is being touched by the user. Alternatively, if GUI components 51-54 have been touched for a predetermined time, the raising or lowering of the car window 40 can continue automatically even if the user does not subsequently touch the screen. In this case, a sound can be emitted or the external display 23 can be vibrated in response. Thus, by pressing and holding any one of the GUI components 51-54, the car window 40 can be automatically opened and closed.

[0070] Here, Figure 8 This diagram illustrates an example of the power window operation screen 50 displayed on the external display 23 when the GUI component 51 used for operating the right front power window 331 is not displayed. For example, when the driver's side window 2, i.e., the right front window 41, is closed, regulations sometimes require pulling the switch up. In regions where such regulations exist, the GUI component 51 used for operating the right front power window 331 may not be displayed. Thus, for example, the right front window 41 can be operated solely by the physical switch located on the driver's side door.

[0071] Figure 9This is a flowchart of the processing in the ECU10 when the electric window 33 is operated via the electric window operation screen 50 of the first embodiment. Figure 9 The process shown is repeatedly executed in ECU10 at predetermined intervals.

[0072] In step S101, the input unit 101 determines whether the user has touched a designated GUI component displayed on the touch panel 25. The designated GUI component is used to move from the main screen or menu screen to the power window operation screen 50. The input unit 101 determines whether there has been a touch operation on the designated GUI component based on the touch signal from the touch panel 25. If the input unit 101 makes an affirmative determination in step S101, the process proceeds to step S102; if the input unit 101 makes a negative determination in step S101, the procedure ends.

[0073] In step S102, the output unit 102 outputs a command to display the power window operation screen 50 to the external display 23. At this time, the output unit 102 determines the text to be displayed on the window lock button 55 based on the window lock status stored in the storage unit 110. Then, based on the window lock status, it displays... Figures 6 to 8 The power window operation screen 50 is generated in any of the shown screen formats. The output unit 102 sends a command to the external display 23 to display the generated power window operation screen 50.

[0074] In step S103, the input unit 101 determines whether a touch operation on the power window operation screen 50 has been detected. The input unit 101 determines whether a touch operation on the power window operation screen 50 has been detected based on the touch signal from the touch panel 25. If the input unit 101 makes a positive determination in step S103, the process proceeds to step S104; if the input unit 101 makes a negative determination in step S103, the input unit 101 executes step S103 again. It should be noted that, alternatively, if no touch operation is detected even after a certain period of time, the output unit 102 sends a command to the external display 23 to return to the main screen and terminates the current routine.

[0075] In step S104, the input unit 101 determines the GUI component touched by the user. The input unit 101 determines the location of the touch detected by the touch panel 25 and... Figures 6 to 8 The position of each GUI component shown determines the GUI component touched by the user. It should be noted that the position of each GUI component displayed on the power window operation screen 50 of the external display 23 at the current time is stored in the storage unit 110.

[0076] In step S105, the input unit 101 determines whether the GUI component identified in step S104 is the end button 56. If the input unit 101 makes an affirmative determination in step S105, the current procedure ends; if the input unit 101 makes a negative determination in step S105, the process proceeds to step S106.

[0077] In step S106, the input unit 101 determines whether the GUI component identified in step S104 is the window lock button 55. If the input unit 101 makes an affirmative determination in step S106, the process proceeds to step S107; if the input unit 101 makes a negative determination in step S106, the process proceeds to step S109.

[0078] In step S107, the output unit 102 outputs a command corresponding to the window lock state to the power window 33. When the window lock is currently released, the output unit 102 generates a command to lock the window and outputs it to the power window 33. This command disables the operation of the left front window 42, right rear window 43, and left rear window 44. Conversely, when the window lock is currently engaged, the output unit 102 generates a command to unlock the window and outputs it to the power window 33. This command allows the operation of the left front window 42, right rear window 43, and left rear window 44.

[0079] In step S108, the output unit 102 outputs a command to the external display 23 to display the power window operation screen 50. If a command to lock the window is generated in step S107, the output unit 102 generates the power window operation screen 50 by changing the text on the window lock button 55 from "Window Lock" to "Window Lock Release," and outputs the power window operation screen 50. Conversely, if a command to unlock the window is generated in step S107, the output unit 102 generates the power window operation screen 50 by changing the text on the window lock button 55 from "Window Lock Release" to "Window Lock," and outputs the power window operation screen 50. Afterwards, the process returns to step S103.

[0080] In step S109, the output unit 102 outputs a command to the power window 33 corresponding to the GUI component determined in step S104. That is, the output unit 102 sends a command to the power window 33 based on the GUI component touched by the user in the power window operation screen 50. In response to the command, the power window 33 activates the corresponding motor, causing the corresponding window glass 40 to rise or fall.

[0081] In step S110, the input unit 101 determines whether the user's touch operation has ended. At this time, the input unit 101 determines whether the user has removed their finger from the touch panel 25 based on the touch signal from the touch panel 25. If the input unit 101 makes a positive determination in step S110, the process proceeds to step S111; if the input unit 101 makes a negative determination in step S110, the process proceeds to step S112.

[0082] In step S111, the output unit 102 outputs a stop command (stop command) to the power window 33, which had been activated in step S109. In this way, the power window 33 only operates while the user touches the power window operation screen 50. Afterwards, the process returns to step S103.

[0083] In step S112, the input unit 101 determines whether the duration of the user's touch operation is less than a predetermined time. The predetermined time is a threshold time for automatically opening and closing the window 40. If the user touches any of the GUI components 51-54 used to open and close the window 40 for more than the predetermined time, it is assumed that the user desires the window 40 to be fully open or fully closed. In such cases, in this disclosure, the power window 33 automatically operates until the window 40 is fully open or fully closed. If the input unit 101 makes an affirmative determination in step S112, the process proceeds to step S109, and the output unit 102 continues to output commands corresponding to the determined GUI components to the power window 33. On the other hand, if the input unit 101 makes a negative determination in step S112, the process proceeds to step S113.

[0084] In step S113, the output unit 102 outputs an automatic command to the power window 33 to automatically open and close the window glass 40. The automatic command is a command that causes the power window 33 to continue operating until the window glass 40, which is currently in an up or down state, is fully open or fully closed. After the automatic command is output from the output unit 102, the power window 33 continues to operate even if the user removes their finger from the touch panel 25.

[0085] In step S114, the output unit 102 outputs information related to the response to the automatic command. The response is a method of automatically opening and closing the window 40 in response to a user notification. The response may, for example, be emitting a predetermined sound. In this case, the output unit 102 outputs a signal to emit the predetermined sound to a speaker. Alternatively, the response may be, for example, vibrating the external display 23. In this case, the output unit 102 may also output a command to the external display 23 to activate the vibrator configured on the external display. Furthermore, as another example of the response, the output unit 102 may also cause a predetermined light to flash or cause the external display 23 or the internal display 22 to flash. Afterwards, the process returns to step S103.

[0086] As explained above, according to this embodiment, by displaying the power window operation screen 50 on the external display 23, the driver can operate the power window 33 without having to significantly look away from the front. Furthermore, by displaying the power window operation screen 50 on the external display 23, compared to displaying it on the internal display 22, it is possible to prevent passengers other than the driver from operating the power window operation screen 50.

[0087] Second Implementation Method

[0088] Figure 10 This is a diagram illustrating an example of the power window operation screen 50 displayed on the external display 23 according to the second embodiment. Figure 10 In the example shown, the power window operation screen 50 displays graphics corresponding to the open / closed states of each window glass 40, indicated by reference numerals 61-64. It should be noted that the graphics shown by reference numerals 61-64 are schematic representations of the shape of the car door, with the upper half corresponding to the window. Furthermore, the window glass 40 is represented by shaded lines. It should be noted that in... Figure 10 In the example shown, the window glass 40 is shown with a shading line, but as another example, a different color (such as light blue) could also be used for the other parts.

[0089] Reference numeral 61 indicates the open / closed state of the right front window 41. Figure 10 In the example shown, the area corresponding to the car window is entirely represented in white, indicating that the right front window 41 is fully open. Reference numeral 62 shows the open / closed state of the left front window 42. Figure 10 In the example shown, a portion corresponding to the window is indicated by a shaded line. This shaded portion is where the left front window glass 42 is located. Figure 10 The example shown illustrates the left front window 42 with it open approximately 20%. Reference numeral 63 indicates the open / closed state of the right rear window 43. Figure 10In the example shown, a portion corresponding to the window is indicated by a shaded line. This shaded portion is where the right rear window glass 43 is located. Figure 10 In the example shown, the right rear window 43 is shown to be about 50% open. Reference numeral 64 indicates the open / closed state of the left rear window 44. Figure 10 In the example shown, the area corresponding to the car window is entirely represented by a shaded line. This shaded area is where the left rear window glass 44 is located. Figure 10 In the example shown, the left rear window 44 is shown to be completely closed.

[0090] It should be noted that, in Figure 10 In the example shown, the opening of the car window 40 is illustrated using a diagram of the car door, but it is not limited to this. For example, the opening of the car window 40 can also be shown using numerical values ​​or text.

[0091] In addition, Figure 10 In the example shown, inoperable GUI components are grayed out. For example, since the right front window 41 is fully open, it cannot be lowered further. Therefore, the GUI component 512 used to lower the right front window 41 is grayed out. Similarly, since the left rear window 44 is fully closed, it cannot be raised further. Therefore, the GUI component 541 used to raise the left rear window 44 is grayed out. Thus, the output unit 102 switches between operable and inoperable GUI components in the display scheme.

[0092] It should be noted that, in Figure 10 In the example shown, inoperable GUI components are grayed out, but this is not the only possibility. For example, inoperable GUI components could also be set to not be displayed.

[0093] Figure 11 This is a flowchart of the processing in the ECU10 when operating the electric window 33 via the electric window operation screen 50 of the second embodiment. Figure 11 The process shown is repeatedly executed in ECU10 at predetermined intervals. Figure 11 In the example shown, regarding execution and Figure 9 The steps shown are the same as those in the accompanying drawings, and the descriptions are omitted.

[0094] exist Figure 11In the example shown, if the input unit 101 makes a positive determination in step S101, the process proceeds to step S201. In step S201, the output unit 102 outputs the power window operation screen 50 to the external display 23. At this time, the output unit 102 determines the text displayed on the window lock button 55 based on the window lock status stored in the storage unit 110. This is the same as the process in step S102.

[0095] Furthermore, the input unit 101 generates a value related to the opening degree of the window glass 40. Figure 10 The figures corresponding to reference numerals 61 to 64 are shown. Information related to the opening degree of the window glass 40 can be stored in the storage unit 110, obtained from information detected by the opening degree sensor configured on the power window 33, calculated by the input unit 101 based on the rotation angle of the motor of the power window 33, or calculated by the input unit 101 based on the operating time of the power window 33. The rotation angle of the motor of the power window 33 can be obtained from the power window 33 by the input unit 101. Furthermore, the operating time of the power window 33 can be the time from when the output unit 102 outputs a command in step S109 to when the output unit 102 outputs a stop command in step S111. As another example, when the power window 33 is operating, information related to the opening degree of the window glass 40 can be sent from the power window 33 to the control unit 100, and the input unit 101 stores the information related to the opening degree of the window glass 40 in the storage unit 110.

[0096] Then, based on the window lock status and the opening degree of the window glass 40, the output unit 102 displays, as shown below. Figure 10 The power window operation screen 50 is generated in the manner shown. At this time, the output unit 102 identifies the inoperable GUI components and grays them out. The output unit 102 sends a command to the external display 23 to display the generated power window operation screen 50.

[0097] In addition, Figure 11In the illustrated routine, step S202 is executed after step S109. In step S202, the output unit 102 outputs the power window operation screen 50 to the external display 23. At this time, the output unit 102 acquires information related to the opening degree of the window glass 40 in real time and reflects this information to the power window operation screen 50. Thus, during the opening and closing of the window glass 40, the output unit 102 animates the opening degree of the window glass 40 as indicated by reference numerals 61 to 64 on the power window operation screen 50. It should be noted that, as another example, the output unit 102 may also output the power window operation screen 50 to the external display 23 if a positive determination is made in step S110. In this case, triggered by the user's touch operation ending, the opening degree of the window glass 40 after the operation of the power window 33 is reflected on the power window operation screen 50.

[0098] In addition, Figure 11 In the illustrated routine, step S203 is executed after step S114. In step S203, the output unit 102 outputs the power window operation screen 50 to the external display 23. At this time, the output unit 102 acquires information related to the opening degree of the window glass 40 in real time and reflects this information to the power window operation screen 50. For example, during the opening and closing of the window glass 40, the output unit 102 can animate the opening degree of the window glass 40 indicated by reference numerals 61 to 64 on the power window operation screen 50. Furthermore, for example, the rising or falling speed of the window glass 40 can be measured in advance, and an animation corresponding to that speed can be displayed. It should be noted that, as another example, after the automatic operation ends, the output unit 102 can generate the power window operation screen 50 reflecting the opening degree of the window glass 40 after the operation ends and output it to the external display 23.

[0099] As explained above, according to this embodiment, by displaying the power window operation screen 50 on the external display 23, the power window 33 can be operated without having to significantly look away from the front. Furthermore, since the opening degree of each window glass 40 is displayed on the external display 23, the driver does not need to visually confirm the opening degree of each window glass 40.

[0100] Third Implementation Method

[0101] Figure 12 This is a diagram illustrating an example of the power window operation screen 50 displayed on the external display 23 according to the third embodiment. Figure 12In the example shown, the power window operation screen 50 includes a GUI component 71 for simultaneously raising all windows 40 and a GUI component 72 for simultaneously lowering all windows 40. When the input unit 101 detects a touch on the GUI component 71, the output unit 102 sends a command to the power window 33 to raise all windows 40. Conversely, when the input unit 101 detects a touch on the GUI component 72, the output unit 102 sends a command to the power window 33 to lower all windows 40.

[0102] As explained above, according to this embodiment, by displaying the power window operation screen 50 on the external display 23, the window glass 40 can be operated uniformly without having to take one's eyes significantly away from the front.

[0103] Other implementation methods

[0104] The above-described embodiments are merely examples, and this disclosure can be appropriately modified and implemented without departing from its spirit. As long as no technical contradictions arise, the processes and parts described in this disclosure can be freely combined and implemented. Furthermore, processes described as being performed by one device can also be performed by multiple devices. Alternatively, processes described as being performed by different devices can also be performed by one device. In a computer system, the hardware configuration used to implement each function can be flexibly changed.

[0105] This disclosure can also be implemented by supplying a computer program that implements the functions described in the above embodiments to a computer, which then reads and executes the program using one or more processors. Such a computer program can be provided to the computer via a non-transitory computer-readable storage medium that can be connected to the computer's system bus, or via a network. Non-transitory computer-readable storage media include, for example, any type of disk such as a hard disk (floppy disk, hard disk drive, etc.), an optical disk (CD-ROM, DVD, Blu-ray disc, etc.), a read-only memory (ROM), a random access memory (RAM), an EPROM, an EEPROM (Electrically Erasable Programmable Read Only Memory), a magnetic card, flash memory, an optical card, or any type of medium suitable for storing electronic instructions.

Claims

1. A vehicle-mounted system, characterized in that, include: Display device; Electric windows are configured to open and close the vehicle's windows electrically. as well as An information processing device is configured to output information via the display device. The display device is located in front of the driver's seat inside the vehicle. The display device includes a pair of display sections, wherein the pair of display sections protrude towards the rear of the vehicle from the instrument section disposed on the front of the steering wheel and are positioned on both sides of the steering wheel, and have a touch panel. The information processing device includes a control unit and a storage unit. The control unit is configured to perform the following actions: Based on the signal received from the touch panel and the information stored in the storage unit, a command is output to the display device to cause the pair of display units to display the operation screen of the power window; Based on the signal from the touch panel, determine the touch operation to the operation screen of the power window; and Based on the determined touch operation, a command to open or close the window glass is output to the power window.

2. A vehicle-mounted system, characterized in that, include: Display device; as well as An information processing device is configured to output information via the display device. The display device is located in front of the driver's seat inside the vehicle. The display device includes a pair of display sections, wherein the pair of display sections protrude towards the rear of the vehicle from the instrument section disposed on the front of the steering wheel and are positioned on both sides of the steering wheel, and have a touch panel. The information processing device includes a control unit configured to perform the following actions: The command to display the operation screen of the electric window on the pair of displays is output to the display device, wherein the electric window is a device for electrically opening and closing the window glass of the vehicle.

3. The vehicle-mounted system according to claim 2, characterized in that, The pair of display units are positioned in the longitudinal direction of the vehicle at a position closer to the front of the vehicle than the grip portion of the steering wheel.

4. The vehicle-mounted system according to claim 2, characterized in that, The control unit is configured to: Receive touch signals from the display device related to touch operations on the touch panel; and Based on the touch signal, a command to open or close the window glass is output to the electric window.

5. The vehicle-mounted system according to claim 2, characterized in that, The control unit is configured to: Obtain information related to the opening degree of the vehicle window glass; as well as The command is output to the display device to display information related to the opening degree of the window glass on the operation screen of the electric window.

6. The vehicle-mounted system according to claim 2, characterized in that, The control unit is configured to output the command to the display device to change the display scheme between an interface that allows operation of the window glass and an interface that does not allow operation of the window glass in the operation screen of the electric window.

7. The vehicle-mounted system according to claim 2, characterized in that, The pair of displays are configured to include: an inner display disposed on the inner side of the vehicle; and an outer display disposed on the outer side of the vehicle. The control unit is configured to output the command to the display device so that the external display shows the operation screen of the power window.

8. The vehicle-mounted system according to claim 2, characterized in that, The control unit is configured to: Receive touch signals related to touch operations on the touch panel from the display device; If, based on the touch signal, it is determined that the interface corresponding to the operation of opening the window has been touched for a specified time or more, a command to automatically and fully open the window will be output to the electric window. as well as If, based on the touch signal, it is determined that the interface corresponding to the operation of closing the window has been touched for a specified time or more, a command to automatically and completely close the window will be output to the power window.

9. An information processing apparatus that outputs information via a display device, characterized in that, The information processing device includes a control unit. The display device is located in front of the driver's seat inside the vehicle. The display device includes a pair of display sections, wherein the pair of display sections protrude towards the rear of the vehicle from the instrument section disposed on the front of the steering wheel and are positioned on both sides of the steering wheel, and have a touch panel. The control unit is configured to perform the following actions: The command to display the operation screen of the electric window on the pair of displays is output to the display device, wherein the electric window is a device for electrically opening and closing the window glass of the vehicle.

10. The information processing apparatus according to claim 9, characterized in that, The pair of display units are positioned in the longitudinal direction of the vehicle at a position closer to the front of the vehicle than the grip portion of the steering wheel.

11. The information processing apparatus according to claim 9, characterized in that, The control unit is configured to: Receive touch signals from the display device related to touch operations on the touch panel; and Based on the touch signal, a command to open or close the window glass is output to the electric window.

12. The information processing apparatus according to claim 9, characterized in that, The control unit is configured to: Obtain information related to the opening degree of the vehicle window glass; as well as The command is output to the display device to display information related to the opening degree of the window glass on the operation screen of the electric window.

13. The information processing apparatus according to claim 9, characterized in that, The control unit is configured to output the command to the display device to change the display scheme between an interface that allows operation of the window glass and an interface that does not allow operation of the window glass in the operation screen of the electric window.

14. The information processing apparatus according to claim 9, characterized in that, The pair of displays are configured to include: an inner display disposed on the inner side of the vehicle; and an outer display disposed on the outer side of the vehicle. The control unit is configured to output the command to the display device so that the external display shows the operation screen of the power window.

15. The information processing apparatus according to claim 9, characterized in that, The control unit is configured to: Receive touch signals related to touch operations on the touch panel from the display device; If, based on the touch signal, it is determined that the interface corresponding to the operation of opening the window has been touched for a specified time or more, a command to automatically and fully open the window will be output to the electric window. as well as If, based on the touch signal, it is determined that the interface corresponding to the operation of closing the window has been touched for a specified time or more, a command to automatically and completely close the window will be output to the power window.

Images