Control device

The control device manages display content switching based on input operations, preventing unwanted transitions and enhancing user experience by maintaining input continuity.

JP2025098666APending Publication Date: 2025-07-02TOYOTA JIDOSHA KK +1
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
JP2023214966
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2023-12-20
Publication Date
2025-07-02

AI Technical Summary

Technical Problem

Conventional display switching devices switch images on a display device during input operations, potentially interrupting the user's input and causing annoyance.

Method used

A control device that controls the display content of a display device with an input device, allowing it to switch to specific content only when predetermined conditions are met and inhibits switching during input operations.

Benefits of technology

Prevents the display content from switching to unrelated content during input operations, thereby reducing user annoyance and ensuring uninterrupted input experiences.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2025098666000001_ABST
    Figure 2025098666000001_ABST
Patent Text Reader

Abstract

To provide a control device that prevents a display content of a display device from being switched to another display content unrelated to an input operation during an input operation of the display device.SOLUTION: A control device 5 that controls a display content of a display device 4 having an input apparatus 42 switches, when a predetermined switching condition is satisfied, the display content of the display device 4 to a specific display content, and does not switch, when it is determined that an input operation is performed via the input apparatus, the display content of the display device 4 to the specific display content even if the switching condition is satisfied.SELECTED DRAWING: Figure 1
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to a control device.

Background Art

[0002] Patent Document 1 discloses a conventional display switching device that switches the image displayed on a display device in a vehicle interior to a camera image captured by an in-vehicle peripheral monitoring camera when an image switching condition is satisfied.

Prior Art Document

Patent Document

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] However, in the above-described conventional display switching device, when an image switching condition is satisfied, even if some input operation is being performed on the display device, the image on the display device may be switched to the camera image.

[0005] The present invention has been made paying attention to such problems, and an object thereof is to suppress the display content of the display device from being switched to another display content unrelated to the input operation during the input operation of the display device.

Means for Solving the Problems

[0006] In order to solve the above problems, a control device according to an aspect of the present invention that controls the display content of a display device having an input device switches the display content of the display device to specific display content when a predetermined switching condition is satisfied, and when it is determined that an input operation is being performed via the input device, even if the switching condition is satisfied, the display content of the display device is configured not to be switched to the specific display content.

Effects of the Invention

[0007] According to this aspect of the present invention, during an input operation of a display device, it is possible to suppress the display content of the display device from switching to another display content that has no relation to the input operation.

Brief Description of the Drawings

[0008]

Figure 1

Figure 2

Embodiments for Carrying Out the Invention

[0009] Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. In the following description, the same reference numerals are assigned to similar components.

[0010] FIG. 1 is a schematic configuration diagram of a driving support device 100 according to an embodiment of the present invention.

[0011] The driving support device 100 includes an imaging device 1, a distance measuring sensor 2, a vehicle sensor 3, an HMI (Human Machine Interface) 4, and a control device 5. The imaging device 1, the distance measuring sensor 2, the vehicle sensor 3, the HMI 4, and the control device 5 are communicably connected via an in-vehicle network 7 compliant with a standard such as a controller area network.

[0012] The imaging device 1 includes one or a plurality of external cameras for photographing the surroundings of a vehicle (hereinafter referred to as "own vehicle") in which driving support by the driving support device 100 is performed. The imaging device 1 photographs the surroundings of the own vehicle at a predetermined frame rate (for example, 10 [Hz] to 40 [Hz]), and generates a surrounding image (for example, an image such as a panoramic view, a front view, both side views, a back view, etc.) in which the surroundings of the own vehicle are shown. Each time the imaging device 1 generates a surrounding image, the generated surrounding image is transmitted to the control device 5 as imaging data.

[0013] The distance measurement sensor 2 measures the distance to targets such as other vehicles and pedestrians existing around the host vehicle, and transmits the measured distance measurement data to the control device 5. Examples of the distance measurement sensor 2 include, for example, a LiDAR (Light Detection And Ranging) that irradiates laser light and measures the distance based on the reflected light, and a millimeter-wave radar sensor that irradiates radio waves and measures the distance based on the reflected waves.

[0014] The vehicle sensor 3 is a sensor for generating vehicle data representing the situation of the host vehicle. In the present embodiment, as the vehicle sensor 3, for example, a speed sensor 31 that generates speed data indicating the traveling speed (vehicle speed) of the host vehicle, and a shift position sensor 32 that generates shift position data indicating the shift position of the host vehicle (for example, P range, N range, D range, R range, etc.) are provided. However, the vehicle sensor 3 is not limited to these sensors 31, 32. The vehicle sensor 3 transmits each data such as the acquired speed data as vehicle data to the control device 5.

[0015] The HMI 4 is a user interface for performing information exchange between the host vehicle and its occupants. The HMI 4 is an example of a display device. The HMI 4 includes an output device 41 for notifying and providing information to the vehicle occupants through the physical sensations of the vehicle occupants (for example, vision, hearing, and touch), and an input device 42 for the vehicle occupants to perform input operations. In the present embodiment, as the output device 41, for example, a display 411 such as a meter display, a center display, and a head-up display, and a speaker 412 are provided. Further, as the input device 42, a touch panel 421, an operation button 422, and a microphone 423 are provided.

[0016] HMI4 displays information (such as character information and image information) corresponding to the display signal received from the control device 5 on the display 411, and outputs sound corresponding to the audio signal from the speaker 412. Further, HMI4 transmits operation data corresponding to an input operation via the input device 42 by the vehicle occupant to the control device 5.

[0017] HMI4 may be pre-mounted on the host vehicle, or may be a terminal such as a smartphone owned by the vehicle occupant. In the latter case, for example, information exchange may be performed by communicating wirelessly over a short distance between the host vehicle and the vehicle occupant's terminal, or communication may be performed between the vehicle occupant's terminal and an external server (not shown), and information exchange may be performed indirectly via the server.

[0018] The control device 5 is an ECU (Electronic Control Unit) including a communication unit 51, a storage unit 52, and a processing unit 53.

[0019] The communication unit 51 includes an interface circuit for connecting the control device 5 to the in-vehicle network 7. The communication unit 51 supplies various data received from the imaging device 1, the respective sensors 2, 3, HMI4, etc. to the processing unit 53. Further, the communication unit 51 outputs various display signals output from the processing unit 53 to HMI4.

[0020] The storage unit 52 has a storage medium such as an HDD (Hard Disk Drive), an SSD (Solid Disk Drive), or a semiconductor memory, and stores various computer programs, data, etc. used in the processing by the processing unit 53.

[0021] The processing unit 53 has one or more CPUs (Central Processing Units) and their peripheral circuits, and executes various computer programs stored in the storage unit 52. The processing unit 53 is, for example, a processor. The processor may further have other arithmetic circuits such as a logical arithmetic unit, a numerical arithmetic unit, or a graphic processing unit. By executing processing according to a computer program, the processing unit 53 functions as the display control unit 61 and operates as a functional unit (module) that realizes a predetermined function. In the following description, when explaining the processing with the display control unit 61 as the subject, it indicates that the processing unit 53 is executing a program that realizes the display control unit 61.

[0022] Hereinafter, the specific processing content implemented in the control device 5 will be described. That is, the content of the display control unit 61 realized by the processing unit 53 executing processing according to a program will be described.

[0023] The display control unit 61 controls the display content of the display 411 to the display content according to the input operation of the vehicle occupant.

[0024] In addition, when a predetermined image switching condition is satisfied, the display control unit 61 automatically switches the display content of the display 411 to the surrounding image of the host vehicle in order to assist the driver's driving. Examples of the image switching condition include that the vehicle speed has become a low vehicle speed less than a predetermined vehicle speed, the shift position has switched to the forward range (in this embodiment, the N range and the D range), the shift position has switched to the reverse range (in this embodiment, the R range), or an object within a predetermined distance from the host vehicle has been detected, and the like.

[0025] Here, when the vehicle occupant is performing an input operation based on the display content of the display 411, if the screen switching condition is satisfied and the display content of the display 411 is switched to the surrounding image, the input operation is interrupted, and a new input operation is required to return from the surrounding image to the original display content. Therefore, there is a possibility that the vehicle occupant may feel annoyed with this driving support that automatically switches the display content of the display 411 to the surrounding image of the host vehicle.

[0026] Therefore, in the present embodiment, when an input operation is being performed via the input device 42, the automatic switching control for automatically switching the display content of the display 411 to the surrounding image of the host vehicle is suppressed.

[0027] FIG. 2 is a flowchart for explaining the details of the automatic switching control according to the present embodiment. The control device 5 repeatedly executes this routine at a predetermined calculation cycle.

[0028] In step S1, the control device 5 determines whether the automatic switching function is in the ON state. The automatic switching function is a function that automatically switches the display content of the display 411 to the surrounding image of the host vehicle when the image switching condition is satisfied. The automatic switching function can be switched between the ON state and the OFF state, for example, when the vehicle occupant performs an input operation via the input device 42. If the automatic switching function is in the ON state, the control device 5 proceeds to the process of step S2. On the other hand, if the automatic switching function is in the OFF state, the control device 5 ends the current process.

[0029] In step S2, the control device 5 determines whether a surrounding image is already displayed on the display 411. If a surrounding image is already displayed on the display 411, the control device 5 ends the current process. If a surrounding image is not already displayed on the display 411, the control device 5 proceeds to the process of step S3.

[0030] In step S3, the control device 5 determines whether or not a predetermined second image switching condition among the image switching conditions is satisfied. In the present embodiment, the control device 5 determines that the second image switching condition is satisfied if the shift position has switched to the reverse range (in this embodiment, the R range), or if an object having a distance less than a predetermined distance from the host vehicle is detected. If the second switching condition is satisfied, the control device 5 proceeds to the process of step S6. On the other hand, if the second switching condition is not satisfied, the control device 5 proceeds to the process of step S4.

[0031] In step S4, the control device 5 determines whether or not a predetermined first image switching condition among the image switching conditions is satisfied. In the present embodiment, the control device 5 determines that the first image switching condition is satisfied if the vehicle speed is lower than a predetermined vehicle speed, or if the shift position has switched from another range to the forward range. If the first image switching condition is satisfied, the control device 5 proceeds to the process of step S5. On the other hand, if the first image switching condition is not satisfied, the control device 5 proceeds to the process of step S7.

[0032] In step S5, the control device 5 determines whether or not the input operation flag F is set to 0. The input operation flag F is a flag that is set to 1 only for a certain time T when it is determined that an input operation has been performed via the input device 42, and the initial value is set to 0. That is, the input operation flag F switches from 0 to 1 when it is determined that an input operation has been performed via the input device 42, and returns to 0 after the elapse of a certain time T. If the input operation flag F is set to 0, the control device 5 proceeds to the process of step S6. On the other hand, if the input operation flag F is set to 1, the control device 5 proceeds to the process of step S7. F1 That is, the input operation flag F is a flag that switches from 0 to 1 when it is determined that an input operation has been performed via the input device 42, and returns to 0 after the elapse of a certain time T. F1 If the input operation flag F is set to 0, the control device 5 proceeds to the process of step S6. On the other hand, if the input operation flag F is set to 1, the control device 5 proceeds to the process of step S7.

[0033] Note that input operations include those that end with a single short-time input operation, such as pressing a button on the touch panel 421 or an operation button 422 only once (hereinafter, for convenience, referred to as "first input operation"), and those that end with a single input operation but the operation is continuous and requires a certain amount of time, such as performing a drag operation, a pinch-in operation, or a pinch-out operation on the touch panel 421 (hereinafter, for convenience, referred to as "second input operation"), and those that require a plurality of consecutive input operations, such as performing various setting changes using a button on the touch panel 421 or an operation button 422 (hereinafter, for convenience, referred to as "third input operation").

[0034] When the vehicle occupant is performing the second input operation and the third input operation in particular, if the display content of the display 411 automatically switches to the surrounding image, the operation is interrupted and it is considered that the occupant is likely to feel annoyed. Therefore, in the present embodiment, when a single input operation is continuously performed for a predetermined time or more, and when the input operation is performed a predetermined number of times or more within a predetermined time, it is determined that the input operation has been performed, and the input operation flag F is set to 1 for a fixed time T F1 only. This can prevent the switching to the surrounding image from being suppressed more than necessary, so that more appropriate driving support becomes possible. Of course, simply, each time an input operation is performed, it may be determined that the input operation has been performed.

[0035] In step S6, the control device 5 switches the display content of the display 411 to the surrounding image. In the present embodiment, the surrounding image is a composite image such as a panoramic view generated based on the image captured by the imaging device 1, but it may also be an image directly captured by the imaging device 1.

[0036] In step S7, the control device 5 continuously displays the current display content without switching the display content of the display 411 to the surrounding image.

[0037] Thus, in this embodiment, when the first image switching condition is satisfied, if it is determined that an input operation has been performed, the display content of the display 411 is not switched to the surrounding image. As a result, the input operation cannot be interrupted, so it is possible to suppress making the input operator feel bothered.

[0038] On the other hand, when the second image switching condition is satisfied, even if it is determined that an input operation has been performed, the display content of the display 411 is switched to the surrounding image. This is because when the second image switching condition is satisfied, it is considered that it is safer to display the surrounding image even if the input operation is interrupted.

[0039] The control device 5 that controls the display content of the HMI4 (display device) having the input device 42 according to the present embodiment described above switches the display content of the HMI4 to specific display content when a predetermined first switching condition (switching condition) is satisfied, and when it is determined that an input operation has been performed via the input device 42, even if the first switching condition is satisfied, the display content of the HMI4 is configured not to be switched to the specific display content.

[0040] Thereby, it is possible to suppress the display content of the HMI4 from switching to another display content that has no relation to the input operation during the input operation of the HMI4. Therefore, it is possible to suppress the input operation from being interrupted, so it is possible to suppress making the input operator feel bothered.

[0041] In addition, the control device 5 according to the present embodiment is configured to determine that an input operation has been performed when the input operation is performed a predetermined number of times or more within a predetermined time, or when the input operation is continuously performed for a predetermined time or more.

[0042] Thereby, it is possible to accurately detect that the input operation is in progress and suppress the display content from switching during the continuation of the input operation.

[0043] In this embodiment, the HMI 4 is mounted on a vehicle, and specific display content is, for example, an image captured by an imaging device 1 that captures the exterior of the vehicle, or a composite image generated based on the image. The control device 5 according to this embodiment switches the display content of the display device to specific display content even when a predetermined second switching condition different from the first switching condition is satisfied. When the second switching condition is satisfied, even if it is determined that an input operation has been performed, the display content of the HMI 4 is configured to be switched to specific display content. The first switching condition includes at least one of the vehicle speed of the vehicle on which the HMI 4 is mounted being less than a predetermined vehicle speed and the shift position of the vehicle being in the forward range. The second switching condition includes at least one of the shift position of the vehicle being in the reverse range and a target having a relative distance less than a predetermined distance from the vehicle being detected.

[0044] Thereby, while suppressing the interruption of the input operation, when it is considered safer to display the surrounding image even if the input operation is interrupted, the periodic image can be displayed.

[0045] As described above, the embodiments of the present invention have been described. However, the above embodiments merely show a part of the application examples of the present invention, and are not intended to limit the technical scope of the present invention to the specific configurations of the above embodiments.

[0046] For example, in the above embodiment, the computer program (for example, automatic switching control) executed in the control device 5 may be provided in a form recorded on a computer-readable portable recording medium such as a semiconductor memory, a magnetic recording medium, or an optical recording medium.

Explanation of Reference Numerals

[0047] 1 Imaging device 4 HMI (display device) 5 Control device 42 Input device

Claims

1. A control device for controlling the display content of a display device having an input device, when a predetermined switching condition is satisfied, switches the display content of the display device to specific display content, and is configured not to switch the display content of the display device to the specific display content even if the switching condition is satisfied when it is determined that an input operation has been performed via the input device. Control device.

2. The display device is mounted on a vehicle, and the specific display content is an image captured by an imaging device that captures the outside of the vehicle or a composite image generated based on the image. The control device according to claim 1.

3. When the input operation is performed a predetermined number of times or more within a predetermined time, or when the input operation is continuously performed for a predetermined time or more, it is configured to determine that the input operation has been performed. The control device according to claim 1 or claim 2.

4. Even when a predetermined second switching condition different from the switching condition is satisfied, the display content of the display device is switched to specific display content, and when the second switching condition is satisfied, the display content of the display device is configured to be switched to the specific display content even if it is determined that the input operation has been performed. The control device according to claim 1 or claim 2.

5. The switching condition includes at least one of the vehicle speed of the vehicle on which the display device is mounted being less than a predetermined vehicle speed and the shift position of the vehicle being in the forward range. The second switching condition includes at least one of the shift position of the vehicle being in the reverse range and a target having a relative distance from the vehicle less than a predetermined distance being detected. The control device according to claim 4.

Citation Information

Patent Citations

  • Indication switching device

    JP2009279957A