Display Control Device

The display control device addresses operability issues by managing display restrictions across vehicle screens, enabling operation on a larger screen when user requests are detected, thus enhancing usability.

JP7615848B2Active Publication Date: 2025-01-17DENSO CORP
View PDF 6 Cites 0 Cited by

Patent Information

Application Number
JP2021064274
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2021-04-05
Publication Date
2025-01-17
Estimated Expiration
2041-04-05

AI Technical Summary

Technical Problem

Existing vehicle display control systems restrict the display of in-vehicle screens during operation, reducing operability when users are dissatisfied with the small screen of a mobile terminal, leading to decreased usability.

Method used

A display control device that includes a processor to manage display restrictions on multiple screens within a vehicle, allowing operation requests to cancel display restrictions on a larger screen when detected, enabling operation on a wider display area.

Benefits of technology

Enhances operability by allowing users to operate on a larger screen when dissatisfied with a restricted smaller screen, reducing stress and improving user interaction.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007615848000001
    Figure 0007615848000001
  • Figure 0007615848000002
    Figure 0007615848000002
  • Figure 0007615848000003
    Figure 0007615848000003
Patent Text Reader

Abstract

To provide a display control device capable of improving operability for a display screen with a display restriction function.SOLUTION: In a vehicle 2, a display control device 1 including a processor 11 controls display of a first image on a first screen 50 and displays of a second image on a second screen 60 narrower than the first screen 50. The processor 11 sets the first screen 50 to a display restriction state for restricting display of at least a part of the first image. The processor 11 determines whether an operation request movement where an occupant of the vehicle 2 requests an operation on display on the first screen 50 was detected. When it determines that the operation request movement was detected in the display restriction state of the first screen 50, the processor releases the display restriction state and displays the image corresponding to the second image being displayed on the second screen 60 on the first screen.SELECTED DRAWING: Figure 1
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present disclosure relates to a display control device. [Background technology]

[0002] Patent Document 1 discloses a vehicle display control system that restricts display so that a part or the entire screen of an in-vehicle display device is not visible while the vehicle is traveling. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2013-221769 A Summary of the Invention [Problem to be solved by the invention]

[0004] The vehicle display control system of Patent Document 1 makes it possible to operate an application displayed on a small screen of a mobile terminal on the large screen of the vehicle display device by linking the screen of the vehicle display device and the screen of the mobile terminal. However, when the screen display of the vehicle display device is restricted, even if the user is dissatisfied with the operation on the small screen of the mobile terminal, the user cannot operate the screen of the vehicle display device, which is a cause of reduced operability.

[0005] An object of the present disclosure is to provide a display control device that improves operability for a display screen having a display restriction function. [Means for solving the problem]

[0006] The technical means of the present disclosure for solving the problems will be described below. Note that the claims and the reference characters in parentheses in this section indicate the corresponding relationship with the specific means described in the embodiments described later in detail, and do not limit the technical scope of the present disclosure.

[0007] A display control device according to one aspect of the present disclosure , P A display control device (1) including a processor (11) for controlling, in a vehicle (2), display of a first image on a first screen (50) and display of a second image on a second screen (60) narrower than the first screen, The processor setting the first screen to a display restricted state in which display of at least a part of the first image is restricted; determining whether or not an operation request action has been detected from a vehicle occupant requesting an operation related to the display on the first screen; when it is determined that an operation request action has been detected in the display restricted state of the first screen, canceling the display restricted state and displaying, on the first screen, a corresponding image corresponding to the second image being displayed on the second screen; configured to run Processor teeth, When a second image including a unique image display content is displayed on the second screen, if it is determined that an operation request action is detected, a corresponding image that maintains the display restriction state is displayed. is configured to .

[0008] this According to the embodiment, when it is determined that an operation request action from the occupant is detected, the display restriction state of at least a part of the first image is released for the first screen, and a corresponding image corresponding to the second image being displayed on the second screen is displayed on the first screen. This allows the occupant to operate the display of the corresponding image on the first screen, which is larger than the second screen, even if the occupant is dissatisfied with the operation related to the display of the second image on the second screen. Therefore, it is possible to provide a display control device that is easy to operate and causes little stress to the occupant. [Brief description of the drawings]

[0009] [Figure 1] 1 is a schematic diagram showing a vehicle equipped with a display control device according to an embodiment of the present disclosure. [Diagram 2] 1 is a block diagram showing a detailed configuration of a display control device according to an embodiment of the present disclosure. [Diagram 3]11 is a table showing detection conditions for an operation requesting motion according to an embodiment of the present disclosure. [Figure 4] 11 is a table showing detection conditions for the end of an operation according to an embodiment of the present disclosure. [Diagram 5] 11 is a table illustrating an example of setting a corresponding image according to an embodiment of the present disclosure. [Figure 6] 1 is a flowchart illustrating a display control procedure according to an embodiment of the present disclosure. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0010] Hereinafter, an embodiment of the present disclosure will be described with reference to the drawings.

[0011] 1 is mounted on a vehicle 2. The display control device 1 generates an image based on sensing data of the vehicle 2, and displays the generated image on a CD (Center Display) 5 and an MID (Multi-Information Display) 6 arranged in the interior of the vehicle 2.

[0012] The CD5 is disposed in a center cluster located in the center of the instrument panel inside the vehicle 2. The CD5 displays a first image generated by the display control device 1 on a first screen 50 as an image showing information related to the driving of the vehicle and the setting status of the in-vehicle devices. The first screen 50 of the CD5 is a touch panel type display screen provided with a touch operation function. The first screen 50 is configured, for example, by combining a touch sensor that detects touch operations with a liquid crystal display. An occupant of the vehicle 2 can perform operations related to the display on the first screen 50 by touching the first screen 50 with a finger or the like.

[0013] First screen 50 may be a display screen without a touch operation function. In this case, CD 5 may be provided with an operation switch that can be operated in response to an image displayed on first screen 50. Note that first screen 50 may be configured as a touch panel type display screen, and CD 5 may be provided with an operation switch that can be operated in response to an image displayed on first screen 50.

[0014] The MID 6 is disposed in a meter cluster located in front of the driver's seat on the instrument panel inside the vehicle 2. The MID 6 displays a second image generated by the display control device 1 on a second screen 60 as an image showing information related to vehicle operation and the setting status of in-vehicle devices. The second screen 60 of the MID 6 has a narrower image display area than the first screen 50 of the CD 5. The second screen 60 is configured by a liquid crystal display or the like. The driver of the vehicle 2 can operate the display on the second screen 60 using an operation switch or the like provided on the steering wheel.

[0015] The display control device 1 is connected to the CD 5, the MID 6, the switch group 3, and the sensor group 4 via at least one of, for example, a LAN (Local Area Network), a wire harness, and an internal bus. Here, the switch group 3 is at least one of, for example, an air conditioner switch for operating the air conditioner, an audio switch for operating the sound, a light switch for operating the light, a mode switch for operating the driving mode, etc. The sensor group 4 is at least one of, for example, a status monitoring device (for example, Driver Status Monitor (registered trademark)) 40 for monitoring the driver's status, a touch sensor for detecting a touch operation on the first screen 50, a vehicle speed sensor for detecting the speed of the vehicle, a rotation speed sensor for detecting the engine rotation speed, and a mileage sensor for detecting the mileage, etc.

[0016] The state monitoring device 40 detects the state of the driver based on an image of the driver, one of the occupants, captured by an interior camera of the vehicle 2. The state monitoring device 40 notifies the display control device 1 of the detected state of the driver. The state monitoring device 40 detects at least one of, for example, the position, direction or movement of the driver's gaze, and the position, direction or movement of the hands.

[0017] The display control device 1 includes at least one dedicated computer. The dedicated computer constituting the display control device 1 may be a navigation ECU that navigates the driving of a vehicle. The dedicated computer constituting the display control device 1 may be an HCU (Human Machine Interface (HMI) Control Unit) that controls the presentation of information on the vehicle 2.

[0018] The display control device 1 is configured to include such a dedicated computer, and has at least one memory 10 and one processor 11. The memory 10 is at least one type of non-transitory tangible storage medium, such as a semiconductor memory, a magnetic medium, or an optical medium, that non-temporarily stores computer-readable programs and data. The processor 11 includes at least one type of core, such as a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), or a RISC (Reduced Instruction Set Computer)-CPU.

[0019] The processor 11 executes a plurality of instructions included in a display control program stored in the memory 10. As a result, the display control device 1 constructs a plurality of functional units, which are functional blocks for controlling image display in the vehicle 2, as shown in Fig. 2. In this manner, in the display control device 1, the display control program stored in the memory 10 causes the processor 11 to execute a plurality of instructions to control image display in the vehicle 2, thereby constructing a plurality of functional units. These functional units include an image control unit 100 and a state determination unit 110.

[0020] The image control unit 100 generates a first image to be displayed on the first screen 50 of the CD5 and a second image to be displayed on the second screen 60 of the MID6 at the respective display timings based on the sensing data acquired from the switch group 3 and the sensor group 4. The image control unit 100 can set the first screen 50 of the CD5 to a display restriction state in which the display of the first image is restricted based on the operation by the occupant. In the display restriction state, the image control unit 100 restricts the display of at least a part of the first screen 50 by displaying a mask image superimposed on at least a part of the first image to be displayed on the first screen 50 of the CD5. As the mask image, for example, a blackout image (or a whiteout image) with a uniform display color indicating that the image display is off can be used. The image control unit 100 realizes an operation restriction so as not to accept an operation from the occupant with respect to the display restricted area of ​​the first screen 50.

[0021] The state determination unit 110 determines whether or not an operation request action by the driver, one of the occupants, requesting an operation on the image on the first screen 50 has been detected based on the sensing data acquired from the sensor group 4. The state determination unit 110 determines that an operation request action by the driver has been detected based on at least one of the driver's movement, line of sight, posture, gesture, and the like. In particular, the state determination unit 110 of this embodiment determines that an operation request action has been detected when at least one of the conditions Ca1 to Ca4 shown in FIG. 3 is satisfied. The state determination unit 110 may determine that an operation request action by the driver has been detected based on the condition Ca1 that the driver's line of sight is directed toward the first screen 50. The state determination unit 110 may determine that an operation request action by the driver has been detected based on the condition Ca2 that the driver's hand approaches the first screen 50. The state determination unit 110 may determine that an operation request action by the driver has been detected based on the condition Ca3 that the driver's hand touches the first screen 50. Additionally, the state determination unit 110 may determine that an operation request action by the driver has been detected, with condition Ca4 being that a swipe action has been detected on the first screen 50. The state determination unit 110 may determine that an operation request action by the driver has been detected, when specific two or more of the above conditions Ca1 to Ca4 are satisfied as an AND condition.

[0022] The state determination unit 110 determines whether or not the driver, one of the occupants, has completed an operation relating to the image on the first screen 50, based on the sensing data acquired from the sensor group 4. The state determination unit 110 determines whether or not the driver has completed an operation relating to the image on the first screen 50, based on at least one of the driver's movement, line of sight, posture, gesture, and the like, for example. In particular, the state determination unit 110 of this embodiment determines whether or not the operation relating to the image on the first screen 50 has completed, when the conditions Ce1 to Ce2 shown in Fig. 4 are satisfied.

[0023] Specifically, the state determination unit 110 may determine that the driver's operation regarding the image on the first screen 50 has ended, using as a condition Ce1 that the line of sight, which was directed toward the first screen 50, has moved away from the first screen 50. The state determination unit 110 may determine that the driver's operation regarding the image on the first screen 50 has ended, using as a condition Ce2 that the hand, which was approaching the first screen 50, has moved onto the steering wheel. The state determination unit 110 may determine that the driver's operation regarding the image on the first screen 50 has ended, when both of the above conditions are satisfied as an AND condition. The determination result by the state determination unit 110 is provided to the image control unit 100.

[0024] The image control unit 100 receives a notification when the state determination unit 110 determines that an operation request action by the driver has been detected in the display restricted state of the first screen 50. In response to the notification, the image control unit 100 releases the display restricted state of the first screen 50 and displays the first image corresponding to the second image being displayed in the second screen 60 of the MID 6 as a corresponding image on the first screen 50. Furthermore, the image control unit 100 may control the display of the first screen 50 and the display of the second screen 60 to be linked when the display restricted state of the first screen 50 is released. Alternatively, the image control unit 100 may control the display of the first screen 50 and the display of the second screen 60 not to be linked when the display restricted state of the first screen 50 is released.

[0025] The above-mentioned corresponding image is set in advance by the passenger's operation on the first screen 50 of the CD 5. Fig. 5 shows a number of setting examples of the corresponding image.

[0026] In the first setting example, a car navigation current position image is set as a corresponding image of a compass image showing the azimuth of the vehicle 2. In the display restricted state of the first screen 50, when a compass image is displayed on the second screen 60 and an operation request action by the driver is detected, the image control unit 100 causes the car navigation current position image to be displayed on the first screen 50.

[0027] In the second setting example, an air conditioner setting image for the front seat of the vehicle 2 is set as the corresponding image of the air conditioner setting image. In this case, when the image control unit 100 detects an operation request action by the driver while the air conditioner setting image is displayed on the second screen 60 in the display restricted state of the first screen 50, it causes the air conditioner setting image for the front seat of the vehicle 2 to be displayed on the first screen 50.

[0028] In the third setting example, audio setting images for a radio, a television, and a media player are set as images corresponding to the vehicle audio setting image. In this case, when the image control unit 100 detects an operation request by the driver while the audio setting image is being displayed on the second screen 60 in the display restricted state of the first screen 50, the image control unit 100 causes the audio setting images for a radio, a television, and a media player to be displayed on the first screen 50.

[0029] In the fourth setting example, an image showing the fuel efficiency of the vehicle 2 is set as a corresponding image to the image showing the fuel efficiency of the vehicle 2. In the display restricted state of the first screen 50, when an operation request action by the driver is detected while an image showing the fuel efficiency of the vehicle 2 is being displayed on the second screen 60, the image control unit 100 causes the image showing the fuel efficiency of the vehicle 2 to be displayed on the first screen 50.

[0030] In the fifth setting example, an image showing vehicle information is set as a corresponding image to the image showing the drive mode, the traction control state, and the driving support mode. In the display restricted state of the first screen 50, when an operation request action by the driver is detected while an image showing any one of the drive mode, the traction control state, and the driving support mode is displayed on the second screen 60, the image control unit 100 causes the first screen 50 to display an image showing vehicle information.

[0031] In the sixth setting example, the current position image of the car navigation is set as the corresponding image of the cut-in guide image of the car navigation. In the display restricted state of the first screen 50, when the image control unit 100 detects an operation request action by the driver while the cut-in guide image of the car navigation is displayed on the second screen 60, the current position image of the car navigation is displayed on the first screen 50.

[0032] In the seventh setting example, an image related to telephone operation is set as the corresponding image of the incoming call image. In the display restriction state of the first screen 50, when the image control unit 100 is displaying the incoming call image on the second screen 60 and an operation request action by the driver is detected, the image control unit 100 displays the image related to telephone operation on the first screen 50.

[0033] In the eighth setting example, a blackout image (or a whiteout image) is set as a corresponding image of the image display content specific to the second screen 60. The image display content specific to the second screen 60 is, for example, an image quality setting image of the second screen 60. Therefore, in the display restricted state of the first screen 50, the image control unit 100 displays a blackout image (or a whiteout image) as a corresponding image, and maintains the display restricted state of the first screen 50, even if an operation request action by the driver is detected while an image specific to the second screen 60 is being displayed.

[0034] 2 receives a notification when the state determination unit 110 determines that the operation related to the display on the first screen 50 has ended after the display restriction state of the first screen 50 has been released. In response to this, the image control unit 100 returns the first screen 50 to the display restriction state.

[0035] With the above-described configuration, the first image displayed on the first screen 50 of the CD 5 can be changed according to the acquisition status of the sensing data by the image control unit 100. If the driver sees a display change, such as a display movement, on the first screen 50 of the CD 5 while driving the vehicle 2, the driver may not be able to concentrate on driving. Therefore, the driver can set the first screen 50 to a display restricted state while no operation related to the display on the first screen 50 is required.

[0036] In this display restriction state on the first screen 50, the driver operates the vehicle devices on the second screen 60. However, since the display area of ​​the second screen 60 is narrower than that of the first screen 50, the information that the second screen 60 can display at one time is limited compared to that of the first screen 50. The driver also operates the display on the second screen 60 via an operation switch on the steering wheel, etc. Therefore, the driver is expected to feel dissatisfied because he operates the display on the second screen 60, which has low operability compared to the first screen 50, where the display can be operated directly using a touch panel. Therefore, when an operation request action by the driver requesting an operation on the display on the first screen 50 is detected, the image control unit 100 releases the display restriction state on the first screen 50. This allows the driver to operate the display on the first screen 50.

[0037] The procedure of display control by the display control device 1 will be described below with reference to the flowchart in Fig. 6. The display control device 1 periodically executes the process shown in Fig. 6 while the image control unit 100 sets the first screen 50 to the display restricted state.

[0038] 6, the state determination unit 110 determines whether or not an operation request action by an occupant has been detected. If it is determined that an operation request action has been detected, the display control flow proceeds to S22. On the other hand, if it is not determined that an operation request action has been detected, the display control flow ends.

[0039] If it is determined that an operation request action has been detected, then in S22, the image control section 100 releases the display restriction state of the first screen 50.

[0040] In S23 following S22, the image control unit 100 causes the first screen 50 to display, as a first image corresponding to the second image being displayed on the second screen 60, a corresponding image that has been preset by the occupant as in the above example.

[0041] In S24 following S23, the image control section 100 causes the first screen 50 to display a first image corresponding to an operation relating to the image on the first screen 50.

[0042] In S25 following S24, state determination unit 110 determines whether or not the operation by the driver regarding the image on the first screen 50 has ended. If it is determined that the operation regarding the image on the first screen 50 has ended, the display control flow proceeds to S26. On the other hand, if it is not determined that the operation regarding the image on the first screen 50 has ended, the display control flow returns to S24.

[0043] In S25, when it is determined that the operation on the image on the first screen 50 by the driver has ended, the image control section 100 returns the first screen 50 to the display restricted state.

[0044] (Action and effect) The effects of the present embodiment described above will be described below.

[0045] According to this embodiment, when it is determined that an operation request action by the driver among the occupants is detected, the display restriction state of at least a part of the first image is released for the first screen 50, and a corresponding image corresponding to the second image being displayed on the second screen 60 is displayed on the first screen 50. This allows the driver to operate the display of the corresponding image on the first screen 50, which is larger than the second screen 60, even if the driver is dissatisfied with the operation related to the display of the second image on the second screen 60. Therefore, it is possible to provide a display control device 1 that provides a display that is easy to operate and less stressful for the driver.

[0046] According to this embodiment, after the display restriction state of the first screen 50 is released, if it is determined that the driver has finished operating on the image on the first screen 50, the first screen 50 is returned to the display restriction state. This allows the first screen 50 to be in the display restriction state while the driver does not need to operate on the display using the first screen 50. Therefore, even if the driver does not need to operate on the display using the first screen 50, it is possible to prevent display changes on the first screen 50 from coming into the driver's field of vision and attracting the driver's attention.

[0047] According to this embodiment, it is determined that an operation request action is detected when the driver's line of sight is directed toward the first screen 50. This makes it possible to release the display restriction state of the first screen 50 based on the driver's action of moving the line of sight. Therefore, it is possible to operate the display on the first screen 50 without making the driver follow complicated procedures.

[0048] According to this embodiment, it is determined that an operation request action is detected when the driver's hand approaches the first screen 50. This makes it possible to release the display restriction state of the first screen 50 based on the driver's action of reaching out to the first screen 50. This makes it possible for the driver to perform operations related to the display on the first screen 50 without having to go through complicated procedures.

[0049] According to this embodiment, it is determined that an operation request action is detected when the driver's hand touches the first screen 50. This makes it possible to release the display restriction state of the first screen 50 based on the driver's action of touching the first screen 50 with his / her hand. This allows the driver to perform operations related to the display on the first screen 50 without having to go through complicated procedures.

[0050] (Other embodiments) Although the embodiments of the present disclosure have been described above, the present disclosure should not be construed as being limited to the above-described embodiments, and may be applied to various embodiments and combinations within the scope not departing from the gist of the present disclosure.

[0051] In the above embodiment, the MID 6, which is a display device for the driver, is exemplified as a display device having a second screen. However, the display device having the second screen may be a display device for a passenger other than the driver. In addition, the state monitoring device 40 may also monitor the state of passengers other than the driver in the vehicle 2. Furthermore, the image control unit 100 may release the display restriction state of the first screen 50 based on an operation request action by a passenger other than the driver requesting an operation related to the display of the first screen 50. In this case, it is possible to provide a display control device 1 that is easy to operate even for passengers other than the driver. [Explanation of symbols]

[0052] 1: display control device, 2: vehicle, 11: processor, 50: first screen, 60: second screen

Claims

1. A display control device (1) including a processor (11) for controlling, in a vehicle (2), display of a first image on a first screen (50) and display of a second image on a second screen (60) narrower than the first screen, The processor, setting the first screen to a display restricted state in which display of at least a part of the first image is restricted; determining whether or not an operation request action has been detected from an occupant of the vehicle requesting an operation related to the display on the first screen; when it is determined that the operation request action has been detected in the display restricted state of the first screen, canceling the display restricted state and displaying, on the first screen, a corresponding image corresponding to the second image being displayed on the second screen; configured to run The processor, A display control device configured to, when it is determined that the operation request action is detected while the second image including unique image display content is being displayed on the second screen, execute the step of displaying the corresponding image while maintaining the display restriction state.

2. The processor, determining whether or not the operation related to the display on the first screen by the occupant has been completed after the display restriction state is released; returning the first screen to the display restricted state when it is determined that an operation related to the display on the first screen by the occupant has ended after the display restricted state is released; The display control device according to claim 1 , further configured to execute the following:

3. Determining whether or not the operation requesting motion has been detected includes determining that the operation requesting motion has been detected when the line of sight of the occupant is directed toward the first screen. The display control device according to claim 1 or 2.

4. Determining whether the operation requesting motion is detected includes determining that the operation requesting motion is detected when the hand of the occupant approaches the first screen. The display control device according to claim 1 .

5. determining whether the operation requesting action has been detected includes determining that the operation requesting action has been detected when the hand of the occupant touches the first screen. The display control device according to claim 1 .

Citation Information

Patent Citations

  • Information display device

    JP2008292753A

  • Screen display device

    JP2009216888A

  • On-vehicle information system, on-vehicle device, and information terminal

    JP2013221769A

  • Navigation device, touch operation receiving method, and touch operation receiving program

    JP2015011000A

  • Vehicular operation device

    JP2016203708A