Display device for vehicle

Abstract

A vehicle display device (100) according to the present application displays information to an occupant in a driver's seat of a vehicle (1), and includes a communication unit (8), a display (4) disposed opposite the driver's seat and extending in a vehicle width direction, and a talk device (10) configured to be capable of talking through the communication unit (8) and capable of displaying, on the display (4), an image received from a talk partner through the communication unit (8). The talk device (10) has a display control section (13) that controls the display (4) to display information of the talk partner on one side in the vehicle width direction of the display (4) at the start of talking between the communication unit (8) and the talk partner, to move and display the information of the talk partner displayed on the one side in the vehicle width direction of the display (4) to the other side in the vehicle width direction of the display (4) at the time when the occupant indicates permission of talking, and to display the image of the talk partner on the one side in the vehicle width direction of the display (4) after that.

Description

Technical Field

[0001] This invention relates to a vehicle display device for displaying information to the occupant in the driver's seat of a vehicle. Background Technology

[0002] As such a device, there are known devices that display information about incoming telephone calls to the driver of a vehicle (see, for example, Patent Document 1). The device described in Patent Document 1 is connected to a portable device with telephone functionality, and when the portable device receives an incoming telephone call, the caller's name, telephone number, and other information are displayed on a display device installed in the vehicle.

[0003] In recent years, vehicles equipped with advanced driver assistance systems such as autonomous driving have become increasingly common. In such vehicles, to enhance convenience, it is preferable to convey various information to the driver and passenger, who are the primary users of the vehicle, through images displayed on a screen.

[0004] Existing technical documents

[0005] Patent documents

[0006] Patent document 1: Japanese Patent Application Publication No. 2016-163176 (JP2016-163176A). Summary of the Invention

[0007] One technical solution of the present invention is a vehicle display device for displaying information to the occupant in the driver's seat of a vehicle, comprising: a communication unit; a display screen disposed opposite to the driver's seat and extending in the vehicle width direction; and a communication device configured to enable communication via the communication unit and to display on the display screen an image received via the communication unit from the communication recipient. The communication device has a display control unit that controls the display screen to display the communication recipient's information on one side of the display screen in the vehicle width direction when a communication between the communication unit and the communication recipient begins; subsequently, when the occupant instructs permission to communicate, the communication recipient's information displayed on one side of the display screen in the vehicle width direction moves to the other side in the vehicle width direction and is displayed; and then, an image of the communication recipient is displayed on one side of the display screen in the vehicle width direction. Attached Figure Description

[0008] The objectives, features, and advantages of the present invention are further illustrated by the following description of embodiments in conjunction with the accompanying drawings.

[0009] Figure 1 This is a diagram illustrating an example of the structure around the dashboard of a vehicle to which an embodiment of the present invention is applied.

[0010] Figure 2 This is a block diagram that schematically illustrates the overall structure of a vehicle display device according to an embodiment of the present invention.

[0011] Figure 3 This shows the start of a video call. Figure 1 and Figure 2 An example of a display screen.

[0012] Figure 4 It indicates that video calls are allowed. Figure 1 and Figure 2 An example of a display screen.

[0013] Figure 5 It shows the video call. Figure 1 and Figure 2 An example of a display screen.

[0014] Figure 6 It shows the video call. Figure 1 and Figure 2 Another example of a display screen.

[0015] Figure 7 It is used for explanation Figure 1 A top view of the vehicle's seating configuration.

[0016] Figure 8 It shows the end of the video call. Figure 1 and 2 An example of a display screen.

[0017] Figure 9 This is a flowchart illustrating an example of a process performed by a vehicle display device according to an embodiment of the present invention. Detailed Implementation

[0018] The following is for reference Figures 1-9 Embodiments of the present invention will be described. The vehicle display device according to the embodiments of the present invention can be applied to vehicles with a driver's seat, especially vehicles with advanced driver assistance functions such as automatic driving functions. Such vehicles include not only vehicles that operate in an automatic driving mode that does not require driver operation, but also vehicles that operate in both automatic driving mode and manual driving mode where the driver performs driving operations.

[0019] Figure 1 This is a diagram illustrating an example of the structure surrounding the dashboard 1a of a vehicle 1 to which an embodiment of the present invention is applied. Figure 1 As shown, the instrument panel 1a is located at the front of the vehicle interior, and the instrument panel 1a is equipped with an instrument display 2, rearview mirror displays 3R and 3L, and an information display (hereinafter referred to as "display") 4.

[0020] Instrument display 2 is configured on the dashboard 1a in the driver's seat (in Figure 1 In the example, the display shows information related to the vehicle's status, such as vehicle speed, opposite the right side (in the vehicle width direction). Rearview mirror displays 3L and 3R are respectively positioned on the left and right ends of the instrument panel 1a in the vehicle width direction, displaying images corresponding to the left and right rearview mirrors reflecting the left and right rear of vehicle 1. Display 4 is positioned on the instrument panel 1a near the center in the vehicle width direction between the instrument display 2 and the rearview mirror display 3L, extending in the vehicle width direction to display various information to the occupants.

[0021] Near the driver's seat of the dashboard 1a, there is also an input unit 7, such as a speaker 5 that outputs sound to the driver's seat occupant, an in-vehicle camera 6 that captures images of the driver's seat occupant, and a microphone that receives sound input from the driver's seat occupant. Figure 2 The input unit 7 may include, in addition to a microphone, a touch panel, buttons, etc., for accepting operational input.

[0022] Various information is displayed on the display 4 based on the instructions input from the occupant via the input unit 7. Examples include navigation screens for setting the destination of vehicle 1 or providing route guidance to the set destination, and video call screens for video chatting via internet or video calling via telephone. The video call screen will be described in particular below.

[0023] Figure 2 This is a block diagram that schematically illustrates the overall structure of a vehicle display device 100 according to an embodiment of the present invention. Figure 2 As shown, the vehicle display device 100 includes a display 4, a speaker 5, an in-vehicle camera 6, an input unit 7, a communication unit 8, and a telephone device 10.

[0024] The communication device 10 is configured as a computer, including an arithmetic unit 11 such as a CPU (Central Processing Unit), a storage unit 12 such as ROM (Read-Only Memory) and RAM (Random Access Memory), and other peripheral circuits (not shown) such as I / O (Input / Output) interfaces. Various control programs and information such as thresholds used in the programs are stored in the storage unit 12. The arithmetic unit 11 has a display control unit 13 that controls the display 4 as a functional structure.

[0025] The communication unit 8 is configured to communicate with external terminal devices via a wireless communication network, including the Internet and mobile phone networks. The network includes not only public wireless communication networks but also closed communication networks set up for each designated management area, such as wireless local area networks, Wi-Fi (registered trademark), and Bluetooth (registered trademark).

[0026] Based on instructions input from the occupant via the input unit 7, the system can transmit image and sound information acquired using the in-vehicle camera 6 and the input unit 7 to an external terminal device via the communication unit 8. Furthermore, based on information received from the external terminal device via the communication unit 8, the system can display images on the display 4 and output sound from the speaker 5.

[0027] The intercom device 10 is configured to enable communication via speaker 5, input unit 7, and communication unit 8, and to display on display 4 an image received from the other party via communication unit 8. The driver can use the intercom device 10 for video calls. The display control unit 13 controls the display 4 based on commands input from the occupant via input unit 7, and on programs stored in storage unit 12 and information obtained via communication unit 8.

[0028] Figure 3 This is an example diagram showing the display screen D1 of monitor 4 when a video call begins. (See diagram below.) Figure 3 As shown, the display control unit 13 controls the display 4 to display an AI (artificial intelligence) agent image 40 on the right side of the display 4 closest to the driver's seat in the vehicle width direction. This AI agent provides various services to the occupant in the driver's seat, who is the primary user of the vehicle 1. The AI ​​agent provides services tailored to the user's preferences based on pre-registered user information and user information obtained from user instructions. For example, it recommends in-vehicle content such as music that matches the user's preferences, the destination of the vehicle 1, and driving routes to the user (occupant in the driver's seat), and mediates video calls with the other party.

[0029] The display control unit 13 controls the display 4 to display the call recipient's information 41 on the right side 4R of the driver's seat side display 4 in the vehicle width direction when a call between the driver and the call recipient begins via the communication unit 8. More specifically, the display 4 is controlled to display the call recipient's information 41, including the sender's surname, name, icon, and phone number, based on the incoming video call information received via the communication unit 8. Furthermore, the display 4 is controlled to display the call recipient's information 41, including the sender's name, icon, and phone number, based on pre-registered contact information when a video call is initiated via the input unit 7.

[0030] During a video call, the driver's seat occupant's own image and the surrounding interior of the vehicle are sent to the other party, whose image is displayed in the vehicle. Therefore, displaying detailed information about the sender and the target before the video call begins provides the occupant with a sense of security. Furthermore, the other party's information 41 is displayed on the right side 4R of the display 4 closest to the driver's seat in the vehicle width direction, making it easy for the driver to confirm. It should be noted that no information is specifically displayed on the left side 4L of the display 4 further from the driver's seat in the vehicle width direction.

[0031] Figure 4 This is an example of the display screen D2 on monitor 4 when a video call is being received by the occupant in the driver's seat. Figure 5 This diagram illustrates an example of the display screen D3 on monitor 4 during a video call. For instance, based on a broadcast from an AI agent such as "Call [name]," output through speaker 5, a command to allow a video call can be input via input unit 7. Figure 4 As shown, the display control unit 13 controls the display 4 so that when a passenger instructs permission to talk, the information 41 of the person being talked to, displayed on the right side 4R of the display 4 in the vehicle width direction, moves to the left side 4L in the vehicle width direction and is displayed. Then, as... Figure 5 As shown, the display control unit 13 controls the display 4 so that the image 42 of the person being called is displayed on the right side 4R of the display 4 in the vehicle width direction.

[0032] like Figure 4 and Figure 5 As shown, the information 41 of the call subject displayed on the display screen D1 before the video call begins does not disappear but moves while remaining on display, and then transitions to the display screen D3 during the video call. Therefore, even after the occupant in the driver's seat has granted permission for the video call, there will be no discomfort during the waiting period, for example, if the connection with the call subject takes time.

[0033] like Figure 5 As shown, during a video call, the display control unit 13 controls the display 4 so that when information about providing services (service information) is obtained from the caller (such as a business operator), the service information 43 is displayed on the left side 4L of the display 4 in the vehicle width direction. For example, the service information 43 displays information about a menu sent from an employee of a coffee shop (the caller).

[0034] like Figure 4 and Figure 5 As shown, when the call recipient is a service provider such as an operator, the AI ​​agent does not provide services during the video call and displays an agent image 40a in a form corresponding to standby mode. In this case, as... Figures 3-5As shown, when a video call begins, the agent image 40b, which corresponds to the working mode of the AI ​​agent implementing the service, is transformed into the agent image 40a, which corresponds to the standby mode, and is displayed.

[0035] Figure 6 This diagram illustrates another example of the display screen D4 on monitor 4 during a video call, where the call recipient is not a service provider, but rather a user requesting an AI agent to provide services during the video call. In this case, as... Figure 6 As shown, image 40b displays an AI agent in a form corresponding to the working mode, where the AI ​​agent intervenes in a conversation with the other party in a video call.

[0036] More specifically, during a video call, information is retrieved via the internet based on keywords spoken by the passenger or the other party, and recommendations related to those keywords (recommendation information) are displayed on display 4. It should be noted that in the recommendation service provided by the AI ​​agent, the agent image 40b is displayed in a manner that subtly intervenes in the conversation, such as nodding in response to the spoken content. The display control unit 13 controls display 4 to display service information 43 corresponding to the recommendation information on the left side 4L of display 4 in the vehicle width direction. For example, representative images such as the name of a restaurant mentioned in the video call, its popular menu, and its exterior, retrieved as keywords, are displayed as service information 43 corresponding to the recommendation information.

[0037] Figure 7 This is a top view used to illustrate the seating configuration of vehicle 1. For example... Figure 7 As shown, vehicle 1 has a driver's seat DR positioned on the right side in the vehicle width direction and a front passenger seat AS positioned on the left side in the vehicle width direction, serving as the front seats. A display 4 is positioned on the instrument panel 1a from opposite the front passenger seat AS to the left front of the driver's seat DR and extends in the vehicle width direction. Therefore, as... Figures 3-6 As shown, the AI ​​agent image 40 displayed on the right side of the display 4 in the vehicle width direction is positioned between the information 41 or image 42 of the call subject and the occupant of the driver's seat DR. Therefore, the role of the AI ​​agent mediating the video call between the occupant of the driver's seat DR and the call subject is clear, and the occupant can naturally accept the AI ​​agent.

[0038] It should be noted that, as Figure 5As shown, even when the AI ​​agent is not providing services during a video call, the recommended service can be initiated by inputting a specified wake-up phrase via the input unit 7. The display control unit 13 controls the display 4 so that when the AI ​​agent switches from standby mode to working mode during a video call, the AI ​​agent image 40a in the form corresponding to the standby mode changes to the AI ​​agent image 40b in the form corresponding to the working mode and is displayed.

[0039] Figure 8 This is an example of the display screen D5 on monitor 4 after a video call has ended. Figure 8 As shown, when the video call ends, the AI ​​agent resumes providing general services. The display control unit 13 controls the display 4 to display an AI agent image 40b in a form corresponding to the working mode on the right side 4R of the display 4 in the vehicle width direction.

[0040] As a general service provided by the AI ​​agent after a video call ends, such as setting the destination of vehicle 1 according to the content of the video call conversation. For example, in the case of making a reservation for a table through a video call with a restaurant, the AI ​​agent broadcasts "Looking forward to going to coffee shop [name], proceeding to coffee shop" through speaker 5, and sets the restaurant as the destination of vehicle 1.

[0041] Figure 9 This is a flowchart illustrating an example of a process performed by a vehicle display device according to an embodiment of the present invention. The process shown in this flowchart begins, for example, when incoming video call information is obtained via the communication unit 8, or when a video call is initiated by an instruction from the input unit 7. Figure 9 As shown, first in S1 (S: processing step), the display 4 is controlled to display the screen D1 at the start of the video call. Figure 3 Next, in S2, it is determined whether the video call is allowed. If S2 is affirmative (S2: Yes), proceed to S3; if it is negative (S2: No), the process ends.

[0042] In S3, based on user information and incoming message information, it is determined whether a recommendation during a video call is required. When S3 is negative (S3: No), proceed to S4, controlling display 4 to display screen D2 when a video call is permitted. Figure 4 ) Displays the screen during a video call (D3) Figure 5 On the other hand, when S3 is affirmative (S3: Yes), it proceeds to S5, controlling display 4 to display screen D2 when video call is permitted. Figure 4 ) Displays the screen during a video call (D4) Figure 6Next, in S6, it is determined whether the video call has been ended. If S6 is negative (S6: No), it returns to S3; if it is positive (S6: Yes), it proceeds to S7 and controls display 4 to show the display screen D5 indicating that the video call has ended. Figure 8 ), and then end the processing.

[0043] The following effects can be achieved by adopting this implementation method.

[0044] (1) The vehicle display device 100 displays information to the occupant in the driver's seat of the vehicle 1. Figures 3-6 , Figure 8 The vehicle display device 100 includes: a communication unit 8; a display 4, which is disposed opposite to the driver's seat DR and extends in the vehicle width direction; and a communication device 10, which is configured to enable communication via the communication unit 8 and to display on the display 4 an image received from the communication recipient via the communication unit 8. Figure 1 , Figure 2 , Figure 7 ).

[0045] The communication device 10 has a display control unit 13 ( Figure 2 The display control unit 13 controls the display 4 so that when a call between the communication unit 8 and the callee begins, the callee's information 41 is displayed on the right side 4R of the display 4 in the vehicle width direction. Figure 3 Then, when the passenger indicates that communication is permitted, the information 41 of the communication target displayed on the right side 4R of the display 4 in the vehicle width direction moves to the left side 4L in the vehicle width direction and is displayed. Figure 4 Then, the image 42 of the person being contacted is displayed on the right side 4R in the vehicle width direction of the display 4. Figure 5 , Figure 6 ).

[0046] Therefore, the information 41 of the person being called can be appropriately displayed to the occupant in the driver's seat of vehicle 1. That is, by displaying the information 41 of the person being called before the video call begins, the occupant can feel a sense of security. Furthermore, the information 41 of the person being called displayed on the display screen D1 before the video call begins moves in a way that keeps it on display and then moves to the display screens D3 and D4 during the video call, so the occupant will not feel uneasy while connected to the person being called.

[0047] (2) The right side 4R of the display 4 in the vehicle width direction is the driver's seat DR side ( Figure 7 Therefore, for the occupant in the driver's seat, it is easy to confirm the information of the person being called before the video call begins 41, and easy to view the image of the person being called during the video call 42.

[0048] (3) The display control unit 13 controls the display 4 so that during a call using the communication unit 8, the image 42 of the call subject displayed on the right side 4R of the display 4 in the vehicle width direction is displayed closer to the driver's seat DR side. The image 40 of the intelligent agent represents an AI agent that mediates the call with the call subject. Figure 6 Therefore, since the AI ​​agent image 40 is displayed between the image 42 of the person being called and the occupant of the driver's seat DR, the role of the AI ​​agent mediating the video call with the person being called is clear, and the occupant of the driver's seat DR can easily accept the service of the AI ​​agent.

[0049] (4) The agent image 40 is in the first form ( Figure 3 , Figure 6 , Figure 8 ) and second form ( Figure 4 , Figure 5 The display shows either of the following: a first mode corresponding to the working mode in which the AI ​​agent provides information corresponding to the occupant's speech, and a second mode corresponding to the standby mode in which the AI ​​agent does not provide information corresponding to the occupant's speech. The display control unit 13 controls the display 4 so that when the occupant instructs permission to talk, the AI ​​agent image 40 changes from the first mode corresponding to the working mode to the second mode corresponding to the standby mode and displays (…). Figures 3-5 For example, when the caller is a service provider, instead of displaying the AI ​​agent's recommended information, the service information 43 sent from the caller is displayed to provide appropriate information to the passenger in the driver's seat.

[0050] In the above embodiments, Figure 1 The specific example of display 4 is shown in the illustration, but the display can be any configuration as long as it is positioned opposite the driver's seat and extends in the width direction of the vehicle. Furthermore, in Figure 2 The specific structure of the communication device 10 has been described in the illustrations, but the communication device is not limited to this; it can also be configured, for example, using a user terminal with telephone functionality. Furthermore, in Figure 3 The specific example shown in the example 41 illustrates the information of the caller, but the information of the caller is not limited to this.

[0051] It is possible to combine one or more of the above-described embodiments and variations, and to combine the variations with each other.

[0052] Using this invention, information can be appropriately displayed to the occupants in the driver's seat of a vehicle.

[0053] The present invention has been described above in conjunction with preferred embodiments, but those skilled in the art should understand that various modifications and alterations can be made without departing from the scope of the claims described below.

Claims

1. A vehicle display device (100), a vehicle display device (100) for displaying information to the occupant of the driver's seat of a vehicle (1), characterized in that, have: Communication unit (8); Display (4), which is configured to face the driver's seat and extend in the vehicle width direction; and The communication device (10) is configured to enable communication via the communication unit (8) and to display on the display (4) an image received via the communication unit (8) from the person on the other end of the conversation. The communication device (10) has a display control unit (13) that controls the display (4) to display information of the caller on one side of the display (4) in the vehicle width direction when a call between the communication unit (8) and the caller begins. Then, when the passenger indicates permission to continue the call, the information of the caller displayed on one side of the display (4) moves to the other side in the vehicle width direction and is displayed thereafter. Finally, an image of the caller is displayed on one side of the display (4) in the vehicle width direction. During the call, information is retrieved via the internet based on keywords spoken by the passenger or the other party. The display control unit (13) controls the display (4) to display recommended information related to the keyword on the other side of the display (4) in the vehicle width direction. The driver's side is the side of the display (4) in the vehicle width direction. The display control unit (13) controls the display (4) so ​​that when a call is made through the communication unit (8), the image of the call subject displayed on the side of the vehicle width direction relative to the display (4) is displayed on the driver's side, showing an AI agent that mediates the call with the call subject.

2. The vehicle display device (100) according to claim 1, characterized in that, The AI ​​agent image is displayed in either a first form or a second form. The first form corresponds to a working mode in which the AI ​​agent provides information corresponding to the occupant's speech, and the second form corresponds to a standby mode in which the AI ​​agent does not provide information corresponding to the occupant's speech. The display control unit (13) controls the display so that when the occupant instructs permission to talk, the image of the agent changes from the first form to the second form and is displayed.

3. The vehicle display device (100) according to claim 1, characterized in that, The AI ​​agent image is displayed in either a first form or a second form. The first form corresponds to a working mode in which the AI ​​agent provides information corresponding to the occupant's speech, and the second form corresponds to a standby mode in which the AI ​​agent does not provide information corresponding to the occupant's speech. When the passenger instructs permission to make a call, the display control unit (13) determines, based on information about the person making the call, to display the image of the agent in the call in either the first mode or the second mode.

4. The vehicle display device (100) according to claim 3, characterized in that, The display control unit (13) controls the display so that when the image of the agent in the call is displayed in the first form, the image of the agent in the call is displayed in a form that suggests intervention in the dialogue between the agent and the caller.

Images