Information presentation device and program

Abstract

To make it easier for occupants to view destination-related information displayed on a screen in a vehicle for the occupants.SOLUTION: An information presentation device 20 is provided, comprising a control unit configured to display a banner for notifying an occupant of a vehicle 12 of destination-related information on a screen upon detection of the presence of the destination-related information when a destination is set by the occupant, the control unit being also configured to store the banner notification in response to voice input of the occupant.SELECTED DRAWING: Figure 1

Description

Technical Field

[0001] The present disclosure relates to an information presentation device and a program.

Background Art

[0002] Patent Document 1 discloses an information display device that displays various types of information about locations around a route to a destination on a navigation system.

Prior Art Document

Patent Document

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] It is difficult for a driver during driving to fully understand various types of information displayed on a navigation system.

[0005] An object of the present disclosure is to make it easier for a passenger in a vehicle to view information related to a destination that is notified to the passenger on a screen.

Means for Solving the Problems

[0006] The information presentation device according to the present disclosure is a control unit that, when detecting the presence of information related to a destination set by a passenger of a vehicle, displays a banner on a screen to notify the passenger about the information related to the destination, and includes a control unit that saves the notification by the banner in response to a voice input from the passenger.

[0007] The program according to the present disclosure is When a computer that detects the presence of information related to the destination and displays a banner on the screen to notify the occupant of the vehicle about the information related to the destination when the destination is set by the occupant of the vehicle, it causes an operation including saving the notification by the banner in response to a voice input from the occupant to be executed.

Advantages of the Invention

[0008] According to the present disclosure, an occupant of a vehicle can save a notification by a banner and view information related to the destination later. Therefore, it becomes easier for the occupant to view information related to the destination notified to the occupant on the screen in the vehicle.

Brief Description of the Drawings

[0009]

Figure 1

Figure 2

Figure 3

Figure 4

Modes for Carrying Out the Invention

[0010] Hereinafter, an embodiment of the present disclosure will be described with reference to the drawings.

[0011] In each figure, the same or corresponding parts are denoted by the same reference numerals. In the description of the present embodiment, the description of the same or corresponding parts will be omitted or simplified as appropriate.

[0012] With reference to FIG. 1, the configuration of the system 10 according to the present embodiment will be described.

[0013] The system 10 according to this embodiment includes an information presentation device 20 and a server device 30. The information presentation device 20 can communicate with the server device 30 via a network 40.

[0014] The information presentation device 20 is a computer having a voice recognition function. The information presentation device 20 is an in-vehicle device such as a navigation device mounted on the vehicle 12. Alternatively, the information presentation device 20 may be a mobile device such as a mobile phone, a smartphone, or a tablet owned by the user 11. The information presentation device 20 is used by the user 11. The user 11 is a passenger in the vehicle 12.

[0015] The server device 30 is a computer belonging to a cloud computing system or other computing system installed in a facility such as a data center. The server device 30 is operated by an operator providing services such as web services.

[0016] The vehicle 12 is, for example, an automobile of any type such as a gasoline vehicle, a diesel vehicle, a hydrogen vehicle, an HEV, a PHEV, a BEV, or an FCEV. "HEV" is an abbreviation for hybrid electric vehicle. "PHEV" is an abbreviation for plug-in hybrid electric vehicle. "BEV" is an abbreviation for battery electric vehicle. "FCEV" is an abbreviation for fuel cell electric vehicle. The vehicle 12 is driven by a driver, but the driving may be automated at a specific level. The level of automation is, for example, any one of levels 1 to 4 in the SAE level classification. "SAE" is an abbreviation for Society of Automotive Engineers. The vehicle 12 may be a vehicle dedicated to MaaS. "MaaS" is an abbreviation for Mobility as a Service.

[0017] Network 40 includes the Internet, at least one WAN, at least one MAN, or any combination thereof. "WAN" is an abbreviation for wide area network. "MAN" is an abbreviation for metropolitan area network. Network 40 may include at least one wireless network, at least one optical network, or any combination thereof. The wireless network is, for example, an ad hoc network, a cellular network, a wireless LAN, a satellite communication network, or a terrestrial microwave network. "LAN" is an abbreviation for local area network.

[0018] Referring to FIG. 1, the outline of this embodiment will be described.

[0019] As shown in the example of FIG. 2, when the information presentation device 20 detects the existence of information related to the destination 13 when the destination 13 is set by the user 11, the information presentation device 20 displays a banner 14 on the screen to notify the user 11 about the information related to the destination 13. The information presentation device 20 saves the notification by the banner 14 in response to the voice input from the user 11.

[0020] According to this embodiment, the user 11 can save the notification by the banner 14 and view the information related to the destination 13 later. Therefore, it becomes easier for the user 11 to view the information related to the destination 13 notified to the user 11 on the screen in the vehicle 12.

[0021] In particular, when the user 11 is a driver, it may be difficult for the user 11 to carefully view the information even when notified of the information related to the destination 13, such as during driving. However, according to this embodiment, the user 11 can view the information related to the destination 13 at a convenient time, such as after arriving at the destination 13. Therefore, the user 11 can fully understand the information related to the destination 13.

[0022] Referring to FIG. 3, the configuration of the information presentation device 20 according to this embodiment will be described.

[0023] The information presentation device 20 includes a control unit 21, a storage unit 22, a communication unit 23, an input unit 24, an output unit 25, and a positioning unit 26.

[0024] The control unit 21 includes at least one processor, at least one programmable circuit, at least one dedicated circuit, or any combination thereof. The processor is a general-purpose processor such as a CPU or GPU, or a dedicated processor specialized for specific processing. "CPU" is an abbreviation for central processing unit. "GPU" is an abbreviation for graphics processing unit. The programmable circuit is, for example, an FPGA. "FPGA" is an abbreviation for field-programmable gate array. The dedicated circuit is, for example, an ASIC. "ASIC" is an abbreviation for application specific integrated circuit. The control unit 21 executes processes related to the operation of the information presentation device 20 while controlling each part of the information presentation device 20.

[0025] The storage unit 22 includes at least one semiconductor memory, at least one magnetic memory, at least one optical memory, or any combination thereof. The semiconductor memory is, for example, RAM, ROM, or flash memory. "RAM" is an abbreviation for random access memory. "ROM" is an abbreviation for read only memory. RAM is, for example, SRAM or DRAM. "SRAM" is an abbreviation for static random access memory. "DRAM" is an abbreviation for dynamic random access memory. ROM is, for example, EEPROM. "EEPROM" is an abbreviation for electrically erasable programmable read only memory. The flash memory is, for example, SSD. "SSD" is an abbreviation for solid-state drive. The magnetic memory is, for example, HDD. "HDD" is an abbreviation for hard disk drive. The storage unit 22 functions as, for example, a main storage device, an auxiliary storage device, or a cache memory. The storage unit 22 stores information used for the operation of the information presentation device 20 and information obtained by the operation of the information presentation device 20.

[0026] The communication unit 23 includes at least one communication module. The communication module is a module compatible with mobile communication standards such as LTE, 4G standard, or 5G standard, or wireless LAN communication standards such as IEEE802.11. "LTE" is an abbreviation for Long Term Evolution. "4G" is an abbreviation for 4th generation. "5G" is an abbreviation for 5th generation. "IEEE" is an abbreviation for Institute of Electrical and Electronics Engineers. The communication unit 23 communicates with the server device 30. The communication unit 23 receives information used for the operation of the information presentation device 20 and transmits information obtained by the operation of the information presentation device 20.

[0027] The input unit 24 includes at least one input device. The input device is, for example, a physical key, a capacitive key, a pointing device, a touch screen provided integrally with a display, a visible light camera, a depth camera, LiDAR, or a microphone. "LiDAR" is an abbreviation for light detection and ranging. The input unit 24 receives an operation for inputting information used for the operation of the information presentation device 20. Instead of being provided in the information presentation device 20, the input unit 24 may be connected to the information presentation device 20 as an external input device. As the connection interface, an interface corresponding to a standard such as USB, HDMI (registered trademark), or Bluetooth (registered trademark) can be used. "USB" is an abbreviation for Universal Serial Bus. "HDMI (registered trademark)" is an abbreviation for High-Definition Multimedia Interface.

[0028] The output unit 25 includes at least one output device. The output device is, for example, a display or a speaker. The display is, for example, an LCD or an organic EL display. "LCD" is an abbreviation for liquid crystal display. "EL" is an abbreviation for electro luminescent. The output unit 25 outputs the information obtained by the operation of the information presentation device 20. Instead of being provided in the information presentation device 20, the output unit 25 may be connected to the information presentation device 20 as an external output device such as a display audio. As the connection interface, an interface corresponding to a standard such as USB, HDMI (registered trademark), or Bluetooth (registered trademark) can be used.

[0029] The positioning unit 26 includes at least one GNSS receiver. "GNSS" is an abbreviation for global navigation satellite system. The GNSS is, for example, GPS, QZSS, BDS, GLONASS, or Galileo. "GPS" is an abbreviation for Global Positioning System. "QZSS" is an abbreviation for Quasi-Zenith Satellite System. The satellites of QZSS are called quasi-zenith satellites. "BDS" is an abbreviation for BeiDou Navigation Satellite System. "GLONASS" is an abbreviation for Global Navigation Satellite System. The positioning unit 26 measures the position of the information presentation device 20.

[0030] The functions of the information presentation device 20 are realized by a processor as the control unit 21 executing the program according to the present embodiment. That is, the functions of the information presentation device 20 are realized by software. The program causes a computer to execute the operations of the information presentation device 20, thereby causing the computer to function as the information presentation device 20. That is, the computer functions as the information presentation device 20 by executing the operations of the information presentation device 20 according to the program.

[0031] The program can be stored in a non-transitory computer-readable medium. Examples of non-transitory computer-readable media include flash memory, magnetic recording devices, optical discs, magneto-optical recording media, or ROM. The program can be distributed, for example, by selling, transferring, or lending a portable medium such as an SD card, DVD, or CD-ROM that stores the program. "SD" is an abbreviation for Secure Digital. "DVD" is an abbreviation for digital versatile disc. "CD-ROM" is an abbreviation for compact disc read only memory. The program can also be distributed by storing it in the server's storage and transferring the program from the server to other computers. The program may be provided as a program product.

[0032] The computer stores, for example, a program stored in a portable medium or a program transferred from a server, once, in the main memory device. Then, the computer reads the program stored in the main memory device with the processor and executes the processing according to the read program with the processor. The computer may directly read the program from the portable medium and execute the processing according to the program. The computer may sequentially execute the processing according to the received program each time a program is transferred from the server to the computer. The processing may be executed by a so-called ASP-type service that realizes the function only by execution instructions and result acquisition without transferring the program from the server to the computer. "ASP" is an abbreviation for application service provider. The program is information for use in processing by an electronic computer and includes things conforming to the program. For example, data that does not directly instruct the computer but has the property of defining the computer's processing corresponds to "things conforming to the program".

[0033] Some or all of the functions of the information presentation device 20 may be realized by a programmable circuit or a dedicated circuit as the control unit 21. That is, some or all of the functions of the information presentation device 20 may be realized by hardware.

[0034] Referring to FIG. 4, the operation of the information presentation device 20 according to the present embodiment will be described. The operations described below correspond to the information presentation method according to the present embodiment. That is, the information presentation method according to the present embodiment includes steps S1 to S9 shown in FIG. 4.

[0035] In S1, the control unit 21 receives an operation in which the user 11 sets the destination 13 via the input unit 24. Specifically, the control unit 21 recognizes a voice input designating a location from the user 11 via a microphone as the input unit 24. Alternatively, the control unit 21 may display a list of destination candidates on a display as the output unit 25, and recognize a touch input for selecting a location from the displayed list by the user 11 via a touch screen as the input unit 24. The control unit 21 sets the designated or selected location as the destination 13. Then, the control unit 21 refers to a map database constructed in an external storage accessible via the storage unit 22 or the communication unit 23, searches for a route to the set destination 13, and starts navigation along the route. For example, when the control unit 21 recognizes an utterance such as "I want to go to the XYZ Shopping Mall" or a tap on the destination candidate "XYZ Shopping Mall", the control unit 21 sets the XYZ Shopping Mall as the destination 13, searches for a route to the XYZ Shopping Mall, and starts navigation.

[0036] In S2, the control unit 21 searches for information related to the destination 13 set in S1. Specifically, as information related to the destination 13, the control unit 21 searches for content such as a homepage introducing the destination 13 on the web or in the cloud via the communication unit 23. Alternatively, the control unit 21 may search for tickets such as coupon tickets or admission tickets that can be used at the facilities at the destination 13 as information related to the destination 13 on the web or in the cloud via the communication unit 23. For example, the control unit 21 searches for the homepage of the XYZ Shopping Mall or a coupon ticket that can be used at a store in the XYZ Shopping Mall.

[0037] In S3, the control unit 21 determines whether there is information related to the destination 13 according to the result of the search in S2. When it is determined that there is information related to the destination 13, such as content introducing the destination 13 or a ticket that can be used at the facilities at the destination 13, that is, when the existence of information related to the destination 13 is detected, the step of S4 is executed. For example, when the homepage of the XYZ Shopping Mall or a coupon ticket that can be used at a store in the XYZ Shopping Mall is found, the step of S4 is executed. On the other hand, when it is determined that there is no information related to the destination 13, that is, when the existence of information related to the destination 13 is not detected, the flow shown in FIG. 4 ends.

[0038] In S4, the control unit 21 displays a banner 14 on the screen to notify the user 11 about information related to the destination 13. Specifically, as in the example shown in FIG. 2, the control unit 21 uses, as the banner 14, an area that prompts the user 11 to view content introducing the destination 13, and displays it on the display as the output unit 25. For example, the control unit 21 displays a notification on the screen such as "At XYZ Shopping Mall, enjoy 15% off at specialty stores from August 1st to 3rd". A link to content introducing the destination 13 is provided on the banner 14. Therefore, when the control unit 21 recognizes a touch input on the banner 14 by the user 11 via the touch screen as the input unit 24, it displays content introducing the destination 13, such as the homepage of the XYZ Shopping Mall, on the display. Alternatively, the control unit 21 may display, as the banner 14, an area on the display that prompts the user 11 to visit a facility at the destination 13 and use a coupon that can be used at that facility. For example, the control unit 21 may display a notification on the screen such as "There is a coupon that can be used at specialty stores. Why not visit the specialty store?"

[0039] In S5, the control unit 21 waits for a certain period of time until it recognizes, via the microphone as the input unit 24, a voice input requesting the saving of the notification by the banner 14 displayed on the screen in S4. For example, the control unit 21 waits until it recognizes an utterance such as "KEEP". If a voice input requesting the saving of the notification is recognized within a certain period of time, the steps of S6 are executed. On the other hand, if a voice input requesting the saving of the notification is not recognized within a certain period of time, the flow shown in FIG. 4 ends. Alternatively, when a voice input requesting the deletion of the notification, such as an utterance of "Unnecessary", is recognized, the flow shown in FIG. 4 may end after the steps of S6 are executed.

[0040] In S6, the control unit 21 saves the notification by the banner 14 according to the voice input recognized in S5. Specifically, the control unit 21 causes the storage unit 22 to store temporary storage data for redisplaying the area displayed as the banner 14 in S4. For example, the control unit 21 saves a notification such as "At the XYZ Shopping Mall, 15% off at specialty stores from August 1st for 3 days" as a bookmark together with a link. Alternatively, the control unit 21 may save a notification such as "There is a coupon that can be used at specialty stores. Why not go to a specialty store?" as a bookmark. These bookmarks are different from general "favorites" in that they are temporarily saved for the user 11 to view later what they cannot see now.

[0041] In S7, the control unit 21 turns off the display of the banner 14.

[0042] In S8, the control unit 21 determines whether the vehicle 12 has arrived at the destination 13. Specifically, the control unit 21 determines that the vehicle 12 has arrived at the destination 13 when the position of the information presentation device 20 measured by the positioning unit 26 matches the destination 13 set in S1. The control unit 21 determines that the vehicle 12 has not arrived at the destination 13 when the position of the information presentation device 20 measured by the positioning unit 26 does not match the destination 13 set in S1. When it is determined that the vehicle 12 has arrived at the destination 13, the step of S9 is executed. On the other hand, when it is determined that the vehicle 12 has not arrived at the destination 13, the step of S8 is executed again.

[0043] In S9, the control unit 21 displays the notification saved in S6 on the screen. Specifically, the control unit 21 refers to the temporarily saved data stored in the storage unit 22, and redisplays, as a banner 14, an area that prompts the user 11 to view content introducing the destination 13 on the display as the output unit 25. For example, the control unit 21 displays, together with a link, the notification "At XYZ Shopping Mall, 15% off at specialty stores from August 1st for 3 days" saved as a bookmark on the screen. When the control unit 21 recognizes a touch input by the user 11 to the banner 14 via the touch screen as the input unit 24, it displays on the display content introducing the destination 13, such as the homepage of the XYZ Shopping Mall. Alternatively, the control unit 21 may refer to the data stored in the storage unit 22 and redisplay on the display an area that prompts the user 11 to visit the facilities at the destination 13 and use the coupons available at those facilities. For example, the control unit 21 may display on the screen the notification "There are coupon tickets available at specialty stores. Why not go to the specialty store?" saved as a bookmark. After S9, the flow shown in FIG. 4 ends.

[0044] When the control unit 21 displays a plurality of banners on the screen, as a result, it may transmit, via the communication unit 23, statistical data regarding the notifications saved in response to voice input from the user 11 and the notifications not saved among the notifications by the plurality of banners to the server device 30. In such an example, the server device 30 instructs the information presentation device 20 to reduce the display frequency of unpopular notifications that were not saved in subsequent times. According to this example, it is possible to provide feedback to the content provider regarding the statistics of popular content and unpopular content, and optimize the banner display, such as reducing the display frequency of unpopular content in subsequent times.

[0045] The present disclosure is not limited to the above-described embodiments. For example, two or more blocks described in the block diagram may be integrated, or one block may be divided. Instead of executing two or more steps described in the flowchart in chronological order according to the description, each step may be executed in parallel or in a different order according to the processing capacity of the device that executes the step, or as necessary. In addition, changes may be made without departing from the spirit of the present disclosure.

Explanation of Signs

[0046] 10 System 11 User 12 Vehicle 13 Destination 14 Banner 20 Information Presentation Device 21 Control Unit 22 Storage Unit 23 Communication Unit 24 Input Unit 25 Output Unit 26 Positioning Unit 30 Server Device 40 Network

Claims

1. A control unit that, when detecting the presence of information related to a destination set by a vehicle occupant, displays a banner on the screen to notify the occupant of the information related to the destination, and includes a control unit that saves the notification by the banner in response to a voice input from the occupant. An information presentation device.

2. The information presentation device according to claim 1, wherein the control unit turns off the display of the banner when saving the notification by the banner.

3. The information presentation device according to claim 1, wherein the control unit displays the saved notification on the screen when determining that the vehicle has arrived at the destination.

4. Further comprising a communication unit that communicates with a server device, The information presentation device according to claim 1, wherein, as a result of displaying a plurality of banners on the screen, the control unit transmits statistical data regarding the notifications saved and not saved in response to the voice input among the notifications by the plurality of banners to the server device via the communication unit.

5. A program for causing a computer that, when detecting the presence of information related to a destination set by a vehicle occupant, displays a banner on the screen to notify the occupant of the information related to the destination, to execute an operation including saving the notification by the banner in response to a voice input from the occupant.

Images