Information presentation device and vehicle

Abstract

The invention provides an information presentation device and a vehicle which enable a person who is closed in the vehicle to unlock and open a vehicle door by himself / herself. The information presentation device (20) is provided with: an output unit provided in the vehicle (12); and a control unit that determines whether or not a person is closed in the vehicle (12) when the door of the vehicle (12) is locked by a locking operation performed other than the vehicle (12), and, when it is determined that a person is closed in the vehicle (12), presents information indicating a sequence in which the door is unlocked and opened via the output unit.

Description

Technical Field

[0001] The present disclosure relates to an information prompting device and a vehicle. Background Art

[0002] In Patent Document 1, there is disclosed a keyless entry system in which, when a person is boarding a vehicle while the vehicle door is locked by a mobile terminal, the situation where a person is boarding is notified to the mobile terminal.

[0003] Prior Art Documents

[0004] Patent Documents

[0005] Patent Document 1: Japanese Unexamined Patent Application Publication No. 2006-062622 Summary of the Invention

[0006] Problems to be Solved by the Invention

[0007] When a person is locked in a vehicle, simply notifying the driver's mobile terminal may not be sufficient to handle the situation. For example, it is conceivable that the driver does not notice the notification or that the unlocking operation cannot be performed due to the depletion of the battery of the mobile terminal. Therefore, although it is desired that the person locked in the vehicle unlock and open the door by themselves, children or the elderly sometimes do not know the unlocking or opening operation method of the door.

[0008] An object of the present disclosure is to enable a person locked in a vehicle to unlock and open the door by themselves.

[0009] Means for Solving the Problems

[0010] The information prompting device according to the present disclosure includes: an output unit provided in the vehicle; and a control unit that determines whether a person is locked in the vehicle when the vehicle door is locked by a locking operation performed outside the vehicle, and when it is determined that a person is locked in the vehicle, prompts information indicating the order of unlocking and opening the door via the output unit.

[0011] Advantages of the Invention

[0012] According to the present disclosure, a person locked in a vehicle can unlock and open the door by themselves. Brief Description of the Drawings

[0013] Figure 1 A diagram showing an example of a vehicle including the information prompting device according to an embodiment of the present disclosure.

[0014] Figure 2A block diagram showing the structure of the information prompting device according to an embodiment of the present disclosure.

[0015] Figure 3 A flowchart showing the operation of the information prompting device according to an embodiment of the present disclosure. Detailed Embodiment

[0016] Hereinafter, an embodiment of the present disclosure will be described with reference to the accompanying drawings.

[0017] In each figure, the same or corresponding parts are marked with the same reference numerals. In the description of the present embodiment, the description of the same or corresponding parts will be appropriately omitted or simplified.

[0018] Refer to Figure 1 to describe the outline of the present embodiment.

[0019] The information prompting device 20 is a computer mounted on the vehicle 12. That is, the information prompting device 20 is provided on the vehicle 12.

[0020] The vehicle 12 is, for example, any type of vehicle such as a gasoline vehicle, a diesel vehicle, a hydrogen vehicle, an HEV, a PHEV, a BEV, or an FCEV. "HEV" is an abbreviation for hybrid electric vehicle. "PHEV" is an abbreviation for plug-in hybrid electric vehicle. "BEV" is an abbreviation for battery electric vehicle. "FCEV" is an abbreviation for fuel cell electric vehicle. Although the vehicle 12 is driven by the driver 11 in the present embodiment, the driving can be automated at any level. The level of automation is, for example, any level from level 1 to level 5 in the SAE level classification. "SAE" is an abbreviation for Society of Automotive Engineers. The vehicle 12 can be a vehicle dedicated to MaaS. "MaaS" is an abbreviation for Mobility as a Service.

[0021] The information prompting device 20 determines whether there is a person in the vehicle 12, that is, whether someone is locked in the vehicle 12, based on a locking operation outside the vehicle 12 that may include the case where the vehicle key of the vehicle 12 is locked inside the vehicle. When the information prompting device 20 determines that someone is locked in the vehicle 12, it notifies the person locked inside of the order to unlock and open the vehicle door via a display or a speaker inside the vehicle 12.

[0022] According to this embodiment, since the order of unlocking and opening the vehicle door is notified to the person confined in the vehicle 12, the possibility that the person can unlock and open the vehicle door by himself / herself and escape from the vehicle 12 is increased.

[0023] When the information prompting device 20 determines that there is a person confined in the vehicle 12, a call can also be started between the mobile terminal of the driver 11 and the information prompting device 20. The call can be either a voice call or a video call. When the information prompting device 20 determines that the confined person is the child 13, a call can also be started between the mobile terminal of the parent of the child 13 other than the driver 11 and the information prompting device 20.

[0024] When the information prompting device 20 determines that the confined person is the child 13, the order of unlocking or opening the vehicle door can also be simplified compared to normal times. For example, the information prompting device 20 can change the order so that unlocking and opening the vehicle door can be simultaneously implemented only by operating the inner handle of the vehicle door.

[0025] When the information prompting device 20 determines that there is a person confined in the vehicle 12, an alarm can also be output toward the outside of the vehicle 12. For example, the information prompting device 20 can pick up the voice in the vehicle 12 through the microphone in the vehicle 12 and output it from the speaker outside the vehicle 12. Or, the information prompting device 20 can also operate the emergency indicator or horn of the vehicle 12. Or, the information prompting device 20 can also display a message indicating that there is a person confined in the vehicle 12 on the display outside the vehicle 12. In particular, when it is determined to be dangerous based on the temperature in the vehicle 12, the remaining amount of the vehicle 12's battery, or the air conditioner of the vehicle 12, the information prompting device 20 can output an alarm toward the outside of the vehicle 12.

[0026] Refer to Figure 2 to describe the structure of the information prompting device 20 according to this embodiment.

[0027] The information prompting device 20 includes a control unit 21, a storage unit 22, a communication unit 23, an input unit 24, and an output unit 25.

[0028] The control unit 21 includes at least one processor, at least one programmable circuit, at least one dedicated circuit, or any combination thereof. The processor is a general-purpose processor such as a CPU or GPU, or a dedicated processor dedicated to specific processing. "CPU" is an abbreviation for central processing unit. "GPU" is an abbreviation for graphicsprocessing unit. The programmable circuit is, for example, an FPGA. "FPGA" is an abbreviation for field-programmable gate array. The dedicated circuit is, for example, an ASIC. "ASIC" is an abbreviation for application specific integrated circuit. While controlling each part of the information presentation device 20, the control unit 21 executes processing related to the operation of the information presentation device 20.

[0029] The storage unit 22 includes at least one semiconductor memory, at least one magnetic memory, at least one optical memory, or any combination thereof. The semiconductor memory is, for example, a RAM, a ROM, or a flash memory. "RAM" is an abbreviation for random access memory. "ROM" is an abbreviation for read only memory. The RAM is, for example, an SRAM or a DRAM. "SRAM" is an abbreviation for static random access memory. "DRAM" is an abbreviation for dynamic random access memory. The ROM is, for example, an EEPROM. "EEPROM" is an abbreviation for electrically erasable programmableread only memory. The flash memory is, for example, an SSD. "SSD" is an abbreviation for solid-state drive. The magnetic memory is, for example, an HDD. "HDD" is an abbreviation for hard disk drive. The storage unit 22 functions as, for example, a main storage device, an auxiliary storage device, or a cache memory. In the storage unit 22, data used in the operation of the information presentation device 20 and data obtained through the operation of the information presentation device 20 are stored.

[0030] The communication unit 23 includes at least one communication module. The communication module is, for example, a module corresponding to a mobile communication standard such as LTE, 4G standard, or 5G standard, or a wireless LAN communication standard such as IEEE 802.11. "LTE" is the abbreviation of Long Term Evolution. "4G" is the abbreviation of 4th generation. "5G" is the abbreviation of 5th generation. "IEEE" is the abbreviation of Institute of Electrical and Electronics Engineers. The communication unit 23 can also communicate with a mobile terminal such as the smart key, mobile phone, smartphone, or tablet computer of the driver 11 via a network such as the Internet. The communication unit 23 receives the information used in the operation of the information presentation device 20, and also transmits the information obtained through the operation of the information presentation device 20.

[0031] The input unit 24 includes at least one input device. The input device is, for example, a physical button, a capacitive button, an indicating device, a touch screen integrated with a display, a visible light camera, a depth camera, LiDAR, or a microphone. "LiDAR" is the abbreviation of light detection and ranging. The input unit 24 accepts an operation of inputting the information used in the operation of the information presentation device 20. For the input unit 24, instead of being provided on the information presentation device 20, it can also be connected to the information presentation device 20 as an external input device. As a connection interface, an interface corresponding to a standard such as USB, HDMI (registered trademark), or Bluetooth (registered trademark) can be used. "USB" is the abbreviation of Universal Serial Bus. "HDMI (registered trademark)" is the abbreviation of High-Definition Multimedia Interface.

[0032] The output unit 25 is provided in the vehicle 12. The output unit 25 includes at least one output device. The output device is, for example, a display or a speaker. The display is, for example, an LCD or an organic EL display. "LCD" is an abbreviation for liquid crystal display. "EL" is an abbreviation for electro luminescent. The output unit 25 outputs the information obtained by the operation of the information presentation device 20. For the output unit 25, instead of being provided on the information presentation device 20, it may be connected to the information presentation device 20 as an external output device such as a display audio. As a connection interface, an interface corresponding to a standard such as USB, HDMI (registered trademark), or Bluetooth (registered trademark) can be used.

[0033] The function of the information presentation device 20 is implemented by the processor as the control unit 21 executing the program according to this embodiment. That is, the function of the information presentation device 20 is implemented by software. The program causes a computer to execute the operation of the information presentation device 20, thereby causing the computer to function as the information presentation device 20. That is, the computer functions as the information presentation device 20 by executing the operation of the information presentation device 20 in accordance with the program.

[0034] The program can be pre-stored in a non-temporary computer-readable medium. The non-temporary computer-readable medium is, for example, a flash memory, a magnetic recording device, an optical disc, a magneto-optical recording medium, or a ROM. The distribution of the program is, for example, implemented by selling, transferring, or lending a removable medium such as an SD card, a DVD, or a CD-ROM storing the program. "SD" is an abbreviation for Secure Digital. "DVD" is an abbreviation for digital versatile disc. "CD-ROM" is an abbreviation for compact disc read only memory. The program can also be distributed by pre-storing the program in a storage of a server and transmitting the program from the server to other computers. The program can also be provided as a program product.

[0035] A computer, for example, temporarily stores a program stored in a removable medium or a program transmitted from a server in a main storage device. Then, in the computer, the processor reads the program stored in the main storage device and performs processing according to the read program. The computer can also directly read the program from the removable medium and perform processing according to the program. The computer can also execute processing according to the received program sequentially each time a program is transmitted from the server to the computer. It is also possible to perform processing through a so-called ASP-type service that realizes functions only based on execution instructions and result acquisition without performing the transmission of the program from the server to the computer. "ASP" is an abbreviation for Application Service Provider. A program is information for processing performed by an electronic computer and includes content regarded as a program. For example, data that is not a direct instruction for a computer but has the nature of prescribing the processing of the computer is equivalent to "content regarded as a program".

[0036] Part or all of the functions of the information prompting device 20 can also be implemented by a programmable circuit or a dedicated circuit as the control unit 21. That is, part or all of the functions of the information prompting device 20 can also be implemented by hardware.

[0037] Refer to Figure 3 to describe the operation of the information prompting device 20 according to this embodiment. The operations described below correspond to the information prompting method according to this embodiment. That is, the information prompting method according to this embodiment includes Figure 3 the steps S1 to S6 shown.

[0038] When the door of the vehicle 12 is locked by a locking operation performed outside the vehicle 12, the step of S1 is started. The locking operation can be an operation in which the driver 11 uses a key to lock the door near the vehicle 12, or can also be an operation in which the driver 11 uses a mobile terminal to lock the door remotely.

[0039] In S1, the control unit 21 determines whether there is a person locked in the vehicle 12. Specifically, the control unit 21 determines whether there is a person sitting on a seat such as the passenger seat or the rear seat in the vehicle 12 through an in-vehicle camera or a seating sensor. The control unit 21 can also further determine whether there is a person in a space such as the floor or the trunk of the vehicle 12 through the in-vehicle camera.

[0040] If it is determined in S1 that there is a person locked in the vehicle 12, the step of S2 is executed. On the other hand, if it is determined in S1 that there is no person locked in the vehicle 12, thenFigure 3 The process shown ends.

[0041] In S2, the control unit 21 prompts information indicating the order of unlocking and opening the vehicle door via the output unit 25. Specifically, the control unit 21 causes a message explaining the order of unlocking and opening the vehicle door to be displayed on the in-vehicle display or output as voice from the in-vehicle speaker. Alternatively, the control unit 21 may also play a video explaining the order of unlocking and opening the vehicle door via the in-vehicle display and the in-vehicle speaker.

[0042] When the control unit 21 determines that the person trapped is the child 13, it may simplify the order of unlocking or opening the vehicle door compared to normal times. In this case, the control unit 21 prompts the information indicating the simplified order via the output unit 25.

[0043] In S3, as a result of the steps in S2, the control unit 21 determines whether the vehicle door has been unlocked and opened. Specifically, the control unit 21 determines whether any one of the vehicle doors of the vehicle 12 has been unlocked and opened through the door sensor. The control unit 21 may further determine whether the trapped person has escaped from the vehicle 12 through the in-vehicle camera or the seating sensor.

[0044] In the case where it is determined in S3 that the vehicle door has been unlocked and opened, make Figure 3 The process shown ends. On the other hand, in the case where it is determined in S3 that the vehicle door has not been unlocked or opened, the steps of S4 are executed. Alternatively, in the case where it is determined that although the vehicle door has been unlocked and opened in S3 but the trapped person has not escaped from the vehicle 12, the steps of S4 may also be executed.

[0045] In S4, the control unit 21 starts a call with the driver 11 via the communication unit 23. When the control unit 21 determines that the person trapped is the child 13, it may also start a call with the parents of the child 13 other than the driver 11 via the communication unit 23.

[0046] In S5, the control unit 21 determines whether the vehicle door has been unlocked and opened as a result of the steps in S4. Specifically, the control unit 21 determines whether any one of the vehicle doors of the vehicle 12 has been unlocked and opened through the door sensor. The control unit 21 may also further determine whether the trapped person has escaped from the vehicle 12 through the in-vehicle camera or the seating sensor.

[0047] In the case where it is determined in S5 that the vehicle door has been unlocked and opened, make Figure 3The process shown ends. On the other hand, when it is determined in S5 that the vehicle door has not been unlocked or opened, the step of S6 is executed. Alternatively, when it is determined that although the vehicle door has been unlocked and opened in S5 but the person inside has not exited the vehicle 12, the step of S6 can also be executed.

[0048] In S6, the control unit 21 outputs an alarm toward the outside of the vehicle 12. Specifically, the control unit 21 causes a message indicating that someone is trapped in the vehicle 12 to be displayed on the external display or outputs voice from the external speaker. When the temperature inside the vehicle 12 exceeds a threshold value, the control unit 21 can also further display a message indicating danger on the external display or further output voice from the external speaker.

[0049] The steps of S3 and S4 can also be executed after the steps of S5 and S6. The steps of S3 and S4 can be omitted. The steps of S5 and S6 can be omitted.

[0050] The present disclosure is not limited to the above-described embodiments. For example, two or more blocks described in the block diagram can be combined, or one block can be divided. Instead of executing two or more steps described in the flowchart in time series according to the description, they can be executed in parallel or in a different order according to the processing capabilities of the devices that execute each step or as needed. In addition, changes can be made within the scope not departing from the gist of the present disclosure.

[0051] Reference Signs

[0052] 11, Driver;

[0053] 12, Vehicle;

[0054] 13, Child;

[0055] 20, Information Prompt Device;

[0056] 21, Control Unit;

[0057] 22, Storage Unit;

[0058] 23, Communication Unit;

[0059] 24, Input Unit;

[0060] 25, Output Unit.

Claims

1. An information prompting device, comprising: an output unit disposed in the vehicle; A control unit determines whether a person is trapped in the vehicle when the vehicle doors are locked by a locking operation performed outside the vehicle, and when it is determined that a person is trapped in the vehicle, prompts information indicating the order of unlocking and opening the vehicle doors via the output unit.

2. The information prompting device according to claim 1, wherein: The vehicle further comprises a communication unit configured to communicate with a mobile terminal of a driver of the vehicle. The control unit starts a conversation with the driver via the communication unit when determining that a person is trapped in the vehicle.

3. The information prompting device according to claim 1, wherein: When the control unit determines that a person is locked in the vehicle and the locked person is a child, the control unit simplifies the procedure of unlocking or opening the door compared to a normal procedure.

4. The information prompting device according to claim 1, wherein: The control unit outputs an alarm to the outside of the vehicle when determining that a person is trapped in the vehicle. 5 . A vehicle comprising the information presenting device according to claim 1 .

Images