Systems and programs
Patent Information
- Application Number
- JP2023174931
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2023-10-10
- Publication Date
- 2025-04-25
- Estimated Expiration
- 2040-09-30
AI Technical Summary
Conventional vehicle monitoring systems fail to address issues such as preventing accidents caused by leaving children or pets in parked vehicles, including heat stroke and hypothermia, as they are focused primarily on vandalism and theft prevention.
A vehicle monitoring system with detection functions for the interior of parked vehicles, including image analysis to identify occupants, temperature sensing, and sound detection, coupled with output functions to notify users of potential dangers and enable remote control of vehicle conditions.
Enables timely notification and prevention of accidents by informing drivers of potential dangers within their vehicles, allowing them to take corrective action to prevent heat stroke or hypothermia, and ensuring children or pets are not left unattended.
Smart Images

Figure 00000019_0000 
Figure 00000019_0001 
Figure 00000020_0000
Abstract
Description
[Technical Field]
[0001] The present invention relates to, for example, a system and a program. [Background technology]
[0002] For example, there is a drive recorder that prevents the in-vehicle battery from running down and enhances security functions while the vehicle is parked, as shown in Patent Document 1. Patent Document 1 discloses that by continuing to record at a frame rate that is lower than the frame rate while driving, even while the vehicle is parked, measures can be taken not only to prevent accidents while driving, but also to prevent car break-ins, vandalism to the vehicle, and incidents around the vehicle, which often occur when the vehicle is left unattended. [Prior art documents] [Patent documents]
[0003] [Patent Document 1] Japanese Patent Publication No. 2020-149433 Summary of the Invention [Problem to be solved by the invention]
[0004] One of the objectives of this technology is to provide a technology that differs from conventional vehicle monitoring. For example, conventional monitoring while parked aims to prevent vandalism and theft of vehicles, but it cannot solve problems such as preventing children from being left in the vehicle or preventing accidents such as heatstroke caused by children trapped inside the vehicle.
[0005] The above-mentioned problems are stated as independent, and the present invention does not necessarily solve all of the problems stated. The purpose of the present invention is not limited to these, and the applicant intends to obtain rights for configurations that aim to achieve the effects achieved by parts of the configuration disclosed in the specification and drawings, etc., through divisional applications, amendments, etc. For example, this specification discloses a problem in which the phrase "can be" is read as "the problem is...". The problems are stated as independent, and the applicant intends to obtain rights for configurations that solve these problems separately through divisional applications, amendments, etc. Even if the problem is implicitly understood from the description in the specification, the applicant intends to claim part of the configuration described in this specification through amendments or divisional applications. Problems that combine these independent problems are also disclosed. [Means for solving the problem]
[0006] The following is an example of a conventional means for solving the problems related to vehicle monitoring.
[0007] (1) A system having a detection function for detecting the state of the interior of a parked and / or stopped vehicle and an output function for outputting predetermined information based on the detection results is desirable. In this way, predetermined information based on the state of the interior of the vehicle is output, allowing the state of the interior of the vehicle to be known. The output function may be, for example, a system that directly notifies the user or transmits the information via communication to an external device. The predetermined information may be, for example, the detection result itself, information used during detection, or other information.
[0008] (2) The state of the vehicle interior detected by the detection function may be whether or not a person is present in the rear seat of the vehicle. In this way, for example, if a person is present in the rear seat, a predetermined output is generated, so the driver can know that there is a person in the rear seat, and it is possible to prevent, for example, children from being left behind. Furthermore, even if a child or other person is left in the vehicle, it is possible to confirm that the child is still in the vehicle, and it is possible to prevent an accident from occurring by, for example, returning to the vehicle as soon as possible.
[0009] (3) The state of the vehicle interior detected by the detection function may be whether or not a person is in a child car seat installed in the vehicle. In this way, for example, if a child is in the child car seat, a predetermined output is made, so the driver can know that a child is in the child car seat and, for example, can prevent the child from being left behind. Furthermore, even if a child is left in the vehicle, the driver can confirm that the child is still in the vehicle, for example, by returning to the vehicle as soon as possible, thereby preventing an accident from occurring.
[0010] (4) It is preferable to provide a function for analyzing images acquired from the means for photographing the rear seat of the vehicle or the child car seat to determine whether or not a person is present in the image. This is advantageous because the presence of a person can be reliably determined through image analysis. If the image analysis is performed by an image processing circuit (edge side) installed in the vehicle, the amount of data transmitted after the analysis can be reduced.
[0011] (5) When the image analysis is performed and the presence of a person is detected in the image, the output function may transmit the detection result without transmitting the image. In this way, when a person is detected, the detection result is transmitted, but image data is not transmitted, so notification can be made quickly and the amount of data transmitted can be reduced.
[0012] (6) The state of the vehicle interior detected by the detection function may be the presence or absence of an object moving within the vehicle interior. The object moving within the vehicle interior may be, for example, a person or an animal, so the driver or the like can be notified of the presence of such an object and can prevent the object from being left behind in the vehicle.
[0013] (7) The detection function may acquire sounds heard within the vehicle cabin and detect a dangerous situation from the acquired sounds, and the output function may communicate and notify an external party when the dangerous situation is detected. In this way, for example, a driver or other person away from the vehicle can be notified that the vehicle is in a dangerous situation. This allows the driver or other person to quickly return to the vehicle. Sounds heard within the vehicle cabin may include, for example, sounds generated within the vehicle cabin, such as the voices of people remaining in the vehicle, sounds generated from the vehicle, and sounds generated around the vehicle that are heard within the vehicle cabin.
[0014] (8) The detection function may detect a dangerous state based on the temperature inside the vehicle cabin, and the output function may communicate with an external device to notify the driver when the dangerous state is detected. In this way, for example, a driver or other person away from the vehicle can be notified that a dangerous state has occurred in the vehicle. This allows the driver or other person to quickly return to the vehicle.
[0015] (9) The detection function detects a dangerous condition based on the temperature inside the vehicle. The output function may be configured not to transmit the predetermined information to the outside if the dangerous state is not detected. In this way, for example, if the driver intentionally leaves a child or the like in the vehicle, no notification will be sent if the temperature inside the vehicle is not dangerous, eliminating the annoyance of receiving unnecessary notifications and preventing the driver from becoming accustomed to the notifications. Therefore, for example, necessary information can be sent when needed.
[0016] (10) The predetermined information may be the detection result, so that the driver or the like can know the state of the interior of the vehicle based on the detection result.
[0017] (11) The detection function may detect the state of the vehicle interior based on the output of a seating sensor provided on a child seat installed in the vehicle. In this way, the presence or absence of a child can be reliably detected and an appropriate output can be made based on the result.
[0018] (12) It is preferable to have a means for detecting the driver's movements, and the output function outputs an alarm when the driver gets off the vehicle with a person still in the child car seat. In this way, the driver can confirm that there is a person (e.g., a child) in the child car seat when getting off the vehicle, preventing the driver from accidentally leaving the child behind. Also, if the driver gets off the vehicle knowing that a child is still in the vehicle, the driver can return quickly, preventing an accident from occurring.
[0019] (13) It is preferable to provide a function that prevents the vehicle doors from being locked when a person is in the child car seat, thereby preventing a child from being left locked inside the vehicle.
[0020] (14) If there is a person in the child car seat, when the vehicle doors are locked, it is preferable to provide a function that notifies the driver that there is a person in the child car seat and prevents the doors from being locked, and if the locking operation is performed after the notification, the doors are locked. In this way, the presence of a person in the child car seat is notified when the locking operation is performed, which prevents the child from being left unintentionally in the vehicle, and further, if the child is intentionally left in the vehicle, the vehicle doors can be locked.
[0021] (15) The detection function detects the temperature inside the vehicle cabin, and the output function transmits to a specified communication destination when the temperature inside the vehicle cabin meets a condition, and it is preferable that the vehicle be equipped with a function to change the condition inside the vehicle cabin by remotely controlling the terminal of the specified communication destination.
[0022] In this way, by appropriately setting the conditions, it is possible to know, for example, whether the temperature inside the vehicle cabin is high enough to cause heatstroke or the like, whether the temperature is low enough to cause hypothermia or the like, or whether the vehicle is in a state one step away from reaching such a dangerous state.The driver can then, for example, return to the vehicle and quickly take measures to avoid such a dangerous state.Furthermore, the state inside the vehicle cabin can be changed by remotely operating the vehicle from the communication destination terminal, which is advantageous in that it is possible to more quickly avoid a dangerous state inside the vehicle.
[0023] (16) The detection function may have a function of taking pictures of the interior of the vehicle, and the output function may transmit the taken pictures to a predetermined communication destination. In this way, a user such as a driver who is away from the vehicle can know the state of the interior of the vehicle, and can appropriately determine whether or not it is necessary to return to the vehicle and take appropriate action.
[0024] (17) Each of the above functions may be implemented by a drive recorder.
[0025] (18) A smart band may be attached to a child's leg or arm to detect the child's biological information, and the state of the vehicle interior detected by the detection function is the biological information of the child inside the vehicle, and the output function may be realized by a communication function of the smart band that transmits the biological information. In this way, a user such as a driver who is away from the vehicle can know the state of the child inside the vehicle and can appropriately determine whether or not it is necessary to return to the vehicle and take appropriate action.
[0026] (19) It is preferable to provide a program for causing a computer to realize the functions of any one of the systems (1) to (18).
[0027] The above-described system may be configured from one device or multiple devices.
[0028] The inventions (1) to (18) above can be combined in any way. For example, it is possible to combine all or part of the configuration of the invention shown in (1) with at least part of the configuration of at least one invention from (2) onwards. In particular, it is preferable to combine the invention shown in (1) with at least part of the configuration of at least one invention from (2) onwards. The applicant intends to obtain patent rights, design rights, etc. for those including these configurations by filing amendments, divisional applications, or applications for conversion to design registration applications, etc. [Effects of the Invention]
[0029] According to the present invention, the driver can check the status of the vehicle interior. Furthermore, depending on the timing of the output, the driver can check the status when getting out of the vehicle or after leaving the vehicle. The driver can then take measures to prevent a dangerous situation from occurring.
[0030] The effects of the present invention are not limited to these, and effects achieved by the components disclosed in the present specification and drawings, etc., are also disclosed, and the applicant intends to obtain rights to the components that achieve these effects through divisional applications, amendments, etc. For example, in this specification, statements such as "can..." clearly state the effects that are achieved, and there are also parts that demonstrate the effects even without the statement "can...". Furthermore, there are effects that can be understood from the components even without such statements. [Brief explanation of the drawings]
[0031] [Figure 1] 1 is a diagram showing a preferred embodiment of a system according to the present invention; [Figure 2] 1 is a block diagram showing a preferred embodiment of a system according to the present invention; [Figure 3] FIG. 10 is a block diagram illustrating another embodiment. [Figure 4] 10 is a flowchart illustrating another embodiment. [Figure 5] 10 is a flowchart illustrating another embodiment. [Figure 6]FIG. [Figure 7] FIG. DETAILED DESCRIPTION OF THE INVENTION
[0032] Hereinafter, embodiments of the present invention will be described with reference to the drawings. These drawings are used to explain technical features that may be adopted by the present invention. The configurations and shapes of the described devices are merely illustrative examples, and the present invention should not be construed as being limited thereto. Various changes, modifications, and improvements may be made based on the knowledge of those skilled in the art without departing from the scope of the present invention. In the following description, labeling using numbers such as "1" and "2" is intended to identify each element and does not define the number of elements.
[0033] [Background to the concept of the present invention] Child car seats are mandatory for drivers with children under the age of six. Even for children over six, it is recommended that they use a child car seat appropriate for their growth until they reach the height of 140 cm, the minimum height required to wear a seat belt. Some child car seats are installed in the rear seat of a vehicle. For example, accidents involving children left in child car seats and trapped inside the vehicle, such as heatstroke, have become a social problem. These accidents can occur for a variety of reasons, including drivers forgetting about their child in a child car seat and exiting the vehicle without taking them in. Drivers may also notice the child but exit the vehicle thinking, "It'll be okay if I'm out shopping" or "I'll be back soon, so it'll be fine." Furthermore, if a driver leaves the engine running and the air conditioner running, out of consideration for the child remaining inside the vehicle, the air conditioner may shut off for some reason, causing the temperature inside the vehicle to rise, putting the child at risk of heatstroke or other illnesses. Regardless of whether a child car seat is installed or not, a similar situation may occur, for example, when the driver plans to return soon, but leaves the vehicle with a child inside, and takes longer than expected to return to the vehicle. Accidents that can occur when a child is left unattended in a parked vehicle are not limited to heatstroke caused by the temperature rise inside the vehicle, but also include hypothermia caused by a drop in the temperature inside the vehicle in winter, for example. The following embodiment is an example of an embodiment for solving such a problem.
[0034] [Basic configuration of one embodiment of the system] 1 and 2 show a preferred embodiment of the system. The system of this embodiment includes a drive recorder 10, which is an embodiment of electronic equipment or in-vehicle equipment, and a power supply device 30 that supplies power to the drive recorder 10. By receiving power from the power supply device 30, the drive recorder 10 can operate for a predetermined period of time, even when the vehicle is parked with the engine or the like turned off. Furthermore, the drive recorder 10 alone constitutes one embodiment of the system of the present application.
[0035] In this embodiment, the drive recorder 10 is a device that is installed later in the vehicle 1. The drive recorder 10 is attached to an appropriate position, such as a predetermined position above the windshield 2 of the vehicle 1 or on the dashboard. In the illustrated example, a child seat 4 is installed in the rear seat 3 of the vehicle 1. The child seat 4 is, for example, a child support device, such as a child seat for infants (also called a baby seat), a child seat for toddlers, or a child seat for school children (also called a junior seat).
[0036] The power supply device 30 is interposed between the vehicle and the drive recorder 10 and supplies power to the drive recorder 10. The power supply device 30 is configured in a separate housing from the drive recorder 10. The power supply device 30 includes a charge / discharge control unit 30a, a DC-DC converter 30b, a CPU 30c, and an internal battery 30d. The charge / discharge control unit 30a controls charging of the internal battery 30d and power supply to the drive recorder 10. The internal battery 30d is a secondary battery, for example, a nickel-metal hydride rechargeable battery. The DC-DC converter 30b converts a voltage of 12V or 24V supplied from the vehicle battery to a voltage of 5V via the charge / discharge control unit 30a and outputs the converted voltage. The CPU 30c uses a memory (for example, a RAM) (not shown) as a work area to control each component of the power supply device 30, such as the charge / discharge control unit 30a. The CPU 30c also communicates with the drive recorder 10 connected via a cable 5. The cable 5 includes a power line and a communication line.
[0037] The charge / discharge control unit 30a receives power from the internal battery 30d. While power is being supplied from the vehicle's battery, the charge / discharge control unit 30a controls the power supply path so that power is supplied from the vehicle's battery to the internal battery 30d and the DC-DC converter 30b. As a result, the internal battery 30d is charged, and the DC-DC converter 30b supplies voltage-converted power to the drive recorder 10. The charge / discharge control unit 30a determines whether the vehicle's ACC is on or off and switches between charging and discharging the internal battery 30d. When the charge / discharge control unit 30a determines that the ACC is on, it controls so that power is supplied from the vehicle's battery to the internal battery 30d and the DC-DC converter 30b. When the charge / discharge control unit 30a determines that the ACC is off, it controls so that the internal battery 30d is discharged and so that power is supplied from the internal battery 30d to the DC-DC converter 30b.
[0038] As described above, while the ACC is ON, the power supply device 30 receives power from the vehicle battery and outputs power to the drive recorder 10. When the power supply from the vehicle battery is cut off, the power supply device 30 outputs power to the drive recorder 10 using the internal battery 30d for a specified time after the power supply is cut off. After the specified time has elapsed, the power output is turned off. When the power supply from the vehicle battery is resumed, the power supply device 30 again outputs power to the drive recorder 10 using the vehicle battery.
[0039] This allows the drive recorder 10 to continue operating for a specified time after the ACC is turned off and the power supply from the vehicle battery is cut off. The specified time may be set, for example, by serial communication from the drive recorder 10. When the drive recorder 10 receives a battery switching signal from the power supply device 30, it transmits a signal commanding the specified time. The CPU 30c may set the specified time to the set value of the specified time included in the signal commanding the specified time that it receives.
[0040] It is also advisable to provide a DIP switch or other operating unit in the power supply device 30 so that it has a function for setting a specified time. In this way, for example, even a drive recorder without a communication function can continue to be supplied with power for a specified time after the supply from the vehicle battery is cut off.
[0041] When the power supply from the vehicle battery is interrupted, the power supply device 30 switches the power supply source to the internal battery 30d and supplies power to the drive recorder 10. Because the drive recorder 10 continues to receive power before and after the switch, the drive recorder 10 cannot determine whether the power supply source is the vehicle battery or the internal battery 30d. For this reason, when the CPU 30c switches the power supply source to the internal battery 30d, it sends a battery switching signal to the drive recorder 10. If the ACC is turned ON after the power supply device 30 turns OFF its output after a specified time has elapsed, the drive recorder 10 resumes the power supply that had been stopped, and can therefore determine that the ACC is ON. On the other hand, if the ACC is turned ON within the specified time, the drive recorder 10 continues to receive power, and therefore cannot determine whether the power supply source is the vehicle battery or the internal battery 30d. Therefore, if the ACC is turned on within the specified time, the CPU 30c transmits a vehicle switching signal to notify that the power supply source has been switched to the vehicle battery. This allows the drive recorder 10 to recognize that the ACC has been turned on and the power supply source has been switched to the vehicle battery. The drive recorder 10 may switch its operating mode in response to the input of the battery switching signal and the vehicle switching signal.
[0042] The drive recorder 10 has functions such as capturing an image of a predetermined area using a camera as a capturing device, generating the captured image and other data, and outputting the generated data. Data output includes output for recording the data in a storage area, output (i.e., transmission) of the data via communication, and output to an external device via a data output terminal. Furthermore, the predetermined area captured by the drive recorder 10 of this embodiment may be, for example, the front area of the vehicle and the interior area including the child seat 4 in the vehicle cabin. The camera for capturing the front area and the interior area may be, for example, a plurality of cameras, each with its field of view facing the respective area, or a camera with a field of view of 360° or greater may be used to capture the front and interior area with a single camera. Using multiple cameras is particularly advantageous because it allows for accurate capture of the area including the child seat.
[0043] The drive recorder 10 includes a camera 11, a microphone 12, an anomaly detection sensor 13, a GPS module 14, an operation unit 15, a control unit 16, a temporary storage memory 17, a monitor 18, a speaker 19, a memory card slot 20, a microwave sensor 22, a temperature and humidity sensor 23, and a communication unit 24. The camera 11 may be one or more cameras, and captures images of a predetermined area, such as the front of the vehicle, and a predetermined area inside the vehicle cabin. The microphone 12 collects, for example, ambient sounds. The microphone 12 collects, for example, the voices of passengers inside the vehicle and other sounds generated inside the vehicle cabin, as well as impact sounds when an object collides with the vehicle. The anomaly detection sensor 13 is, for example, an acceleration sensor or a six-axis sensor (integrated with three-axis acceleration and three-axis angular velocity), and detects vehicle conditions such as impacts applied to the vehicle, vehicle acceleration, and tilt.
[0044] The control unit 16 estimates that an accident (collision) has occurred when the detection value of the abnormality detection sensor 13 exceeds a threshold value or shows a predetermined temporal change indicating, for example, the occurrence of an impact. In addition to the occurrence of an accident, the control unit 16 may also be used to detect driving conditions such as sudden braking, sudden steering, sudden acceleration, and sudden braking, and to record the history of these conditions.
[0045] The GPS module 14 receives GPS signals based on the positioning. GPS is a satellite positioning system known as the Global Navigation Satellite System (GNSS). The GPS module 14 is an example of a GPS (Global Navigation Satellite System). Positioning using GNSS is commonly known as GPS positioning. GPS signals are signals that can be received from GPS satellites. The GPS module 14 obtains position information (longitude, latitude) of the current position from the received GPS signals using a unique algorithm. The control unit 16 may obtain the position information output from the GPS module 14, for example, periodically (for example, every second).
[0046] The operation unit 15 is a button that issues various instructions to the control unit 16, and has a function to issue an instruction to start recording, for example. When the operation unit 15 is pressed, the control unit 16 may perform event recording, which starts recording the video captured by the camera 11 and the sound collected by the microphone 12. The operation unit 15 may also have a function to issue an instruction to stop recording. The instruction to start recording and the instruction to stop recording may be issued by different buttons, for example, but it is also preferable to issue them by different operations on the same button. This reduces the number of buttons and advantageously reduces the size of the drive recorder 10.
[0047] The temporary storage memory 17 is, for example, a RAM that temporarily stores video data captured by the camera 11. The control unit 16 constantly stores video data captured at least a certain amount of time in the past. Since the storage capacity is limited, the control unit 16 deletes old video data according to a certain criterion. The certain criterion may be, for example, video data stored a certain amount of time ago or when the storage memory capacity exceeds a certain amount. In this embodiment, the temporary storage memory 17 may be, for example, a ring buffer.
[0048] The monitor 18 is a display unit that displays images. The control unit 16 displays, for example, video data captured by the camera 11 on the monitor 18 in real time. The speaker 19 outputs sound. The control unit 16 outputs predetermined sounds from the speaker 19 during predetermined recording, alarm, operation, etc. The control unit 16 uses the speaker 19 to notify, for example, operation sounds in the operation unit 15 and various messages (guides, alarms, etc.).
[0049] The memory card slot 20 allows, for example, a microSD card 21 to be attached and detached. When the microSD card 21 is attached, the control unit 16 reads and writes data from and to the microSD card 21. The microSD card 21 is a storage medium on which data such as video and location information is recorded by the drive recorder 10. The microSD card 21 is an external storage means that is attachable and detachable to the memory card slot 20. However, instead of or in combination with this, an internal storage means of the drive recorder 10 (e.g., a hard disk or EEPROM) or other storage means may be used. However, in order to protect the data stored in the storage means, it is desirable for the drive recorder 10 to be able to access a system that can record data without using an environment that is accessible to the general public (e.g., a cloud computing environment).
[0050] The microwave sensor 22 detects, for example, the movement of an object inside the vehicle, and may be configured to detect the movement of an object (such as a person) on the rear seat 3 or on the child seat 4. The temperature and humidity sensor 23 detects the temperature and humidity inside the vehicle. The communication unit 24 may be, for example, an LTE-M module capable of LTE (Long Term Evolution) communication.
[0051] The control unit 16 is a microcomputer equipped with a CPU, ROM, RAM, non-volatile memory, I / O, etc., and executes predetermined processing based on information input from the various input devices (camera 11, microphone 12, anomaly detection sensor 13, GPS module 14, operation unit 15, temporary storage memory 17, memory card slot 20, microwave sensor 22, temperature and humidity sensor 23, etc.), and outputs predetermined information using output devices (temporary storage memory 17, monitor 18, speaker 19, memory card slot 20, communication unit 24, etc.). The functions of the drive recorder 10 are stored in the EEPROM of the control unit 16 as programs executed by a computer included in the control unit 16, and are realized by the computer executing these programs. Functions realized by the computer using the programs stored in the control unit 16 include various control functions for the drive recorder 10. The control unit 16 has functions such as recording data such as video and location information, outputting data, and displaying images (video).
[0052] The control unit 16 is a circuit for implementing the basic functions of the drive recorder 10. It stores video data captured by the camera 11 as a video file in the temporary storage memory 17, and stores the captured video file in a non-volatile memory based on a detection signal from the abnormality detection sensor 13 or a press on the operation unit 15. In this embodiment, a microSD card 21 inserted in the memory card slot 20 is used as the non-volatile memory. By removing the microSD card 21 and inserting it into a memory card reader or the like connected to a PC, data can be imported into the PC and the video file can be played back using a viewer installed on the PC. Recorded video and other data can be transmitted via wired or wireless communication, rather than simply being retrieved by removing and inserting the microSD card 21 as described above. For wired communication, the drive recorder 10 may be provided with a connector, USB, or the like for connecting a communication cable.
[0053] The function of recording this video data (recording function) will be explained in more detail. For example, when the engine is started and the ACC is ON, the camera 11 constantly captures images of the surroundings of the vehicle. The control unit 16 then stores the video data captured by the camera 11 in a temporary storage memory 17 such as a ring buffer. The video stored in the temporary storage memory 17 is updated to the latest video sequentially, and past video data is held for a set period of time.
[0054] When the output value of the abnormality detection sensor 13, which may be due to an impact such as an accident, sudden braking, or sudden steering, exceeds a threshold or shows a predetermined temporal change, the control unit 16 reads video data from the temporary storage memory 17 for a certain period before the impact was detected and stores it in a nonvolatile memory, such as the microSD card 21. After the threshold is exceeded, the control unit 16 records the video captured by the camera 11 on the microSD card 21 directly or via the temporary storage memory 17. This allows video footage spanning a predetermined period before and after the impact to be stored in the microSD card 21, which is a nonvolatile memory. At this time, the control unit 16 also records the surrounding sounds collected by the microphone 12 in association with the video data. The control unit 16 also temporarily stores this recording in the temporary storage memory 17, and when storing the video data on the microSD card 21, it also stores the recorded audio data on the microSD card 21.
[0055] The storage of data in the micro SD card 21 in the drive recorder 10 is not limited to being triggered by the detection signal from the abnormality detection sensor 13 as described above. The control unit 16 may have a function to trigger the storage of data by, for example, pressing the operation unit 15. In this way, video recording can be performed when a situation occurs that the user wants to record.
[0056] Furthermore, recording to the microSD card 21 is not limited to an event recording mode, which is performed when a recording start condition is met, such as when an accident or the like occurs based on the output of the abnormality detection sensor 13 or when a recording start condition is met, such as when the operation unit 15 is pressed. For example, a continuous recording mode, in which recording is performed to the microSD card 21 from when the drive recorder 10 is turned on until it is turned off, may be provided. The continuous recording mode is a mode in which continuous recording is performed, which is an example of recording other than event recording. When the continuous recording mode is provided, the control unit 16 may record the video data output from the camera 11 and the audio data output from the microphone 12 directly to the microSD card 21, rather than to the temporary storage memory 17. Recording directly to the microSD card 21 in this manner advantageously eliminates the need for a process of writing the data to the temporary storage memory 17.
[0057] Furthermore, when video data, etc., is written directly to the microSD card 21 and the device has a continuous recording mode and an event recording mode, when the control unit 16 meets the event recording start condition, it is preferable that the control unit 16 use the data recorded as continuous recording for the past section from the time the condition was met.The control unit 16 may then record the event recording as, for example, a file separate from the file for continuous recording.The event recording mode is a mode in which event recording is performed.Event recording is performed when a specified event (an example of a phenomenon) occurs.Event recording is performed when a specified event occurs, even if the user does not explicitly instruct the start of recording.
[0058] When the vehicle is parked with the engine stopped (ACC OFF), it is preferable that the system operates in parking monitoring mode, and record video data captured by the camera 11 and the like to the microSD card 21 according to set operating conditions. Recording in parking monitoring mode may include, for example, continuous recording, which constantly records images captured for a predetermined recording time (e.g., 30 minutes), as when the ACC is ON, and event recording, which continuously records video data for a predetermined time when the abnormality detection sensor 13 detects an abnormality. Event recording is performed when event conditions are met, such as "detection of the approach of a person or vehicle," "detection of an impact of a certain level or more," "detection of the vehicle tilt of a certain level or more (e.g., jacked up)," or "detection of the vehicle door opening." The abnormality detection sensor 13 is equipped with one or more sensors for performing these detections.
[0059] [In-vehicle danger alert and avoidance function] The drive recorder 10 has a function to notify the driver or the like and to perform predetermined risk avoidance processing if a dangerous situation occurs inside the vehicle while the vehicle is stopped or parked. Dangerous situations include, for example, children being left behind in the vehicle, or situations in which children left inside the vehicle may be at risk of heat stroke or other life-threatening conditions. When the drive recorder 10 receives a battery switching signal from the power supply device 30 (ACC is turned off), it switches to a monitoring mode that monitors whether or not there is a dangerous situation inside the vehicle, and the control unit 16 performs the following processing.
[0060] *Image-based detection The control unit 16 has an image analysis function that analyzes whether a person is present in the image being processed. When switching to monitoring mode, the control unit 16 acquires an image captured by the camera 11, which captures an area including the child seat 4, and performs image analysis to determine whether a person is present. If a person is detected in the image, the control unit 16 transmits predetermined information to a registered destination using the communication unit 24. The predetermined information may be a notification of the presence of a child, the acquired image, temperature and humidity information in the vehicle interior acquired from the temperature and humidity sensor 23, and location information acquired from the GPS module 14. However, transmitting only the recognition results without sending the images can reduce communication traffic and enable faster notification. Furthermore, image analysis can be performed by software, but it is also preferable to use a chip equipped with image recognition functionality that transmits only the recognition results to a server without sending images.
[0061] The registered destination may be, for example, a server 32 such as a cloud server or the driver's smartphone 33. The server 32 associates and stores information about the drive recorder 10 and the user's destination. When predetermined information is sent from the drive recorder 10, the server 32 stores the received information and transmits all or part of the acquired information to the associated user's destination. As a result, for example, if a child is sitting in the child seat 4 when the ACC is turned off to park or stop the vehicle, the driver's smartphone 33 or the like is notified directly or via the server 32. This makes the driver aware of the presence of the child and minimizes the risk of the driver forgetting the child sitting in the child seat 4 and getting out of the vehicle. Furthermore, even if the driver leaves the child in the vehicle for some reason, being aware of the child's presence allows the driver to take action, such as restarting the engine and turning on the air conditioner or returning to the vehicle as soon as possible, thereby minimizing the risk of the child remaining in the vehicle suffering from heatstroke or the like.
[0062] When the drive recorder 10 sends data to the server 32, access information for the server 32 can be registered in advance, for example, when the drive recorder 10 is shipped. This eliminates the need for a user who purchases the drive recorder 10 to register destinations, such as the user's telephone number or address, in the drive recorder 10. The drive recorder 10 may be small and, when installed, may be hidden behind a rearview mirror, for example, at a predetermined position above the windshield, making it difficult to perform operations such as mode setting. However, this eliminates the need for processing the drive recorder 10 to register destinations. The user can then receive notifications via the server by, for example, accessing the server 32 and registering information about a smartphone or other device from which the user wishes to receive notifications. Accessing the server 32 and registering the information can be performed relatively easily.
[0063] Furthermore, even after the above transmission, the control unit 16 acquires images captured by the camera 11 at appropriate timing, analyzes the images, and determines whether or not a person is present. If a person is detected in the image, the control unit 16 transmits predetermined information to the registered destination using the communication unit 24. The predetermined timing is preferably on the order of minutes, such as every few minutes to 10 minutes. By periodically receiving a notification that a child is in the vehicle, the driver is reminded of the child's presence and is given an opportunity to quickly return to the vehicle.
[0064] Furthermore, the predetermined information may not only be the recognition result, but also images captured by a camera, temperature information and humidity information detected by the temperature and humidity sensor 23, and so on. In this way, if a driver gets out of the vehicle leaving a child behind, information about the interior condition of the vehicle is periodically sent to the driver's mobile device, such as the smartphone 33, so that the driver can return to the vehicle if something happens, thereby preventing an accident from occurring. For example, if an image captured by the camera 11 is sent as the predetermined information, for example, if the child was asleep when the driver got out of the vehicle, the driver can know that the child has woken up, which can serve as an opportunity to return to the vehicle immediately. Furthermore, if temperature information and humidity information are used as the predetermined information, the driver, who is located away from the vehicle, can be informed of temperature and humidity changes, such as a rise or fall in temperature, at an early stage, and can return to the vehicle and take action before the environment becomes dangerous and causes heatstroke, hypothermia, or the like.
[0065] On the other hand, if the image analysis result indicates that no person is present, the control unit 16 does not transmit the image to the server 32, smartphone 33, or the like. By communicating in this manner when an abnormality or the like is detected, the number of communications can be reduced, and the amount of communication data can be reduced. That is, although the captured image can be sent to a server and image analysis can be performed on the server side, it is preferable to make the determination on the edge side, such as the drive recorder 10, as in this embodiment, and communicate only when an abnormality is detected. Since no image is transmitted when there is no abnormality, the amount of communication data can be reduced, which is advantageous. Furthermore, by processing on the edge side, images can be prevented from being included in the predetermined information to be transmitted in the event of an abnormality, which is advantageous, as the amount of data can be further reduced.
[0066] Furthermore, the predetermined information to be transmitted may be the same each time, or may be different. For example, the first notification after switching to monitoring mode may notify the driver that a person is present, without sending other information such as an image. After a predetermined number of notifications or a predetermined time has elapsed, images or other information may be sent. Since the first notification is often sent when the driver is inside or near the vehicle, the notification allows the driver to directly confirm the presence of the child by visual inspection. Furthermore, even after a predetermined number of notifications or a predetermined time has elapsed, information with a large amount of data, such as images, may be sent, for example, once every several notifications. This reduces the communication load, allows for efficient and rapid notification of the presence of a child, and occasionally notifying the driver of the actual situation with images creates a more realistic feeling and encourages the driver to return to the vehicle as soon as possible.
[0067] If the result of image analysis shows that no person is present, it is advisable not to perform further analysis. If no person is present, it is because the child has been left behind or has been taken out, and subsequent image analysis will continue to produce an analysis result of "not present." Therefore, not performing the analysis process itself is advantageous because it reduces the load on the drive recorder 10. Furthermore, since there is a risk of erroneous determination even if an analysis result of "not present" is produced once, it is advisable not to perform further analysis if, for example, the analysis result of "not present" is produced multiple times.
[0068] In the above-described embodiment, the presence or absence of a person is determined by image analysis and a warning is issued if a person is present. However, it is also possible to acquire second information and take that information into consideration when making a judgment and issuing a warning. The second information may be, for example, the detection result of the temperature and humidity sensor 23. For example, when switching to monitoring mode, if a person is detected based solely on image analysis, a warning is transmitted. After a predetermined number of times or a predetermined time has elapsed, if a person is detected and the second information, such as temperature or humidity, exceeds a set threshold or there is a large change in temperature or humidity, a warning is transmitted. However, if a person is detected but the temperature or humidity is within a predetermined range, a warning is not transmitted. If a child is intentionally left in the car, receiving continuous warnings can be annoying and the driver may become accustomed to the warnings. In contrast, in this embodiment, a warning is not transmitted if the temperature inside the car is not at a level that poses a risk of heatstroke or the like, but is transmitted if a dangerous condition such as a rise in temperature is imminent. This notifies the driver of an emergency and provides an opportunity to return to the vehicle immediately.
[0069] Furthermore, for example, it would be beneficial to monitor the temperature inside the vehicle while there are people inside, and if the temperature inside the vehicle becomes too high or too low, change the function to send predetermined information to notify the driver, or in addition to this function, automatically start the air conditioner. In this way, the temperature inside the vehicle will be within the appropriate range before the driver returns to the vehicle, thereby ensuring the safety of people remaining inside. Such a function would also be beneficial, for example, in insurance products that utilize connected cars.
[0070] Furthermore, image analysis should be able to recognize not only the presence or absence of a person, but also the state of the person, such as whether they are sleeping, awake, or crying, and transmit the results of this recognition.
[0071] Furthermore, in the above-described embodiment, it is detected that the ACC has been turned off based on a signal from the power supply device 30, but the present invention is not limited to this, and the fact that the ACC has been turned off may be obtained directly from the vehicle, for example, or may be detected using various methods.
[0072] On the other hand, when the vehicle is parked without turning off the engine, the ACC is not turned off. Therefore, for example, a means for detecting the driver's exit may be provided, and the above-mentioned processing may be performed when the driver's exit is detected. The means for detecting the driver's exit may be, for example, a seat sensor installed in the driver's seat. The seat sensor turns ON when a person sits in the driver's seat and turns OFF when the person stands up from the seat. When the seat sensor installed in the driver's seat changes from ON to OFF, it may be determined that the driver has exited the vehicle. Alternatively, a sensor may be installed to detect the opening and closing of the driver's door, or information on the opening and closing of the door may be obtained from the vehicle. For example, when the driver's door opens from a closed state, it may be determined that the driver has exited the vehicle. Alternatively, various methods may be used, such as setting the camera's imaging range to include the driver's seat and determining whether or not there is a person in the driver's seat through image analysis.
[0073] *Sound-based detection For example, when switching to monitoring mode, the control unit 16 acquires and analyzes the sound detected by the microphone 12. The sound analysis may be performed using deep learning (neural network) or other machine learning methods. When the control unit 16 detects an abnormal sound through sound analysis, it transmits predetermined information to a registered destination using the communication unit 24. The predetermined information may be the analysis result, and in addition to the analysis result, location information, room temperature, humidity, etc. may also be transmitted. Examples of abnormal sounds include the sound of breaking glass, collision sounds, screams, and cries. Examples of screams include a child's cry such as "help me!". Examples of cries include the crying of an infant. The analysis result to be transmitted may be the presence or absence of an abnormal sound, but it is also preferable to transmit the details of the analysis.
[0074] For example, if a driver leaves a sleeping child in the vehicle when getting off, the driver can know that the child has woken up by, for example, screaming or crying, which gives the driver an opportunity to return to the vehicle early.Furthermore, by learning of an abnormality in the vehicle due to the sound of breaking glass or a collision, the driver can go and check on the vehicle, and in particular, if a child has been left in the vehicle, the driver can know that he or she needs to return more quickly.
[0075] The voice analysis may be performed by various analyses using a database or the like to determine the type of sound. Furthermore, the voice analysis is not limited to sounds generated inside the vehicle, but may also be performed based on sounds generated outside the vehicle. For example, if a person discovers that a child has been left inside the vehicle and starts making a fuss outside the vehicle, the control unit 16 may recognize the child's presence and the state of the child inside from the content of the recognized voice and transmit the information.
[0076] Furthermore, the operation timing and transmitted information in this sound-based detection can be the same as those in the embodiment and modified examples of image-based detection described above. For example, the transmitted information may include temperature and humidity, or an image of the interior of the vehicle taken by a camera, in addition to the analysis results. Furthermore, various other elements can be applied, such as providing a means for detecting when the driver has exited the vehicle and starting operation after detecting that the driver has exited the vehicle.
[0077] *Microwave sensor based detection For example, when the control unit 16 switches to monitoring mode, it acquires the output of the microwave sensor 22 and determines whether or not there is an object moving inside the vehicle. If there is a moving object, there is a risk that a child or the like is present in the rear seat 3 or in the child car seat 4, so it transmits predetermined information to the registered destination using the communication unit 24. Furthermore, even after the detection based on this microwave sensor 22 has been transmitted once, it is preferable to periodically detect and output the determination result, etc., in the same manner as in the above-mentioned examples.
[0078] Furthermore, the moving object detected by the microwave sensor 22 is not limited to a person, but may be an animal inside a vehicle, etc. This makes it possible to detect a pet that has been left behind.
[0079] In each of the above-described embodiments and variants, the drive recorder 10 is used to transmit predetermined information to a registered destination when an abnormality is detected, but the information is not necessarily transmitted to the outside. In a situation where the driver is present in or near the vehicle, such as immediately after switching to monitoring mode, an alarm may be sounded, for example, from the speaker 19 of the drive recorder 10.
[0080] In addition, in the above-described embodiments and modifications, power is supplied from the power supply device 30, but power may be supplied directly from the vehicle battery so that power can be supplied even after the ACC is turned off, or an internal battery may be provided and power may be supplied from the internal battery after the ACC is turned off. In such cases, the internal battery may be a rechargeable secondary battery.
[0081] Furthermore, in each of the above-described embodiments and variant examples, the function is implemented as part of the drive recorder, but it is not limited to the drive recorder, and it may be implemented as part of the function of various in-vehicle devices, electronic devices, etc., or may be realized as an independent device or equipment.
[0082] For example, in a system using image analysis, it is recommended to use a camera that supports LTE communications and is capable of edge AI processing. This camera is an AI camera that integrates a communications module, SIM card, camera, and power supply, enabling edge processing. Device management, such as remotely switching AI algorithms and monitoring communication connection status via a cellular line, is also possible. Human detection through image analysis can be implemented using relatively simple deep learning, such as with a Neural Network Console (NNC). This AI-enabled camera can capture images of the rear seat, including child seats, and then perform AI processing on the resulting images to analyze the presence or absence of a human. If a human is detected in the image, the communication module can be activated, sending the detection results to a specified destination.
[0083] [Alarm based on seating sensors installed in child seats] FIG. 3 shows a block diagram of a system according to another embodiment. The system according to this embodiment is for preventing infants and young children from being left in a vehicle, and as shown in the figure, includes a main unit 40, a seating sensor 41, and the like. In this embodiment, the system is configured as a dedicated device, but it may also be implemented as a function of a drive recorder or other in-vehicle device, or may be realized as an independent device. The main unit 40 may be configured in the same housing or multiple housings.
[0084] In this embodiment, for example, the seating sensor 41 is installed on the child seat. A plurality of seating sensors 41 may be provided and placed at appropriate positions on the seat or backrest of the child seat. The seating sensor 41 is turned ON when an infant or small child is seated in the child seat and turned OFF when no infant or small child is seated in the child seat. The main unit 40 includes an interface unit 43 that receives an input signal from the seating sensor 41, a control unit 42, a speaker 45, and an interface unit 46 that outputs a control signal to the vehicle side.
[0085] The interface unit 43 for the seat occupancy sensor 41 includes, for example, a pin jack or connector into which the output terminal of the seat occupancy sensor 41 is inserted, and transmits the output signal of the seat occupancy sensor 41 to the control unit 42. The control unit 42 has a function of outputting an alarm from a speaker 45 when the driver leaves the driver's seat or stands up if there is an infant or small child in a child seat. The control unit 42 also has a function of outputting a signal to the vehicle side via the interface unit 46 to prevent the doors from locking when predetermined conditions are met.
[0086] To achieve this function, the control unit 42 determines whether the seat sensor is ON or not (S1), as shown in Fig. 4. If the seat sensor is OFF, there is no baby or the like present, and therefore S1 is looped.
[0087] When a baby or toddler is in a child seat, the control unit 42 determines whether the driver has left the seat. Leaving the seat may occur, for example, when the driver leaves the driver's seat or when the driver stands up from the driver's seat in preparation for leaving the seat. The determination of leaving the seat may be based, for example, on whether a seat occupancy sensor is installed in the driver's seat and the output of the seat occupancy sensor is turned OFF or whether the ACC is turned OFF. The determination of leaving the seat may be based on whether the driver has left the seat (the branch judgment is Yes) immediately upon the occurrence of such a state, or whether the branch judgment is Yes after a predetermined period of time has elapsed. Determining leaving the seat immediately is advantageous because an alarm will sound before the driver leaves the vehicle. Alternatively, the driver may carry a slave device capable of wireless communication with a master device installed in the vehicle, and the distance between the master device and the slave device may be greater than a certain distance to determine whether the driver has left the seat. Alternatively, a camera may be provided to capture images of the driver's seat, and the image captured by the camera may be analyzed to determine whether the driver has left the seat.
[0088] If the driver has not left the seat (No in S2), the process returns to S1 and the seat occupancy sensor is turned on or off. If the driver has left the seat (Yes in S2), the control unit 42 issues an alarm from the speaker (S3). The alarm may be a buzzer or a voice message. In this way, the alarm will make the driver aware that there is a child, such as an infant, in the child seat, and the driver will forget about the child when getting out of the vehicle, thereby minimizing the risk of the child being left behind in the vehicle.
[0089] Furthermore, in this embodiment, the control unit 42 disables the vehicle doors from being locked after issuing the alarm (S4). For example, the control unit 42 outputs a door unlock signal to the vehicle side via the interface unit 46. As a result, the vehicle doors are not locked but remain unlocked, and even if a child is left inside the vehicle, a third party (the finder) can open the vehicle doors and rescue the child.
[0090] When the seating sensor is turned OFF (Yes in S5), the control unit 42 releases the lock-disabled state and enables locking (S6). As a result, by removing a child from the child seat, the seat can be locked, and the driver can lock it by performing a locking operation, for example, and leave the vehicle safely.
[0091] In addition, by attaching a seating sensor to the child seat itself, it is possible to detect which seat the child seat is installed in. Furthermore, it is preferable to connect this system to a drive recorder, and the above-mentioned unlocked state can be used as an external trigger to notify a smartphone or server from the drive recorder. As with the above-mentioned embodiment, this notification can be made by sending predetermined information including video.
[0092] As mentioned above, by making the ACC OFF condition for determining whether or not the driver is leaving the vehicle, it is possible to issue a warning when the engine is turned off with a child in a child seat. Also, by setting the warning to be issued when the engine is turned off, it is possible to prevent unnecessary warnings from being issued if the driver wants to remove a child from the child seat by leaving the engine running.
[0093] Fig. 5 shows another embodiment using a seat occupancy sensor. In this embodiment, the function of determining whether the driver has left the seat, etc., in the control unit 42 in the system shown in Fig. 3 is changed so that the opening and closing of the driver's door is used to determine whether the driver has left the seat, etc. As in the above, the control unit 42 determines whether the seat occupancy sensor is ON (S11). If the seat occupancy sensor is OFF, there is no baby or other child present, and the system loops S1.
[0094] If the seating sensor is ON, the control unit 42 determines whether the driver's door is open (S12). If the door is closed, the process returns to S11. If the door is open, the control unit 42 waits for the door to close next (S13). Then, when the door is closed (Yes in S13), the control unit 42 issues an alarm from the speaker (S14). The alarm may be a buzzer sound or a voice alarm message. In this way, the alarm will make the driver aware that a child, such as an infant, is in a child seat, and the driver will forget about the child when getting out of the vehicle, thereby minimizing the occurrence of the child being left behind in the vehicle.
[0095] Furthermore, in this embodiment, after issuing an alarm, the control unit 42 also disables the vehicle doors from being locked (S15). This allows a third party (the finder) to open the vehicle doors and rescue a child even if the child is left inside the vehicle.
[0096] When the seating sensor is turned OFF (Yes in S16), the control unit 42 releases the lock-disabled state and enables locking (S17). As a result, by removing the child from the child seat, the seat can be locked, and the driver can leave the vehicle safely.
[0097] In the above-described embodiment, the alarm is issued after the door is opened and then closed. However, the alarm may be issued when the door is opened without providing step S13. However, in order for the driver to remove a child from a child car seat, the driver often opens the driver's door, walks around the vehicle, and reaches the rear seat. Therefore, opening the driver's door to remove the child may cause the alarm to sound, which may be annoying to the driver. Therefore, as in this embodiment, by setting the door closing as the condition for issuing the alarm, the alarm will not sound if, for example, the driver removes the child from the child car seat with the door open and then closes the driver's door.
[0098] 4 and 5, instead of disabling locking in S4 or S15 so that locking is not possible even if an operation to lock is performed, an alarm may be issued when an attempt is made to lock. In this case, the alarms in S3 and S14 do not have to be issued, but if they are issued, a double alarm is generated, which is advantageous.
[0099] Also, rather than disabling locking in S4 or S15, it would be better to lock the vehicle after an alarm is issued, or to lock the vehicle if another locking operation is performed after an alarm is issued. This allows the driver to leave children in the vehicle at their discretion, and by locking the vehicle, it is possible to prevent suspicious persons from entering the vehicle.
[0100] [Communication-type temperature measurement device] FIG. 6 shows an example of a system that prevents heatstroke and the like in children and the like left in a vehicle based on the temperature inside the vehicle. The system 50 of this embodiment includes a function for measuring the temperature inside the vehicle (e.g., a temperature and humidity sensor 51), a communication function (e.g., a communication unit 52), and a control unit 53 that controls these functions. When the temperature inside the vehicle exceeds a set temperature, the control unit 53 notifies a registered destination using the communication function. The communication function may use, for example, an LTE-M module capable of LTE communication, and notifies, for example, a server 32 or a smartphone 33 of a driver who has been registered in advance. When transmitting to the server 32, it is preferable that the notification be sent to the driver's smartphone 33 or the like via the server.
[0101] This system is installed in a vehicle, and when the temperature inside the vehicle approaches a temperature at which heatstroke may occur after the engine is stopped, a notification of the approaching danger is sent to the driver's smartphone or other device. In this way, the driver receives the notification and goes to the vehicle to take appropriate measures to prevent the temperature inside the vehicle from becoming too high. In addition, this embodiment may be equipped with a function to determine whether a child is present in the vehicle, as in the above-mentioned embodiments, but not having this function simplifies the configuration and is therefore preferable.
[0102] Also, it is possible to detect engine stoppage, such as when the ACC is turned off, and then monitor the room temperature and issue a notification when the condition is met, but the engine stop detection function is not necessarily provided. Generally, when the driver is in the vehicle, the engine is running, and the vehicle is ready to drive, the room temperature is unlikely to rise to a dangerous level that could cause heatstroke or other problems, for example, by using the air conditioner or opening the windows. Therefore, it is often when the vehicle is parked with the engine turned off that the temperature inside the vehicle rises above the set temperature. Therefore, by not providing a function to detect engine stoppage, the device can be installed independently of the vehicle, which is advantageous because it allows for effective measures against heatstroke and other problems with a simple configuration.
[0103] In this mode, by sending a notification to a smartphone when the temperature is high, it can be used to deal with situations such as leaving a child behind or leaving the vehicle for a short time. In addition, by appropriately setting the temperature to be notified, it is possible to notify in advance from the warning stage and rush to the scene before the temperature reaches a dangerous level. It is advisable to set the initial value for the temperature to be notified to an appropriate value taking into account the temperature at which there is a risk of heatstroke, and then allow the user to change the setting.
[0104] Furthermore, while temperature is one of the important factors in heatstroke, humidity also has an effect. Therefore, it is a good idea to provide a function to measure temperature and humidity and to send a notification when the relationship between temperature and humidity meets a certain condition. When humidity is taken into account, it is also good to be able to notify if the environment is such that there is a risk of heatstroke due to the humidity, even if the temperature is relatively low.
[0105] [Communication type temperature measuring device + remote operation] In addition to the functions of the above-described embodiments of the communication-type temperature measurement device, it is also desirable to provide a function that allows remote opening of windows or starting of the engine by connecting to an OBD. In this way, for example, when a high temperature notification arrives on the driver's smartphone, a prompt such as "Do you want to open the windows fully?" or "Do you want to start the engine?" is displayed on the smartphone screen. Touching the "YES" button displayed on the screen enables remote operation. This allows the driver to open the windows to let in outside air or turn on the air conditioner in advance to cool the interior of the vehicle by starting the engine, preventing heatstroke in children before rushing to the vehicle.
[0106] In this embodiment, this function is effective when you are unable to rush to the scene immediately after receiving a notification. Even if you are able to return to the vehicle immediately, you can quickly remove the child from a dangerous situation by taking immediate action.
[0107] Furthermore, it is advisable to limit such remote control to dangerous situations, which will minimize the occurrence of situations such as windows opening unnecessarily to allow entry or exit, or the vehicle starting accidentally when the engine is started.
[0108] [In-car drive recorder (with motion detection)] For example, the shooting area of the camera of the drive recorder shown in Figures 1 and 2 can be set to the interior of the vehicle. Furthermore, the driver's smartphone 33, for example, can be registered as a destination of the communication unit 24, and the drive recorder 10 and smartphone can be linked to send images being captured by the drive recorder to the smartphone. This allows the user to check on the status of children in the back seat in real time from the smartphone. Furthermore, for example, LTE communication can be used to check on the status of children even from a distance. Furthermore, it is desirable to have a drive recorder specialized for recording inside the vehicle. Furthermore, it is desirable to equip the drive recorder with a temperature sensor so that the temperature inside the vehicle can also be displayed at the same time, which leads to early detection of heatstroke. It is even more desirable to further equip it with a humidity sensor so that the humidity can be displayed along with the temperature. For example, in the example shown in Figure 2, the temperature and humidity sensor 23 is equipped, making it possible to display both temperature and humidity.
[0109] Furthermore, the above-mentioned video can be viewed by the user either by connecting to the dashcam voluntarily or by the dashcam transmitting the video to a smartphone when motion is detected inside the vehicle, and this can be selected in the user's settings. The inclusion of a motion detection function is also beneficial for crime prevention while the vehicle is parked.
[0110] [Smart band] FIG. 7 shows yet another embodiment of the system. The system of this embodiment includes a smart band 60. The smart band 60 includes a band unit 60a to be worn on, for example, a child's foot, leg, or arm. The smart band 60 includes, inside its main body, a biological information acquisition sensor 61 that measures biological information such as body temperature, heart rate, and blood pressure of the user wearing the smart band 60, a communication unit 62 that transmits the biological information to a smartphone 33, and a control unit 63 that controls these components. The smart band 60 is then worn on, for example, a child's foot, leg, or arm. This allows the user to constantly monitor biological information such as body temperature and heart rate of a child waiting in a car using the smartphone 33 held by the user even when the user is away from the vehicle.
[0111] Furthermore, the smart band 60 may be worn on the feet or legs, for example. For example, if worn on the arm, a child sitting in a child car seat may touch the smart band 60 and remove it, turn off the power, or cause a malfunction. On the other hand, if worn on the feet or legs, it is difficult to reach the smart band 60 in such a position, which is preferable because it minimizes the occurrence of the above problems.
[0112] It is preferable that the smart band 60 has a function of sending a notification to the smartphone 33 when a child wearing the smart band 60 is in a dangerous state. For example, a child may be in a dangerous state when the detection value of the biometric information acquisition sensor 61 exceeds a preset threshold. In addition, it is preferable that the smart band does not have a screen and is configured to be specialized for transmitting information. Not having a screen not only reduces costs, simplifies the configuration, and makes the smart band smaller and thinner, but also minimizes the risk of a child becoming interested in the screen and touching it.
[0113] In the above embodiment, the notification destination of the smart band is a smartphone, but this is not limited to this and the notification may be forwarded to a smart watch carried by the user. Since there is a possibility that a smartphone is not carried at home, it is preferable to use a smart watch that is easy to wear and makes it easy to check notifications.
[0114] Furthermore, this embodiment is not limited to being used on children left in vehicles, but can also be used at home or on the go, for example. For example, in dual-income households, and even at home, there are situations where children need to be left alone, so this is useful in preventing unexpected accidents in various locations.
[0115] In the above-described embodiment, the case where GPS is used as the satellite positioning system has been described, but GLONASS, Galileo, the Quasi-Zenith Satellite System, etc. may also be used within the scope of the present invention.
[0116] The scope of the present invention is not limited to the structures explicitly described in the specification, but also includes combinations of various aspects of the present invention disclosed herein. The structures of the present invention that are sought to be patented are specified in the appended claims, but it is the intention of the present inventors to claim structures disclosed in this specification in the future, even if they are not currently specified in the claims.
[0117] The present invention is not limited to the configurations described in the above-described embodiments. The components of each of the above-described embodiments and variations may be arbitrarily selected and combined. Furthermore, any component of each embodiment or variation may be arbitrarily combined with any component described in the Summary of the Invention or any component embodying any component described in the Summary of the Invention. The present invention also intends to obtain rights to these configurations through amendments or divisional applications of the present application. Even if a description is made of "in the case of..." or "when...," it is not intended to describe a configuration limited to that case or time. Configurations that are not limited to those cases or times are also disclosed, and the present invention intends to obtain rights to them. Furthermore, any descriptions that specify an order are not limited to this order. Configurations in which some parts are deleted or the order is changed are also disclosed, and the present invention intends to obtain rights to them.
[0118] Furthermore, by converting the application to a design registration, the applicant intends to obtain rights to the overall design or partial design. The drawings depict the entire device in solid lines, but they also include partial designs claimed for parts of the device. For example, the drawings may include some components of the device as partial designs, or may include some parts of the device as partial designs regardless of the components. A part of the device may be a part of the device, or it may be part of that component. The applicant intends to obtain rights not only to the overall design, but also to partial designs in which any part of the solid line portion of the drawings is drawn as a dashed line. [Explanation of symbols]
[0119] 1: Vehicle 2: Windshield 3: Rear seat 4: Child seats 5: Cable 10: Drive recorder 11: Camera 12: Microphone 13: Abnormality detection sensor 14: GPS module 15:Operation section 16: Control section 17: Temporary memory 18: Monitor 19: Speaker 20: Memory card slot 21: Micro SD card 22: Microwave sensor 23: Temperature and humidity sensor 24: Communications Department 30: Power supply 32: Server 33: Smartphone
Claims
1. A detection function for detecting the state of the interior of a vehicle while parked and / or stopped; A system equipped with an output function that outputs specified information based on the detection results.
2. The system according to claim 1 , wherein the state of the vehicle interior detected by the detection function is whether or not a person is present in the rear seat of the vehicle.
3. 3. The system according to claim 1, wherein the state inside the vehicle compartment detected by the detection function is whether or not a person is present in a child seat installed in the vehicle.
4. The system according to claim 2 or 3, further comprising a function of performing image analysis on an image acquired from a means for photographing the rear seat of the vehicle or the child seat to determine whether or not a person is present in the image.
5. The system according to claim 4 , wherein when the image analysis is performed and the presence of a person is detected in the image, the output function sends the detection result without sending the image.
6. The system according to claim 1 , wherein the state inside the vehicle compartment detected by the detection function is the presence or absence of an object moving inside the vehicle compartment.
7. The detection function acquires sounds heard within the vehicle cabin and detects a dangerous state from the acquired sounds, 7. The system according to claim 1, wherein the output function communicates with an external device to notify the external device when the dangerous state is detected.
8. The detection function detects a dangerous state based on the temperature inside the vehicle compartment, 8. The system according to claim 1, wherein the output function communicates with an external device to notify the external device when the dangerous state is detected.
9. The detection function detects a dangerous state based on the temperature inside the vehicle compartment, The system according to claim 1 , wherein the output function does not communicate the predetermined information to the outside when the dangerous state is not detected.
10. The system according to claim 1 , wherein the predetermined information is the detection result.
11. 11. The system according to claim 1, wherein the detection function detects the state of the interior of the vehicle based on an output of a seating sensor provided in a child seat installed in the vehicle.
12. The system according to claim 11, further comprising means for detecting the movement of the driver, wherein the output function outputs an alarm when the driver gets out of the vehicle with a person in the child seat.
13. 13. The system according to claim 11, further comprising a function of preventing the doors of the vehicle from being locked when a person is present in the child seat.
14. a function of notifying the driver of the presence of a person in the child car seat and preventing the vehicle doors from being locked when the vehicle doors are locked while the child car seat is in a state where a person is present in the child car seat; 13. The system according to claim 11, wherein if the locking operation is performed after the notification, the system is locked.
15. the detection function detects the temperature inside the vehicle interior, the output function is to transmit information to a predetermined communication destination when the temperature inside the vehicle interior satisfies a condition; The system according to claim 1 , further comprising a function of remotely controlling the vehicle from the predetermined communication destination terminal to change the state of the interior of the vehicle.
16. The detection function has a function of photographing the interior of the vehicle, The system according to claim 1 , wherein the output function transmits the captured image to a predetermined destination.
17. The system according to claim 1 , wherein each of the functions is implemented by a drive recorder.
18. It is equipped with a smart band that can be worn on a child's leg or arm to detect the child's biological information. The state inside the vehicle interior detected by the detection function is the biological information of a child inside the vehicle interior, The system according to claim 1 , wherein the output function is realized by a communication function of the smart band that transmits the biological information.
19. A program for causing a computer to implement the functions used in the system according to any one of claims 1 to 18.