Monitoring system

The monitoring system addresses the issue of unnecessary reports by using a sensing device and notification unit to display the monitoring state on the vehicle's glass, ensuring safety and transparency.

JP7806678B2Active Publication Date: 2026-01-27TOYOTA JIDOSHA KK
View PDF 5 Cites 0 Cited by

Patent Information

Application Number
JP2022202002
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2022-12-19
Publication Date
2026-01-27
Estimated Expiration
2042-12-19

AI Technical Summary

Technical Problem

Existing systems fail to effectively notify people around a vehicle that a child or other individuals are being monitored inside, leading to unnecessary reports to authorities when parents leave them in the car temporarily.

Method used

A monitoring system equipped with a sensing device and notification unit that acquires environmental information and displays a monitoring state on the vehicle's glass using OLED or liquid crystal technology, allowing people to see through the signage and providing environmental information.

Benefits of technology

The system effectively notifies people that a child is being supervised, preventing unnecessary reports and ensuring safety by displaying the monitoring state and environmental conditions.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007806678000001
    Figure 0007806678000001
  • Figure 0007806678000002
    Figure 0007806678000002
  • Figure 0007806678000003
    Figure 0007806678000003
Patent Text Reader

Abstract

To provide a watching system capable of notifying persons around a vehicle of watching by a user's operation.SOLUTION: A watching system 1 comprises a sensing device 500 for obtaining environmental information inside a vehicle, a notification part 430 for notifying an outside of the vehicle of a watching state where it is indicated that the sensing device is in operation, and so forth. The notification part comprises a display part, and the display part displays together lapse time in the watching state, and the environmental information inside the vehicle sensed by the sensing device.SELECTED DRAWING: Figure 1
Need to check novelty before this filing date? Find Prior Art

Description

[Technical Field]

[0001] The present disclosure relates to a monitoring system. [Background technology]

[0002] A system for detecting whether a living body has been left behind in a vehicle is known. Patent Document 1 discloses a vehicle control device that changes a detection condition for whether a living body has been left behind in a vehicle by referring to information on a history of past abandonment. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Publication No. 2020-149360 Summary of the Invention [Problem to be solved by the invention]

[0004] There are times when a parent driver needs to leave a child in the car to go shopping or relieve themselves for a few minutes. However, people around the car may not be aware of this situation and may simply assume that a child has been left in the car, which may result in reporting the incident to a third party such as the police or a security guard. Even if the parent driver intentionally leaves the child behind by controlling the environment, such as the temperature inside the vehicle, (i.e., keeping an eye on the child), unless people around them understand the situation, they may still report the incident to a third party.

[0005] The present disclosure has been made to solve such problems, and aims to provide a monitoring system that can notify people around a vehicle that children or other people inside the vehicle are being watched over. [Means for solving the problem]

[0006] A monitoring system according to one aspect of the present disclosure includes: a sensing device that acquires environmental information within the vehicle; a notification unit that notifies the outside of the vehicle of a monitoring state indicating that the sensing device is operating in response to a user operation; Equipped with. [Effects of the Invention]

[0007] According to the present disclosure, it is possible to provide a monitoring system that can, through user operation, notify people around a vehicle that they are being monitored. [Brief explanation of the drawings]

[0008] [Figure 1] 1 is a diagram illustrating the overall configuration of a monitoring system according to a first embodiment. [Figure 2] FIG. 2 is a block diagram showing the configuration of a user terminal and a sensing device according to the first embodiment. [Figure 3] FIG. 2 is a diagram illustrating a function selection of an actuator according to the first embodiment. [Figure 4] FIG. 10 is a diagram illustrating automatic trigger function selection according to the first embodiment. [Figure 5] FIG. 10 is a diagram illustrating an operation procedure of a monitoring system according to a comparative example. [Figure 6] FIG. 2 is a diagram illustrating the operation procedure of the monitoring system according to the first embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0009] Embodiment 1 Hereinafter, an embodiment of the present invention will be described with reference to the drawings. The monitoring system according to this embodiment sets the sensing content and notification conditions according to the purpose, and notifies people around the vehicle when a child has been left behind in the vehicle or when a child must be left behind. By displaying such a situation on the door glass, rear window, etc. of the vehicle using a transparent display or projection technology, it is possible to notify people around that the child is safely supervised in the vehicle.

[0010] This system uses signage. The signage uses OLED (Organic Light Emitting Diode) or liquid crystal technology, which allows it to switch between transparent and opaque by applying voltage (ON / OFF), making it possible to switch images. The signage can be displayed by touching a smartphone or other device to indicate that monitoring is in progress. The signage technology can also use a combination of dimming glass and a projector. Similar to a screen door, transparent OLEDs allow the background scenery to be seen through the lattice-like holes, and by arranging RGB colored cells and transparent pixels alternately, the background can be seen through the transparent parts when the OLED is off.

[0011] FIG. 1 shows the overall configuration of a monitoring system according to an embodiment. The monitoring system 1 may include a user terminal 100, a management server 200, a security company server 300, a vehicle 400, and a sensing device 500. The components are connected to each other via a network N (including wired and wireless). Examples of the network N include, but are not limited to, BLE (Bluetooth Low Energy), LAN, 5G, and 4G.

[0012] The user terminal 100 is a portable device carried by a user U, and may be, for example, a smartphone, a tablet, or a wearable device. The user terminal 100 can receive sensing information from a sensing device 500 (described later) and display the information on a display screen. The user terminal 100 can also issue instructions to an actuator of a vehicle 400 (described later), such as to start or stop operation.

[0013] The management server 200 collects various data from the user terminal 100, the vehicle 400, the sensing device 500, and the security company server 300, and manages the overall control of the monitoring system. The management server 200 is realized by a server computer having a processor, memory, etc.

[0014] In the monitoring system, the security company server 300 can be used to receive instruction information from the management server 200 and request the dispatch of security guards in the event of an emergency such as when a child is left behind in a car.

[0015] Vehicle 400 includes various actuators. The various actuators include, for example, a speaker, an air conditioner, door locks, signage, and external communication means mounted on the vehicle. Vehicle 400 is equipped with a DCM (Data Communication Module) 450. The external communication means include, for example, communication means (for example, telephone, email, etc.) for contacting a dealer, a security company, and personal registration.

[0016] The DCM450 is connected via a signal line (wired connection), enabling two-way communication through an in-vehicle network based on communication protocols such as CAN (Controller Area Network) or Ethernet.

[0017] The sensing device 500 is a portable in-vehicle device used to perform various sensing operations required to operate the monitoring system. The sensing device 500 may be mounted, for example, on a child's diaper or on a vehicle seat (e.g., the driver's seat, the passenger seat, or the rear seat). Other sensing devices 500 may include an in-vehicle microphone, an in-vehicle temperature sensor, or an in-vehicle CO2 sensor. The sensing device 500 may also be a camera (e.g., an infrared camera). For example, sensing the diaper can detect a child's urination. Sensing the vehicle seat can detect whether the driver (e.g., a parent) has left the vehicle. The in-vehicle microphone can detect, for example, a child's crying in the vehicle or a sound such as a person outside the vehicle knocking on the vehicle door. Note that these sensing devices are merely examples, and various modifications are possible. For example, a biological sensor may be attached to the child.

[0018] The lower right of FIG. 1 shows an example of signage (display unit 430) mounted on the door glass and rear glass of vehicle 400. Normally, the glass is transparent, but upon receiving an instruction from user terminal 100, the glass can display a message indicating that the vehicle is in a monitoring state, thereby alerting people in the vicinity. This allows people in the vicinity to know that the vehicle environment is being safely managed, even if a baby is left inside the vehicle, and prevents unnecessary reports from being made. Examples of content displayed on the glass include the temperature inside the vehicle (e.g., 25°C), whether the vehicle is in a monitoring state or not, and the elapsed monitoring time (e.g., 2 minutes and 15 seconds). Note that these display contents are merely examples, and various modifications are possible.

[0019] In some embodiments, the monitoring system 1 includes a sensing device 500 that acquires environmental information inside the vehicle, and a notification unit (such as a display unit 430 or a speaker) that, in response to a user's operation, notifies the outside of the vehicle of a monitoring state indicating that the sensing device is operating. The notification unit may be the display unit 430, which will be described later. Alternatively, if the notification unit is a speaker, the notification unit may notify the outside of the vehicle of a monitoring state by voice when a nearby person outside the vehicle approaches within a predetermined distance of the vehicle or touches the vehicle door.

[0020] In some embodiments, the display unit 430 displays the elapsed time of the monitoring state and the environmental information inside the vehicle sensed by the sensing device 500. The display unit 430 is a transparent display mounted on the windshield, door glass, or rear glass. By applying a voltage to the transparent display through a user's operation, the display unit 430 displays the monitoring state and the environmental information inside the vehicle sensed by the sensing device. When the sensing device 500 detects a sensing content, it notifies the user terminal 100 of the detection and activates an actuator in the vehicle 400 corresponding to the sensing content. The sensing device 500 senses the baby's diaper and the seat inside the vehicle, sound inside or outside the vehicle (e.g., a microphone), the temperature inside the vehicle, and CO2 (e.g., a temperature sensor and a gas sensor). The actuators include a speaker, air conditioner, door lock, signage, and outside vehicle communication. In other embodiments, the display unit 430 may also display advertisements for cooperating stores and the like.

[0021] FIG. 2 is a block diagram showing the configuration of the user terminal 100 and the sensing device 500. As shown in FIG. The user terminal 100 may be a terminal carried by a user, such as a smartphone or tablet terminal. The user terminal 100 includes an information acquisition unit 101, a notification unit 102, and a determination unit 103. The information acquisition unit 101 acquires information from the management server 200, the vehicle 400, and the sensing device 500. The notification unit 102 notifies the user of warnings, cautions, etc. (by at least one of audio and visual means). The determination unit 103 transmits various signals (ON, OFF) in response to a user operation.

[0022] The sensing device 500 is a carry-on vehicle-mounted device and may include a communication unit 501, a processor 502, a memory 503, a battery 504, a sensor A 511, a sensor B 512, a sensor C 513, etc. The memory 503 stores a program. Types of sensors include, but are not limited to, photoelectric sensors, fiber sensors, laser sensors, color sensors, proximity sensors, eddy current displacement sensors, contact displacement sensors, ultrasonic sensors, and image discrimination sensors. The communication unit 501 can wirelessly communicate various sensing information to a user terminal or the like via an antenna.

[0023] The advance registration by a user when using the monitoring system will be described with reference to Figures 3 and 4. Figure 3 is a diagram for explaining the selection of an actuator function. Figure 4 is a diagram for explaining the selection of an automatic trigger function. The user can perform function customization settings using the user terminal 100. Specifically, the user can select a sensor function, an actuator function, and an automatic trigger function in that order, and save the customized settings in the user terminal 100 in advance.

[0024] The user can select the actuator function according to the table shown in Figure 3. Actuator targets include, but are not limited to, speakers, air conditioners, door locks, signage, and outside vehicle communications. Furthermore, for items set to ON in the sensor and actuator selection, the user can set the automatic trigger content as shown in Figure 4. Automatic trigger targets include, but are not limited to, diapers, leaving the seat, microphones, heatstroke warnings, and CO2 warnings. For example, if a diaper is wet, the speaker is activated and voice A is played. Furthermore, if the driver leaves the driver's seat and moves outside the vehicle, the speaker is activated and voice B is played. Furthermore, if the microphone inside the vehicle picks up the sound of a baby crying, the speaker is activated and voice C is played. Furthermore, if the temperature sensor inside the vehicle exceeds a predetermined temperature, the air conditioner is activated and controlled to keep the temperature inside the vehicle below the predetermined temperature. Furthermore, if the temperature sensor inside the vehicle exceeds a predetermined temperature, the doors are unlocked and message B is displayed on the signage. Furthermore, when a predetermined amount of CO2 is detected by the gas sensor, the door is unlocked, display B is displayed on the signage, and the security company is contacted. Note that these are merely examples.

[0025] The operation procedure of the monitoring system according to the comparative example will be described with reference to FIG. The user uses the user terminal 100 to launch the app before starting to drive the vehicle 400 (skip S101). The user can complete the settings by selecting settings previously saved on the app (YES in skip S103) and loading the saved setting information (skip S105). On the other hand, if the user is using the app for the first time or if the saved settings do not contain the settings the user desires (NO in skip S103), the user can also perform function customization settings as described above (skip S104). When the settings are completed as described above, the user starts driving the vehicle 400 (skip S106).

[0026] The management server 200 updates the settings in accordance with the setting information set by the user (skip S107). The management server 200 acquires sensing information from the sensing device 500 (skip S108). If the management server 200 detects a predetermined state (for example, a wet diaper) based on the sensing information acquired from the sensing device 500 (YES in skip S110), it sets the automatic trigger to ON (skip S112). The management server 200 transmits a notification of the detection to the user terminal 100, and the user terminal 100 receives the notification (skip S111).

[0027] When the vehicle 400 (or DCM 450) receives instruction information (turning the automatic trigger ON) from the management server 200, the actuator of the vehicle is turned ON (skip S113). The vehicle 400 transmits a notification that the actuator has been turned ON to the user terminal 100. The user terminal 100 receives the notification from the vehicle 400 (skip S115). The user U performs an action in accordance with the notification on the display screen of the user terminal 100 (skip S117). For example, the user can manually open a window or change a diaper in accordance with the notification. After taking the appropriate action, the user manually turns ON the trigger using the user terminal 100 (skip S119). Thereafter, the actuator of the vehicle 400 is turned ON (skip S120). This returns the vehicle to the state of sensing the interior environment. Thereafter, the process returns to skip S108, and the above-described series of processes are repeated.

[0028] The operation procedure of the monitoring system according to this embodiment will be described with reference to FIG. The user stops the vehicle 400 they are driving (skip S201). Next, the user uses the user terminal 100 to start the app, select a setting previously saved on the app (YES in skip S203), and load the saved setting information to complete the setting (skip S205). On the other hand, if this is the first time the app is used or if the saved settings do not contain the user's desired setting (NO in skip S203), the user can perform function customization setting as described above (skip S204). As described above, once the setting is complete, the user determines whether to set signage, i.e., whether it is necessary to leave the child in the vehicle (skip S206). If signage setting is necessary, the user turns on the signage (alert unit) of the vehicle 400 (skip S207) and can move outside the vehicle (skip S208). In this case, as shown in FIG. 1, the display unit 430 may display information indicating that the vehicle is in monitoring mode, the elapsed time of the monitoring mode, and in-vehicle environmental information (e.g., the in-vehicle temperature). In some examples, when a user turns on the signage (for example, by operating an app) and the sensor is turned on when the driver leaves the seat (and the passenger seat), a monitoring state in which the environment inside the vehicle is being sensed may be notified.

[0029] Furthermore, even if there is no signage setting (that is, there is no need to leave the child in the car) (No in skip S206), the user can still move out of the car (skip S208).

[0030] The management server 200 updates the settings in accordance with the setting information set by the user (skip S209). The management server 200 can also recognize whether the user (driver) has left the vehicle while the signage is set to the monitoring state, or whether the user (driver) has left the vehicle while the signage is not set to the monitoring state. In either case, the management server 200 continuously acquires sensing information from the sensing device 500 (skip S210). If the management server 200 detects a predetermined state (e.g., a wet diaper or a loud crying baby) based on the sensing information acquired from the sensing device 500 (YES in skip S211), it sets the automatic trigger to ON (skip S213). The management server 200 transmits a notification of the detection to the user terminal 100, and the user terminal 100 receives the notification (skip S212).

[0031] When the vehicle 400 (or DCM 450) receives instruction information (turning the automatic trigger ON) from the management server 200, the vehicle's actuator is turned ON (skip S215). The vehicle 400 sends a notification that the actuator has been turned ON to the user terminal 100. The user terminal 100 receives the notification from the vehicle 400 (skip S216). The user U returns to the vehicle in accordance with the notification on the display screen of the user terminal 100 and performs the necessary action (skip S217). The user uses the user terminal 100 to manually turn ON the trigger (skip S218). The actuator of the vehicle 400 is then turned ON (skip S221). The process then returns to skip S108, and the above-described series of processes are repeated.

[0032] The present invention is not limited to the above-described embodiment, and can be modified as appropriate within the scope of the invention. [Explanation of symbols]

[0033] 1 Monitoring system, 100 User terminal, 101 Information acquisition unit, 102 Notification unit, 103 Decision unit, 200 Management server, 300 Security company server, 400 Vehicle, 430 Display unit, 450 DCM, 500 Sensing device, 501 Communication unit, 502 Processor, 503 Memory, 504 Battery, 511 Sensor A, 512 Sensor B, 513 Sensor C, N Network

Claims

1. a sensing device that acquires environmental information within the vehicle; a notification unit that notifies the outside of the vehicle of a monitoring state indicating that the sensing device is operating in response to a user operation; A monitoring system equipped with

2. The monitoring system of claim 1, wherein the notification unit includes a display unit, and the display unit displays the elapsed time of the monitoring state together with environmental information inside the vehicle sensed by the sensing device.

3. The monitoring system of claim 2, wherein the display unit is a transparent display mounted on the windshield, door glass, or rear glass, and when a voltage is applied to the transparent display by a user's operation, the display also displays the monitoring state, the elapsed time of the monitoring state, and environmental information inside the vehicle sensed by the sensing device.

4. When the sensing device detects the sensing content, it notifies the user terminal of the detection; The monitoring system according to claim 1 , wherein an actuator of the vehicle corresponding to the sensing content is activated.

5. The sensing devices include baby diapers and seats in the car, sounds inside or outside the car, temperature inside the car, and CO 2 The monitoring system according to claim 4 , wherein the actuators include a speaker, an air conditioner, a door lock, a signage, and an outside vehicle communication.

Citation Information

Patent Citations

  • In-vehicle abnormality notification device for vehicle

    JP2020086855A

  • Vehicle controller, and vehicle control method

    JP2020149360A

  • Vehicle control device, mobile device, vehicle control system, control method, and program

    JP2020149487A

  • Vehicle alarm device

    JP2020201108A

  • In-transitcar alarm

    US20090134986A1