In-vehicle monitoring system, safety status monitoring and control program

Abstract

Based on the current passenger behavior, announcements will be made to warn passengers according to the degree of potential danger of future disruptions. [Solution] Based on the status of passengers 14 inside the vehicle (standing, changes in standing position of seated passengers, etc.) and the driving information of the bus 12 (acceleration / deceleration, approaching a bus stop, etc.), it is determined whether or not there are any passengers at risk. If there are such passengers, the level of risk is identified, and an appropriate announcement (image, audio) is made. This allows the passengers to recognize that they are engaging in dangerous behavior inside the vehicle and to refrain from such behavior, thus preventing accidents.

Description

Technical Field

[0006] , , , , ,

[0001] The present invention relates to an in-vehicle monitoring device and a safety situation monitoring control program.

Background Art

[0002] In a vehicle such as a bus where seated passengers and standing passengers are mixed, the crew has an obligation to monitor the interior of the vehicle so that a situation where passengers lose their balance does not occur. In the case of a bus, the driver, who is the crew member, monitors the interior of the vehicle while driving, so the burden is greater than when there is a dedicated monitor. For this reason, it has been proposed to automate the process of monitoring the interior situation of the vehicle.

[0003] Patent Document 1 describes an anti-fall system that is mounted on a vehicle capable of transporting a person and that distinguishes and determines whether a person is standing or sitting, and executes an anti-fall process for preventing the person from falling as a process according to the determination result.

[0004] Specifically, Patent Document 1 describes prompting sitting through vision and hearing for a standing person, notifying a driver or the like that there is a standing person, not starting when there is a standing person, and notifying a driver or the like that there is a fallen person.

Prior Art Documents

Patent Documents

[0005]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0006] However, prior art such as Patent Document 1 does not describe how to address future behaviors of current passengers (e.g., standing passengers, passengers looking away). In other words, there is no concept of warning about potential problems that may occur in the future.

[0007] Considering the above facts, the present invention aims to provide an in-vehicle monitoring device and a safety situation monitoring and control program that can issue warning announcements based on the current passenger behavior, according to the degree of risk of potential future incidents. [Means for solving the problem]

[0008] The in-vehicle monitoring device according to the present invention includes: a confirmation unit that confirms the status of a passenger, including whether they are standing or sitting, within the vehicle where the passenger can move; a determination unit that determines the presence or absence of a target passenger corresponding to a preset in-vehicle condition based on determination elements including the status confirmed by the confirmation unit; and a provision unit that provides announcement information to passengers in the vehicle, based on the determination result of the determination unit, suggesting the possibility of an injury affecting the target passenger.

[0009] According to the present invention, the confirmation unit confirms the status of a passenger, including whether they are standing or sitting, within the vehicle where the passenger can move. The determination unit determines, based on the determination elements including the status confirmed by the confirmation unit, whether or not there is a target passenger who matches a preset vehicle condition. The provision unit provides announcement information to passengers in the vehicle, based on the determination result of the determination unit, suggesting the possibility of an injury caused by the target passenger.

[0010] Passengers on board who provide announcement information include, for example, the passenger in question and other passengers located around that passenger.

[0011] This allows for announcements to be made to warn passengers based on their current behavior, according to the degree of risk of potential disruptions.

[0012] In the present invention, the providing unit selects and provides the announcement information based on a table showing the relationship between the determination result of the determination unit and the risk level set in the determination result.

[0013] The present invention is characterized in that the providing unit provides the announcement information when it predicts, based on the determination result of the determination unit, that there is a possibility of an incident caused by the passenger in question.

[0014] The present invention is characterized in that the in-vehicle conditions include the state of the passengers, the relationship between the passengers and the support members installed inside the vehicle, and the acceleration and deceleration of the vehicle, or any one of these states or a combination of two or more states.

[0015] The present invention is characterized in that the in-vehicle conditions include at least one of the following states: a state in which a standing passenger is not holding onto a support member; a state in which a passenger is moving around inside the vehicle and is not looking in the direction of movement; and a state in which a seated passenger stands up while the vehicle is in motion.

[0016] The present invention is characterized in that the providing unit provides the announcement information as announcement information using at least one of a display device that outputs an image and an audio device that outputs sound.

[0017] The present invention is characterized in that, when the providing unit determines different specific states at the same time, it selects from the state with the highest priority assigned to each specific state in advance and provides the announcement information.

[0018] In the present invention, when the providing unit determines different specific states at the same time, it provides the announcement information based on the cumulative degree of each specific state accumulated each time it is determined.

[0019] In the present invention, the providing unit includes a first notification function and a second notification function with different influences on the announcement to the passengers. First, the announcement information is provided using the first notification function, and when there is still a possibility of a failure after the provision of the announcement information by the first notification function, the announcement information is provided using the second notification function. This is the gist of the present invention.

[0020] In the present invention, the first notification function is executed using an audio device that outputs audio, and the second notification function is executed using a display device that outputs an image, or using the audio device and the display device. This is the gist of the present invention.

[0021] In the present invention, the determination unit executes the determination when the vehicle reaches a speed below a predetermined speed in order to park in a parking lot, or when the distance between the vehicle and the parking lot becomes less than a predetermined distance. This is the gist of the present invention.

[0022] In the present invention, the event until a failure further has a database stored for each predetermined degree of failure, and the providing unit reads out an event belonging to the predicted degree of failure from the database, and based on the read event, generates a failure prediction video as the announcement information and displays it on a display unit installed in the vehicle interior. This is the gist of the present invention.

[0023] In the present invention, the confirmation unit confirms a state including the standing or sitting position of the passenger based on an in-vehicle captured image captured by a camera installed in the vehicle interior. This is the gist of the present invention.

[0024] The safety situation monitoring control program according to the present invention causes a computer to operate as the above-described in-vehicle monitoring device. This is the gist of the present invention.

Effect of the Invention

[0025] As described above, in the present invention, based on the current actions of the passengers, it is possible to execute an announcement for alerting according to the risk of a possible future failure, which is an effect of the present invention.

Brief Description of the Drawings

[0026] [Figure 1] It is a side view of a bus with an in-vehicle monitoring device according to this embodiment mounted thereon. [Figure 2] (A) is a plan view of a bus according to this embodiment, and (B) is a perspective view showing the interior of a bus with a different seat arrangement from (A). [Figure 3] (A) is a front view of an output device provided at the back of the driver's seat, and (B) is a state diagram showing the time-series flow of a moving image and sound output by the output device. [Figure 4] (A) is a functional block diagram for executing safety situation monitoring control according to this embodiment, and (B) is an in-vehicle situation - risk level table stored in the in-vehicle situation - risk level table storage unit. [Figure 5] It is a flowchart showing a safety situation monitoring control routine according to this embodiment.

Embodiments for Carrying Out the Invention

[0027] FIG. 1 is a side view of a bus 12 with an in-vehicle monitoring device 10 (see FIG. 4) according to this embodiment mounted thereon. Note that the bus 12 is an example, and the in-vehicle monitoring device 10 can be applied to any vehicle in which passengers 14 board. As an example of a vehicle in which seated passengers 14 and standing passengers 14 are mixed, a bus is exemplified.

[0028] The bus 12 has a driver's seat 18 installed at the front of the vehicle, and seats 16 for passengers 14 to sit are arranged behind the driver's seat 18. Here, the bus 12 is configured such that a driver sits on the driver's seat 18 and drives, but it may be a so-called autonomous bus in which the driver does not directly drive or the driver is unnecessary. The autonomous bus executes various controls for autonomous driving by itself, but it is preferable to construct a system in which an operator monitors remotely.

[0029] The passenger bus 12 is equipped with an entrance / exit 20 at the front of the vehicle and an entrance / exit 21 in the middle of the vehicle. Passengers 14 mainly board through the entrance / exit 20 and alight through the entrance / exit 21, but there are no strict restrictions. In Figure 1, the entrance / exit 20 is shown at the front of the vehicle and the entrance / exit 21 is shown in the middle of the vehicle, but there are also passenger buses that have an entrance / exit at the rear of the vehicle, and the number of entrance / exits (combinations of front, middle, and rear of the vehicle) is not limited.

[0030] The floor surface 22 on which the seats 16 are located is stepped due to the vehicle's structure, and the steps rise towards the rear of the vehicle, making it less safe for passengers 14 to move around compared to a flat surface. Even if it were a flat surface (a low-floor bus), the driver 24 seated in the driver's seat 18 has an obligation to monitor the interior of the vehicle using rearview mirrors (not shown) etc., while driving, to prevent situations where passengers 14 might lose their balance. With a stepped floor surface 22, even more attention must be paid to the interior of the vehicle.

[0031] A wall 48 is installed at the rear of the vehicle behind the driver's seat 18 (at the boundary with the seat 16 located at the very front of the vehicle) to protect the driver 24. An output device 50 is mounted on the rear surface of the wall 48. The output device 50 is equipped with a monitor 50A and a speaker 50B, and provides information to passengers 14 in the form of images (video, still images) and sound as needed. In this embodiment, safety announcements are made according to the degree of danger to passengers 14 inside the vehicle (details will be described later). Note that the installation location of the output device 50 is not limited to the structure of the wall 48, and it may be installed in other locations or multiple locations as long as it is visible to some or all of the passengers 14.

[0032] In general, from the perspective of safety monitoring, passengers 14 seated in seats 16 are considered "safe," while passengers 14 who are not seated are considered "unsafe." In other words, the degree of safety (risk) for passengers 14 within the vehicle differs depending on the presence or absence of standing passengers, and changes in the standing position of seated passengers.

[0033] Here, the passenger bus 12 is equipped with support members such as hand straps 26, support bars 26A that support the hand straps 26, and handrails 28 to prevent standing passengers 14 from losing their balance. By holding onto the support members (by holding on), standing passengers 14 can maintain their posture against the swaying of the bus while it is moving, compared to passengers 14 who are not holding on. Although it is less safe than sitting, standing may be considered safe in some cases. Support members also include assist grips provided at the upper corners of the backrests of seats.

[0034] As shown in Figure 2, surveillance cameras 30, which constitute the in-vehicle monitoring system 10, are installed in each of the four corners (front right, front left, rear right, and rear left) of the passenger bus 12.

[0035] Note that Figures 2(A) and (B) each represent a passenger bus 12, but they illustrate different types of seating arrangements. In addition to these, there are various other seating arrangements, such as so-called face-to-face seating, folding seats, and tour bus-type seating. However, in this embodiment, regardless of the seating arrangement, surveillance cameras 30 are installed at least in all four corners to minimize blind spots.

[0036] The surveillance camera 30 is designed to capture the area in which passengers 14 can move within the vehicle without creating blind spots. The surveillance camera 30 may be an existing safety camera installed to monitor the safety situation inside the vehicle, or a new dedicated camera may be installed to determine whether the seats are full or empty. Using an existing safety camera reduces the number of devices, while using a dedicated camera improves the accuracy of the determination; therefore, both may be used in combination, depending on the situation.

[0037] The field of view of surveillance camera 30A on the front right of the vehicle shows that the area being filmed is the front right side of bus 12. Similarly, the field of view of surveillance camera 30B on the front left of the vehicle shows that the area being filmed is the front left side of bus 12.

[0038] On the other hand, the field of view of the surveillance camera 30C on the right rear of the vehicle shows that the area to the right rear of the passenger bus 12 is captured. Also, the field of view of the surveillance camera 30D on the left rear of the vehicle shows that the area to the left rear of the passenger bus 12 is captured.

[0039] In this embodiment, the captured image information from the four surveillance cameras 30 is aggregated and used to guide passengers 14 based on predetermined objectives through in-vehicle guidance announcements, etc. Note that the number of surveillance cameras 30 may be 1 to 3, or 5 or more, instead of 4.

[0040] The safety status monitoring control unit 32 shown in Figure 4 primarily uses images captured by the surveillance camera 30 to determine the safety (in other words, the level of danger) of the passengers 14 inside the vehicle, and makes announcements as appropriate using the output device 50.

[0041] Furthermore, in this embodiment, information from an acceleration sensor and GPS (both not shown) installed on the bus 12 is taken into account as elements for identifying the presence or absence of passengers at risk and the level of risk. For example, the acceleration sensor detects acceleration and deceleration that occur when the bus 12 starts and stops. The GPS detects the distance from the bus 12's location to the bus stop (not shown).

[0042] The level of danger for passenger 14 inside the vehicle can be considered as follows, as an example. Each situation inside the vehicle has a different level of danger, and they are listed below in descending order of danger level (lower numbers indicate lower danger levels).

[0043] (Danger Level 1) There are standing passengers. (Risk Level 2) When standing passengers are far from the support structure (e.g., they need to take more than one step to reach it). (Risk Level 3) When a seated passenger stands up from a seated position (Risk Level 4) When passengers are moving around inside the vehicle (Risk Level 5) When passengers are moving around inside the vehicle and looking away (e.g., the situation in Figure 3(B)) (Risk Level 6) When passengers are moving around inside the vehicle while it is in motion. (Danger Level 7) When seated passengers stand up as the bus approaches the stop. (Danger Level 8) When seated passengers stand up and the vehicle slows down

[0044] The safety status monitoring control unit 32 (see Figure 4) of the in-vehicle monitoring device 10 selects announcement information based on the risk level set as described above and executes it (provides information to the passenger 14) using the output device 50.

[0045] For example, when the danger level is 5, that is, when it is determined that passenger 14 is moving around inside the vehicle and looking away, as shown in Figure 3(B), the monitor 50A of the output device 50 outputs a video of passenger 14 continuing to use their smartphone while walking and colliding with a wall, and the speaker 50B outputs a voice message saying, "Please refrain from moving around inside the vehicle while it is in motion. Also, please stop using your smartphone while walking, as it is extremely dangerous."

[0046] (In-vehicle monitoring device 10) Figure 4 is a schematic diagram of the in-vehicle monitoring device 10 according to this embodiment, installed in a passenger bus 12 (see Figure 1).

[0047] The in-vehicle monitoring device 10 includes n monitoring cameras 30 (where n is a positive integer, and in this embodiment, n=4) and a safety status monitoring control unit 32.

[0048] When installing multiple surveillance cameras 30, they do not need to be the same model or have the same specifications. Instead, the most suitable camera 30 should be selected for each location, with the most appropriate specifications (magnification, zoom range, wide-angle range, aperture, shutter speed, pan / tilt angle, etc.).

[0049] Furthermore, the surveillance camera 30 only needs to be able to capture the outlines of the passengers 14, and is not limited to images based on density, but may also be images based on temperature differences using infrared light, etc.

[0050] The surveillance camera 30 is connected to the image acquisition unit 34 of the safety situation monitoring control unit 32.

[0051] The image acquisition unit 34 is connected to the in-vehicle status confirmation unit 36 ​​and sends the acquired image information to the in-vehicle status confirmation unit 36.

[0052] The in-vehicle status confirmation unit 36 ​​uses image recognition technology to confirm the status of passengers 14, such as whether there are standing passengers (passengers 14 standing) and whether seated passengers (passengers 14 sitting) have changed to a standing position (standing up).

[0053] The in-vehicle status confirmation unit 36 ​​is connected to the target passenger presence / absence determination unit 38 and outputs the passenger status from the passenger status confirmation unit 36.

[0054] Furthermore, the passenger presence / absence determination unit 38 is connected to the driving information acquisition unit 40, which acquires driving information such as starting and stopping times and the distance to the bus stop, based on acceleration / deceleration information from the acceleration sensor and location information from GPS.

[0055] The passenger presence / absence determination unit 38 is connected to the in-vehicle conditions-risk level table storage unit 42. The passenger presence / absence determination unit 38 combines the passenger status from the passenger status confirmation unit 36 ​​and the driving information acquisition unit 40 to determine whether there are any passengers whose in-vehicle conditions correspond to the in-vehicle conditions-risk level table 42A (see Figure 4(B)) stored in the in-vehicle conditions-risk level table storage unit 42.

[0056] The passenger presence determination unit 38 is connected to the risk level identification unit 44, and if the presence of the passenger is confirmed, it outputs an instruction to identify the risk level.

[0057] The risk level identification unit 44 identifies the risk level based on the in-vehicle situation-risk level table 42A stored in the in-vehicle situation-risk level table storage unit 42, and sends it to the announcement information selection unit 46.

[0058] The announcement information selection unit 46 is connected to the danger level-announcement information table storage unit 47, and selects announcement information (at least one of an image and an audio) from the danger level-announcement information table according to the identified danger level, and sends it to the announcement execution unit 49.

[0059] The announcement execution unit 49 is connected to the output device 50, and images (videos, still images) are output to the monitor 50A, and audio is output to the speaker 50B, and announcements are made to the passengers 14.

[0060] The operation of this embodiment will be explained below with reference to the flowchart in Figure 5.

[0061] The program in the flowchart of Figure 5 is activated, for example, when the passenger bus 12 begins its service. However, the program may also be activated when the engine starts, when it leaves the depot, or by manual operation by the driver.

[0062] In step 100, images captured by the surveillance camera 30 are taken in, then the process moves to step 102 to check the conditions inside the vehicle (presence or absence of standing passengers, changes in the standing position of seated passengers, etc.), and then the process moves to step 104.

[0063] In step 104, driving information (acceleration and deceleration due to starting and stopping, distance to the bus stop, etc.) is collected, and the process moves to step 106.

[0064] In step 106, the presence or absence of the target passenger (passenger 14 with a high risk level) is determined based on the in-vehicle situation - risk level table, and the process proceeds to step 108.

[0065] In step 108, determine whether or not there are any passengers who meet the criteria. If the determination is negative, there is no need to make an announcement, so return to step 100 and repeat the above process.

[0066] Furthermore, if the result in step 108 is positive, an announcement needs to be made, so the process proceeds to step 110.

[0067] Step 110 identifies the risk level (see Figure 4(B)). In the next step, 112, announcement information is selected based on the risk level, and then the process moves to step 114 to deliver the announcement.

[0068] In the next step, 116, it is determined whether the operational operation has finished. If the determination is negative, the process returns to step 100 and the above steps are repeated. If the determination in step 116 is positive, this routine ends.

[0069] Specifically, as shown in Figure 3(B), the monitor 50A of the output device 50 displays a video of passenger 14 continuing to use their smartphone while walking and colliding with a wall, and the speaker 50B outputs audio indicating the level of danger.

[0070] This video may be an animation, or it may be actual footage recorded in the past (with personal information hidden). If it is an animation, it may be exaggerated to emphasize the danger. Animation has the advantage of being easier for passenger 14 to visualize. The characters that appear may be simple stick figures, complex 3D animations, or something in between with a degree of realism.

[0071] Additionally, the audio output from speaker 50B states, "Please refrain from moving around inside the vehicle while it is in motion. Also, please refrain from using your smartphone while walking, as this is extremely dangerous." However, the volume can be adjusted, or sound effects can be used to vary the message according to the level of danger.

[0072] Additionally, the audio output may have the effect of directing the passenger's gaze towards the monitor 50A.

[0073] As described above, in this embodiment, based on the state of passengers 14 inside the vehicle (standing, changes in standing position of seated passengers, etc.) and driving information of the passenger bus 12 (acceleration / deceleration, approaching a bus stop, etc.), it is determined whether or not there are any passengers at risk. If there are such passengers, the level of risk is identified, and an appropriate announcement (image, sound) is made. This allows the passengers to recognize that they are engaging in dangerous behavior inside the vehicle and to take preventative measures against accidents by refraining from such behavior.

[0074] (Variation 1) In this embodiment, the presence or absence of a target passenger is determined and the risk level is identified based on the passenger's in-vehicle condition and driving information using the in-vehicle condition-risk table 42A. However, for example, AI may be used to predict the future movements of passengers 14 based on the in-vehicle condition and driving information, and the presence or absence of a target passenger and the risk level may be identified accordingly.

[0075] In addition to predictions, new videos could be generated in real time and announced as needed.

[0076] (Modification 2) The images displayed on monitor 50A are not limited to videos; they may also be still images or still images in a frame-by-frame sequence. Image and audio output do not always need to be performed simultaneously. Furthermore, images and audio may be intentionally output with a time delay (for example, audio to direct the user's gaze towards monitor 50A, followed by image output).

[0077] (Variation 3) The in-vehicle conditions corresponding to the level of danger are not limited to those shown in the In-Vehicle Conditions-Danger Level Table 42A in Figure 4(B). In addition, more detailed in-vehicle conditions may be defined to determine the presence or absence of danger and the level of danger.

[0078] For example, in this embodiment, the system determines whether a person is simply standing, standing and far from a support member, standing up, standing up and accelerating / decelerating, moving, and moving without looking (looking away). However, by improving the accuracy of the image recognition technology, it may be possible to determine even more detailed conditions inside the vehicle, such as whether there is a stroller, whether high-risk individuals such as the elderly or disabled are standing, or whether there are a relatively large number of children.

[0079] (Modification 4) In this embodiment, the output device 50 was mounted on the rear surface of the rear wall 48 behind the driver's seat 18 of the vehicle, in a position easily visible to all passengers 14. However, it may be mounted on the side of the vehicle (part of the advertising area) or at the rear of the vehicle, or in other locations, for specific passengers. It may also be mounted in multiple locations.

[0080] While it is assumed that multiple output devices 50 will display the same image, if different risk levels occur simultaneously, prioritization may be set in advance, and the higher-priority device may be selected for output, or the announcements on each output device 50 may be changed according to the location of the affected passenger. Alternatively, the announcements may be changed based on the cumulative degree of each in-vehicle situation (specific state) accumulated each time it is identified.

[0081] (Variation 5) In this embodiment, when it is determined that there are passengers posing a risk, an announcement is made according to the level of risk. However, before making an announcement according to the level of risk, a general announcement (e.g., "Those standing, please sit in an empty seat or hold on tightly to a handrail, etc.") may be made, and if there are still passengers posing a risk, then an announcement according to the level of risk may be made.

[0082] (Experimental variation 6) In this embodiment, when it is determined that there is a passenger with a risk level, a single announcement is made according to the risk level. However, a stepwise announcement may be made, such as first making a milder announcement, and if that is insufficient, then making a stronger announcement. For example, a stepwise announcement could be made by first outputting only audio and then outputting an image, or by gradually increasing the volume. Alternatively, for example, a stepwise announcement could be made by first outputting an image and then outputting audio.

[0083] [Note] (Note 1) A confirmation unit that confirms the status of a passenger, including whether they are standing or sitting, within the vehicle where the passenger can move, A determination unit that determines the presence or absence of a target passenger corresponding to a preset in-vehicle condition from the determination elements including the state confirmed by the confirmation unit, Based on the determination result of the determination unit, a provision unit provides announcement information to passengers inside the vehicle suggesting the possibility of injury affecting the target passenger. An in-vehicle monitoring device having the following features.

[0084] (Note 2) The aforementioned supply unit, An in-vehicle monitoring device as described in Appendix 1, which selects and provides the announcement information based on a table showing the relationship between the determination result of the determination unit and the degree of risk set for the determination result.

[0085] (Note 3) The aforementioned supply unit, An in-vehicle monitoring device according to Appendix 1 or Appendix 2, which, based on the determination result of the determination unit, predicts that there is a possibility of an incident caused by the passenger in question, and provides the announcement information.

[0086] (Note 4) An in-vehicle monitoring device according to any one of the appendices 1 to 3, wherein the in-vehicle conditions include the state of the passengers, the relationship between the passengers and the support members installed inside the vehicle, and the acceleration and deceleration of the vehicle, or any one of the states or a combination of two or more states.

[0087] (Note 5) An in-vehicle monitoring device according to any one of the appendices 1 to 4, wherein the in-vehicle conditions include at least one of the following states: a standing passenger is not holding onto a support member; a passenger is moving around the vehicle and is not looking in the direction of movement; and a seated passenger stands up while the vehicle is in motion.

[0088] (Note 6) The aforementioned supply unit, An in-vehicle monitoring device according to any one of Appendix 1 to Appendix 5, which provides the aforementioned announcement information as the aforementioned announcement information using at least one of a display device that outputs an image and an audio device that outputs sound.

[0089] (Note 7) The aforementioned supply unit, An in-vehicle monitoring device as described in any one of Appendix 1 to Appendix 6, which, when different specific states are identified simultaneously, selects the one with the highest priority assigned to each specific state in advance and provides the aforementioned announcement information.

[0090] (Note 8) The aforementioned supply unit, An in-vehicle monitoring device as described in any one of Appendix 1 to Appendix 7, which, when different specific states are identified at the same time, provides the announcement information based on the cumulative degree of each specific state, which is accumulated each time it is identified.

[0091] (Note 9) The aforementioned supply unit, The system is equipped with a first notification function and a second notification function, each having a different impact on the passengers through the announcement. An in-vehicle monitoring device according to any one of the appendices 1 to 8, which first provides the announcement information using the first notification function, and then provides the announcement information using the second notification function if there is still a possibility of a malfunction after the provision of the announcement information by the first notification function.

[0092] (Note 10) The first notification function is performed using an audio device that outputs sound, The in-vehicle monitoring device according to Appendix 9, wherein the second notification function is performed using a display device that outputs an image, or using the audio device and the display device.

[0093] (Note 11) The determination unit, An in-vehicle monitoring device as described in any one of Appendix 1 to Appendix 10, which performs a determination when the vehicle reaches a predetermined speed or less in order to stop at a station, or when the distance between the vehicle and the station becomes less than or equal to a predetermined distance.

[0094] (Note 12) Furthermore, it has a database in which events leading up to a failure are stored according to predetermined levels of failure. The aforementioned supply unit, From the aforementioned database, read out the events that belong to the predicted degree of failure. An in-vehicle monitoring device according to any one of Appendix 1 to Appendix 11, which displays a fault prediction video generated based on the read event as announcement information on a display unit installed inside the vehicle.

[0095] (Note 13) An in-vehicle monitoring device according to any one of Appendix 1 to Appendix 12, wherein the confirmation unit confirms the status of the passenger, including whether they are standing or sitting, based on images of the interior of the vehicle taken by a camera installed inside the vehicle.

[0096] (Note 14) Computers, It will be operated as an in-vehicle monitoring device as described in any one of the appendices 1 to 13. Safety status monitoring and control program. [Explanation of symbols]

[0097] 10 In-vehicle monitoring device, 12 Passenger bus, 14 Passenger, 16 Seat, 18 Driver's seat, 20 Entrance / exit, 21 Entrance / exit, 22 Floor surface, 24 Driver, 26 Handrail, 26A Support bar, 28 Handrail, 30 Surveillance camera 30(A~D), 32 Safety status monitoring control unit, 34 Image acquisition unit, 36 In-vehicle status confirmation unit (confirmation unit), 38 Target passenger presence / absence determination unit, 40 Driving information acquisition unit, 42 In-vehicle status-risk level table storage unit, 42A In-vehicle status-risk level table, 44 Risk level identification unit (determination unit), 46 Announcement information selection unit (providing unit), 47 Risk level-announcement information table storage unit (providing unit), 48 Wall unit, 49 Announcement execution unit (providing unit), 50 Output device (providing unit), 50A Monitor, 50B speaker

Claims

1. A confirmation unit that confirms the status of a passenger, including whether they are standing or sitting, within the vehicle where the passenger can move, A determination unit that determines whether or not there are target passengers corresponding to a preset in-vehicle condition based on the determination elements including the state confirmed by the confirmation unit, Based on the determination result of the determination unit, a provision unit provides announcement information to passengers inside the vehicle suggesting the possibility of injury affecting the target passenger. An in-vehicle monitoring device having the following features.

2. The aforementioned supply unit, The in-vehicle monitoring device according to claim 1, which selects and provides the announcement information based on a table showing the relationship between the determination result of the determination unit and the degree of risk set for the determination result.

3. The aforementioned supply unit, The in-vehicle monitoring device according to claim 1, which provides the announcement information when it is predicted that there is a possibility of an incident caused by the passenger in question, based on the determination result of the determination unit.

4. The in-vehicle monitoring device according to claim 1, wherein the in-vehicle conditions include the state of the passengers, the relationship between the passengers and the support members installed inside the vehicle, and the acceleration and deceleration of the vehicle, or any one of these states or a combination of two or more states.

5. The in-vehicle monitoring device according to claim 1, wherein the in-vehicle conditions include at least one of the following states: a state in which a standing passenger is not gripping a support member; a state in which a passenger is moving around the vehicle and is not looking in the direction of movement; and a state in which a seated passenger stands up while the vehicle is in motion.

6. The aforementioned supply unit, The in-vehicle monitoring device according to claim 1, wherein the announcement information is provided as the announcement information using at least one of a display device that outputs an image and an audio device that outputs sound.

7. The aforementioned supply unit, The in-vehicle monitoring device according to claim 1, which, when different specific states are identified at the same time, selects the one with the highest priority assigned to each specific state in advance and provides the announcement information.

8. The aforementioned supply unit, The in-vehicle monitoring device according to claim 1, which, when different specific states are identified at the same time, provides the announcement information based on the cumulative degree of each specific state, which is accumulated each time it is identified.

9. The aforementioned supply unit, The system is equipped with a first notification function and a second notification function, each having a different impact on the passengers through the announcement. The in-vehicle monitoring device according to claim 1, wherein the first notification function is used to first provide the announcement information, and the second notification function is used to provide the announcement information if there is still a possibility of a malfunction after the announcement information has been provided by the first notification function.

10. The first notification function is performed using an audio device that outputs sound, The in-vehicle monitoring device according to claim 9, wherein the second notification function is performed using a display device that outputs an image, or is performed using the audio device and the display device in combination.

11. The determination unit, The in-vehicle monitoring device according to claim 1, which performs a determination when the vehicle reaches a speed below a predetermined speed in order to stop at a station, or when the distance between the vehicle and the station becomes below a predetermined distance.

12. Furthermore, it has a database in which events leading up to a failure are stored according to predetermined levels of failure. The aforementioned supply unit, From the aforementioned database, read out the events that belong to the predicted degree of failure. The in-vehicle monitoring device according to claim 1, wherein the fault prediction video generated based on the read event is displayed on a display unit installed inside the vehicle as the announcement information.

13. The in-vehicle monitoring device according to claim 1, wherein the confirmation unit confirms the state of the passenger, including whether they are standing or sitting, based on images of the interior of the vehicle taken by a camera installed inside the vehicle.

14. Computers, To be operated as an in-vehicle monitoring device according to any one of claims 1 to 13, Safety status monitoring and control program.

Images