Leaving behind detection system and leaving behind detection method

Abstract

To provide a technology capable of detecting targets to be detected such as children and luggage with high accuracy in a predetermined space such as a vehicle interior.SOLUTION: A leaving behind detection system includes: at least one sensor that detects a target to be detected in a predetermined space; a moving device that is provided within the predetermined space and moves the sensor within the predetermined space; and a processing device that determines whether or not the target to be detected is present in the predetermined space based on the detection result of the sensor.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to an abandonment detection system and an abandonment detection method. [Background technology]

[0002] 2. Description of the Related Art Conventionally, as a child abandonment warning device for use in a vehicle interior such as an automobile, a device that detects whether a child seat belt is fastened and issues a warning has been proposed (for example, Patent Document 1). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2012-188035 A Summary of the Invention [Problem to be solved by the invention]

[0004] When determining whether a child has been left behind in a vehicle by detecting whether the child has their seat belt fastened, it is necessary to ensure that the child has their seat belt fastened, so it was not possible to detect a child who is not fastening their seat belt. Furthermore, it was not possible to detect children on route buses that are not equipped with seat belts, or to detect baggage, etc.

[0005] The technology disclosed herein has been made in consideration of the above-mentioned situation, and its purpose is to provide technology that can accurately detect objects such as children and luggage within a specified space such as the interior of a vehicle. [Means for solving the problem]

[0006] In order to solve the above problems, the technology disclosed herein employs the following configuration: That is, an abandoned object detection system as one aspect of the technology disclosed herein includes at least one sensor that detects an object to be detected within a predetermined space, a moving device that is installed within the predetermined space and moves the sensor within the predetermined space, and a processing device that determines whether the object to be detected is present within the predetermined space based on a detection result of the sensor.

[0007] In addition, in the above-mentioned abandoned object detection system, the processing device may be configured to include a judgment unit that compares a reference state in the specified space with a state of the specified space based on information obtained from the sensor, and determines whether the detection target is present or not.

[0008] In the above-described abandoned object detection system, the processing device may further include a notification unit that notifies an outside party of an abnormality when the detection object is detected within the specified space.

[0009] In the above-described abandoned vehicle detection system, the sensor may further include a power storage device, and the sensor may be configured to be driven by the power storage device.

[0010] In addition, in the above-mentioned abandoned object detection system, the moving device may be equipped with a drive motor, the drive motor may be controlled by a control unit provided in the processing device, and the drive motor may be configured to move the sensor along a predetermined trajectory.

[0011] In the above-mentioned abandoned object detection system, a stop position is provided on the predetermined track, the moving device further includes a position detection unit that detects the stop position, the processing device determines the stop position based on information from the position detection unit, and the sensor detects the stop position. The detection target may be detected by a detection device.

[0012] In addition, in the above-mentioned abandoned object detection system, the moving device may include a power supply device, which may include a power supply roller and a connecting device that provides electrical conductivity along the specified track, and the power supply device may be configured so that the power supply roller and the connecting device come into contact with each other to supply power to the sensor.

[0013] In the above-described abandoned object detection system, the processing device may be configured to start determining whether or not the detection target is present at a predetermined timing.

[0014] Furthermore, an abandoned object detection method as one aspect of the technology disclosed herein may be configured to have a computer execute the following steps: moving a sensor that detects an object to be detected within a specified space; performing detection using the sensor; comparing a reference state within the specified space with a state of the specified space based on information obtained by the detection based on information obtained from the sensor, and determining whether or not the object to be detected is present; generating notification data based on the determination result of the presence or absence of the object to be detected; and notifying the notification data. Effect of the Invention

[0015] According to the present disclosure, it is possible to provide a technology that can accurately detect detection targets such as children and baggage within a specified space such as the interior of a vehicle. [Brief description of the drawings]

[0016] [Figure 1] FIG. 1 is a cross-sectional view taken along the traveling direction of a bus equipped with an abandoned vehicle detection system according to an embodiment. [Diagram 2] FIG. 2 is an overall view of the abandoned object detection system according to the embodiment, seen from above. [Diagram 3] FIG. 3 is a diagram illustrating each element of the abandoned object detection system according to the embodiment. [Figure 4] FIG. 4 is a diagram illustrating a mobile unit of the abandoned object detection system according to the embodiment. [Diagram 5]FIG. 5 is a diagram illustrating a power supply device and the like of the abandoned object detection system according to the embodiment. [Figure 6] FIG. 6 is a diagram illustrating the overall configuration of an abandoned object detection system according to an embodiment. [Figure 7] FIG. 7 is a diagram illustrating a processing device of the abandoned object detection system according to the embodiment. [Figure 8] FIG. 8 is a flowchart illustrating the abandonment detection method according to the embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0017] Hereinafter, an embodiment of the present disclosure will be described with reference to the drawings. Note that each configuration and their combinations in the present embodiment are merely examples, and the configurations can be added, omitted, replaced, and otherwise modified as appropriate within the scope of the present invention. Furthermore, the present disclosure is not limited to the embodiments, but is limited only by the claims. The embodiment described below is an aspect in which an abandoned vehicle detection system according to the present disclosure is installed inside a bus cabin, but the technology of the present disclosure is not limited to this. In other words, the technology of the present disclosure can be used to install an abandoned vehicle detection system not limited to inside a bus cabin.

[0018] <Embodiment> [Device configuration] FIG. 1 is a cross-sectional view of the bus 100 along the traveling direction of the bus 100 equipped with the abandoned vehicle detection system 1 according to the embodiment. FIG. 2 is an overall view of the abandoned vehicle detection system 1 according to the embodiment viewed from above. For convenience of explanation of the embodiment, the front side of the bus 100 is defined as the front side, and the rear side of the bus 100 is defined as the rear side in the traveling direction of the bus 100. As shown in FIG. 2, the driver's seat 1010 side of the bus 100 is defined as the right side, the passenger seat 102 side is defined as the left side, the ceiling side of the vehicle interior is defined as the upper side, and the floor side is defined as the lower side. Such front side, rear side, right side, left side, upper side, and lower side merely indicate the relative positional relationship of each element in the abandoned vehicle detection system 1 and the bus 100.

[0019] The bus 100 includes a vehicle interior space 100A (an example of a "predetermined space" in the present disclosure), a driver's seat 101, a passenger seat 102, a plurality of passenger seats 103, a ceiling 104, a floor 105, a right wall 106R, a left wall 106L, and the like. In this embodiment, the vehicle interior space 100A is formed as a space in which the upper side is closed by the ceiling 104, the lower side is closed by the floor 105, the right side is closed by the right wall 106R, and the left side is closed by the left wall 106L. The vehicle interior space 100A is provided with the driver's seat 101, the passenger seat 102, and a plurality of passenger seats 103, all of which are installed on the floor 105. However, the arrangement of the seats in the vehicle interior space 100A in this embodiment is merely an example, and the passenger seats 103 may be arranged in a long seat structure, for example.

[0020] The abandoned vehicle detection system 1 includes a camera 10 (an example of a "sensor" in this disclosure), a moving device 20, a processing device 30 (an example of a "computer" in this disclosure), a power storage device 40, and a power supply device 50. The abandoned vehicle detection system 1 is configured to be able to capture an image of a child 2 (an example of a "detection target" in this disclosure) that is one of the occupants in a vehicle interior space 100A using the camera 10 regardless of the location of the child 2. FIG. 1 shows a moving unit 99 that includes the camera 10, the processing device 30, the power storage device 40, and a part of the position detection unit 24. The moving unit 99 is installed on the belt 22 and is configured to be movable in accordance with the movement of the belt 22 by the operation of the moving device 20. In addition, as shown in FIG. 2, the moving device 20 is installed on a ceiling 104, and a route R is defined as a track along which the moving device 20 moves the camera 10 (moving unit 99). The route R is set so that the camera 10 passes above a passenger seat 102 and a plurality of passenger seats 103. In this embodiment, the route R does not include the upper part of the driver's seat 101, but this is not limited thereto, and the route R can be changed depending on the application. Furthermore, the detection target detected by the abandoned vehicle detection system 1 is not limited to a human being, and may be, for example, an object such as an umbrella or a wallet. Furthermore, in this embodiment, the abandoned vehicle detection system 1 is installed in the bus 100, but the location where the abandoned vehicle detection system 1 is installed is not limited to the inside of the vehicle cabin, and for example, the abandoned vehicle detection system 1 may be installed so that the detection target can be photographed in the indoor space of a building or other structure as the predetermined space.

[0021] The camera 10 is an example of a sensor that captures images of the interior of the vehicle interior space 100A. The camera 10 of this embodiment is provided on a moving device 20 installed on the ceiling 104, and is installed facing the floor 105. This allows the camera 10 to capture images of the interior of the vehicle interior space 100A from the ceiling 104 side. The camera 10 moves by the moving device 20, and captures still images of the seat surfaces of the passenger seat 102 and each passenger seat 103 in the vehicle interior space 100A, leg spaces provided in the passenger seat 102 and each passenger seat 103, and the like, at the position of a position detection seal 242 described later. In this embodiment, the camera 10 is a general wide-angle camera having an imaging element, and its operation is controlled by a camera control unit 311 included in the processing device 30 described later. However, the mode of the camera 10 is not limited to this, and for example, the camera 10 may continuously capture video images, or the camera 10 may be replaced with a temperature sensor, an ultrasonic sensor, a three-dimensional scanner, or the like to capture images.

[0022] The moving device 20 includes a driving motor 21, a belt 22, a vent pulley 23, and a position detection unit 24. As shown in FIG. 2, the belt 22 extends along a route R, and defines a "predetermined track" in the present disclosure. A vent pulley 23 is provided at each bend of the belt 22 on the route R. In this embodiment, by providing a plurality of vent pulleys 23, the route R is set so that the belt 22 can make a full circle on the ceiling 104 and pass above the passenger seat 102 and all passenger seats 103. A drive pulley 211 is connected to the driving motor 21, and the rotational motion of the driving motor 21 drives the belt 22 via the drive pulley 211. In this embodiment, the driving motor 21 is a DC motor, and the driving motor 21 is provided in parallel with a control board (not shown) and connected to each other. The control board is equipped with a processor and a communication IF, and is connected to a processing device 30 described later by wireless communication or the like. As a result, the operation of the driving motor 21 is controlled by a movement control unit 312 included in the processing device 30. In addition, the drive motor 21 is preferably equipped with a rotational speed sensor or the like for controlling the drive motor 21. However, the form of the drive motor 21 is not limited thereto, and may be, for example, an AC motor or a servo motor. When an AC motor is used for the drive motor 21, an inverter device may be further provided together with the drive motor 21. The belt 22 is formed in a belt shape like a chain as described later. Thereby, when the drive motor 21 operates, the belt 22 operates to rotate along the path R. The length of the belt 22 is ensured to be sufficient to rotate around the upper side of the passenger seat 102 and all passenger seats 103 arranged in the vehicle interior space 100A. However, although a part of the belt 22 is omitted in FIG. 2, in reality, the belt 22 is provided continuously so as to rotate once. In addition, a tension pulley or the like capable of adjusting the tension of the belt 22 may be further added to the moving device 20.

[0023] FIG. 3 is a diagram for explaining each element of the abandoned vehicle detection system 1. In this embodiment, a plurality of protrusions are formed on the circumference of the drive pulley 211 connected to the drive motor 21. In this embodiment, the belt 22 is formed in a belt-like shape like a chain by connecting a plurality of rubber links 221. In addition, since the plurality of links 221 are connected to each other and continuously by a first connector 52 described later, the belt 22 is formed to be bendable. The links 221 are formed with recesses 222 that fit with protrusions provided on the drive pulley 211. This allows the rotational motion of the drive motor 21 to be reliably transmitted to the belt 22 via the drive pulley 211.

[0024] In this embodiment, a configuration including one each of the processing device 30, the power storage device 40, and the position detection sensor 241 for one camera 10 is referred to as a moving unit 99. FIG. 4 shows a perspective view of the moving unit 99 seen from the longitudinal direction. In the moving unit 99, the camera 10 and the processing device 30 are stored in one frame 221, the power storage device 40 is stored in one frame 221, and the position detection sensor 241 is stored in one frame 221. The processing device 30, the power storage device 40, and the position detection sensor 241 are each connected by a ribbon cable, and the connection is maintained without being broken even when the belt 22 is bent. However, the form of the moving unit 99 is not limited to this, and for example, the outer shell of the moving unit 99 may be formed by a roughly box-shaped housing. In this case, it is preferable that the housing is formed of a bendable material, for example, rubber, etc., and can be deformed along the circumference of the drive pulley 211. The housing may be configured such that one end and the other end are connected to the pieces 221 in the longitudinal direction of the moving unit 99, so that the housing moves in conjunction with the movement of the belt 22. Furthermore, the housing may be connected to at least one piece 221 via a hinge or the like, and the housing may be formed of a rigid body, so that the housing can move with the belt 22 without being deformed to fit the circumference of the drive pulley 211.

[0025] 4 is a diagram illustrating a moving unit 99 according to an embodiment. In FIG. 4, a frame 221 in which the processing device 30 and the camera 10 of the moving unit 99 are stored is shown on the circumference of the drive pulley 211. When the belt 22 moves, In order not to impede the rotation of top 221, processing device 30, camera 10, power storage device 40, and position detection sensor 241 are each formed to be equal to or smaller than the size of top 221. As a result, even when moving unit 99 moves accompanying belt 22, processing device 30, camera 10, power storage device 40, and position detection sensor 241 are configured not to impede the movement of top 221.

[0026] The embodiment of the moving device 20 is one example, and for example, a guide rail may be installed along the path R and the camera 10 may be moved along the guide rail, or the belt 22 may be replaced with a wire, a V-belt, a rubber belt, or the like.

[0027] The position detection unit 24 includes a position detection sensor 241 and a position detection sticker 242. In this embodiment, the position detection sensor 241 uses a photoelectric sensor that emits a light beam and captures reflected light, and the position detection sticker 242 uses a reflective tape. FIG. 1 shows an example of a position where the position detection sticker 242 is attached. The position detection sticker 242 is installed at a position on the route R corresponding to a stop position where the camera 10 stops and takes pictures. The stop position is a position set so that images used to determine the presence or absence of a child 2 (detection target) can be taken without omission, such as images of the seat surface of the passenger seat 102 and each passenger seat 103, leg spaces provided in the passenger seat 102 and each passenger seat 103, and an aisle in the vehicle interior space 100A. In this embodiment, a plurality of stop positions are set on the route R, and the position detection stickers 242 are installed on the right wall surface 106R and the left wall surface 106L along the route R. 3, the position detection sensor 241 is included in the moving unit 99 together with the camera 10 on the belt 22. This allows the position detection sensor 241 to capture a change in reflected light at a specific position on the route R where the position detection sticker 242 is attached, making it possible to determine a stop position for photographing by the camera 10. In addition, the position of each stop position within the vehicle interior space 100A may be specified by changing the reflectance of each position detection sticker 242, or by providing an IC tag receiving device in the position detection sensor 241 and embedding an IC tag in the position detection sticker 242. However, the method of detecting the position of the position detection unit 24 is just one example, and for example, the position detection sensor 241 may be replaced with a physical sensor or a protrusion may be provided on the position detection sticker 242.

[0028] FIG. 5 is a diagram for explaining the power supply device 50 and the like related to the abandoned object detection system 1. As shown in FIG. 5, the power storage device 40 is supplied with power by the power supply device 50. In addition, the camera 10, the processing device 30, the power storage device 40, and the position detection sensor 241 included in the moving unit 99 are electrically connected to each other by ribbon cables, so that electricity supplied to the power storage device 40 is distributed to and used by each of the processing device 30, the camera 10, and the position detection sensor 241. However, the method of connecting the camera 10, the processing device 30, the power storage device 40, and the position detection sensor 241 of the moving unit 99 is not limited to this, and for example, the camera 10, the processing device 30, the power storage device 40, and the position detection sensor 241 may be connected to each other by flexible substrates, or all of the camera 10, the processing device 30, the power storage device 40, and the position detection sensor 241 may be mounted on one electronic substrate.

[0029] The power supply device 50 includes a power supply roller 51, a first connector 52, a second connector 53, and a power supply cable 54. The power supply roller 51, the first connector 52, and the second connector 53 are formed of a conductive material such as metal. The power supply roller 51 includes a positive power supply roller 511 and a negative power supply roller 512. The first connector 52 includes a positive first connector 521 and a negative first connector 522. The second connector 53 includes a positive second connector 531 and a negative second connector 532. The power supply cable 54 includes a positive power supply cable 541 and a negative power supply cable 542. The power supply roller 51 in this embodiment is installed above and below the belt 22, and electricity is supplied from an external power source (not shown). The first connector 52 is connected to the belt 22. The plurality of frames 221 are pivotally connected to each other and configured to receive electricity from the power supply roller 51. One end of the second connector 53 is connected to the first connector 52 attached to the frame 221, and the other end is connected to the first connector 52 attached to the other frame 221. In this manner, the first connector 52 and the second connector 53 are electrically connected continuously to each other in the plurality of frames 221, so that power can be supplied along the belt 22 (path R) formed by the plurality of frames 221. According to this, when the power supply roller 51 and the first connector 52 come into contact with each other, power is supplied along the belt 22, so that even if the moving unit 99 is moved to any position on the belt 22 or a plurality of moving units 99 are installed on the belt 22, power can be supplied to the moving unit 99. One end of the power supply cable 54 is connected to the second connector 53, and the other end is connected to the power storage device 40. As a result, electricity supplied from the power supply roller 51 is transmitted to the power storage device 40 of the moving unit 99 via the first connector 52, the second connector 53, and the power supply cable 54.

[0030] In this embodiment, for example, the electrical components of the bus 100 are driven by a DC 24-volt power source, and the +-side power supply roller 511 and the --side power supply roller 512 are supplied with electricity from a vehicle battery or an alternator mounted on the bus 100. As shown in FIG. 5, a +-side first connector 521 is provided on the upper side of the belt 22 so as to contact the +-side power supply roller 511, and the multiple +-side first connectors 521 are connected to each other by a +-side second connector 531. The +-side second connector 531 is connected to a +-side power supply cable 541. One end of the +-side power supply cable 541 is connected to the +-side second connector 531, and the other end is connected to the power storage device 40 of the moving unit 99. In addition, a --side first connector 522 is provided on the lower side of the belt 22 so as to contact the --side power supply roller 512, and the multiple --side first connectors 522 are connected to each other by the --side second connector 532. The negative side second connector 532 is connected to the negative side power supply cable 542. One end of the negative side power supply cable 542 is connected to the negative side second connector 532, and the other end is connected to the power storage device 40 of the mobile unit 99.

[0031] When the belt 22 moves, the contact between the power supply roller 51 and the first connector 52 is intermittent. More specifically, when the belt 22 moves from the position where the power supply roller 51 and the first connector 52 are in contact, a section where the power supply roller 51 and the first connector 52 do not contact each other occurs until the belt 22 reaches the position where the power supply roller 51 and the next first connector 52 are in contact. In this embodiment, for convenience, the section is called a no-power section. That is, in the power supply along the belt 22, the contact position between the power supply roller 51 and the first connector 52 and the no-power section are alternately switched, and the power supply to the moving unit 99 is intermittent. In the no-power section, the power storage device 40 of the moving unit 99 supplies power to the processing device 30 and the camera 10. The power storage device 40 is composed of, for example, a lithium ion battery or a supercapacitor. This allows continuous power supply to the camera 10, the processing device 30, and the position detection sensor 241. At this time, it is desirable for the processing device 30 to switch the power supply destination. However, the manner of power supply to the camera 10 and the processing device 30 is not limited to this, and for example, the camera 10 itself may be equipped with a rechargeable battery such as a supercapacitor, so that power can be supplied to the camera 10 in a non-powered section where there is no power supply from the power supply roller 51.

[0032] FIG. 6 is a diagram for explaining the overall configuration of the abandoned vehicle detection system according to the embodiment. The mobile unit 99 according to the present embodiment is provided in the mobile device 20, which is installed in the vehicle interior space 100A. The processing device 30 provided in the mobile unit 99 is connected to the management server 3 and the administrator terminal 4 via a communication line 5 such as the Internet. It is preferable that the management server 3 and the administrator terminal 4 are monitored by, for example, the company that owns the bus 100, the operator of the bus 100, or a person in charge of a monitoring service provider. FIG. 7 is a diagram for explaining the processing device 30 according to the embodiment. The processing device 30 is a so-called computer, and is electrically connected to the camera 10, the mobile device 20, the power storage device 40, the position detection sensor 241, etc. 7, the processing device 30 includes a CPU 31, a main memory device 32, an auxiliary memory device 33, a communication IF (Interface) 34, and an I / O IF (Input / Output Interface) 35. The processing device 30 performs various functions, such as taking pictures with the camera 10, starting and stopping the operation of the mobile device 20, processing information acquired by the position detection sensor 241, detecting the child 2 based on information acquired by the camera 10, and notifying the user when the child 2 is inside the vehicle interior space 100A. The processing device 30 includes a CPU 31, a main memory device 32, an auxiliary memory device 33, a communication IF (Interface) 34, and an I / O IF (Input / Output Interface) 35, as shown in FIG.

[0033] The CPU 31 executes a program to perform the processes described in this embodiment. For example, the CPU 31 provides the functions of a camera control unit 311, a movement control unit 312, a position processing unit 313, a determination unit 314, and a notification unit 315.

[0034] The camera control unit 311 acquires an image of the interior of the vehicle interior space 100A by using the camera 10 to take a photograph at a predetermined timing. At this time, the camera control unit 311 may simultaneously control focus adjustment and focal position adjustment. In this embodiment, the camera control unit 311 performs an operation to acquire a still image using the camera 10. At this time, the camera control unit 311 cooperates with the movement control unit 312 and the position processing unit 313 described later to stop the camera 10 at the stop position, and an image without blur can be acquired. In addition, the camera control unit 311 may be provided with an image sharpening function such as an electronic image stabilization function so that an even clearer image can be acquired.

[0035] The movement control unit 312 controls the start and stop of rotation, the direction of rotation, and the number of rotations of the drive motor 21 of the moving device 20. In this embodiment, the drive motor 21 uses a DC motor, so the number of rotations is controlled by changing the drive voltage of the drive motor 21 using PWM control or the like. At this time, the change to a predetermined number of rotations, the stop of rotation, and the information on the direction of rotation may be processed by processing a signal from a rotation speed sensor or the like mounted on the drive motor 21. In addition, in this embodiment, the movement control unit 312 is wirelessly connected to a control board (not shown) attached to the drive motor 21 via a communication IF 34 described later. More specifically, since the control board attached to the drive motor 21 includes a processor and a communication IF, the CPU 31 mounted on the processing device 30 transmits and receives signals via the communication IF 34, and the processor of the control board attached to the drive motor 21 transmits and receives signals via the communication IF provided on the control board, so that the drive motor 21 is controlled. As a result, the processing result of the movement control unit 312 is reflected in the drive motor 21. However, the function of the movement control unit 312 may be incorporated in a processor of a control board provided in association with the drive motor 21, and the processing device 30 may be installed as a separate processing device.

[0036] The position processing unit 313 detects the stop position of the camera 10 on the route R based on the information acquired by the position detection sensor 241. The position processing unit 313 processes information for the movement control unit 312 to start and stop the rotation of the drive motor 21. For example, when the position detection sensor 241 receives reflected light reflected by the position detection sticker 242, the position processing unit 313 recognizes that the camera 10 provided in the same moving unit 99 as the position detection sensor 241 has reached a stop position for photographing. At this time, as described above, the reflectance of the position detection sticker 242 may be changed for each sticker, or an IC tag receiving device may be provided in the position detection sensor 241 and an IC tag may be embedded in the position detection sticker 242, to specify the position of each stop position within the vehicle interior space 100A. In this case, the position of each position detection sticker 242 may be detected by the position processing unit 313. When the driving motor 21 starts rotating again after the camera 10 has completed shooting, the operation of detecting the next stopping position of the camera 10 is resumed. However, the operation of the position processing unit 313 is not limited to this, and for example, it is also possible to stop the camera 10 at an arbitrary position and take an image without using the position detection unit 24 by measuring the travel distance and travel time of the belt 22 in the moving device 20. Furthermore, the position processing unit 313 may perform a calibration operation every time the camera makes one revolution to check whether a positional deviation has occurred. More specifically, in order to reduce a positional deviation, it may perform a calibration operation to check whether a predetermined stopping position and the camera are located at the predetermined stopping position and the travel time of the belt 22 in the moving device 20 are measured. By detecting a deviation from the actual position of camera 10 using position processing unit 313, an operation instruction may be sent to movement control unit 312 to move camera 10 to a normal stop position in order to correct the deviation.

[0037] The determination unit 314 determines whether or not the child 2 is present in the vehicle interior (presence or absence of a detection target) based on an image captured by the camera 10 (hereinafter also simply referred to as a captured image). For example, the determination unit 314 may determine whether or not the child 2 (detection target) is captured in the captured image by pattern matching or AI. The determination unit 314 may also compare an image (preliminary image) acquired in advance (an example of a "reference state" in this disclosure) with an image captured by the camera 10, and determine that the child 2 is present when the preliminary image and the captured image are different (there is a difference). According to this, when the child 2 that did not exist in the preliminary image is captured in the captured image, the object is determined to be the child 2, and the child 2 is determined to be present in the vehicle interior space 100A. In addition, when the difference is equal to or smaller than a predetermined value (threshold value), it may be determined that the child 2 is not present in the vehicle interior space 100A as noise, and when the difference is greater than the predetermined value, it may be determined that the child 2 is present in the vehicle interior space 100A. At this time, even if the photographing position of the preliminary image and the photographing position of the image captured by the camera 10 are different stopping positions (position of the position detection sticker 242), a process of determining the difference may be performed by image processing. More specifically, for example, by generating and storing three-dimensional information of the interior of the vehicle interior space 100A from a plurality of preliminary images, even if the photographing position of the preliminary image and the photographing position of the image captured by the camera 10 are different, a difference between a 2D image obtained from the three-dimensional information of the interior of the vehicle interior space 100A and the photographed image acquired by the camera 10 may be obtained to determine that the child 2 is present.

[0038] In this embodiment, the determination unit 314 detects the child 2 as a detection target, but may detect the removal or destruction of equipment in the vehicle interior space 100A. For example, when an object that existed before the operation of the bus 100 is no longer present after the operation of the bus 100, it is determined that the equipment has been removed. Furthermore, when an object that existed before the operation of the bus 100 is partially removed or its shape has changed after the operation of the bus 100, it is determined that the equipment has been destroyed. Note that the position of movable equipment in the vehicle interior space 100A is registered as a movable object, and even if the equipment is not present at the position before the operation of the bus 100 after the operation of the bus 100, if the equipment is present at a different position, it is determined that the equipment has been moved normally, and it is not necessary to determine that the equipment has been taken away. Then, the position of the movable object is updated to the position after the movement. In addition, equipment that can move within a specified range (for example, opening and closing the doors, reclining, sliding, etc.) such as the boarding and alighting doors, driver's seat 101, and passenger seat 102 of bus 100 can be registered in advance as an object that can move within a specified range, and if the equipment is found within the range of movement after bus 100 has started operating, regardless of its position before bus 100 started operating, it can be determined that the movement is normal and it does not have to be determined that an abnormality has occurred.

[0039] When the camera 10 continuously captures video, the determination unit 314 may determine that the child 2 is present in the vehicle interior space 100A by capturing a moving object. In this case, the determination unit 314 may perform a process of tracking the child 2, and may transmit a signal to the camera 10 in cooperation with the movement control unit 312 so that the camera 10 continues to capture the child 2 regardless of the child's location. In addition, when the camera 10 is a temperature sensor, the function of the determination unit 314 may be appropriately changed depending on the configuration of the camera 10, for example, the camera 10 may determine that the child 2 is present in the vehicle interior space 100A by detecting an abnormality in temperature.

[0040] When the determination unit 314 determines that the child 2 is present in the vehicle interior space 100A, the notification unit 315 displays information indicating that the child 2 is present in the vehicle interior space 100A on a display device such as the administrator terminal 4. This information is object detection information in the present disclosure, and is generated by extracting, for example, the difference between an image of the bus 100 before it starts moving and an image of the bus 100 after it starts moving, and generating notification data indicating the child 2. In addition, the notification may be made by displaying text information toward the outside of the bus 100 or playing audio information. In the case of displaying text information, the notification unit 315 The notification unit 315 may be connected to a display device such as an LED direction sign (not shown) installed on the bus 100. This may output a message such as "There is a person inside" using text or images to a display device that is visible outside the bus 100. In addition, in the case of reproducing audio information, the notification unit 315 may be connected to an audio output device such as an exterior speaker (not shown) installed on the bus 100. This may transmit an audio signal to the exterior speaker, etc., to output an audio message such as "There is a person inside" or to reproduce an alarm to the outside of the vehicle. In addition, the notification unit 315 may include this identification information in the event information and transmit it to the management server 3 or the administrator terminal 4. When it is determined that a child 2 is present in the vehicle interior space 100A, the event information (abandonment occurrence information) notifying the information is transmitted to the management server 3 or the administrator terminal 4. In addition, when the location processing unit 313 identifies the location of each stopping position within the vehicle interior space 100A, the detailed location of the child 2 within the vehicle interior space 100A may be included in the event information and transmitted to the management server 3 or the administrator terminal 4.

[0041] The main memory device 32 is used as a cache for programs and data read by the CPU 31, and as a working area for the CPU. Specifically, the main memory device 32 is a RAM (Random Access Memory) or a ROM (Read Only Memory), etc. The main memory device 32 stores, for example, images acquired in advance to be used by the determination unit 314, and when comparing the images acquired in advance with the images captured by the camera 10, the determination unit 314 can refer to the images acquired in advance.

[0042] The auxiliary storage device 33 stores programs executed by the CPU 31, setting information used in this embodiment, etc. Specifically, the auxiliary storage device 33 is an HDD, an SSD, a flash memory, or the like.

[0043] The communication IF 34 transmits and receives data to and from other computer devices. Specifically, the communication IF 34 is a wired or wireless network card or the like. In this embodiment, the functions of the CPU 31 are accessed from a computer such as the administrator terminal 4 via the communication IF 34, inputs to the functions of the CPU 31 are received, and information is output to a user. In addition, signals of the movement control unit 312 may be transmitted and received to and from a control board provided in addition to the drive motor 21 via the communication IF 34. Furthermore, when a plurality of movement units 99 are provided on the belt 22, one movement unit 99 may share information with the other movement units 99 and cooperate with each other by performing wireless communication or the like via the communication IF 34. More specifically, the information of each movement unit 99 may be shared among the functions of the CPU 31 by making one movement unit 99 a parent unit and making the other movement units 99 child units.

[0044] Processing device 30 may further include a GPS or the like and may detect location information of bus 100. Location information of bus 100 identified by the GPS may be transmitted to manager terminal 4 using communication IF 34 so that the manager can manage the location information of bus 100, or the location information may be transmitted to management server 3 using communication IF 34 so that a log of the location information may be stored by management server 3.

[0045] [Method of detecting abandoned items] Next, an abandoned object detection method based on the operation of the abandoned object detection system 1 according to the embodiment will be described. However, the operation of the abandoned object detection system 1 of the present disclosure is not limited to the following procedure. Fig. 8 is a flowchart explaining the abandoned object detection method according to the embodiment. The following description will be given based on Fig. 8.

[0046] In the abandoned vehicle detection system 1 in this embodiment, the movement control unit 312 detects the timing when the ignition of the bus 100 is turned off (an example of the "predetermined timing" in this disclosure), and starts the detection operation of the child 2. At the timing when it is turned off, the detection start condition of step S5 is satisfied. When the detection start condition of step S5 is satisfied, the abandoned object detection system 1 proceeds to step S10. In step S10, the movement control unit 312 sends a signal to a control board attached to the drive motor 21, causing the drive motor 21 to start rotating. This allows the camera 10 to start moving. However, the detection start condition is one example, and for example, the detection start condition may be set to coincide with a scheduled time at any timing before or after the bus 100 is in operation, or if the processing device 30 is equipped with a GPS or the like, the detection start condition may be satisfied by detecting that the bus 100 has returned to the garage.

[0047] In step S20, the position processing unit 313 judges whether the camera 10 is at the stop position. At this time, if the camera 10 is at the stop position based on the detection result of the position detection sensor 241, the process proceeds to step S30 and the rotation of the drive motor 21 is stopped. After the rotation of the drive motor 21 is stopped in step S30, the camera 10 captures an image based on a signal from the camera control unit 311 in step S40. Alternatively, if the camera 10 is not at the stop position, the drive motor 21 continues to rotate until the camera 10 moves to the stop position. However, this is just one example, and for example, the process may proceed to step S40 without going through step S30, while the drive motor 21 is rotating, and the camera 10 captures an image. After the image is captured, in step S50, the judgment unit 314 compares the image acquired beforehand with the image captured by the camera 10, and judges the presence or absence of a child 2 (detection target) based on the difference between the beforehand image and the captured image.

[0048] After the process of step S50, if the child 2 is detected by the determination unit 314 in step S60 (an example of a "determination result" in this disclosure), object detection information (an example of "notification data" in this disclosure) is generated in step S70. The object detection information is generated by the notification unit 315, and an image of the child 2 photographed in step S40 and text information and audio information directed to the outside of the bus 100 are generated. Also, if the child 2 is not detected by the determination unit 314 in step S60 after the process of step S50, the process returns to step S10 and the drive motor 21 starts rotating again. At this time, the operation from the determination of the stop position in step S20 to the detection of the object in step S60 is performed in about 3 seconds, and the operation of step S10 is repeated, which helps to obtain an image with less blur in step S40. However, the time of the operation from the determination of the stop position in step S20 to the detection of the object in step S60 and the stop time for the shooting time related to step S40 are not limited to these and may be freely set.

[0049] The object detection information generated in step S70 notifies a person outside the vehicle interior space 100A that a child 2 is present in the vehicle interior space 100A by the notification of the object detection information in step S80. At this time, the image showing the child 2 (detection object) is transmitted to the management server 3 or the administrator terminal 4 as event information (abandonment occurrence information) that notifies information. Also, when text information directed to the outside of the vehicle interior space 100A is generated in step S60, a text message or the like is output to a display device such as an LED direction sign installed in the bus 100. At this time, the image generated in step S60 or a warning image prepared in advance may be displayed on the display device. Also, when audio information is generated in step S60, audio information may be output by an audio output device such as an outward-facing speaker installed in the bus 100, or an alarm may be played toward the outside of the vehicle interior space 100A.

[0050] The notification of the object detection information in step S80 allows a person outside the vehicle interior space 100A to confirm the notification. In step S90, an operator of a computer such as the administrator terminal 4 can operate a terminal such as the administrator terminal 4 to send an instruction to stop operation to the abandoned vehicle detection system 1. At this time, if the operator of the terminal does not issue an instruction to stop operation to the abandoned vehicle detection system 1, the process returns to step S10 and the drive motor 21 starts rotating again.

[0051] The steps relating to steps S5, S10, S20, S30, S40, S50, S60, S70, S80, and S90 are executed by the processing device 30. In addition, the camera control unit 311, the movement control unit 312, and the position processing unit 313 may cooperate to determine whether or not the detection start condition of step S10 is satisfied. This allows the processing device 30 to make flexible decisions, such as taking an image of step S40 before the drive motor 21 starts rotating in step S10, when the start condition of step S5 is satisfied with the camera 10 in a stopped position.

[0052] [Effects] According to the abandoned object detection system 1 of this embodiment, the camera 10 can move within the vehicle interior space 100A and capture images of the entire vehicle interior space, so that objects to be detected such as a child 2 or baggage can be detected with high accuracy.

[0053] In addition, since the camera 10 itself moves, there is no need to use a lens with a wide angle of view such as an ultra-wide-angle lens. This provides excellent cost performance when replacing the camera 10. In addition, since there is no need to install many cameras 10 in the vehicle interior space 100A, it is possible to reduce the number of cameras while minimizing blind spots in the vehicle interior space 100A.

[0054] Furthermore, even if the position of the passenger seats 103 is changed or the seats are arranged in the vehicle interior space 100A, the stop position (the photographing position of the camera 10) can be changed by a simple task such as replacing the position detection sticker 242.

[0055] Although the embodiments according to the present disclosure have been described above, each aspect disclosed in this specification can be combined with any other feature disclosed in this specification. [Explanation of symbols]

[0056] 1: Abandonment detection system 2: Children 10: Camera 20: Mobile device 30: Processing device 99: Photographing unit 100: Bus 100A: Vehicle interior space

Claims

1. At least one sensor that detects a detection target within a predetermined space; a moving device that is installed inside the predetermined space and moves the sensor inside the predetermined space; and a processing device that determines whether the detection target is present in the predetermined space based on the detection result of the sensor. Abandonment detection system.

2. The processing device includes a determination unit that compares a reference state in the predetermined space with a state of the predetermined space based on information obtained from the sensor, and determines whether the detection target is present. The abandonment detection system according to claim 1 .

3. When the processing device detects the detection target in the predetermined space, Further comprising a notification unit for notifying an external device of an abnormality. The abandonment detection system according to claim 2 .

4. The sensor further includes a power storage device. The sensor is driven by the power storage device. The abandonment detection system according to claim 1 .

5. The moving device is A drive motor is provided. The drive motor is controlled by a control unit provided in the processing device, The drive motor moves the sensor along a predetermined trajectory. The abandonment detection system according to claim 1 .

6. The predetermined track is provided with a stop position, The moving device further includes a position detection unit that detects the stop position, The processing device determines the stop position based on information from the position detection unit, and the sensor detects the detection target at the stop position. The abandonment detection system according to claim 5 .

7. The mobile device includes a power supply device, The power supply device includes a power supply roller and a connector that conducts electricity along the predetermined track, The power supply device supplies power to the sensor by contacting the power supply roller with the connector. The abandonment detection system according to claim 5 .

8. the processing device starts detecting the detection target within the specified space at a specified timing. The abandonment detection system according to claim 1 .

9. Sending a signal to move a sensor that detects an object within a predetermined space; A step of performing detection by the sensor, and a step of comparing a reference state in the predetermined space with a state of the predetermined space based on information obtained by the detection and determining the presence or absence of the detection target; generating notification data based on a result of the determination of the presence or absence of the detection target; and notifying the notification data, A method for detecting abandonment.

Images