Vehicle periphery monitoring device

Abstract

To protect a vehicle from animals.SOLUTION: A vehicle periphery monitoring device that monitors the periphery of a vehicle includes: a detection unit that detects an object in the periphery of the vehicle (various sensors such as an on-board camera, a radar sensor, a sound sensor, an impact sensor); an in-vehicle device that can perform threatening actions toward given animals (a horn, lamps, a speaker in a notification unit of an HMI device); and a processor (a control unit). The processor identifies whether the object is a given animal based on the detection results by the detection unit (step S114 and step S118), and if the object is identified as the given animal, controls the in-vehicle device to perform the threatening actions (step S119).SELECTED DRAWING: Figure 2

Description

Technical Field

[0001] This disclosure relates to a vehicle peripheral monitoring device that monitors the periphery of a vehicle.

Background Art

[0002] Conventionally, there has been a vehicle peripheral monitoring device that uses an in-vehicle camera to photograph the peripheral situation of a vehicle and take measures to prevent the vehicle from suffering damage such as theft (see, for example, Patent Document 1).

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] The object approaching the vehicle is not limited to a person, and it is also conceivable that it is an animal. Therefore, it is desirable to take measures so that the vehicle is not damaged by animals.

[0005] This disclosure has been made to solve such problems, and an object thereof is to provide a vehicle peripheral monitoring device capable of protecting a vehicle from animals.

Means for Solving the Problems

[0006] The vehicle peripheral monitoring device according to this disclosure is a device that monitors the periphery of a vehicle, and includes a detection unit that detects an object around the vehicle, an in-vehicle device capable of performing a threatening action against a predetermined animal, and a processor. The processor identifies whether the object is a predetermined animal from the detection result by the detection unit, and controls the in-vehicle device to perform a threatening action when it is identified that the object is a predetermined animal.

[0007] According to such a configuration, when an object around the vehicle is identified as a predetermined animal, a threatening action is executed on the predetermined animal. As a result, it is possible to provide a vehicle peripheral monitoring device capable of protecting the vehicle from animals.

Brief Description of the Drawings

[0008]

Figure 1

Figure 2

Embodiments for Carrying Out the Invention

[0009] Hereinafter, embodiments of the present disclosure will be described in detail with reference to the drawings. In the drawings, the same or corresponding parts are denoted by the same reference numerals and their description will not be repeated.

[0010] FIG. 1 is a block diagram for explaining the configuration of a vehicle peripheral monitoring system 10 according to this embodiment. Referring to FIG. 1, the vehicle peripheral monitoring system 10 includes a vehicle 100 and a mobile terminal 200 used by a user of the vehicle 100. The vehicle 100 and the mobile terminal 200 are configured to be communicable via a communication network 300 such as the Internet or a telephone line. The vehicle 100 and the mobile terminal 200 are configured to be able to exchange information with the communication network 300 by wireless communication.

[0011] The vehicle 100 includes a control device 110, a communication unit 130, various sensors 160, an in-vehicle camera 170, an HMI (Human Machine Interface) device 180, a horn 150, and lamps 140. The control device 110, the communication unit 130, the in-vehicle camera 170, the HMI device 180, the horn 150, and the lamps 140 are connected to each other by a wired in-vehicle network 190 such as a CAN (Controller Area Network).

[0012] The communication unit 130 transmits and receives data with an external device (e.g., a mobile terminal 200, etc.) via a communication network 300 according to a predetermined protocol. The communication unit 130 transmits the data received from a device connected to the in-vehicle network 190 such as the control device 110 to the outside, or delivers the data received from the outside to a device connected to the in-vehicle network 190 such as the control device 110.

[0013] The various sensors 160 detect the actions on the vehicle 100. The detection signals of the various sensors 160 are transmitted to the HMI device 180 or the control device 110. The various sensors 160 include a radar sensor 162, a sound sensor 164, and a shock sensor 165. The various sensors 160 may include at least one of these, or may include other sensors.

[0014] The radar sensor 162 detects an abnormal approach of any object to the vehicle 100 by radio waves or the like. The sound sensor 164 detects only abnormal sounds in a specific frequency band such as the cries of animals around the vehicle 100. The shock sensor 165 detects an impact on the vehicle body by any object.

[0015] The in-vehicle camera 170 is, for example, a CCD (Charge Coupled Device) camera, and is attached to at least one of the front, rear, right, and left of the vehicle 100. The in-vehicle camera 170 captures an image of the periphery of the vehicle 100. The captured data of the in-vehicle camera 170 is transmitted to the HMI device 180 or the control device 110.

[0016] The HMI device 180 includes a control unit 181 for controlling the entire HMI device 180, a storage unit 182 for storing predetermined information, an operation unit 183 for operating the HMI device 180, and a notification unit 184 for displaying and notifying the predetermined information of the HMI device 180 by voice.

[0017] The memory unit 182 includes a RAM (Random Access Memory) used as a work area necessary for the control unit 181 to execute programs, and a ROM (Read Only Memory) for storing programs to be executed by the control unit 181. Also, programs and data for executing predetermined processes are read from the ROM or the like and stored in the RAM. Further, a recording medium such as a memory card may be used as an auxiliary storage device for assisting the storage area of the RAM.

[0018] The operation unit 183 includes a plurality of operation buttons for causing the HMI device 180 to execute predetermined functions, and a touch panel formed on the display of the notification unit 184. An operation signal indicating the operation content input to the HMI device 180 when the operation buttons and the touch panel of the operation unit 183 are operated is passed to the control unit 181.

[0019] The notification unit 184 includes a liquid crystal display device (hereinafter referred to as "LCD" (Liquid Crystal Display)) having a touch panel formed on the display, and a speaker. The LCD of the notification unit 184 displays an image received from the control unit 181, such as information regarding the vehicle 100 and an image indicating the operation buttons of the touch panel. Note that the notification unit 184 may include another FPD (Flat Panel Display) such as an EL (Electro-Luminescence) display instead of the LCD. The speaker of the notification unit 184 outputs the voice signal received from the control unit 181 as voice.

[0020] The control unit 181 consists of a CPU (Central Processing Unit) and its auxiliary circuits. The control unit 181 controls the storage unit 182, the operation unit 183, and the notification unit 184, executes predetermined processing according to the programs and data stored in the storage unit 182, processes the data input from the operation unit 183 or other devices (such as the in-vehicle camera 170, the control device 110, and the communication unit 130, etc.) connected to the in-vehicle network 190, and stores the processed data in the storage unit 182, or causes the notification unit 184 to notify, or outputs it to other devices.

[0021] The horn 150 is a so-called siren that emits a loud alarm sound to the outside, and is controlled by the control device 110 in response to an operation of the horn button by the user to emit an alarm sound.

[0022] The lamps 140 include the headlight 141, the tail lamp 142, and the turn lamp 143. The headlight 141 is controlled by the control device 110 in response to a user's operation to illuminate the front of the vehicle 100. The tail lamp 142 is lit by the control device 110 together with the headlight 141 in response to a user's operation to turn on the headlight 141 to notify the presence of the own vehicle to the following vehicles, etc. Also, when the tail lamp 142 is used in combination with the brake lamp, it is lit by the control device 110 at an illuminance brighter than that as a tail lamp in response to a user's brake operation. The turn lamp 143 is controlled by the control device 110 in response to a user's operation during a right or left turn or a course change to indicate the traveling direction of the vehicle 100 to the surroundings, or is used as a hazard lamp to indicate that the vehicle 100 is in an emergency by flashing left and right simultaneously.

[0023] The control device 110 is a so-called ECU (Electronic Control Unit), and includes a control unit 111 for controlling the entire vehicle 100 and a storage unit 112 for storing predetermined information. Since the storage unit 112 is the same as the storage unit 182 of the aforementioned HMI device 180, duplicate explanations will not be repeated.

[0024] The control unit 111 consists of a CPU and its auxiliary circuits. The control unit 111 executes predetermined processing according to the programs and data stored in the storage unit 112, processes the data input from other devices (such as the communication unit 130, the in-vehicle camera 170, and the HMI device 180, etc.) connected to the in-vehicle network 190, stores the processed data in the storage unit 112, outputs it to other devices such as the HMI device 180 and the in-vehicle camera 170, or controls other devices such as the HMI device 180 and the horn 150. Further, the control unit 111 controls each part such as the drive device of the motor generator so that the vehicle 100 is in a desired state according to the signals from various sensors of the vehicle 100.

[0025] The mobile terminal 200 includes a control unit 210 for controlling the entire mobile terminal 200, a storage unit 220 for storing predetermined information, an operation unit 230, an output unit 240, an external storage device 250, and a wireless communication unit 270. Although not shown, the mobile terminal 200 also includes other configurations such as a voice input / output unit for inputting and outputting voice.

[0026] The control unit 210 consists of a CPU and its auxiliary circuits, controls the storage unit 220, the operation unit 230, the output unit 240, and the wireless communication unit 270, executes predetermined processing according to the programs or data stored in the storage unit 220, processes the data input from the operation unit 230 and the wireless communication unit 270, and stores the processed data in the storage unit 220 or outputs it to the output unit 240 and the wireless communication unit 270.

[0027] The storage unit 220 includes a RAM used as a work area necessary for the control unit 210 to execute programs, and a ROM for storing programs for the control unit 210 to execute. Also, programs and data for executing predetermined processing are read from the operation unit 230, the wireless communication unit 270, or the external storage device 250 and stored in the RAM. Further, a memory card may be used as an auxiliary storage device for assisting the storage area of the RAM.

[0028] The external memory device 250 is composed of a memory card reader / writer. The external memory device 250 electrically records the predetermined data or program received from the control unit 210 on a recording medium 251 such as a memory card or a USB (Universal Serial Bus) memory, or reads the data from the recording medium 251 and delivers it to the control unit 210.

[0029] The operation unit 230 includes a touch panel and operation buttons for inputting numbers, alphabets, other characters such as telephone numbers and various data. Note that the operation unit 230 may include parts for other operations. When the operation unit 230 is operated by the user, an operation signal corresponding to the operation is transmitted from the operation unit 230 to the control unit 210. The control unit 210 controls each part of the mobile terminal 200 according to the operation signal from the operation unit 230.

[0030] The wireless communication unit 270 is controlled by the control unit 210 to receive a wireless signal via a communication device capable of data communication, such as the vehicle 100 or another mobile terminal 200, and the communication facilities and antennas of the telecommunications carrier, convert the received wireless signal into data, store the converted data in the storage unit 220, or transmit the data to the output unit 240 for display. At the same time, the data to be transmitted is converted into a wireless signal and transmitted to the vehicle 100 or another mobile terminal 200 that is the data communication destination via the antenna and the communication facilities of the telecommunications carrier.

[0031] In addition, the wireless communication unit 270 is controlled by the control unit 210 to exchange data with other network communication-capable devices, such as the vehicle 100 and another mobile terminal 200, via a public wireless LAN or a wireless LAN of a private network.

[0032] The output unit 240 includes a display and a speaker. The output unit 240 is controlled by the control unit 210 to display, as images, the image signals and audio signals obtained by converting the information received by the wireless communication unit 270, the information stored in the storage unit 220, or the information read from the recording medium 251 by the external storage device 250 by the control unit 210 on the display, and to output them as sounds from the speaker.

[0033] In the vehicle 100 described above, it is conceivable to use the in-vehicle camera 170 to photograph the surrounding situation of the vehicle 100 and take measures to prevent the vehicle from suffering damage such as theft. The object approaching the vehicle 100 is not limited to a person, and it is also conceivable that it is an animal. Therefore, it is desirable to take measures to prevent the vehicle 100 from being damaged by animals.

[0034] Therefore, the control device 110 identifies whether the object is a predetermined animal from the detection results by the in-vehicle camera 170 or various sensors 160, and controls in-vehicle devices such as the horn 150 to execute a threatening operation when the object is identified as a predetermined animal. The predetermined animal is an animal other than a human, for example, a wild boar, a deer, a bear, etc. that may cause harm to the vehicle 100, or a creature that does not want to approach the vehicle, such as a cat that gets into the bonnet or the like.

[0035] As a result, when the object around the vehicle 100 is identified as a predetermined animal, a threatening operation is executed on the predetermined animal by the in-vehicle device. As a result, the vehicle 100 can be protected from animals.

[0036] FIG. 2 is a flowchart showing the flow of the peripheral monitoring process executed in this embodiment. Referring to FIG. 2, the peripheral monitoring process includes a peripheral monitoring vehicle-side process executed by the control device 110 of the vehicle 100 and a peripheral monitoring terminal-side process executed by the control unit 210 of the mobile terminal 200. The peripheral monitoring vehicle-side process is called from an upper-level process at a predetermined cycle by the control unit 111 of the control device 110 and executed. The peripheral monitoring terminal-side process is called from an upper-level process included in an application program related to the vehicle 100 installed in the mobile terminal 200 and executed.

[0037] In the vehicle 100, the control unit 111 determines whether the vehicle 100 is parked (step S111). If it is determined that the vehicle is parked (YES in step S111), the control unit 111 detects a threat to the vehicle 100 using the in-vehicle camera 170 and various sensors 160 (step S112). For example, as a threat to the vehicle 100, an object approaching the vehicle 100 is detected by the in-vehicle camera 170 or the radar sensor 162, an abnormal sound such as an animal's cry is detected by the sound sensor 164, or an impact on the vehicle 100 is detected by the impact sensor 165.

[0038] If it is determined that a threat has been detected (YES in step S112), the control unit 111 controls the in-vehicle camera 170 to capture the periphery of the vehicle 100 and stores the captured image in the storage unit 112 (step S113). Then, the control unit 111 determines whether what is shown in the captured image is an object, a person, or an animal using image processing technology (step S114).

[0039] When it is determined that an object or a person is shown in the captured image, the control unit 111 determines whether the person is a person pre-registered in the storage unit 112 by using an image processing technique (step S115). When it is determined that the person is a pre-registered person (YES in step S115), the control unit 111 executes a pre-registered operation that is not a warning operation (for example, an operation of flashing the turn lamp 143 once, an operation of outputting a greeting voice such as "Good day" or "Good evening" from the speaker of the notification unit 184 of the HMI device 180 according to the time zone), and controls the communication unit 130 to transmit notification information notifying that the pre-registered person has approached the vehicle 100 to the mobile terminal 200 (step S116).

[0040] In the mobile terminal 200, the control unit 210 determines whether notification information has been received from the vehicle 100 (step S211). When it is determined that notification information has been received (YES in step S211), the control unit 210 causes the information indicating that the pre-registered person has approached the vehicle 100, which is included in the notification information, to be displayed on the screen of the display of the output unit 240 (step S212). When it is determined that notification information has not been received (NO in step S211), or after step S212, the control unit 210 proceeds to step S213 for the process to be executed.

[0041] In the vehicle 100, when it is determined that the person is not a pre-registered person (NO in step S115), the control unit 111 stores the data of the captured image in the storage unit 112, executes warning light emission by the lamps 140 such as the headlight 141, and controls the communication unit 130 to transmit alarm information notifying that a person who is not pre-registered has approached the vehicle 100 to the mobile terminal 200 (step S117).

[0042] When it is determined that an animal is shown in the captured image, the control unit 111 determines whether the animal is an animal to be warned (for example, the aforementioned predetermined animal) (step S118). When it is determined that the animal is an animal to be warned (YES in step S118), the control unit 111 restarts the shooting by the in-vehicle camera 170, executes warning light emission by the lamps 140 such as the headlight 141, and controls the communication unit 130 to transmit warning information indicating that any of the predetermined animals has approached the vehicle 100 to the mobile terminal 200, and controls to sound the horn 150 or output a threatening sound (for example, the cry of an animal that is a natural enemy of the predetermined animal) from the speaker of the notification unit 184 of the HMI device 180 (step S119).

[0043] When it is determined that the animal is not an animal to be warned (NO in step S118), after steps S116, S117, and S119, when it is determined that the vehicle is not parked (NO in step S111), or when it is determined that no threat to the vehicle is detected (NO in step S112), the control unit 111 returns the process to be executed to the upper-level process of the call source of this process.

[0044] In the mobile terminal 200, the control unit 210 determines whether warning information has been received from the vehicle 100 (step S213). When it is determined that warning information has been received (YES in step S213), the control unit 210 causes the information indicating that an unregistered person has approached the vehicle 100 or that any of the predetermined animals has approached the vehicle 100, which is included in the warning information, to be displayed on the screen of the display of the output unit 240 (step S214). When it is determined that warning information has not been received (NO in step S213), or after step S214, the control unit 210 returns the process to be executed to the upper-level process of the call source of this process.

[0045] [Modification Example] (1) In the above-described embodiment, the control unit 111 of the control device 110 executes the peripheral monitoring vehicle-side processing shown in FIG. 2. However, the present invention is not limited to this, and other control devices, for example, the control unit 181 of the HMI device 180 may execute it.

[0046] (2) In the above-described embodiment, as shown in steps S212 and S214 of FIG. 2, information is displayed on the display of the output unit 240 of the mobile terminal 200. However, the present invention is not limited to this, and it may be displayed on other devices. For example, it may be notified by the display or speaker of the notification unit 184 of the HMI device 180 of the vehicle 100.

[0047] (3) The above-described embodiment can be regarded as a disclosure of the vehicle peripheral monitoring system 10 or the vehicle 100 as shown in FIG. 1, and a detection unit for detecting an object around the vehicle 100 (for example, various sensors 160 such as the in-vehicle camera 170, the radar sensor 162, the sound sensor 164, and the impact sensor 165), an in-vehicle device capable of performing a threatening operation on a predetermined animal (for example, the horn 150, the lamps 140, and the speaker of the notification unit 184 of the HMI device 180), and a control device 110, and can be regarded as a disclosure of a vehicle peripheral monitoring device provided in the vehicle 100 for monitoring the periphery of the vehicle. It can also be regarded as a disclosure of a vehicle peripheral monitoring method or program by the vehicle peripheral monitoring system 10, the vehicle 100, or the vehicle peripheral monitoring device as shown in FIG. 2.

[0048] [Summary] As shown in FIG. 1, the vehicle surrounding monitoring device is a device that monitors the surroundings of the vehicle 100, and includes a detection unit that detects an object around the vehicle 100 (for example, various sensors 160 such as in-vehicle camera 170, radar sensor 162, sound sensor 164, impact sensor 165), an in-vehicle device capable of performing a threatening operation on a predetermined animal (for example, horn 150, lamps 140, speaker of notification unit 184 of HMI device 180), and a processor (for example, control device 110). As shown in FIG. 2, the processor identifies whether the object is a predetermined animal from the detection result by the detection unit (for example, step S114, step S118), and controls the in-vehicle device to perform a threatening operation when it is identified that the object is a predetermined animal (for example, step S119).

[0049] Thereby, when an object around the vehicle 100 is identified as a predetermined animal, a threatening operation is performed on the predetermined animal. As a result, the vehicle 100 can be protected from animals.

[0050] The embodiments disclosed this time should be considered as illustrative in all respects and not restrictive. The scope of the present disclosure is shown not by the description of the above-described embodiments but by the claims, and is intended to include all modifications within the meaning and scope equivalent to the claims.

Description of Reference Numerals

[0051] 10 Vehicle surrounding monitoring system, 100 Vehicle, 110 Control device, 111, 181, 210 Control unit, 112, 182, 220 Storage unit, 130 Communication unit, 140 Lamps, 141 Headlight, 142 Taillight, 143 Turn signal, 150 Horn, 160 Various sensors, 162 Radar sensor, 164 Sound sensor, 165 Impact sensor, 170 In-vehicle camera, 180 HMI device, 183, 230 Operation unit, 184 Notification unit, 190 In-vehicle network, 200 Portable terminal, 240 Output unit, 250 External storage device, 251 Recording medium, 270 Wireless communication unit, 300 Communication network.

Claims

Claim 1 A vehicle peripheral monitoring device for monitoring the periphery of a vehicle, comprising: a detection unit that detects an object around the vehicle; an in-vehicle device capable of performing a threatening operation on a predetermined animal; and a processor, wherein the processor identifies whether the object is the predetermined animal from the detection result by the detection unit, and controls the in-vehicle device to perform the threatening operation when the object is identified as the predetermined animal. A vehicle peripheral monitoring device.

Images