Information processing device, information processing method, and information processing program

The information processing device accurately identifies pets in vehicles and issues alarms only when specific conditions are met, addressing the inefficiencies of existing systems in distinguishing pets and temperature-based determinations to prevent accidents.

JP2025128738APending Publication Date: 2025-09-03OKI ELECTRIC INDUSTRY CO LTD
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
JP2024025616
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2024-02-22
Publication Date
2025-09-03

AI Technical Summary

Technical Problem

Existing in-vehicle accident prevention systems struggle to accurately distinguish between pets and other occupants, leading to inappropriate alerts and inefficient temperature-based determinations of vehicle abnormalities.

Method used

An information processing device that utilizes an imaging unit and sensors to identify the type of animal inside a vehicle, sets specific animal and temperature conditions, and issues an alarm only when these conditions are met for a predetermined time, thereby preventing accidents by accurately detecting abnormal states.

Benefits of technology

The system effectively prevents accidents by accurately identifying pets left in vehicles and issuing alarms only when abnormal conditions persist, reducing unnecessary alerts and ensuring timely intervention.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2025128738000001_ABST
    Figure 2025128738000001_ABST
Patent Text Reader

Abstract

To provide an information processing device, an information processing method, and an information processing program capable of preventing an accident involving an animal left behind in a vehicle.SOLUTION: An information processing device 10 acquires an in-vehicle image taken by an imaging part in a vehicle, and state information representing a state of the inside of the vehicle obtained by a sensor in the vehicle. The information processing device 10 discriminates the kind of an animal captured in the image based on the acquired image. The information processing device 10 determines whether or not the inside of the vehicle is in an abnormal state based on the discriminated kind of the animal, the acquired state information, a condition regarding a preset kind of an animal, and a condition regarding preset state information. The information processing device 10 outputs a notification signal outside the vehicle when a determination result represents the abnormal state.SELECTED DRAWING: Figure 1
Need to check novelty before this filing date? Find Prior Art

Description

[Technical Field]

[0001] The present invention relates to an information processing device, an information processing method, and an information processing program. [Background technology]

[0002] In recent years, there have been many accidents in which small children have been left in cars and the temperature inside the car has risen, causing damage to the children's health or even death.

[0003] In response to this, there has been proposed an in-vehicle accident prevention device that issues an alarm or provides appropriate measures to mitigate the abnormality depending on the occupants left in the vehicle in the abnormal state.

[0004] For example, Patent Document 1 discloses an in-vehicle accident prevention device that includes an occupant detection unit that detects occupants inside the vehicle, an abnormality detection unit that detects abnormalities inside the vehicle, and a control unit that, when the occupant detection unit detects an occupant and the abnormality detection unit detects an abnormality, controls an alarm device to issue an alarm inside or outside the vehicle, or controls on-board equipment to alleviate the abnormality inside the vehicle; the occupant detection unit extracts physical or behavioral characteristics of the occupants inside the vehicle and further detects the type of occupant or the ability of the occupant to respond to the abnormality; and the control unit issues an alarm using the alarm device or alleviates the abnormality using on-board equipment depending on the type or state of the occupant detected by the occupant detection unit. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] Japanese Patent Publication No. 2020-93684 Summary of the Invention [Problem to be solved by the invention]

[0006] Patent Document 1 describes detecting the type of occupant or the state of whether the occupant can respond to an abnormality. For example, Patent Document 1 discloses that the types of occupants include infants, pets (animals such as dogs and cats), children, impaired adults (those with illnesses or disabilities), and able-bodied adults (e.g., paragraph

[0045] ). However, there is room for improvement in determining whether an occupant left in a vehicle is a pet and setting conditions for reporting the same.

[0007] The present invention has been made in consideration of the above-mentioned circumstances, and aims to provide an information processing device, an information processing method, and an information processing program that can prevent accidents involving animals left behind in vehicles. [Means for solving the problem]

[0008] The information processing device of the present invention comprises an acquisition unit that acquires an image of the interior of the vehicle captured by an imaging unit inside the vehicle and status information indicating the status of the interior of the vehicle obtained by a sensor inside the vehicle; a discrimination unit that discriminates the type of animal appearing in the image based on the image acquired by the acquisition unit; an abnormality judgment unit that judges whether the interior of the vehicle is in an abnormal state based on the type of animal discriminated by the discrimination unit, the status information acquired by the acquisition unit, predetermined conditions related to the type of animal, and predetermined conditions related to the status information; and an alarm unit that outputs an alarm signal to the outside of the vehicle when the judgment result by the abnormality judgment unit indicates an abnormal state.

[0009] In addition, the information processing method of the present invention acquires an image of the interior of the vehicle taken by an imaging unit inside the vehicle and status information indicating the status of the interior of the vehicle obtained by a sensor inside the vehicle, determines the type of animal appearing in the image based on the acquired image, determines whether the interior of the vehicle is in an abnormal state based on the determined type of animal, the acquired status information, predetermined conditions related to the type of animal, and predetermined conditions related to the status information, and if the determination result indicates an abnormal state, outputs an alarm signal to the outside of the vehicle.

[0010] In addition, the information processing program of the present invention acquires an image of the interior of the vehicle taken by a photographing unit inside the vehicle and status information indicating the status of the interior of the vehicle obtained by a sensor inside the vehicle, determines the type of animal appearing in the image based on the acquired image, determines whether the interior of the vehicle is in an abnormal state based on the determined type of animal, the acquired status information, predetermined conditions related to the type of animal, and predetermined conditions related to the status information, and causes a computer to execute a process of outputting an alarm signal to the outside of the vehicle if the determination result indicates an abnormal state. [Effects of the Invention]

[0011] According to the present invention, it is possible to provide an information processing device, an information processing method, and an information processing program that are capable of preventing accidents involving animals left behind in vehicles. [Brief explanation of the drawings]

[0012] [Figure 1] 1 is a diagram for explaining an outline of an information processing device according to an embodiment of the present invention; [Figure 2] 1 is a block diagram showing a schematic configuration of an information processing device according to an embodiment of the present invention; [Figure 3] 2 is a block diagram showing the configuration of a main part of an electrical system of a control unit in the drive recorder according to the embodiment; FIG. [Figure 4] 5 is a flowchart showing an example of the flow of processing performed by a control unit of the drive recorder of the information processing device according to the present embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0013] Hereinafter, the present embodiment will be described with reference to the drawings. Fig. 1 is a diagram for explaining an outline of an information processing device according to the present embodiment. Fig. 2 is a block diagram showing a schematic configuration of the information processing device according to the present embodiment.

[0014] As shown in FIG. 1, an information processing device 10 according to this embodiment includes a drive recorder 12, a human presence sensor 14, and a temperature sensor 16 as an example of a sensor.

[0015] The drive recorder 12, the human presence sensor 14, and the temperature sensor 16 are provided inside the vehicle 18.

[0016] The drive recorder 12 is provided in a position where it can record images of the interior of the vehicle, for example, near the ceiling at the front of the vehicle, to record images of the interior of the vehicle.

[0017] The drive recorder 12 is also capable of communicating with a GPS satellite 20 and has a function of detecting the position of the vehicle based on a signal from the GPS (Global Positioning System) satellite 20.

[0018] A plurality of human presence sensors 14 and a plurality of temperature sensors 16 are installed inside the vehicle, for example, on the ceiling of each seat in the vehicle 18. The human presence sensors 14 detect the presence or absence of animals inside the vehicle, and the temperature sensors 16 detect the temperature inside the vehicle. The animals are, for example, pets of occupants (people) of the vehicle 18. Note that, although the present embodiment shows an example in which a plurality of human presence sensors 14 and a plurality of temperature sensors 16 are provided, there may be only one of each. The temperature detected by the temperature sensor 16 at each time is stored in a storage 30D, which will be described later.

[0019] In detail, as shown in FIG. 2, the drive recorder 12 includes a control unit 30 as an example of an acquisition unit, a discrimination unit, an abnormality determination unit, and an alarm unit, a photographing unit 32, a communication unit 34 as an example of a contact means, a GPS receiving unit 36, and a display operation unit 38.

[0020] The photographing unit 32, the communication unit 34, the GPS receiving unit 36, and the display operation unit 38 are connected to the control unit 30. In addition, the human sensor 14 and the temperature sensor 16 are connected to the control unit 30.

[0021] The photographing unit 32 photographs images of the interior of the vehicle. The photographing unit 32 is, for example, a camera. The photographing unit 32 photographs the interior of the vehicle, particularly photographs animals present in the vehicle, and the communication unit 34 is capable of communicating with an information processing terminal 22 such as an external computer via wireless communication. In this embodiment, the communication unit 34 communicates with, for example, the information processing terminal 22 of a passenger or company that manages the vehicle 18 and has a pre-contract with the information processing terminal 22. Note that communication between the communication unit 34 and the information processing terminal 22 may be via a wireless base station and a router (not shown). For example, communication may be via the Internet.

[0022] The GPS receiver 36 receives signals from a plurality of GPS satellites 20 to determine the position of the vehicle 18 .

[0023] The display operation unit 38 displays various information of the drive recorder 12 and functions as a user interface for performing various settings, etc. For example, it may be configured with a touch panel, or may be configured with a liquid crystal display and mechanical switches.

[0024] FIG. 3 is a block diagram showing the configuration of the main parts of the electrical system of the control unit 30 in the drive recorder 12 according to this embodiment.

[0025] The control unit 30 is composed of a general microcomputer including a CPU (Central Processing Unit) 30A, a ROM (Read Only Memory) 30B, a RAM (Random Access Memory) 30C, a storage 30D, an interface (I / F) 30E, and a bus 30F.

[0026] The CPU 30A is a central processing unit that controls the overall operation of the device by executing various programs. The ROM 30B stores various control programs, such as information processing programs, and various parameters in advance. The RAM 30C is used as a work area when the CPU 30A executes various programs. The storage 30D is composed of various storage units, such as a hard disk drive (HDD), a solid state drive (SSD), and a flash memory, and stores various data and application programs. The I / F 30E is connectable to, for example, a communication unit 34, and transmits and receives various data to and from external devices via the communication unit 34. The above-mentioned units of the control unit 30 are electrically connected to each other by a bus 30F.

[0027] The information processing device 10 according to this embodiment determines the type of animal left behind in a vehicle 18. If the determined type of animal corresponds to a predetermined type of animal and the temperature inside the vehicle satisfies a predetermined temperature condition, the information processing device 10 performs processing to notify the outside.

[0028] Specifically, the human presence sensor 14 detects an animal inside the vehicle 18 while the vehicle 18 is stopped. For example, the human presence sensor 14 detects an animal left inside the vehicle at a timing such as a predetermined time after the vehicle 18 has stopped and the ignition switch (not shown) has been turned off.

[0029] When the human sensor 14 detects a person, it notifies the control unit 30 of the drive recorder 12 that a person has been detected.

[0030] When the control unit 30 is notified that an animal has been detected by the human sensor 14, the control unit 30 acquires the time-series information of the temperature information stored in the storage 30D.

[0031] The control unit 30 also controls the imaging unit 32 of the drive recorder 12 to capture images of the interior of the vehicle and acquire images of the interior of the vehicle.

[0032] The control unit 30 determines the type of animal appearing in an image based on an image of the interior of the vehicle. For example, the control unit 30 determines the type of animal appearing in the image using well-known AI (Artificial Intelligence) recognition technology. The trained model is configured to be able to determine the type of animal appearing in an image from an input image. For example, when an animal is input from an image of the interior of the vehicle, the trained model outputs a probability for each type of animal. Therefore, for example, the control unit 30 outputs the type of animal corresponding to the highest probability among the probabilities output by the trained model as the determination result.

[0033] In addition, the occupant of the vehicle 18 can set conditions related to the type of animal (hereinafter simply referred to as "animal conditions") and the temperature (hereinafter simply referred to as "temperature conditions") by operating the display operation unit 38 of the drive recorder 12. The animal conditions are conditions related to the type of animal present inside the vehicle. The temperature conditions are an example of conditions related to status information that represents the status inside the vehicle. By operating the display operation unit 38 to set the animal conditions and the temperature conditions, the occupant of the vehicle 18 can set the type of animal that will be notified of an abnormality to the outside and the temperature at which it is determined that the interior of the vehicle is abnormal.

[0034] For example, if the type of animal that the occupant of vehicle 18 owns is a cat, the occupant sets the type of animal to cat by operating display operation unit 38. Also, for example, if the type of animal that the occupant of vehicle 18 owns is a dog, the occupant sets the type of animal to dog by operating display operation unit 38. This sets the animal condition for the target to be notified to the outside.

[0035] Next, the occupant of the vehicle 18 sets the temperature conditions by operating the display operation unit 38. The temperature conditions include the temperature and its duration.

[0036] For example, first, the occupant of vehicle 18 sets a temperature range in which the type of animal set above can live comfortably inside the vehicle. For example, the occupant of vehicle 18 sets the temperature inside the vehicle to be equal to or higher than 5°C and lower than 30°C as the predetermined temperature range. A state of equal to or higher than 5°C and lower than 30°C is the temperature range in which the type of animal set above can live comfortably inside the vehicle, and if the temperature falls outside this range (for example, if the temperature inside the vehicle is lower than 5°C or higher than 30°C), an external notification may be required.

[0037] Furthermore, the occupant of vehicle 18 sets the duration of the temperature. For example, the occupant of vehicle 18 assumes that his pet cat can only tolerate a temperature outside the above-mentioned range for about an hour, and sets the duration of the temperature to one hour. In such a case, the temperature condition is met when the temperature inside the vehicle is below 5°C or above 30°C and this condition continues for one hour or more. In this case, it is determined that an abnormal condition has occurred, as will be described later, and the condition is notified to the outside.

[0038] The temperature condition may be automatically determined depending on the type of animal. For example, if the type of animal is a cat, the temperature range condition may be 5°C or higher and lower than 30°C, and if the type of animal is a dog, the temperature range condition may be 0°C or higher and lower than 33°C. Also, only one of the high temperature and the low temperature may be set as the temperature condition.

[0039] In this way, an occupant of the vehicle 18 can set the animal conditions and temperature conditions, thereby making it possible to more appropriately determine an abnormal state. Specifically, when using conventional technology, even if an animal present inside the vehicle is, for example, a pest, it is conceivable that the human presence sensor 14 may detect the presence of the animal and issue an alert to the outside.

[0040] In contrast, in this embodiment, an occupant can preset an animal condition, and if a preset type of animal is detected, an alert is issued to the outside. This allows for more appropriate alerting, since no alert is issued to the outside even if, for example, a pest or other type of animal is present inside the vehicle.

[0041] Furthermore, when using conventional technology, if the temperature inside the vehicle momentarily falls outside a preset temperature range, it is conceivable that the vehicle interior may be determined to be abnormal and an alert may be sent to the outside. In this case, even though there is no abnormality, the alert may be sent to the outside frequently, which is undesirable.

[0042] In contrast, in this embodiment, the occupant can preset the temperature conditions, and if the temperature indicated by the temperature time-series information is outside the preset range and this state continues for a preset time or longer, an external notification is issued, thereby achieving more appropriate notification.

[0043] As described above, after the animal conditions and temperature conditions are set by the occupant of the vehicle 18, the notification process is executed when an animal is left behind inside the vehicle.

[0044] Specifically, the control unit 30 determines the type of animal shown in the image based on the image of the interior of the vehicle. Next, the control unit 30 determines whether the interior of the vehicle is in an abnormal state based on the determined type of animal, time-series information of temperature information, which is an example of status information indicating the status of the interior of the vehicle, the animal condition, and the temperature condition.

[0045] More specifically, if the identified type of animal inside the vehicle corresponds to a predetermined type of animal, the time-series information of the temperature inside the vehicle is outside a predetermined range, and this state continues for a predetermined time or longer, the control unit 30 determines that the inside of the vehicle is in an abnormal state. If it is determined that the inside of the vehicle is in an abnormal state, the control unit 30 outputs an alarm signal to the outside of the vehicle.

[0046] The notification to the outside of the vehicle is made, for example, from the drive recorder 12 to an external information processing terminal 22 via wireless communication such as wireless LAN. The content of the notification may include, for example, information on the type of animal, temperature information inside the vehicle, vehicle position information, and images taken inside the vehicle, and is sent to the information processing terminal 22 of the occupant managing the vehicle 18, a company with which the vehicle has a contract, a security company, the police, or the like, to notify the driver of an abnormality inside the vehicle.

[0047] Next, specific processing performed by the control unit 30 of the drive recorder 12 of the information processing device 10 according to this embodiment configured as described above will be described. Fig. 4 is a flowchart showing an example of the flow of processing performed by the control unit 30 of the drive recorder 12 of the information processing device 10 according to this embodiment. Note that the processing in Fig. 4 starts, for example, after a predetermined time has elapsed since the vehicle 18 has stopped and an ignition switch (not shown) has been turned off. The processing in Fig. 4 is executed repeatedly.

[0048] For example, when the human sensor 14 detects the presence of an animal inside the vehicle, the control unit 30 of the drive recorder 12 of the information processing device 10 executes the process of FIG.

[0049] In step 100, the CPU 30A acquires an image of the interior of the vehicle taken by the photographing unit 32.

[0050] In step 102, CPU 30A determines the type of animal appearing in the image of the interior of the vehicle based on step S100.

[0051] In step S104, CPU 30A determines whether or not the animal condition is met based on the determination result obtained in step S102. Specifically, CPU 30A determines whether or not the type of animal in the vehicle determined in step S102 corresponds to a preset animal type. If the type of animal in the vehicle determined in step S102 corresponds to a preset animal type, the process proceeds to step S106. On the other hand, if the type of animal in the vehicle determined in step S102 does not correspond to a preset animal type, the process ends.

[0052] In step 106, CPU 30A acquires the time-series information of the temperature information inside the vehicle. Specifically, CPU 30A reads out the time-series information of the temperature information inside the vehicle stored in storage 30D.

[0053] In step 108, CPU 30A determines whether a preset temperature condition is satisfied based on the time-series information of the temperature information inside the vehicle. Specifically, it determines whether the temperature represented by the time-series information of the temperature information inside the vehicle indicates that a state outside a preset temperature range has continued for a preset time or longer. If the temperature represented by the time-series information of the temperature information inside the vehicle satisfies the temperature condition, the process proceeds to step S110. On the other hand, if the temperature represented by the time-series information of the temperature information inside the vehicle does not satisfy the temperature condition, the process ends.

[0054] In step 110, the CPU 30A determines that the interior of the vehicle is in an abnormal state.

[0055] In step 112, the CPU 30A outputs a notification signal to the outside of the vehicle.

[0056] In this manner, the information processing device according to this embodiment acquires images of the interior of the vehicle captured by an in-vehicle camera and time-series information on temperature information inside the vehicle obtained by a temperature sensor, which is an example of a sensor inside the vehicle. The information processing device determines the type of animal depicted in the acquired images based on the acquired images. The information processing device determines whether the interior of the vehicle is in an abnormal state based on the determined type of animal, the time-series information on the acquired temperature information, a preset animal condition, and a preset temperature condition. If the determination result indicates an abnormal state, the information processing device outputs an alarm signal to the outside of the vehicle. In this manner, the information processing device determines the type of animal left behind inside the vehicle and issues an alarm to the outside when the animal condition and the temperature condition are met. This makes it possible to prevent accidents, such as those caused by animals such as pets being left behind inside the vehicle.

[0057] Furthermore, by determining the type of animal left behind in the vehicle, it becomes possible to accurately determine whether the animal present in the vehicle is, for example, a pet of a passenger, thereby reducing unnecessary alerts.

[0058] In the above embodiment, an example in which the human presence sensor 14 is provided has been described, but the human presence sensor 14 may be omitted. In this case, the human presence sensor 14 can be omitted by detecting an animal by image recognition from the image captured by the image capturing unit 32.

[0059] In the above embodiment, an example has been described in which the type of animal is determined by the drive recorder 12, but the type of animal may be determined by another device. For example, an image of the inside of the vehicle may be transmitted to an external server or the like, and the external server or the like may determine the type of animal.

[0060] In the above embodiment, an abnormality inside the vehicle is notified by transmitting information to the information processing terminal 22 of the occupants, the company, the security company, the police, etc., but the notification method is not limited to this. For example, the occurrence of an abnormality may be notified to the outside of the vehicle 18 by honking the horn or flashing the headlights, or a notification may be made by transmitting information to the information processing terminal 22 and by honking the horn or flashing the headlights, etc.

[0061] Furthermore, although the processes performed by the various components of the information processing device 10 in the above embodiment have been described as processes performed by software by executing a program, they may also be processes performed by hardware, or may be processes that combine both software and hardware.

[0062] In addition to the animal conditions and temperature conditions, various settings such as the notification method including the notification content and notification destination may be set by operating the display operation unit 38.

[0063] Furthermore, the type of animal may be more specific than simply cat or dog. For example, dog breeds such as Chihuahua and Toy Poodle may be distinguished as animal types. By adopting such a configuration, it becomes possible to set temperature conditions more suited to the type of animal. For example, for a dog breed that is sensitive to high temperatures, the high temperature setting can be set to 28°C.

[0064] Furthermore, in the above-described step 112, information may be sent based on preset contact information instead of sending the information to the information processing terminal 22. For example, the information processing terminal 22 connected to the Internet may send an email to a preset email address or URL, or make a request using HTTP to send the information.

[0065] In the above embodiment, a temperature condition is set and an abnormality is determined using temperature information inside the vehicle. However, this is not limiting. For example, an abnormality may be determined based on status information indicating the status inside the vehicle obtained by various sensors, such as that disclosed in Japanese Patent Application Laid-Open No. 2020-93684. In this case, instead of a temperature condition, a condition related to the status information inside the vehicle obtained by the various sensors is set in advance. In this case, the condition related to the status information inside the vehicle is a condition related to whether a predetermined status inside the vehicle has continued for a predetermined period of time or longer. In such a case, the control unit 30 of the drive recorder 12 of the information processing device 10 determines that an abnormality exists inside the vehicle when the identified animal type corresponds to a predetermined animal type and the acquired status information inside the vehicle indicates that the predetermined status has continued for a predetermined period of time or longer. For example, when using the CO sensor disclosed in JP 2020-93684 A, the control unit 30 of the drive recorder 12 may determine that an abnormal state exists if the CO concentration inside the vehicle remains above a predetermined threshold for a predetermined period of time or longer, and output an alarm signal to the outside of the vehicle.

[0066] Furthermore, the present invention is not limited to the above, and it goes without saying that various modifications can be made without departing from the spirit of the present invention.

[0067] (Addendum) The following additional notes are provided regarding aspects of the present disclosure. (Appendix 1) an acquisition unit that acquires an image of the interior of the vehicle captured by an image capturing unit inside the vehicle and status information indicating a status of the interior of the vehicle obtained by a sensor inside the vehicle; a discrimination unit that discriminates the type of animal appearing in the image based on the image acquired by the acquisition unit; an abnormality determination unit that determines whether the interior of the vehicle is in an abnormal state based on the type of animal determined by the determination unit, the status information acquired by the acquisition unit, a preset condition related to the type of animal, and a preset condition related to the status information; a notification unit that outputs a notification signal to the outside of the vehicle when the determination result by the abnormality determination unit indicates an abnormal state; An information processing device comprising: (Appendix 2) the condition regarding the type of animal is a condition regarding the type of animal present in the vehicle, the condition regarding the state information is a condition regarding whether a preset state has continued in the vehicle for a preset time or more, the abnormality determination unit determines that the interior of the vehicle is in an abnormal state when the type of animal determined by the determination unit corresponds to a predetermined type of animal and the acquired interior state information indicates that the predetermined state has continued for a predetermined time or longer. 2. The information processing device according to claim 1. (Appendix 3) the state information is time-series information of temperature information, the abnormality determination unit determines that the interior of the vehicle is in an abnormal state when time-series information of the temperature information acquired by the acquisition unit indicates that the temperature information is outside a predetermined range and has continued for a predetermined time or longer. 10. The information processing device according to claim 1 or 2. (Appendix 4) the notification unit transmits information including the image of the interior of the vehicle captured by the image capturing unit to an information processing terminal outside the vehicle using a predetermined communication means. 4. The information processing device according to claim 1. (Appendix 5) the information further includes the type of animal identified by the identification unit, the status information detected by the sensor, and vehicle position information; 5. The information processing device according to claim 4. (Appendix 6) acquiring an image of the interior of the vehicle captured by an image capturing unit inside the vehicle and status information representing a status of the interior of the vehicle obtained by a sensor inside the vehicle; Identifying the type of animal depicted in the image based on the acquired image; determining whether the interior of the vehicle is in an abnormal state based on the determined type of animal, the acquired status information, a preset condition related to the type of animal, and a preset condition related to the status information; If the determination result indicates an abnormal state, an alarm signal is output to the outside of the vehicle. An information processing method in which processing is performed by a computer. (Appendix 7) acquiring an image of the interior of the vehicle captured by an image capturing unit inside the vehicle and status information representing a status of the interior of the vehicle obtained by a sensor inside the vehicle; Identifying the type of animal depicted in the image based on the acquired image; determining whether the interior of the vehicle is in an abnormal state based on the determined type of animal, the acquired status information, a preset condition related to the type of animal, and a preset condition related to the status information; If the determination result indicates an abnormal state, an alarm signal is output to the outside of the vehicle. An information processing program that causes a computer to execute a process. [Explanation of symbols]

[0068] 10. Information processing equipment 12 Drive recorder 14 Human Sensor 16 Temperature Sensor 18 vehicles 30 Control Unit 30A CPU 32 Photography Department 34 Communications Department

Claims

1. an acquisition unit that acquires an image of the interior of the vehicle captured by an image capturing unit inside the vehicle and status information indicating a status of the interior of the vehicle obtained by a sensor inside the vehicle; a discrimination unit that discriminates the type of animal appearing in the image based on the image acquired by the acquisition unit; an abnormality determination unit that determines whether the interior of the vehicle is in an abnormal state based on the type of animal determined by the determination unit, the status information acquired by the acquisition unit, a preset condition related to the type of animal, and a preset condition related to the status information; a notification unit that outputs a notification signal to the outside of the vehicle when the determination result by the abnormality determination unit indicates an abnormal state; An information processing device comprising:

2. the condition regarding the type of animal is a condition regarding the type of animal present in the vehicle, the condition regarding the state information is a condition regarding whether a preset state has continued in the vehicle for a preset time or more, the abnormality determination unit determines that the interior of the vehicle is in an abnormal state when the type of animal determined by the determination unit corresponds to a predetermined type of animal and the acquired interior state information indicates that the predetermined state has continued for a predetermined time or longer. The information processing device according to claim 1 .

3. the state information is time-series information of temperature information, the abnormality determination unit determines that the interior of the vehicle is in an abnormal state when time-series information of the temperature information acquired by the acquisition unit indicates that the temperature information is outside a predetermined range and has continued for a predetermined time or longer. The information processing device according to claim 2 .

4. the notification unit transmits information including the image of the interior of the vehicle captured by the image capturing unit to an information processing terminal outside the vehicle using a predetermined communication means.

3. The information processing device according to claim 1.

5. the information further includes the type of animal identified by the identification unit, the status information detected by the sensor, and vehicle position information; The information processing device according to claim 4 .

6. acquiring an image of the interior of the vehicle captured by an image capturing unit inside the vehicle and status information representing a status of the interior of the vehicle obtained by a sensor inside the vehicle; Identifying the type of animal depicted in the image based on the acquired image; determining whether the interior of the vehicle is in an abnormal state based on the determined type of animal, the acquired status information, a preset condition related to the type of animal, and a preset condition related to the status information; If the determination result indicates an abnormal state, an alarm signal is output to the outside of the vehicle. An information processing method in which processing is performed by a computer.

7. acquiring an image of the interior of the vehicle captured by an image capturing unit inside the vehicle and status information representing a status of the interior of the vehicle obtained by a sensor inside the vehicle; Identifying the type of animal depicted in the image based on the acquired image; determining whether the interior of the vehicle is in an abnormal state based on the determined type of animal, the acquired status information, a preset condition related to the type of animal, and a preset condition related to the status information; If the determination result indicates an abnormal state, an alarm signal is output to the outside of the vehicle. An information processing program that causes a computer to execute a process.

Citation Information

Patent Citations

  • In-car accident prevention device and in-car accident prevention system

    JP2020093684A