Vehicle equipment control method and vehicle equipment control device

Abstract

The present invention provides a vehicle equipment control method and a vehicle equipment control device that can accurately ensure the safety and comfort of pets inside a vehicle's cabin. [Solution] The vehicle equipment control method using a vehicle equipment control device acquires pet information regarding the behavior of a pet inside the vehicle, and determines whether the pet's behavior is abnormal based on the pet information. If it is determined that the pet's behavior is abnormal, the vehicle equipment is controlled based on the pet information.

Description

Technical Field

[0001] The present invention relates to a vehicle equipment control method and a vehicle equipment control device.

Background Art

[0002] When a vehicle user performs a remote door lock operation and confines a pet inside the vehicle cabin, a technology for remotely operating the equipment inside the vehicle in consideration of the vehicle situation has been developed (for example, Patent Document 1). By using this technology, even when there is no occupant inside the vehicle, the safety and comfort of the pet inside the vehicle can be ensured.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] However, in the above-described technology, the situation of the pet inside the vehicle cabin, for example, whether it is in a comfortable situation or a situation where its physical condition has deteriorated, etc. is not considered, and there is a problem that the safety and comfort of the pet inside the vehicle may not be accurately ensured in some cases.

[0005] The present invention has been made in view of the above problems, and an object thereof is to provide a vehicle equipment control method and a vehicle equipment control device capable of accurately ensuring the safety and comfort of a pet inside the vehicle cabin of a vehicle.

Means for Solving the Problems

[0006] A vehicle equipment control method according to one aspect of the present invention is a vehicle equipment control method using a vehicle equipment control device, which acquires pet information regarding the behavior of a pet inside the vehicle, and determines whether the pet's behavior is abnormal based on the acquired pet information. If it is determined that the pet's behavior is abnormal, the vehicle equipment is controlled based on the pet information. [Effects of the Invention]

[0007] According to one aspect of the present invention, it becomes possible to accurately ensure the safety and comfort of pets inside a vehicle. [Brief explanation of the drawing]

[0008] [Figure 1] Figure 1 is a block diagram showing the configuration of a vehicle system using a vehicle equipment control device according to one embodiment. [Figure 2] Figure 2 is a flowchart showing the processes executed by a vehicle equipment control device according to one embodiment. [Figure 3] Figure 3 is a flowchart showing the processes executed by a vehicle equipment control device according to one embodiment. [Figure 4] Figure 4 is a flowchart showing the processes executed by a vehicle equipment control device according to one embodiment. [Figure 5] Figure 5 is a table showing an example of first equipment control information used by a vehicle equipment control device according to one embodiment. [Figure 6A] Figure 6A is a table showing an example of second equipment control information used by a vehicle equipment control device according to one embodiment. [Figure 6B] Figure 6B is a table showing an example of second equipment control information used by a vehicle equipment control device according to one embodiment. [Figure 6C] Figure 6C is a table showing an example of second equipment control information used by a vehicle equipment control device according to one embodiment. [Figure 6D] Figure 6D is a table showing an example of second equipment control information used by a vehicle equipment control device according to one embodiment. [Modes for carrying out the invention]

[0009] A vehicle system and a vehicle equipment control method using a vehicle equipment control device according to one embodiment will be described with reference to the drawings. In each figure, common parts are denoted by the same reference numerals, and redundant explanations are omitted.

[0010] <Configuration of a vehicle system according to one embodiment> Figure 1 is a block diagram showing the configuration of the vehicle system 1 according to this embodiment. The vehicle system 1 includes equipment mounted on the vehicle, such as a blower 11, an air conditioning unit (air conditioner) 12, a seat heater 13, an audio unit 14, a window opening / closing device 15, a navigation unit 16, an in-vehicle camera unit 17, and a driving control device 18, as well as a vehicle equipment control device 20 that is communicatively connected to these devices, and a management server 30 that is communicatively connected to the vehicle equipment control device 20.

[0011] Communication between each of the devices 11-18 and the vehicle equipment control device 20, and communication between the vehicle equipment control device 20 and the management server 30, may be wireless or wired. Furthermore, the devices connected to the vehicle equipment control device 20 are not limited to the devices 11-18 described above, but may be other devices installed in the vehicle.

[0012] The blower 11 blows air into the vehicle interior. The air conditioning unit 12 provides air conditioning to the vehicle interior. The seat heater 13 is a heating device installed in the seats inside the vehicle interior. The audio unit 14 plays music and other sounds inside the vehicle interior. The window opening / closing device 15 opens and closes the vehicle's windows.

[0013] The navigation device 16 includes a first CPU 161, a display 162, and a speaker 163. The first CPU 161 is, for example, a CPU (Central Processing Unit) provided in a general-purpose microcomputer, and constitutes one or more information processing units by installing and executing a predetermined navigation program. The first CPU 161 generates information on the current position of the vehicle and route guidance to the destination, and outputs it from the display 162 and the speaker 163.

[0014] The in-vehicle camera device 17 photographs the interior of the vehicle. The travel control device 18 controls the travel of the vehicle.

[0015] The vehicle equipment control device 20 includes a second communication unit 21, an application information storage unit 22, and a second CPU 23. The second communication unit 21 communicates with the management server 30. The application information storage unit 22 stores application information for in-vehicle pet monitoring sent from the second CPU 23 as described later.

[0016] This application information includes program information for performing in-vehicle pet monitoring processing, first device control information indicating the device control content for each abnormal behavior of the pet during pet stay-at-home monitoring when only the pet is in the vehicle interior, and second device control information indicating the device control content for each abnormal behavior of the pet during co-riding pet monitoring when the pet and the occupant are in the vehicle interior. Details of the first device control information and the second device control information will be described later.

[0017] The second CPU 23 is, for example, a CPU (Central Processing Unit) provided in a general-purpose microcomputer, and constitutes one or more information processing units shown below by installing and executing a predetermined vehicle equipment control program. The second CPU 23 includes a setting unit 231, an image processing unit 232, a pet information acquisition unit 233, a determination unit 234, and a device control unit 235.

[0018] The setting unit 231 installs by acquiring application information for in-vehicle pet monitoring from the management server 30 via the second communication unit 21, storing it in the application information storage unit 22, and setting it up. Further, the setting unit 231 updates the application information stored in the application information storage unit 22 based on an instruction from the management server 30.

[0019] The image processing unit 232 detects the passengers and pets in the vehicle interior by acquiring and analyzing the imaging information captured by the in-vehicle camera device 17. The pet information acquisition unit 233 acquires pet information regarding the behavior of the detected pet. The determination unit 234 determines whether the behavior of the pet is abnormal based on the pet information acquired by the pet information acquisition unit 233.

[0020] When the determination unit 234 determines that the behavior of the pet is abnormal, the device control unit 235 controls at least one of the blower 11, air conditioner 12, seat heater 13, audio device 14, window opening / closing device 15, or navigation device 16 of the vehicle based on the pet information.

[0021] The management server 30 transmits application information for in-vehicle pet monitoring to the vehicle device control device 20, for example, by FOTA (Firmware Over-The-Air). Further, the management server 30 transmits an instruction to update the application information installed in the vehicle device control device 20 to the vehicle device control device 20 at a predetermined timing.

[0022] <Operation of the vehicle system according to an embodiment> FIGS. 2 to 4 are flowcharts showing the processes executed by the vehicle device control device 20 during the operation of the vehicle system 1.

[0023] After the vehicle is started (YES in S1), if the user turns on the pet monitoring function (YES in S2), the vehicle equipment control device 20 starts the in-vehicle situation detection process P1. In the in-vehicle situation detection process P1, the image processing unit 232 acquires image information of the inside of the vehicle taken by the in-vehicle camera device 17 (S3), and determines whether or not a pet is inside the vehicle by analyzing the acquired image information (S4). This "user" includes the occupants of the vehicle and users who remotely monitor the vehicle.

[0024] If the image processing unit 232 determines that the pet is not inside the vehicle (NO in S4), the device control unit 235 transmits notification information to the navigation device 16 informing it that the pet is not inside the vehicle. The navigation device 16 notifies the user that the pet is not inside the vehicle by outputting the notification information obtained from the image processing unit 232 through at least one of the display 162 or speaker 163 (S5).

[0025] If the user does not subsequently turn off the pet monitoring function (NO in S6), the process returns to step S3 and is repeated. If the user turns off the pet monitoring function while the in-vehicle condition detection process P1 is being executed (YES in S6), the vehicle equipment control device 20 terminates the process.

[0026] Furthermore, if the image processing unit 232 determines in step S4 that a pet is inside the vehicle (YES in S4), it further analyzes the imaging information to determine whether or not an occupant is inside the vehicle (S7).

[0027] If the image processing unit 232 determines that there are no occupants inside the vehicle (NO in S7), the vehicle equipment control device 20 starts the pet absence monitoring process P2, which monitors whether only the pet is inside the vehicle. In the pet absence monitoring process P2, the image processing unit 232 acquires image information of the inside of the vehicle taken by the in-vehicle camera device 17 (S8), and analyzes the acquired image information to determine whether or not there are occupants inside the vehicle (S9).

[0028] If the image processing unit 232 determines that there are no occupants inside the vehicle ("NO" in S9), it further analyzes the imaging information to determine whether or not there is a pet within the shooting angle of view (S10). If the image processing unit 232 determines that there is a pet within the shooting angle of view ("YES" in S10), the pet information acquisition unit 233 acquires pet information regarding the pet's behavior based on the analysis of the imaging information. Then, the determination unit 234 determines whether or not the pet has exhibited abnormal behavior based on the pet information acquired by the pet information acquisition unit 233 and the first device control information in the application information storage unit 22 (S11).

[0029] Figure 5 is a table showing an example of the first device control information. This first device control information stores information on the estimated state (normal / abnormal) and location of the pet, which is set for each type of pet behavior during pet monitoring while the pet is away. In the first device control information, pet behaviors include, for example, behaviors indicating a change in the pet's physical condition, behaviors indicating the pet's intention to defecate, behaviors indicating a change in the pet's stress level, behaviors by the pet that threaten the safety of occupants or pets inside the vehicle, or behaviors by the pet that interfere with the operation of the vehicle.

[0030] In the first device control information in Figure 5, for example, for pet behaviors such as "sleeping" and "sitting," the estimated pet state is stable and set to "normal," and the pet's position is set to "seat" or "floor." On the other hand, for pet behaviors such as "knocking on the window," "circling in the same place," "moving around," "approaching operating parts such as doors and the driver's seat," "sticking out tongue and breathing heavily," "moving to the camera's blind spot," "approaching the camera lens," "crouching," and "shaking," the pet's state is set to "abnormal." Furthermore, for each pet behavior where the state is set to "abnormal," information on the pet's position is also set.

[0031] For example, if the pet information acquisition unit 233 acquires pet information indicating that a pet is banging on a window near the window, the determination unit 234 determines, based on the first device control information, that the pet has exhibited abnormal behavior.

[0032] If the determination unit 234 determines that the pet has exhibited abnormal behavior (YES in S11), it identifies the device control content for the pet's unattended monitoring based on the content of the abnormal behavior in the first device control information.

[0033] As shown in Figure 5, the first device control information stores information about device control content set for each type of pet behavior. In the first device control information, the device control content is, for example, control of a vehicle device that affects the pet's behavior, control to disable the operation of a vehicle device, or control to output notification information to the vehicle user.

[0034] "Control of equipment in the vehicle that affects pet behavior" includes switching the air conditioning unit 12 on and off, adjusting the temperature, adjusting the airflow, etc. For example, it is set to raise the air conditioner's temperature when the pet is shivering.

[0035] Furthermore, "control to disable the operation of vehicle equipment" is set to, for example, disable the operation of the window opening and closing device near where the pet is when the pet is banging on the window.

[0036] Furthermore, the "control to output notification information to the vehicle user" is configured to send notification information indicating the nature of the pet's abnormal behavior to a remote user terminal (not shown).

[0037] The equipment control unit 235 controls at least one of the vehicle's blower 11, air conditioning unit 12, seat heater 13, audio unit 14, window opening / closing device 15, or navigation device 16 based on the equipment control content during pet home monitoring identified by the determination unit 234 (S12).

[0038] Here, when the device control unit 235 transmits notification information to the user terminal indicating the nature of the pet's abnormal behavior, the notification information includes, for example, information about the pet's physical condition, information indicating that the pet's behavior is abnormal, information indicating that the pet is located within a predetermined range, or information guiding the user to a predetermined location by vehicle. This "information guiding the user to a predetermined location by vehicle" could be, for example, information guiding the user to a park to take a bored pet, or information guiding the user to a veterinary hospital to take a sick pet.

[0039] If the user does not subsequently turn off the pet monitoring function (NO in S13), the process returns to step S8 and is repeated. If the user turns off the pet monitoring function while the pet absence monitoring process P2 is running (YES in S13), the vehicle equipment control device 20 terminates the process.

[0040] Furthermore, if the image processing unit 232 determines in step S10 that the pet is not within the shooting field of view (YES in S10), the device control unit 235 transmits the video of the vehicle interior to the remote user terminal and notifies it that the pet is inside the vehicle (S14).

[0041] Furthermore, if the image processing unit 232 determines in step S7 or step S9 that an occupant is inside the vehicle (YES in S7), the vehicle equipment control device 20 starts the passenger pet monitoring process P3. In the passenger pet monitoring process P3, the determination unit 234 obtains information indicating the vehicle's driving status from the driving control device 18 (S15). This information indicating the vehicle's driving status is, for example, "driving" or "stopped".

[0042] Furthermore, the image processing unit 232 acquires imaging information of the interior of the vehicle captured by the in-vehicle camera device 17 (S16), and analyzes the acquired imaging information to determine whether or not there is an occupant inside the vehicle (S17).

[0043] If the image processing unit 232 determines that an occupant is inside the vehicle (YES in S17), it analyzes the image information to detect the occupant's state (S18). The occupant's state may be, for example, "operating the vehicle" or "unaware of the pet's condition." "Aware of the pet's condition" means, for example, that the occupant is looking at a smart device.

[0044] The image processing unit 232 further determines whether or not there is a pet within the shooting field of view (S19). If the image processing unit 232 determines that there is a pet within the shooting field of view (YES in S19), the pet information acquisition unit 233 acquires pet information regarding the pet's behavior based on the analysis information of the imaging information. Then, the determination unit 234 determines whether or not the pet has exhibited abnormal behavior based on the pet information acquired by the pet information acquisition unit 233 and the second device control information in the application information storage unit 22 (S20).

[0045] Figures 6A, 6B, 6C, and 6D are tables showing an example of second-device control information. This second-device control information stores information on the estimated state of the pet (normal / abnormal) and the pet's location, which are set for each type of pet behavior during pet monitoring. In the second-device control information, pet behaviors include, for example, behaviors indicating a change in the pet's physical condition, behaviors indicating an intention to defecate, behaviors indicating a change in the pet's stress level, behaviors by the pet that threaten the safety of occupants or pets inside the vehicle, or behaviors by the pet that interfere with the operation of the vehicle.

[0046] If the determination unit 234 determines that the pet has exhibited abnormal behavior (YES in S20), it identifies the content of the abnormal behavior, the vehicle's driving status acquired in step S15, and the equipment control content during pet monitoring that corresponds to the occupant's status detected in step S18, based on the second equipment control information.

[0047] As shown in Figures 6A, 6B, 6C, and 6D, the second device control information stores information on device control settings that are set for each type of pet behavior, each vehicle driving state, and each occupant's state. For example, when a pet is tapping on the window, if the vehicle is moving and the occupant is operating the vehicle, the following control settings are set: "lower the air conditioner temperature to calm the pet," "notify with sound or icon," "activate the seat heater to guide the pet to a comfortable seat," "adjust the air conditioner's airflow and, if the pet is in an undesirable area, use a strong breeze and loud fan noise to guide the pet to a seat," and "disable control functions near the pet." Also, when a pet is tapping on the window, if the vehicle is stopped and the occupant is unaware of the pet's condition, the following control settings are set: "display a pet status notification on the navigation screen or meter screen," and "disable control functions near the pet."

[0048] The equipment control unit 235 controls at least one of the vehicle's blower 11, air conditioning unit 12, seat heater 13, audio unit 14, window opening / closing device 15, or navigation device 16 based on the equipment control content during passenger pet monitoring identified by the determination unit 234 (S21).

[0049] If the user does not subsequently turn off the pet monitoring function (NO in S22), the process returns to step S15 and is repeated.

[0050] In step S19, the image processing unit 232 determines that the pet is not within the shooting field of view (YES in S19), and the determination unit 234 determines that the vehicle is stopped (YES in S23). Then, the device control unit 235 transmits the video of the vehicle interior to the navigation device 16 for display and outputs information informing the user that the pet is inside the vehicle (S24). After that, the process proceeds to step S22.

[0051] Furthermore, if the determination unit 234 determines in step S23 that the vehicle is in motion (NO in S23), the equipment control unit 235 notifies the user that a pet is inside the vehicle by outputting an audio signal and displaying an icon on the navigation device or meter screen, which are display devices related to driving operations (S25). The process then proceeds to step S22.

[0052] If the user turns off the pet monitoring function while the pet absence monitoring process P2 is running (YES in S22), the vehicle equipment control device 20 terminates the process.

[0053] In the passenger pet monitoring process P3 described above, if there is a pet and an occupant inside the vehicle, in step S18, information indicating the positional relationship between the pet and the occupant may be acquired as the occupant's status, and based on the acquired information, the determination unit 234 may determine the control content of the vehicle's equipment in step S21.

[0054] For example, the determination unit 234 may specify the equipment control content such that, when the seating positions of the pet and the occupant are far apart, only the temperature of the space near the pet is the target of equipment control when monitoring the passenger pet, and the space where the occupant is located continues to operate the air conditioning system 12 at the temperature set by the occupant. Alternatively, when the determination unit 234 executes a process to disable the control panel of equipment near the pet, if the pet and the occupant are within a predetermined distance from the equipment, it may specify the equipment control content such that it outputs a notification to the occupant about disabling the control panel of the equipment, and only executes the disabling of the control panel after receiving an operation from the occupant acknowledging this. Alternatively, when the determination unit 234 executes a process to send strong air from the fan 11 or air conditioning system 12 near the pet, if the pet and the occupant are within a predetermined distance from the fan 11 or air conditioning system 12, it may specify the equipment control content such that it outputs a notification to the occupant about sending strong air, and only executes the airflow after receiving an operation from the occupant acknowledging this.

[0055] [Effects of the Embodiment] According to the above embodiment, the vehicle equipment control method by the vehicle equipment control device acquires pet information regarding the behavior of a pet inside the vehicle, determines whether the pet's behavior is abnormal based on the pet information, and if it is determined that the pet's behavior is abnormal, controls the vehicle's equipment based on the pet information. This makes it possible to accurately ensure the safety and comfort of pets inside the vehicle.

[0056] Furthermore, if it is determined that a pet's behavior is abnormal, the system may, based on the pet information, control any vehicle equipment that may affect the pet's behavior, disable the operation of any vehicle equipment, or output notification information to the vehicle user. This allows for even more accurate assurance of the safety and comfort of pets inside the vehicle.

[0057] Furthermore, devices that may affect pet behavior may include at least one of the following installed in the vehicle: a fan, air conditioning system, seat heater, audio system, window opening / closing device, or navigation system. This allows for even more precise assurance of the safety and comfort of pets inside the vehicle.

[0058] Furthermore, the notification information may include at least one of the following: information regarding the pet's health, information indicating abnormal behavior, information indicating that the pet is located within a predetermined range, or information providing directions for the vehicle to a designated location. This allows for appropriate action to be taken when the pet's health deteriorates.

[0059] Furthermore, by acquiring information indicating the activity status of the vehicle occupants, and determining that the pet's behavior is abnormal, if it is determined that the occupants are driving or are in a situation where they cannot notice the abnormal behavior of the pet, information regarding the pet's abnormal behavior or information regarding the response policy to the abnormal behavior may be displayed on the vehicle's driving operation display device. This allows the occupants to be notified of the pet's abnormal behavior even when they cannot see the pet.

[0060] Furthermore, whether a pet's behavior is abnormal may be determined based on at least one of the following: behavior indicating a change in the pet's physical condition, behavior indicating an urge to urinate or defecate, behavior indicating a change in the pet's stress level, behavior that threatens the safety of the occupants or the pet, or behavior that interferes with the operation of the vehicle. This allows for an appropriate determination of the situation that requires action to ensure the safety and comfort of the pet inside the vehicle, based on the pet's behavior.

[0061] Furthermore, if there are pets and passengers inside the vehicle, information indicating the relative positions of the pets and passengers may be acquired, and the control content of the vehicle's equipment may be determined based on the acquired information indicating the relative positions of the pets and passengers. This makes it possible to ensure the safety and comfort of pets inside the vehicle with even greater precision.

[0062] Although several embodiments have been described, it is possible to modify or transform the embodiments based on the above disclosure. All components of the above embodiments, and all features described in the claims, may be taken individually and combined, provided that they do not conflict with each other.

[0063] As described above, embodiments of the present invention have been presented, but the statements and drawings that constitute part of this disclosure should not be understood as limiting the invention. Various alternative embodiments, examples, and operational techniques will become apparent to those skilled in the art from this disclosure. [Explanation of symbols]

[0064] 1. Vehicle System 11 Blower 12 Air conditioner 13 Seat heaters 14 Audio equipment 15 Window opening and closing device 16 Navigation System 17. In-car camera system 18. Driving control device 20 Vehicle Equipment Control Device 21. Second Communications Department 22 Application Information Storage Unit 23 2nd CPU 30 Management Server 161 1st CPU 162 displays 163 speakers 231 Settings Section 232 Image Processing Unit 233 Pet Information Acquisition Department 234 Judgment section 235 Equipment Control Unit

Claims

1. A method for controlling vehicle equipment using a vehicle equipment control device, We obtain pet information regarding the behavior of pets inside the vehicle. Based on the aforementioned pet information, it is determined whether or not the pet's behavior is abnormal. A vehicle equipment control method that, when it is determined that the behavior of the pet is abnormal, controls the equipment of the vehicle based on the pet information.

2. The vehicle equipment control method according to claim 1, wherein, upon determining that the behavior of the pet is abnormal, the method controls, based on the pet information, any equipment in the vehicle that affects the behavior of the pet, disables the operation of any equipment in the vehicle, or outputs notification information to the user of the vehicle.

3. The vehicle equipment control method according to claim 2, wherein the equipment that affects the behavior of the pet is at least one of a blower, air conditioner, seat heater, audio system, window opening / closing device, or navigation system installed in the vehicle.

4. The vehicle equipment control method according to claim 2, wherein the notification information outputs information that includes at least one of the following: information regarding the pet's physical condition, information indicating that the pet's behavior is abnormal, information indicating that the pet is located within a predetermined range, or guidance information for the vehicle to proceed to a predetermined location.

5. Information indicating the operational status of the occupants of the aforementioned vehicle is acquired. The vehicle equipment control method according to claim 1, wherein when it is determined that the behavior of the pet is abnormal, and it is determined that the occupant is driving or is in a situation where they cannot notice that the behavior of the pet is abnormal, the method causes the vehicle's driving operation display device to display information about the abnormal behavior of the pet or information about a policy for responding to the abnormal behavior.

6. The vehicle equipment control method according to claim 1, wherein the determination of whether the pet's behavior is abnormal is made based on at least one of the following: behavior indicating a change in the pet's physical condition, behavior indicating the pet's intention to defecate, behavior indicating a change in the pet's stress state, behavior by the pet that threatens the safety of the vehicle's occupants or the pet, or behavior by the pet that interferes with the operation of the vehicle.

7. When a pet and an occupant of the vehicle are inside the vehicle, information indicating the relative positions of the pet and the occupant is acquired. The vehicle equipment control method according to claim 1, wherein the control content of the vehicle equipment is determined based on acquired information indicating the positional relationship between the pet and the occupant.

8. A pet information acquisition unit that acquires pet information regarding the behavior of pets inside the vehicle's cabin, A determination unit that determines whether or not the pet's behavior is abnormal based on the aforementioned pet information, A vehicle equipment control device comprising: an equipment control unit that controls the vehicle's equipment based on the pet information when the determination unit determines that the pet's behavior is abnormal.

Images