Information processing device and information processing method

Abstract

To provide an information providing device and an information providing method capable of reducing erroneous notifications when notifying a predetermined authority of occurrence of an abnormality on a vehicle.SOLUTION: An information processing device 100 comprises: a check request reception unit 11 that receives a vehicle state check request for requesting checking of a state of a vehicle 20; a vehicle information reception unit 12 that receives vehicle information acquired by a detection device 21 mounted on the vehicle 20 on the basis of the vehicle state check request; a vehicle information transmission unit 15 that transmits vehicle information to a user terminal 10; and a notification necessity checking information transmission unit 16 that transmits, to the user terminal 10, notification necessity checking information for checking whether or not to notify a predetermined authority of occurrence of an abnormality on the vehicle 20.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present invention relates to an information processing device and an information processing method. [Background technology]

[0002] Patent Document 1 describes an information processing device that detects vehicle theft. When the information processing device described in Patent Document 1 detects vibrations applied to the vehicle and a person approaching the vehicle, it acquires captured images of the area around the vehicle and transmits the captured images to an alarm notification device. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2002-166823 Summary of the Invention [Problem to be solved by the invention]

[0004] However, the information processing device described in Patent Document 1 may transmit an image to the alarm notification device even if the person approaching the vehicle is an acquaintance of the driver and no abnormality such as theft has actually occurred.

[0005] An object of the present invention is to provide an information providing device and an information providing method that can reduce false notifications when notifying a predetermined organization of the occurrence of a vehicle abnormality. [Means for solving the problem]

[0006] The present invention solves the above problem by transmitting vehicle information acquired by a detection device installed in the vehicle to a user terminal, and also by transmitting reporting necessity confirmation information to the user terminal that confirms whether or not to report the occurrence of an abnormality in the vehicle to a designated organization. [Effects of the Invention]

[0007] According to the present invention, vehicle information is sent to a user terminal and the user is asked whether or not to report the occurrence of an abnormality to a designated organization, thereby reducing false reports when reporting the occurrence of a vehicle abnormality to a designated organization. [Brief explanation of the drawings]

[0008] [Figure 1] 1 is a block diagram showing a configuration of an information processing device according to an embodiment of the present invention; [Figure 2] 2 is a flowchart showing an information processing method executed by the information processing device shown in FIG. DETAILED DESCRIPTION OF THE INVENTION

[0009] Hereinafter, an embodiment of the present invention will be described with reference to the drawings. As shown in FIG. 1 , the information processing device 100 includes a confirmation request receiving unit 11, a vehicle information receiving unit 12, a facial image information storage unit 13, a facial image information determination unit 14, a vehicle information transmitting unit 15, a notification necessity confirmation information transmitting unit 16, a response information receiving unit 17, and a reporting unit 18. The information processing device 100 is capable of communicating with a user terminal 10 of a user who is the owner of the vehicle 20, the vehicle 20, and a TSP (Telematics Service Provider) 30. Note that the information processing device 100 is part of a server, but is not limited to this, and may be an application of the user terminal 10 or a device mounted on the vehicle 20. Note that the TSP 30 is, for example, an operator that notifies the police or security when an abnormality occurs in the vehicle 20, or an operator that checks the condition of the vehicle 20 itself when an abnormality occurs in the vehicle 20.

[0010] The vehicle 20 also has a detection device 21 and an on-board communication unit 22. The detection device 21 has an imaging device 21a, an audio acquisition unit 21b, a position information acquisition unit 21c, a speed sensor 21d, and an occupant sensor 21e. Specifically, the imaging device 21a is an in-vehicle camera or an outside-vehicle camera. The audio acquisition unit 21b is a microphone (sound collection device). The position information acquisition unit 21c acquires the current position of the vehicle 20 using a global navigation satellite system (GNSS). The speed sensor 21d acquires a vehicle speed signal from a vehicle control module (not shown) of the vehicle 20. The occupant sensor 21e is a radar sensor or a seat sensor, and detects the presence or absence of an occupant inside the vehicle 20.

[0011] The configuration of the information processing device 100 will be described in detail. The confirmation request receiving unit 11 of the information processing device 100 receives a vehicle state confirmation request requesting confirmation of the state of the vehicle 20 from the user terminal 10 or the in-vehicle communication unit 22 of the vehicle 20. Specifically, when a user (owner of the vehicle 20) who is located away from the vehicle 20 senses that an abnormality such as theft may have occurred in the vehicle 20, the user operates the user terminal 10 to transmit a vehicle state confirmation request stating, "I would like to confirm the state of the vehicle 20," to the information processing device 100. Alternatively, when the detection device 21 detects that there is a person inside the vehicle 20 and that the person is not a predetermined user (owner of the vehicle 20), the vehicle 20 transmits the vehicle state confirmation request to the information processing device 100 via the in-vehicle communication unit 22.

[0012] The vehicle information receiving unit 12 receives vehicle information acquired by the detection device 21 mounted on the vehicle 20 via the in-vehicle communication unit 22 of the vehicle 20 based on the vehicle state confirmation request received by the confirmation request receiving unit 11. The vehicle information includes image information acquired by the imaging device 21a, audio information acquired by the audio acquisition unit 21b, current position information of the vehicle 20 acquired by the position information acquisition unit 21c, vehicle speed information acquired by the speed sensor 21d, and information regarding the presence or absence of an occupant acquired by the occupant sensor 21e. In particular, the image information includes in-vehicle image information acquired by the imaging device 21a, which is an in-vehicle camera. The in-vehicle image information also includes captured face image information, which is face image information of people riding in the vehicle 20.

[0013] The facial image information storage unit 13 stores specific facial image information, which is facial image information of a predetermined person. The specific facial image information is facial image information of a person who has previously ridden the vehicle 20, or facial image information associated with a predetermined person registered in the facial image information storage unit 13. In other words, the specific facial image information stored in the facial image information storage unit 13 is a whitelist of facial image information of the user's acquaintances. Specifically, the facial image information storage unit 13 creates a whitelist by associating facial images of people who have previously ridden the vehicle 20 with names or IDs entered by the user. The facial image information storage unit 13 may also create a whitelist that includes facial image information saved by the user and the names or IDs of predetermined people associated with each piece of facial image information.

[0014] The facial image information determination unit 14 compares the captured facial image information acquired by the imaging device 21a with the specific facial image information (whitelist) stored in the facial image information storage unit 13, and determines whether the person riding in the vehicle 20 matches the person identified by the specific facial image information.

[0015] The vehicle information transmitting unit 15 transmits vehicle information including the captured face image information to the user terminal 10 when the person riding in the vehicle 20 matches the person identified by the specific face image information.

[0016] In addition, the vehicle information transmission unit 15 transmits vehicle information to the user terminal 10, and the notification necessity confirmation information transmission unit 16 transmits notification necessity confirmation information to the user terminal 10 to confirm whether or not to report the occurrence of an abnormality in the vehicle 20 to the TSP30, which is a specified organization.

[0017] The response information receiving unit 17 receives response information to the notification necessity confirmation information transmitted by the notification necessity confirmation information transmitting unit 16. The response information is notification request information requesting that the occurrence of an abnormality in the vehicle 20 be notified to the TSP30, which is a predetermined organization, or notification cancellation information requesting that the occurrence of an abnormality in the vehicle 20 not be notified to the TSP30. The notification request information includes use cancellation request information requesting that the use of the vehicle 20 be stopped. The notification cancellation information includes use permission information permitting the use of the vehicle 20. If the vehicle information transmitted to the user terminal 10 includes facial image information of a person riding in the vehicle 20, the notification request information may include specific person use cancellation request information requesting that the person riding in the vehicle 20 stop using the vehicle 20, and the notification cancellation information may include specific person use permission information permitting the person riding in the vehicle 20 to use the vehicle 20.

[0018] When the response information receiving unit 17 receives the report request information, the reporting unit 18 reports the occurrence of an abnormality in the vehicle 20 to the TSP 30.

[0019] Next, the procedure of the information processing method executed by the information processing device 100 will be described with reference to FIG. First, in step S1, the information processing device 100 determines whether the confirmation request receiving unit 11 has received a vehicle state confirmation request from the user terminal 10 or the vehicle 20. If it is determined that there has been no vehicle state confirmation request from the user terminal 10 or the vehicle 20, the information processing device 100 terminates the processing.

[0020] Next, in step S1, if the information processing device 100 determines that there is a vehicle status confirmation request from the user terminal 10 or the vehicle 20, in step S2, the vehicle information receiving unit 12 acquires the vehicle information transmitted by the in-vehicle communication unit 22.

[0021] Next, in step S3, the information processing device 100 determines whether or not it is possible to acquire captured face image information of a person riding in the vehicle 20 from the vehicle information. If it is determined that captured face image information cannot be acquired, that is, if the vehicle information does not include captured face image information or the captured face image information is unclear, the process proceeds to step S8, and the reporting unit 18 reports the occurrence of an abnormality in the vehicle 20 to the TSP 30.

[0022] On the other hand, if the information processing device 100 determines in step S3 that it is possible to acquire captured face image information of a person riding in the vehicle 20, then in step S4 the face image information determination unit 14 compares the captured face image information with specific face image information (whitelist) stored in the face image information storage unit 13. That is, in step S4, the face image information determination unit 14 determines whether or not the person riding in the vehicle 20 matches the person identified by the specific face image information (person registered in the whitelist). If the person riding in the vehicle 20 matches the person identified by the specific face image information, then in step S5 the vehicle information transmission unit 15 transmits the captured face image information to the user terminal 10. Then, next in step S6, the report necessity confirmation information transmission unit 16 transmits report necessity confirmation information to the user terminal 10 for confirming whether or not to report the occurrence of an abnormality in the vehicle 20 to the TSP 30. On the other hand, if the captured face image information cannot be matched with the whitelist (specific face image information), the process proceeds to step S6 without going through step S5, and the report necessity confirmation information transmitting unit 16 transmits report necessity confirmation information to the user terminal 10 in a state in which the captured face image information is not transmitted to the user terminal 10. Note that this is not limited to this, and even if the person riding in the vehicle 20 does not match the person identified by the specific face image information, the vehicle information transmitting unit 15 may execute the process of step S5 and transmit the captured face image information to the user terminal 10.

[0023] Next, in step S7, the information processing device 100 determines whether the response information receiving unit 17 has received report request information from the user terminal 10. If the response information receiving unit 17 has not received report request information, that is, if the response information receiving unit 17 has received report stop information, the processing ends. On the other hand, if the response information receiving unit 17 has received report request information, in step S8, the reporting unit 18 reports the occurrence of an abnormality in the vehicle 20 to the TSP 30.

[0024] Next, a description will be given of the processing executed by the TSP30 upon receiving a report from the information processing device 100. Note that the following processing may be executed manually by a staff member of the TSP30, or may be executed automatically by the TSP30 system. First, when the TSP30 receives a report from the information processing device 100, it requests the information processing device 100 to transmit vehicle information as necessary. In response to the request from the TSP30, the information processing device 100 transmits current vehicle information to the TSP30. The TSP30 acquires current location information of the vehicle 20 from the vehicle information. Furthermore, the TSP30 determines whether or not a person is currently riding in the vehicle 20 based on the vehicle information including interior image information, and if a person is currently riding in the vehicle 20, acquires the location information of the vehicle 20 as well as recorded video from the drive recorder and audio recording data acquired by the audio acquisition unit 21b. The TSP30 then transmits this vehicle information to the user terminal 10 and asks the user, via the user terminal 10, whether or not it can be determined that an abnormality (theft) has occurred in the vehicle 20. If the user replies via the user terminal 10 that the vehicle 20 has been stolen, the TSP 30 reports the theft of the vehicle 20 to the police or security and remotely switches the vehicle 20 to a mode in which the engine will not start. On the other hand, if the user replies via the user terminal 10 that the vehicle 20 has not been stolen, the TSP 30 erases the received vehicle information.

[0025] As described above, the information processing device 100 according to this embodiment includes a confirmation request receiving unit 11 that receives a vehicle state confirmation request, a vehicle information receiving unit 12 that receives vehicle information acquired by the detection device 21 based on the vehicle state confirmation request, a vehicle information transmitting unit 15 that transmits vehicle information to the user terminal 10, and a report necessity confirmation information transmitting unit 16 that transmits report necessity confirmation information to the user terminal 10 to confirm whether or not to report an abnormality occurring in the vehicle 20 to a predetermined organization. That is, the information processing device 100 transmits the vehicle information and the report necessity confirmation information to the user terminal 10 before reporting an abnormality occurring in the vehicle 20 to a predetermined organization, allowing the user to confirm whether or not an abnormality has actually occurred, thereby reducing false reports. Furthermore, because the information processing device 100 transmits the vehicle information to the user terminal 10 before reporting an abnormality occurring in the vehicle 20 to a predetermined organization, the user can know early on whether or not an abnormality has occurred based on the vehicle information, giving the user a sense of security.

[0026] Furthermore, the detection device 21 mounted on the vehicle 20 includes an imaging device 21a, and the vehicle information includes interior image information acquired by the imaging device 21a. As a result, when the information processing device 100 transmits the vehicle information to the user terminal 10, the user can visually recognize the state of the interior of the vehicle 20 based on the interior image information, and can easily check whether or not an abnormality such as theft has occurred in the vehicle 20.

[0027] The in-vehicle image information also includes captured face image information, which is face image information of people riding in the vehicle 20. As a result, when the information processing device 100 transmits vehicle information to the user terminal 10, the user can confirm whether or not the people riding in the vehicle 20 are acquaintances based on the captured face image information. As a result, after the reporting unit 18 of the information processing device 100 reports an abnormality in the vehicle 20 to the TSP 30, the police or security who receive the report from the TSP 30 can more easily identify the culprit who stole the vehicle 20 based on the captured face image information.

[0028] The information processing device 100 also includes a facial image information storage unit 13 that stores specific facial image information, which is facial image information of a predetermined person, and a facial image information determination unit 14 that compares the captured facial image information with the specific facial image information and determines whether the person riding in the vehicle 20 matches the person identified by the specific facial image information. The vehicle information transmission unit 15 transmits vehicle information to the user terminal 10 when the person riding in the vehicle 20 matches the person identified by the specific facial image information. As a result, if the person riding in the vehicle 20 is a person pre-stored in the facial image information storage unit 13, the information processing device 100 transmits vehicle information to the user terminal 10 before reporting to the TSP 30 to prompt the user to check whether an abnormality has occurred, thereby reducing false reports. Furthermore, if the person riding in the vehicle 20 is a person not identified by the specific facial image information (whitelist), the information processing device 100 does not transmit vehicle information to the user terminal 10, thereby reducing the user's anxiety or fear associated with checking the vehicle information.

[0029] Furthermore, the specific face image information stored in the face image information storage unit 13 is face image information of a person who has previously ridden in the vehicle, or face image information associated with a predetermined person registered in the face image information storage unit 13. As a result, the face image information storage unit 13 stores face image information of a person who is an acquaintance of the user and who may use the vehicle 20, and therefore, before reporting to the TSP 30, the face image information determination unit 14 compares the captured face image information with the specific face image information, thereby reducing erroneous reporting.

[0030] Furthermore, the confirmation request receiving unit 11 receives a vehicle state confirmation request transmitted from the user terminal 10 or the vehicle 20. As a result, when the user senses the possibility of an abnormality occurring in the vehicle 20, or when the detection device 21 of the vehicle 20 detects the possibility of an abnormality occurring in the vehicle 20, the confirmation request receiving unit 11 can receive a vehicle state confirmation request from the user terminal 10 or the vehicle 20.

[0031] The vehicle information also includes location information of the vehicle 20. This allows the user to know the current location of the vehicle 20 when the vehicle information is transmitted to the user terminal 10. This also allows the TSP 30, police, or security to know the current location of the vehicle 20 based on the vehicle information after the reporting unit 18 of the information processing device 100 reports an abnormality in the vehicle 20 to the TSP 30.

[0032] Furthermore, the predetermined organization to which the information processing device 100 reports an abnormality that has occurred in the vehicle 20 is a business operator, such as the TSP 30, that reports the occurrence of an abnormality in the vehicle 20 to the police or security. As a result, when the occurrence of an abnormality is confirmed by the TSP 30, the TSP 30 reports the occurrence to the police or security, which makes it easier for the abnormality that has occurred in the vehicle 20 to be resolved quickly.

[0033] The information processing device 100 also includes a response information receiving unit 17 that receives response information to the notification necessity confirmation information transmitted by the notification necessity confirmation information transmitting unit 16. The response information is notification request information that requests that the occurrence of an abnormality in the vehicle 20 be notified to a predetermined organization, or notification cancellation information that requests that the occurrence of an abnormality in the vehicle 20 not be notified to a predetermined organization. This allows the information processing device 100 to receive, via the user terminal 10, information indicating the user's decision on whether or not to report the occurrence of the abnormality to a predetermined organization.

[0034] The report request information also includes use stop request information that requests the suspension of use of the vehicle 20. This allows the information processing device 100 to notify the TSP30 of an abnormality in the vehicle 20 and to request the TSP30 to execute processing to stop the use of the vehicle 20 (for example, processing to transition the vehicle 20 to a mode in which the engine does not start by remote operation) based on the use stop request information. The report stop information also includes use permission information that permits the use of the vehicle 20. This allows the information processing device 100 to stop reporting to the TSP30 and receive information indicating a decision to permit the use of the vehicle 20 via the user terminal 10.

[0035] Furthermore, when the vehicle information transmitted to the user terminal 10 includes captured face image information, the report request information includes specific person use suspension request information that requests the person in the vehicle 20 to stop using the vehicle 20. Furthermore, the report suspension information includes specific person use permission information that permits the person in the vehicle 20 to use the vehicle 20. This allows the information processing device 100 to receive, via the user terminal 10, information indicating the user's decision, having checked the captured face image information, as to whether to suspend or permit the person in the vehicle 20 to use the vehicle 20. Furthermore, when the information processing device 100 receives the specific person use suspension request information, it can notify the TSP 30 of an abnormality in the vehicle 20 and request the TSP 30 to execute processing to stop the person in the vehicle 20 from using the vehicle 20 (for example, processing to transition the vehicle 20 to a mode in which the engine does not start by remote operation). [Explanation of symbols]

[0036] 100...Information processing device 10...User terminal 11...Confirmation request receiving unit 12...Vehicle information receiving unit 13...Facial image information storage unit 14...Facial image information determination unit 15...Vehicle information transmission unit 16...Notification confirmation information transmission section 17...Response information receiving unit 20...Vehicle 21...Detection device 21a...imaging device 30...TSP (prescribed institution)

Claims

1. a confirmation request receiving unit that receives a vehicle state confirmation request that requests confirmation of the vehicle state; a vehicle information receiving unit that receives vehicle information acquired by a detection device that is mounted on the vehicle and includes an imaging device that captures an image of the interior of the vehicle, based on the vehicle state confirmation request; a vehicle information transmitting unit configured to transmit to a user terminal the vehicle information including interior image information including captured face image information, which is face image information of a person riding in the vehicle and is acquired by the imaging device; a notification necessity confirmation information transmission unit that transmits notification necessity confirmation information to the user terminal to confirm whether or not the occurrence of an abnormality in the vehicle should be reported to a predetermined organization; a face image information storage unit that stores specific face image information that is face image information of a predetermined person; a face image information determination unit that compares the captured face image information with the specific face image information and determines whether or not a person riding in the vehicle matches a person identified by the specific face image information, The vehicle information transmission unit transmits the vehicle information to the user terminal when a person riding in the vehicle matches a person identified by the specific face image information.

2. The information processing device according to claim 1 , wherein the specific face image information is face image information of a person who has previously ridden in the vehicle, or face image information associated with a predetermined person registered in the face image information storage unit.

3. a response information receiving unit that receives response information to the notification necessity confirmation information transmitted by the notification necessity confirmation information transmitting unit, 3. The information processing device according to claim 1, wherein the response information is notification request information requesting that a predetermined organization be notified of an occurrence of an abnormality in the vehicle, or notification cancellation information requesting that a predetermined organization not be notified of an occurrence of an abnormality in the vehicle.

4. the report request information includes use stop request information requesting the use of the vehicle to be stopped, The information processing device according to claim 3 , wherein the notification stop information includes use permission information that permits use of the vehicle.

5. When the vehicle information transmitted to the user terminal includes the captured face image information of the person riding in the vehicle, the report request information includes specific person use suspension request information requesting a person riding in the vehicle to stop using the vehicle, The information processing device according to claim 3 , wherein the notification stop information includes specific person use permission information that permits a person riding in the vehicle to use the vehicle.

6. a confirmation request receiving unit that receives a vehicle state confirmation request that requests confirmation of the vehicle state; a vehicle information receiving unit that receives vehicle information acquired by a detection device mounted on the vehicle based on the vehicle state confirmation request; a vehicle information transmission unit that transmits the vehicle information to a user terminal; a notification necessity confirmation information transmission unit that transmits notification necessity confirmation information to the user terminal to confirm whether or not the occurrence of an abnormality in the vehicle should be reported to a predetermined organization; a response information receiving unit that receives response information to the notification necessity confirmation information transmitted by the notification necessity confirmation information transmitting unit, the response information is report request information requesting that the occurrence of an abnormality in the vehicle be reported to a predetermined organization, or report cancellation information requesting that the occurrence of an abnormality in the vehicle not be reported to a predetermined organization, An information processing device, wherein when the vehicle information sent to the user terminal includes captured facial image information of a person riding in the vehicle, the reporting request information includes specific person use suspension request information requesting the person riding in the vehicle to stop using the vehicle, and the reporting suspension information includes specific person use permission information permitting the person riding in the vehicle to use the vehicle.

7. the report request information includes use stop request information requesting the use of the vehicle to be stopped, The information processing device according to claim 6 , wherein the notification stop information includes use permission information that permits use of the vehicle.

8. The information processing device according to any one of claims 1 to 7, wherein the confirmation request receiving unit receives the vehicle state confirmation request transmitted from the user terminal or the vehicle.

9. The information processing device according to claim 1, wherein the vehicle information includes location information of the vehicle.

10. The information processing device according to any one of claims 1 to 9, wherein the predetermined organization is a business that reports the occurrence of an abnormality in the vehicle to the police or security.

11. receiving a vehicle status confirmation request requesting confirmation of the vehicle status; receiving vehicle information acquired by a detection device that is mounted on the vehicle and includes an imaging device that captures an image of the interior of the vehicle based on the vehicle state confirmation request; transmitting the vehicle information including vehicle interior image information including captured face image information, which is face image information of a person riding in the vehicle acquired by the imaging device, to a user terminal; transmitting, to the user terminal, notification necessity confirmation information for confirming whether or not to notify a predetermined organization of the occurrence of the abnormality in the vehicle; In the process of transmitting the vehicle information, storing specific face image information that is face image information of a predetermined person; comparing the captured face image information with the specific face image information to determine whether the person riding in the vehicle matches the person identified by the specific face image information; an information processing method for transmitting the vehicle information to the user terminal when a person riding in the vehicle matches a person identified by the specific face image information;

12. receiving a vehicle status confirmation request requesting confirmation of the vehicle status; receiving vehicle information acquired by a detection device mounted on the vehicle based on the vehicle state confirmation request; Transmitting the vehicle information to a user terminal; transmitting, to the user terminal, notification necessity confirmation information for confirming whether or not to notify a predetermined organization of the occurrence of the abnormality in the vehicle; Receive response information to the transmitted notification necessity confirmation information; the response information is report request information requesting that the occurrence of an abnormality in the vehicle be reported to a predetermined organization, or report cancellation information requesting that the occurrence of an abnormality in the vehicle not be reported to a predetermined organization, An information processing method, wherein, when the vehicle information sent to the user terminal includes captured facial image information of a person riding in the vehicle, the reporting request information includes specific person use suspension request information requesting that the person riding in the vehicle stop using the vehicle, and the reporting suspension information includes specific person use permission information that permits the person riding in the vehicle to use the vehicle.

Images