Information output device and information output method

Abstract

The information output device comprises: an event detection unit (10) for detecting an event occurring inside or outside a vehicle; a member determination unit (20) for determining a person who can perceive the event as a first member; and an event storage unit (30) for storing event data related to the detected event in association with the first member. The information output device comprises a data output unit (50) for automatically outputting the event data stored in the event storage unit (30), and the member determination unit (20) determines a person who can view and listen to the event data output from the data output unit (50) as a second member. The information output device further comprises an output control unit (40) for determining whether the second member includes a person other than the first member, and when it is determined that the second member includes a person other than the first member, prohibiting the data output unit (50) from automatically outputting the event data.

Description

Technical Field

[0001] The invention relates to an information output device and an information output method. Background Art

[0002] Conventionally, there is known a video and audio recording and reproducing device (see Patent Document 1) that automatically acquires video data and audio data (AV data) in a vehicle, acquires and records various information related to the date and time when the AV data is acquired, the destination, the travel route, and the passengers, and reproduces the recorded AV data in the vehicle. The invention described in Patent Document 1 records the acquired AV data in association with the above-mentioned various information, and when a condition based on the various information is specified by a user, the AV data corresponding to the condition can be easily extracted and reproduced.

[0003] Prior art literature

[0004] Patent Literature

[0005] Patent Document 1: Japanese Patent No. 5478462 Summary of the invention

[0006] Problem that the invention aims to solve

[0007] However, when the video and audio recording and reproducing device disclosed in Patent Document 1 reproduces the recorded AV data, it does not consider who will see and hear the AV data. Therefore, if the recorded AV data contains private information that the user does not want to be known by other persons other than the passengers when the AV data was recorded, the user's private information may be leaked to the above-mentioned other persons through the reproduction of the AV data.

[0008] The present invention has been made in view of the above-mentioned problems, and an object of the present invention is to provide an information output device and an information output method for automatically outputting event data while protecting the privacy information of users included in the event data.

[0009] Solutions for solving problems

[0010] An information output device according to one embodiment of the present invention includes an event detection unit, a member determination unit, an event storage unit, a data output unit, and an output control unit. When the event detection unit detects an event that has occurred inside or outside a vehicle, the member determination unit determines a person who can perceive the event as a first member, and the event storage unit stores event data related to the detected event in association with the first member. The member determination unit determines a person who can view and listen to the event data as a second member. The output control unit determines whether the second member includes a person other than the first member, and when it is determined that the second member includes a person other than the first member, the automatic output of the event data is prohibited.

[0011] Effects of the Invention

[0012] According to the present invention, event data can be automatically output while protecting the privacy information of the user included in the event data. BRIEF DESCRIPTION OF THE DRAWINGS

[0013] Figure 1 This is a block diagram showing the structure of the information output device according to the first embodiment.

[0014] Figure 2 This is a flowchart showing the operation of storing event data in the information output device according to the first embodiment.

[0015] Figure 3 This is a flowchart showing the operation of outputting event data by the information output device according to the first embodiment.

[0016] Figure 4A This is a schematic diagram showing the composition of members when the information output device according to the first embodiment determines whether or not to output event data.

[0017] Figure 4B This is a schematic diagram showing the composition of members when the information output device according to the first embodiment determines whether or not to output event data.

[0018] Figure 4C This is a schematic diagram showing the composition of members when the information output device according to the first embodiment determines whether or not to output event data.

[0019] Figure 5 It is a block diagram showing the structure of the information output device according to the second embodiment.

[0020] Figure 6 This is a flowchart showing the operation of storing event data in the information output device according to the second embodiment.

[0021] Figure 7 This is a flowchart showing the operation of outputting event data by the information output device according to the second embodiment.

[0022] Figure 8 This is a block diagram showing the structure of an information output device according to a third embodiment.

[0023] Fig. 9 This is a flowchart showing the operation of storing event data in the information output device according to the third embodiment.

[0024] Fig.10 This is a flowchart showing the operation of outputting event data by the information output device according to the third embodiment. DETAILED DESCRIPTION

[0025] The embodiments will be described with reference to the drawings. In the description of the drawings, the same reference numerals are given to the same parts and the description thereof will be omitted.

[0026] (First Embodiment)

[0027] [Structure of information output device]

[0028] Reference Figure 1 The overall structure of the information output device involved in this embodiment is described. The information output device is a device that includes a second member as a person who can view and listen to the output event data, in addition to the second member who can view and listen to the output event data when an event is detected inside or outside the vehicle. It's When an event occurs, when a person other than the person who can perceive the event (the first member) is prohibited from automatically outputting the event data, the event data is automatically output while protecting the user's privacy.

[0029] The information output device is mainly composed of the controller 1. The information output device includes a camera 11 for photographing the outside of the vehicle, a microphone 12 provided in the vehicle, a camera 13 for photographing the inside of the vehicle, a GPS receiver 14, an event storage unit 30, and a data output unit 50.

[0030] The controller 1 is a general-purpose microcomputer having a CPU (central processing unit), a memory, and an input / output unit. A computer program for making the microcomputer function as an information output device is installed in the microcomputer. By executing the computer program, the microcomputer functions as a plurality of information processing circuits possessed by the information output device. In addition, in the present embodiment, an example of realizing a plurality of information processing circuits possessed by the information output device by software is shown. Of course, dedicated hardware for performing each information processing shown below can also be prepared to constitute an information processing circuit. In addition, a plurality of information processing circuits can also be constituted by independent hardware.

[0031] The controller 1 includes an event detection unit 10 , a member identification unit 20 , and an output control unit 40 as a plurality of information processing circuits.

[0032] The event detection unit 10 acquires data output from the camera 11, the microphone 12, the camera 13, and the GPS receiver 14 to detect an event that has occurred inside or outside the vehicle. The event detection unit 10 is used to detect that an event has occurred, and the event is the memory of a person (first member) who can perceive the event. The first member includes the occupants of the vehicle.

[0033] The camera 11 is arranged inside or outside the vehicle, and a plurality of cameras 11 are arranged in front, on the side, and on the rear of the vehicle. The camera 11 captures the surrounding conditions of the vehicle and outputs them as image data outside the vehicle. The camera 11 can also utilize a stereo camera or a monocular camera used in an automatic driving device or a driving assistance device.

[0034] The microphone 12 is disposed inside the vehicle cabin, collects the voice of a person riding in the vehicle, and outputs the voice as in-vehicle sound data.

[0035] The camera 13 is disposed in the vehicle interior, and captures images of people riding in the vehicle, particularly faces of the people, and outputs the images as video data of the interior of the vehicle.

[0036] The GPS receiver 14 is installed inside the vehicle and outputs the position information of the vehicle on the ground (including latitude and longitude information) by receiving radio waves from artificial satellites. The GPS receiver 14 can use a device for navigation function. In this embodiment, the GPS receiver 14 is installed inside the vehicle, but it can also be installed together with a radio antenna outside the vehicle and an antenna for communicating with other communication devices.

[0037] The event detection unit 10 detects an event that has occurred inside or outside the vehicle based on the sound data and image data inside the vehicle output from the microphone 12 and the camera 13, the image data outside the vehicle output from the camera 11, and the position information of the vehicle detected by the GPS receiver. As a device having a function similar to that of the event detection unit, there is, for example, an event recorder. The event recorder is set in the vehicle and determines whether a traffic accident (event) has occurred based on the operating status of the device equipped in the vehicle. The following specifically describes the method by which the event detection unit 10 detects an event that has occurred.

[0038] The event detection unit 10 analyzes the sound data in the car output from the microphone 12, and when it is determined that the conversation atmosphere of the members in the car is high, it is determined that an event is detected. Specifically, the event detection unit 10 can determine the conversation of the members in the car by having a sound recognition function. Therefore, the event detection unit 10 can determine whether the conversation of the members in the car contains a predetermined topic for determining that the conversation atmosphere is high, and can calculate the appearance rate of the topic in the conversation. When the event detection unit 10 determines that the conversation of the members in the car contains a predetermined topic for determining that the conversation atmosphere is high and the appearance rate of the topic in the conversation is high, it is determined that the conversation atmosphere of the members in the car is high, and it is determined that an event is detected. Predetermined topics for determining that the conversation atmosphere is high include, for example, weather, scenery, and tourist spots. The event detection unit 10 can also determine that the conversation atmosphere of the members in the car is high and detect an event when it detects that the volume of the conversation of the members in the car becomes louder based on the sound data in the car.

[0039] The event detection unit 10 analyzes the image data outside the vehicle output from the camera 11 and the image data inside the vehicle output from the camera 13, and determines that an event is detected when it is determined that the members of the vehicle react to the scenery seen from the vehicle. Specifically, first, the event detection unit 10 determines whether a scene similar to a predetermined scene including the sea, a mountain, a river, a sunrise, a sunset, and fireworks is detected based on the image data outside the vehicle output from the camera 11. Next, when the scene similar to the predetermined scene is detected, the event detection unit 10 analyzes the image data inside the vehicle output from the camera 13 and determines whether the members of the vehicle react to the detected scenery. As a method for determining whether the members of the vehicle react to the detected scenery, a facial recognition function can be used to determine the person based on the image data and determine the direction of the face of the determined person. Thus, the event detection unit 10 determines whether each person of the vehicle is facing the direction of the detected scenery, and when a certain proportion or more of the passengers are facing the direction of the scenery, it can be determined that the members of the vehicle react to the detected scenery. Thus, the event detection unit 10 can determine whether or not the occupant of the vehicle has responded to the detected scenery, and can determine that an event has been detected.

[0040] The event detection unit 10 acquires the position information of the vehicle detected by the GPS receiver 14 and determines that an event has been detected when it is determined that the current position of the vehicle is near a place known as a tourist attraction.

[0041] Furthermore, the event detection unit 10 acquires not only the position information of the vehicle detected by the GPS receiver 14 but also the date and time information received by the GPS receiver 14 to determine the position and date and time of the vehicle when the event is determined to be detected. The date and time when the event is determined to be detected can be accurately determined by using the date and time information received by the GPS receiver 14.

[0042] The member determination unit 20 acquires the in-vehicle sound data output from the microphone 12 and the in-vehicle image data output from the camera 13 when the event is detected by the event detection unit 10. The member determination unit 20 determines the first member who is a person riding in the vehicle and who can perceive the event by analyzing the acquired in-vehicle sound data and in-vehicle image data. Specifically, the member determination unit 20 can determine the person riding in the vehicle by having a speaker recognition function, which is a function of extracting acoustic features of sounds that differ according to different persons from the in-vehicle sound data output from the microphone 12 and recognizing the sounds based on the extracted acoustic features.

[0043] In addition, the member determination unit 20 obtains the image data output from the camera 13. The member determination unit 20 can determine the person riding in the vehicle by having a facial recognition function, which is a function of detecting the face of each person from the image data and identifying the face of each person based on the relative position, size, shape of the eyes, nose, and chin of the detected facial parts. In addition, the member determination unit 20 can also estimate the age based on the facial features. In addition, the facial recognition function can detect the direction of the face, the degree of opening of the eyes, and the mouth of each determined person. Thereby, the member determination unit 20 can determine whether each determined person is facing the direction of the detected event and whether he is sleeping, and can determine the first member as a person who can perceive the detected event.

[0044] In addition, the member determination unit 20 may also determine whether there is a user of the information output device among the determined first members. The user of the information output device refers to a person who is the main user of the information output device and is pre-registered as a user in the information output device. Specifically, the member determination unit 20 can determine whether there is a user of the information output device among the first members based on the facial data of the user of the information output device captured by the camera 11 and the voice data of the user of the information output device collected by the microphone 12.

[0045] In addition, the member identification unit 20 identifies the second member who is a person riding in the vehicle and who can view and listen to the output event data in the same way as when the first member was identified. The event data refers to data related to the detected event, and refers to data including the sound and image inside and outside the vehicle acquired by the cameras 11, 13 and the microphone 12 when the event detection unit 10 detects the event.

[0046] The member determination unit 20 determines a person who can watch and listen to the output event data and can understand the output event data as the second member. Specifically, the member determination unit 20 can estimate the age of each person who can watch and listen to the output event data by having a facial recognition function. Thus, the member determination unit 20 can determine whether the members who can watch and listen to the output event data include children of an age who cannot understand the language and text contained in the event data. The member determination unit 20 excludes the person who cannot understand the language and text from the members who can watch and listen to the output event data, thereby determining the person who can understand the output event data as the second member.

[0047] The event storage unit 30 is composed of an information storage device including a hard disk drive and an online storage. The event storage unit 30 not only stores the position and date and time of the vehicle when the event is detected as determined by the event detection unit 10, but also stores event data including the sound and image inside and outside the vehicle acquired by the cameras 11, 13 and the microphone 12. The event storage unit 30 stores the stored event data in association with the first member determined by the member determination unit 20. Specifically, the event storage unit 30 stores each person of the determined first member, and stores the detected event data in association with each stored person. Alternatively, the event storage unit 30 may also store each person of the determined first member in association with the event data.

[0048] The output control unit 40 is composed of a similar event determination unit 41 , a member comparison unit 42 , and a reproduction possibility determination unit 43 , and determines whether the event data stored in the event storage unit 30 can be output.

[0049] When other events are detected by the event detection unit 10, the similar event determination unit 41 determines whether the detected other events are other events similar to the events stored in the event storage unit 30 as event data. Specifically, it is determined whether at least one of the content of the conversation of the members riding in the vehicle, the scenery seen from the vehicle, and the position of the vehicle when the event detection unit 10 determines that the event is detected is similar to the content of the conversation of the members, the scenery seen from the vehicle, and the position of the vehicle stored in the event data. For example, similarity is determined by whether the conversation of the members riding in the vehicle contains the topic of the conversation stored in the event data, and whether the scenery seen from the inside of the vehicle contains a part of the scenery stored in the event data (e.g., the sea, mountains, rivers, sunrise, sunset, fireworks).

[0050] When the similar event determination unit 41 determines that the detected other event is similar to the event stored as event data in the event storage unit 30, the member comparison unit 42 compares the second member with the first member. Specifically, the member comparison unit 42 extracts the first member stored in association with the event data determined to be similar and stored in the event storage unit 30, and compares the second member determined by the member determination unit 20 with the extracted first member. Then, the member comparison unit 42 determines whether the second member includes a person other than the first member.

[0051] In addition, the process of comparing the second member with the first member to determine whether the second member includes a person other than the first member may not be performed when other events similar to the event data stored in the event storage unit 30 are detected. For example, the member comparison unit 42 may also compare the second member with the first member to determine whether the second member includes a person other than the first member when the second member is determined as a person riding in the vehicle and able to view and listen to the output event data. Specifically, the member comparison unit 42 extracts the first member stored in association with each event data stored in the event storage unit 30, and compares the second member determined by the member determination unit 20 with the first member associated with each event data for each event data. Thus, it is possible to determine for each event data whether the second member includes a person other than the first member associated with each event data.

[0052] The reproduction possibility determination unit 43 prohibits automatic output of event data when the member comparison unit 42 determines that the second member includes a person other than the first member.

[0053] When the member comparing unit 42 determines that the second member does not include any person other than the first member, the reproduction possibility determining unit 43 permits automatic output of the event data.

[0054] The reproduction determination unit 43 may inquire of the first member included in the second members whether the event data can be output when other similar events are detected, when the member comparison unit 42 determines that the second members include characters other than the first member and the second members include at least one character of the first member. In addition, the reproduction determination unit 43 may also inquire of the user of the information output device whether the event data can be output when the member determination unit 20 determines that the user of the information output device is included in the first member included in the second members.

[0055] Specifically, in order to inquire the first member included in the second member whether the event data can be output, the reproduction determination unit 43 outputs a message for inquiring whether the event data can be output as voice data to the speaker 51. Alternatively, the reproduction determination unit 43 outputs a message for inquiring whether the event data can be output as text data to the display 52. ​​The message for inquiring the first member included in the second member whether the event data can be output can be output from either the speaker 51 or the display 52, or from both the speaker 51 and the display 52.

[0056] The regeneration determination unit 43 acquires the answer to whether the regeneration is possible collected by the microphone 12. Alternatively, the regeneration determination unit 43 acquires the answer to whether the regeneration is possible input to the display 52 installed in the vehicle. If the acquired answer is the answer of the first member included in the second member, the regeneration determination unit 43 determines whether the event data can be output based on the answer of the first member included in the second member. Whether the acquired answer is the answer of the first member included in the second member is determined by the member determination unit 20.

[0057] Here, refer to Figure 4A , Figure 4B , Figure 4C , showing the second member and the first member to schematically illustrate the determination of whether the event data can be output by the output control unit 40.

[0058] Figure 4A The situation inside the vehicle when the event is detected is shown, and characters P1, P2, P3, and P4 are riding in the vehicle. Characters P1, P2, P3, and P4 are the first members determined to be able to perceive the detected event. Character P1 is a user of the information output device. Event data when the event is detected is stored in association with characters P1, P2, P3, and P4.

[0059] Figure 4B Shown in Figure 4AAn example of the situation inside a vehicle at different times, where characters P1, P2, P3, and P5 are riding in the vehicle. Characters P1, P2, P3, and P5 are second members determined to be able to view and listen to the output event data. The member comparison unit 42 extracts the first members stored in association with each event data stored in the event storage unit 30, and compares the second members with the first members associated with each event data for each event data. Figure 4A In the case of event data stored under the condition shown in FIG. 1 , the second member includes a character P5 other than the first member. Therefore, the member comparison unit 42 determines that the second member includes a member other than the first member, and the reproduction determination unit 43 prohibits automatically outputting the Figure 4A Event data stored under the conditions shown.

[0060] Furthermore, the reproduction possibility determination unit 43 may determine whether or not the event data can be output when another similar event is detected and the detected other event is determined to be similar to an event stored as event data in the event storage unit 30 .

[0061] exist Figure 4B The second member shown includes Figure 4A The character P5 other than the first member shown in the figure, but also includes the characters of the first member, namely, the characters P1, P2, and P3. Therefore, the reproduction possibility judgment unit 43 inquires the characters P1, P2, and P3 of the first member included in the second member whether the event data can be output. In addition, the character P1 is a character of the first member and is a user of the information output device. The reproduction possibility judgment unit 43 may also inquire the user of the information output device whether the event data can be output when there is a user of the information output device among the first members included in the second member. Then, the reproduction possibility judgment unit 43 decides whether the event data can be output based on the answer of the character of the first member included in the second member obtained.

[0062] Figure 4C Shows when similar other events are detected Figure 4A Another example of the situation in the vehicle at different times is that person P1, person P2, and person P3 are riding in the vehicle. Person P1, person P2, and person P3 are second members who are determined to be able to view and listen to the output event data. Figure 4A In the case of other events similar to the event data stored in the situation shown, the second member is compared with the first member by the member comparison unit 42. The second member does not include any person other than the first member. Therefore, the member comparison unit 42 determines that the second member does not include any person other than the first member, and the reproduction determination unit 43 allows the event data to be automatically output.

[0063] As described above, the output control unit 40 can determine whether or not the second member includes a person other than the first member, and can determine whether or not the event data can be output.

[0064] In addition, the output control unit 40 may extract event data storing information related to the second member from the event data stored in the event storage unit 30, and present the extracted event data to the second member in the form of a list.

[0065] Specifically, the member comparison unit 42 compares the first member and the second member stored in association with the event data. Furthermore, when the member comparison unit 42 determines that the first member and the second member are the same person, the event data associated with the first member is extracted. Thus, the event data storing information related to the second member can be presented to the second member in the form of a list.

[0066] In addition, when presenting event data storing information related to the second member to the second member in the form of a list, the output control unit 40 may also calculate the proportion of the second member to the first member stored in each event data presented in the form of a list, and present each event data to the second member in order from high to low proportion.

[0067] The data output unit 50 is composed of a speaker 51 and a display 52, and is provided at a position where passengers in the vehicle can see and hear. When the reproduction determination unit 43 permits output of event data, the data output unit 50 outputs the audio data stored in the event data from the speaker 51 and outputs the video data stored in the event data from the display 52.

[0068] [Information storage method]

[0069] Next, refer to Figure 2 illustrate Figure 1 A method for storing event data in an information output device is shown. Figure 2 The operation of the information output device shown in the flowchart starts when the power of the vehicle is turned on (IGN: ON), and the processing ends at the time when the power of the vehicle is detected to be turned off (IGN: OFF).

[0070] In step S10, the event detection unit 10 determines whether an event occurring inside or outside the vehicle is detected based on the sound data and image data inside the vehicle, the image data outside the vehicle, and the position information of the vehicle detected by the GPS receiver. If it is determined that an event is not detected (step S10: "No"), the process stops at step S10 and continues to perform event detection processing.

[0071] When the event detection unit 10 determines that an event has been detected (step S10: Yes), the process proceeds to step S20. In step S20, the member identification unit 20 analyzes the acquired in-vehicle audio data and in-vehicle video data to identify the first member who is a person riding in the vehicle and can perceive the event.

[0072] In step S30, the event detection unit 10 obtains the position information detected by the GPS receiver 14 to determine the position of the vehicle when the event is detected. In step S40, the event detection unit 10 obtains the date and time information received by the GPS receiver 14 to determine the date and time when the event is detected.

[0073] Entering step S50, the event storage unit 30 stores not only the position and date of the vehicle when the event is detected determined by the event detection unit 10, but also event data including the sound and image inside and outside the vehicle acquired by the cameras 11, 13 and the microphone 12. The event storage unit 30 stores the stored event data in association with the first member determined by the member determination unit 20.

[0074] Entering step S60, the shutdown determination unit ( Figure 1 When the power cut (IGN: cut) of the vehicle is not detected (not shown in the figure) (step S60: "No"), the process returns to step S10 and continues. The process ends at the time when the cut-off determination unit detects the power cut (IGN: cut) of the vehicle (step S60: "Yes").

[0075] By executing the above-described process, the information output device can store event data related to the event, including the sound and image inside or outside the vehicle when the event is detected, in association with the first member.

[0076] [Information output method]

[0077] Next, refer to Figure 3 illustrate Figure 1 The method of outputting event data by the information output device shown. Figure 3 The operation of the information output device shown in the flowchart starts when the power of the vehicle is turned on (IGN: ON), and the processing ends at the time when the power of the vehicle is detected to be turned off (IGN: OFF).

[0078] In step S70, when other events are detected by the event detection unit 10, the similar event determination unit 41 determines whether the detected other events are other events similar to the events stored as event data in the event storage unit 30. When the detected event is not a similar other event (step S70: No), the process stops at step S70 and continues to execute the process of determining whether the detected other events are similar other events.

[0079] If it is determined in step S70 that the detected other event is a similar event (step S70: Yes), the process proceeds to step S80. In step S80, the member comparing unit 42 extracts the first member stored in association with the event data.

[0080] Proceeding to step S90 , the member identification unit 20 identifies a person who can view and listen to the output event data as a second member.

[0081] The process proceeds to step S100, where the member comparison unit 42 compares the second member with the first member. The process proceeds to step S110, where the member comparison unit 42 determines whether the second member includes a member other than the first member. If the member comparison unit 42 determines that the second member includes a member other than the first member (step S110: No), the process proceeds to step S150. At the time of proceeding to step S150, the reproduction determination unit 43 prohibits automatically outputting the event data.

[0082] In step S110 , when the member comparing unit 42 determines that the second member does not include any member other than the first member (step S110 : Yes), the process proceeds to step S120 , and the reproduction possibility determining unit 43 permits automatic output of the event data.

[0083] In step S150, the member comparison unit 42 determines whether the second members include at least one person of the first member, or whether the second members include a person who is the first member and the user of the information output device. If the member comparison unit 42 determines that the second members do not include any person of the first member (step S150: No), the process proceeds to step S180, and the reproduction determination unit 43 prohibits the output of the event data.

[0084] If the member comparison unit 42 determines in step S150 that the second members include at least one person who is the first member, or the second members include a person who is the first member and the user of the information output device (step S150: Yes), the process proceeds to step S160.

[0085] In step S160 , the reproduction determination unit 43 outputs a message to the speaker 51 or the display 52 for asking the first member included in the second member or the character who is the first member included in the second member and is the user of the information output device whether the event data can be output.

[0086] The process proceeds to step S170, where the reproducibility determination unit 43 determines whether the event data can be output based on the answer of the first member included in the second member or the person who is the first member included in the second member and is the user of the information output device, obtained from the microphone 12 or the display 52 installed in the vehicle. When the reproducibility determination unit 43 determines that the answer obtained from the microphone 12 or the display 52 is to prohibit the output of the event data (step S170: No), the process proceeds to step S180, where the output of the event data is prohibited by the reproducibility determination unit 43.

[0087] When the reproduction possibility determination unit 43 determines in step S170 that the answer obtained from the microphone 12 or the display 52 is that the output of the event data is permitted (step S170: Yes), the process proceeds to step S120, and the reproduction possibility determination unit 43 permits the output of the event data.

[0088] Entering step S130, the reproducibility determination unit 43 determines whether the output of the event data has been completed. If the reproducibility determination unit 43 does not determine that the output of the event data has been completed (step S130: No), the process stops at step S130 and continues to determine whether the output of the event data has been completed.

[0089] If the reproduction possibility determination unit 43 determines in step S130 that the output of the event data has been completed (step S130: Yes), the process proceeds to step S140. In step S140, the shutdown determination unit ( Figure 1 If the vehicle power cut (IGN: cut) is not detected (not shown) (step S140: "No"), the process returns to step S70 to continue processing.

[0090] When the shutdown determination unit detects that the power supply of the vehicle is turned off (IGN: off) (step S140: Yes), the process ends.

[0091] As described above, according to the first embodiment, the following effects can be obtained.

[0092] The information output device prohibits output of the event data when it is determined that the second members who can view and listen to the output event data include members other than the first member when the event data is detected. Thus, the privacy information of the first member when the event data is detected can be prevented from being known by members other than the first member, thereby protecting the privacy information of the first member.

[0093] The information output device allows the output of the event data when it is determined that the second members who can view and listen to the output event data do not include members other than the first member when the event data is detected. Thus, it is possible to prevent the private information of the first member when the event data is stored from being known by members other than the first member, so that the event data can be automatically output while protecting the private information of the first member.

[0094] When the information output device determines that the second members include characters other than the first member and the second members include at least one character of the first member, when detecting other similar events, it inquires the first member included in the second members whether the event data can be output. Thus, the first member included in the second members can decide whether the event data can be output, and the event data containing the first member's private information can be output when the first member included in the second members believes that it is okay to disclose the user's private information to the second members other than the first member.

[0095] The information output device can determine whether to output the event data for the second member currently in the vehicle by identifying the first member who was in the vehicle when the event was detected and the second member currently in the vehicle.

[0096] The information output device determines the person who can understand the output event data as the second member, thereby excluding the person who cannot understand the output event data and determining whether to output the event data. Thus, the event data can be output to the second member while protecting the privacy information of the first member.

[0097] The information output device extracts event data storing information related to the second member from the event data stored in the event storage unit 30, and presents the extracted event data to the second member in the form of a list. Thus, the second member can select event data storing information related to the second member from the list and output it.

[0098] When presenting the event data storing information related to the second member to the second member in the form of a list, the information output device calculates the proportion of the second member to the first member stored in each event data presented in the form of a list. Then, the information output device presents each event data to the second member in descending order of the proportion of the second member to the first member. Thus, the second member can select and output event data with high relevance to the second member.

[0099] The information output device allows the data output unit 50 to automatically output the event data when the event detection unit detects other events similar to the events stored as event data in the event storage unit 30 and determines that the second member does not include a person other than the first member. Thus, when other events similar to the events stored as event data are detected, the event data can be automatically output to the second member.

[0100] (Second Embodiment)

[0101] [Structure of information output device]

[0102] Reference Figure 5 The configuration of the information output device according to the second embodiment will be described. The only difference from the first embodiment is the communication unit 60. Therefore, only the processing performed by the communication unit 60 will be described, and description of other common configurations will be omitted.

[0103] The information output device includes a communication unit 60 in addition to the configuration of the first embodiment, and further specifies a first member connected to the vehicle via the communication unit when the event is detected and a second member currently connected to the vehicle. The communication unit 60 includes a communication partner specifying unit 61.

[0104] The communication unit 60 transmits the sound data and image data inside the vehicle and the image data outside the vehicle to the person connected to the vehicle via the communication unit. Specific examples of the communication unit include a mobile phone, a smart phone, a PC connected to the Internet, a tablet computer, etc. These communication devices can reproduce the sound data or the image data.

[0105] The communication partner determination unit 61 determines a person connected to the vehicle via a communication unit. A person who can watch and listen to the sound data and image data inside the vehicle and the image data outside the vehicle via the communication unit is a person who can perceive the event. Specifically, the communication partner determination unit 61 can determine the communication partner by determining the telephone number and communication ID of the communication device connected to the vehicle. Thus, the information output device can determine the person connected to the vehicle via the communication unit when the event is detected as the first member, and can determine the person currently connected to the vehicle as the second member.

[0106] [Information storage method]

[0107] Next, refer to Figure 6 illustrate Figure 5 The method of storing event data in the information output device shown in the figure is different from the first embodiment only in the processing of step S21, step S22, and step S23. Therefore, only the processing steps that are the differences will be described, and the description of other common processing will be omitted.

[0108] In step S21, the communication partner identification unit 61 determines whether there is a person currently connected to the vehicle via the communication unit. If the communication partner identification unit 61 determines that there is no person currently connected to the vehicle via the communication unit (step S21: No), the process proceeds to step S30.

[0109] When the communication partner identification unit 61 determines in step S21 that there is a person currently connected to the vehicle via the communication means (step S21 : Yes), the process proceeds to step S22 .

[0110] In step S22, the communication partner identification unit 61 identifies a person currently connected to the vehicle via the communication unit, and the process proceeds to step S23.

[0111] In step S23, the communication partner identification unit 61 transmits information of the identified person to the member identification unit 20. The member identification unit 20 identifies not only the first member who is in the vehicle when the event is detected, but also the member who is connected to the vehicle via the communication device when the event is detected as the first member.

[0112] [Information output method]

[0113] Next, refer to Figure 7 illustrate Figure 5 The method of outputting event data by the information output device shown in the figure is different from the first embodiment only in the processing of step S121 to step S124. Therefore, only the processing steps that are the difference will be described, and the description of other common processing will be omitted.

[0114] In step S121, the communication partner identification unit 61 determines whether there is a person currently connected to the vehicle via the communication unit. If the communication partner identification unit 61 determines that there is no person currently connected to the vehicle via the communication unit (step S121: No), the process proceeds to step S130.

[0115] When the communication partner identification unit 61 determines in step S121 that there is a person currently connected to the vehicle via the communication means (step S121 : Yes), the process proceeds to step S122 .

[0116] In step S122, the communication partner identification unit 61 identifies the person currently connected to the vehicle via the communication unit and transmits it to the member identification unit 20. The member identification unit 20 can identify not only the second member currently riding in the vehicle, but also the person currently connected to the vehicle via the communication device as the second member.

[0117] Entering step S123, the member comparison unit 42 compares the second member currently connected to the vehicle via the communication device with the first member, and determines whether the second member currently connected to the vehicle via the communication device includes members other than the first member. In the case where the member comparison unit 42 determines that the second member currently connected to the vehicle via the communication device includes members other than the first member (step S123: "No"), the process proceeds to step S190. At the time of entering step S190, the regeneration determination unit 43 prohibits the automatic output of event data for the second member currently connected to the vehicle via the communication device. The processing of steps S190 to S220 is the same as the processing of steps S150 to S180 of the first embodiment.

[0118] In step S123 , when the member comparing unit 42 determines that the second members currently connected to the vehicle via the communication device do not include any member other than the first member (step S123 : Yes), the process proceeds to step S124 .

[0119] In step S124 , the communication unit 60 transmits the event data to the second member currently connected to the vehicle via the communication device.

[0120] As described above, according to the second embodiment, the following effects can be obtained.

[0121] The information output device not only determines the first member who was in the vehicle when the event was detected and the second member who is currently in the vehicle, but also determines the first member who was connected to the vehicle via the communication unit when the event was detected and the second member who is currently connected to the vehicle. Thus, it is possible to determine whether the event data can be output for the second member who is currently connected via the communication unit.

[0122] (Third Embodiment)

[0123] [Structure of information output device]

[0124] Reference Figure 8 The configuration of the information output device according to the third embodiment will be described. The only difference from the second embodiment is the configuration of the communication unit 60. Therefore, only the processing performed by the communication unit 60 will be described, and description of other common configurations will be omitted.

[0125] The information output device further identifies the first member who was in the other vehicle when the event was detected and the second member who is currently in the other vehicle when it is determined that the other vehicle is connected to the vehicle via the communication unit and is traveling within a predetermined distance from the vehicle. The communication unit 60 includes a communication partner identification unit 61, an inter-vehicle distance determination unit 62, and an image / sound receiving unit 63.

[0126] The communication unit 60 transmits the sound data and image data inside the vehicle and the image data outside the vehicle to other vehicles connected to the vehicle via the communication unit. As a specific example of the communication unit, there is Internet communication. Thus, members (persons) riding in other vehicles can perceive events and watch and listen to event data.

[0127] The communication partner identification unit 61 determines whether another vehicle is connected to the vehicle via the communication unit, and identifies the other vehicle that is connected based on the vehicle number (VIN) of the other vehicle or the like.

[0128] The inter-vehicle distance determination unit 62 determines whether the distance between the vehicle and other vehicles is within a predetermined distance range. Specifically, the inter-vehicle distance determination unit 62 obtains the distance between the vehicle and other vehicles measured by a stereo camera and a ranging radar used in the automatic driving device and the driving assistance device, and determines whether the distance between the vehicle and other vehicles is within a predetermined distance range.

[0129] The image / sound receiving unit 63 receives images and sounds inside other vehicles connected to the vehicle via the communication unit. The image / sound receiving unit 63 transmits images and sounds inside other vehicles connected to the vehicle to the member identifying unit 20. The member identifying unit 20 identifies the occupants of other vehicles. Thus, the information output device can identify the person who was in other vehicles when the event was detected as the first member, and the person who is currently in other vehicles as the second member.

[0130] [Information storage method]

[0131] Next, refer to Fig. 9 illustrate Figure 8The method of storing event data in the information output device shown in the figure is different from the second embodiment only in the processing of step S201 to step S204. Therefore, only the processing steps that are the difference will be described, and the description of other common processing will be omitted.

[0132] In step S201, the communication partner identification unit 61 determines whether there is another vehicle currently connected to the vehicle via the communication unit. If the communication partner identification unit 61 determines that there is no other vehicle currently connected to the vehicle via the communication unit (step S201: No), the process proceeds to step S30.

[0133] When the communication partner identification unit 61 determines in step S201 that there is another vehicle currently connected to the vehicle via the communication unit (step S201 : Yes), the process proceeds to step S202 .

[0134] In step S202, the inter-vehicle distance determination unit 62 measures the distance between the vehicle and other vehicles. The process proceeds to step S203, where the inter-vehicle distance determination unit 62 determines whether the measured distance between the vehicle and other vehicles is within a predetermined distance range. If the inter-vehicle distance determination unit 62 determines that the distance between the vehicle and other vehicles is not within the predetermined distance range (step S203: No), the process proceeds to step S30.

[0135] When the inter-vehicle distance determination unit 62 determines in step S203 that the distance to the other vehicle is within the predetermined distance range (step S203 : Yes), the process proceeds to step S204 .

[0136] In step S204, the video / sound receiving unit 63 receives the video and sound data of the interior of the other vehicle from the other vehicle currently connected to the vehicle via the Internet communication. Then, the video / sound receiving unit 63 transmits the received video and sound data of the interior of the other vehicle to the member identification unit 20. Thus, the member identification unit 20 can identify not only the first member who was in the vehicle when the event was detected, but also the first member who was in the other vehicle when the event was detected.

[0137] [Information output method]

[0138] Next, refer to Fig.10 illustrate Figure 8 The method of outputting event data by the information output device shown in the figure is different from the second embodiment only in the processing of step S1201 to step S1205. Therefore, only the processing steps that are the difference will be described, and the description of other common processing will be omitted.

[0139] In step S1201, the communication partner identification unit 61 determines whether there is another vehicle currently connected to the vehicle via the communication unit. If the communication partner identification unit 61 determines that there is no other vehicle currently connected to the vehicle via the communication unit (step S1201: No), the process proceeds to step S130.

[0140] When the communication partner identification unit 61 determines in step S1201 that there is another vehicle currently connected to the vehicle via the communication unit (step S1201 : Yes), the process proceeds to step S1202 .

[0141] In step S1202 , the inter-vehicle distance determination unit 62 measures the distance between the vehicle and another vehicle.

[0142] The process proceeds to step S1203, where the inter-vehicle distance determination unit 62 determines whether the distance between the vehicle and other vehicles is within a predetermined distance range. If the inter-vehicle distance determination unit 62 determines that the distance between the vehicle and other vehicles is not within the predetermined distance range (step S1203: No), the process proceeds to step S130.

[0143] When the inter-vehicle distance determination unit 62 determines in step S1203 that the distance between the vehicle and the other vehicle is within the predetermined distance range (step S1203 : Yes), the process proceeds to step S1204 .

[0144] In step S1204, the video / sound receiving unit 63 receives the video and sound inside the other vehicle currently connected to the vehicle via the communication unit and transmits the video and sound to the member identifying unit 20. Thus, the member identifying unit 20 can identify not only the second member currently in the vehicle but also the second member currently in the other vehicle.

[0145] Entering step S1205, the member comparison unit 42 compares the second member currently in the other vehicle connected to the vehicle via the communication device with the first member, and determines whether the second member currently in the other vehicle includes a member other than the first member. In the case where the member comparison unit 42 determines that the second member currently in the other vehicle includes a member other than the first member (step S1205: "No"), the process proceeds to step S190. At the time of entering step S190, the regeneration determination unit 43 prohibits the automatic output of event data to the second member currently in the other vehicle. The processing of steps S190 to S220 is the same as the processing of steps S150 to S180 of the first embodiment.

[0146] In step S1205 , when the member comparing unit 42 determines that the second members of the other vehicles currently connected to the vehicle via the communication device do not include any member other than the first member (step S1205 : Yes), the process proceeds to step S124 .

[0147] As described above, according to the third embodiment, the following effects can be obtained.

[0148] The information output device determines the first member who was riding in the vehicle when the event was detected and the second member who is currently riding in the vehicle. Furthermore, in a case where another vehicle different from the vehicle is connected to the vehicle via a communication unit and is traveling within a predetermined distance from the vehicle, the first member who was riding in the other vehicle when the event was detected and the second member who is currently riding in the other vehicle are determined. Thus, it is possible to determine whether event data can be output for the second member who is currently riding in the other vehicle. Furthermore, by making it a condition that the other vehicle is traveling within a predetermined distance from the vehicle, it is possible to determine that the first member who was riding in the other vehicle when the event was detected was in a state capable of perceiving the event. In addition, in a case where event data is output, the second member who is currently riding in the other vehicle can understand why the event data is output.

[0149] The embodiments of the present invention are described above, but the description and drawings forming part of the present disclosure should not be understood as limiting the present invention. Based on the present disclosure, various alternative embodiments, examples, and application technologies can be clearly understood by those skilled in the art.

[0150] The entire contents of Japanese Tokugan Application No. 2020-152214 (filing date: September 10, 2020) are applied here.

[0151] Description of Reference Numerals

[0152] 10: event detection unit; 20: member determination unit; 30: event storage unit; 40: output control unit; 50: data output unit.

Claims

1. An information output device, comprising: An event detection unit for detecting an event occurring inside or outside the vehicle; a member determining unit that determines a person who can perceive the event when the event is detected as a first member; an event storage unit that stores event data related to the detected event in association with the first member; and a data output unit that automatically outputs the event data stored in the event storage unit, The information output device is characterized in that: the member determination unit determines a person who can view and listen to the event data output from the data output unit as a second member, The information output device further includes an output control unit, which determines whether the second members include a person other than the first member, and prohibits the data output unit from automatically outputting the event data when it is determined that the second members include a person other than the first member. The member determination unit not only determines the first member who was riding in the vehicle when the event was detected and the second member who is currently riding in the vehicle, but also determines the first member who was connected to the vehicle via a communication unit when the event was detected and the second member who is currently connected to the vehicle.

2. The information output device according to claim 1, characterized in that: The output control unit allows the data output unit to automatically output the event data when it is determined that the second members do not include any person other than the first member.

3. The information output device according to claim 1 or 2, characterized in that: When the output control unit determines that the second members include persons other than the first member and the second members include at least one person of the first member, and when the event detection unit detects other events similar to the event stored in the event storage unit as the event data, the output control unit inquires the first member included in the second members whether the event data can be output.

4. The information output device according to claim 1 or 2, characterized in that: The output control unit extracts event data storing information related to the second member from the event data stored in the event storage unit, and presents the extracted event data to the second member in the form of a list.

5. The information output device according to claim 4, characterized in that: When presenting event data storing information related to the second member to the second member in the form of a list, the output control unit calculates the proportion of the second member to the first member stored in each event data presented in the form of the list, and presents the event data in descending order of the proportion.

6. The information output device according to claim 1 or 2, characterized in that: When the event detection unit detects other events similar to the event stored as the event data in the event storage unit and the output control unit determines that the second member does not include any person other than the first member, the output control unit allows the data output unit to automatically output the event data.

7. An information output device comprising: An event detection unit for detecting an event occurring inside or outside the vehicle; a member determining unit that determines a person who can perceive the event when the event is detected as a first member; an event storage unit that stores event data related to the detected event in association with the first member; and a data output unit that automatically outputs the event data stored in the event storage unit, The information output device is characterized in that: the member determination unit determines a person who can view and listen to the event data output from the data output unit as a second member, The information output device further includes an output control unit, which determines whether the second members include a person other than the first member, and prohibits the data output unit from automatically outputting the event data when it is determined that the second members include a person other than the first member. The member identification unit not only identifies the first member who was riding in the vehicle when the event was detected and the second member who is currently riding in the vehicle, but also identifies the first member who was riding in the other vehicle when the event was detected and the second member who is currently riding in the other vehicle when another vehicle different from the vehicle is connected to the vehicle via a communication unit and travels within a predetermined distance from the vehicle.

8. An information output method, performing the following processing: Detecting events occurring inside or outside of a vehicle; determining a person who is able to perceive the event when the event is detected as a first member; storing event data related to the detected event in association with the first member; and automatically outputting the stored event data, The information output method is characterized in that the following processing is further performed: determining a person who can watch and listen to the outputted event data as a second member; determining whether the second members include a person other than the first member; and If it is determined that the second members include a person other than the first member, automatically outputting the event data is prohibited, Among them, not only the first member who was riding in the vehicle when the event was detected and the second member who is currently riding in the vehicle are determined, but also the first member who was connected to the vehicle via a communication unit when the event was detected and the second member who is currently connected to the vehicle are determined.

9. An information output method, performing the following processing: Detecting events occurring inside or outside of a vehicle; determining a person who is able to perceive the event when the event is detected as a first member; storing event data related to the detected event in association with the first member; and automatically outputting the stored event data, The information output method is characterized in that the following processing is further performed: determining a person who can watch and listen to the outputted event data as a second member; determining whether the second members include a person other than the first member; and If it is determined that the second members include a person other than the first member, automatically outputting the event data is prohibited, In which, not only the first member who was riding in the vehicle when the event was detected and the second member who is currently riding in the vehicle are determined, but also, when other vehicles different from the vehicle are connected to the vehicle via a communication unit and travel within a predetermined distance from the vehicle, the first member who was riding in the other vehicle when the event was detected and the second member who is currently riding in the other vehicle are determined. 10 . A recording medium having recorded thereon a computer program executable on a computer, wherein the computer program is executed by a processor to implement the information output method according to claim 8 or 9 .

11. A computer program product, comprising a computer program that can be run on a computer, wherein the computer program is executed by a processor to implement the information output method according to claim 8 or 9.

Images