Privacy protection systems and privacy protection methods

Abstract

To provide a privacy protection system and a privacy protection method for appropriately protecting privacy of a witness when an abnormal event occurs.SOLUTION: A privacy protection system 10 includes: an acquisition unit 21 for acquiring voice data; an event detection unit 22 for detecting occurrence of an event in which abnormality occurs and determining a type of abnormality; and a control unit 20 for generating restricted voice data in which voice which is not related to the determined abnormality type is restricted from voice data when the event occurs.SELECTED DRAWING: Figure 1

Description

Technical Field

[0001] The present invention relates to a privacy protection system and a privacy protection method.

Background Art

[0002] In recent years, the number of vehicles equipped with a drive recorder has been increasing. A drive recorder is used as a recording device that captures the situation inside or outside the vehicle and records the captured data. The data recorded in the drive recorder is used to investigate the cause of an accident when an accident occurs or to confirm the facts when an incident occurs. For example, in Patent Document 1, a recording device is disclosed that collects the sound around the vehicle and records the image and sound around the vehicle in a recording unit when it is determined that the host vehicle is being tailgated.

[0003] For example, in Patent Document 1, there is disclosed a recording device that collects the sound around the vehicle and records the image and sound around the vehicle in a recording unit when it is determined that the host vehicle is being tailgated.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0005] Data such as that from a drive recorder may be provided to the police, insurance companies, the media, the cloud, etc. as witness information. Such data may include personal conversation voices and the like as information related to the privacy of the witness. However, when providing data as witness information, there is a need to protect the privacy of such witnesses.

[0006] The present invention has been made to solve the above-mentioned problems and provides a privacy protection system and privacy protection method that suitably protects the privacy of witnesses in the event of an abnormal situation. [Means for solving the problem]

[0007] A privacy protection system according to one aspect of the present invention comprises: an acquisition unit that acquires audio data; an event detection unit that detects the occurrence of an event in which an anomaly is detected and determines the type of anomaly; and a control unit that, when an event occurs, generates restricted audio data from the audio data in which audio unrelated to the determined type of anomaly is restricted.

[0008] A privacy protection system according to one aspect of the present invention includes an acquisition unit for acquiring audio data, an event detection unit for detecting the occurrence of an event in which an anomaly is detected, a restricted audio detection unit for detecting a person's speech when an event occurs, and a control unit for generating restricted audio data from the audio data in which the audio signal corresponding to a person's speech is restricted when an event occurs.

[0009] A privacy protection method according to one aspect of the present invention comprises an acquisition step of acquiring audio data, an event detection step of detecting the occurrence of an event in which an anomaly is detected and determining the type of anomaly, and a control step of generating restricted audio data from the audio data in which audio unrelated to the determined type of anomaly is restricted when an event occurs.

[0010] A privacy protection method according to one aspect of the present invention comprises an acquisition step of acquiring audio data; an event detection step of detecting the occurrence of an event in which an anomaly is detected; a restricted audio detection step of detecting a person's speech when an event occurs; and a control step of generating restricted audio data from the audio data in which the audio signal corresponding to a person's speech is restricted when an event occurs. [Effects of the Invention]

[0011] According to the present invention, a privacy protection system and a privacy protection method can be provided that suitably protect the privacy of witnesses in the event of an abnormal situation. [Brief explanation of the drawing]

[0012] [Figure 1] This is a configuration diagram of the recording device according to Embodiment 1. [Figure 2] This figure shows an example of the relationship between the data recorded in the recording unit according to Embodiment 1 and the data recorded in the buffer memory. [Figure 3] This figure shows an example of the relationship between the data recorded in the recording unit according to Embodiment 1 and the data recorded in the buffer memory. [Figure 4] This figure shows an example of the event detection process flow according to Embodiment 1. [Figure 5] This diagram shows the flow of media data recording processing according to Embodiment 1. [Figure 6] This figure shows an example of the relationship between the data recorded in the recording unit according to Embodiment 2 and the data recorded in the buffer memory. [Figure 7] This is a configuration diagram of the recording device according to Embodiment 3. [Figure 8] This diagram shows the flow of media data recording processing according to Embodiment 3. [Figure 9] This is a configuration diagram of the recording device according to Embodiment 4. [Modes for carrying out the invention]

[0013] The present invention will be described below through embodiments of the invention, but the invention as claimed in the patent claims is... The embodiments are not limited to those described below. Furthermore, all configurations described in the embodiments address the problem. It is not necessarily essential as a means of resolving the issue. For the sake of clarity, please refer to the following description and The drawings have been omitted and simplified as appropriate. Note that the same elements are shown in each drawing. are assigned the same reference numerals.

[0014] <Embodiment 1> Hereinafter, embodiments of the present invention will be described with reference to the drawings. With reference to FIG. 1, Embodiment 1 will be described with regard to a configuration example of such a recording system (hereinafter referred to as a recording device) 10. FIG. 1 is a configuration diagram of the recording device 10 according to Embodiment 1. The recording device 10 may be used, for example, as a drive recorder mounted on a vehicle. The recording device 10 may be a computer device that operates by a processor executing a program stored in a memory. The processor may be, for example, a microprocessor, an MPU (Micro Processing Unit), or a CPU (Central Processing Unit). The memory may be a volatile memory or a non-volatile memory, or may be a combination of a volatile memory and a non-volatile memory. The processor executes one or more programs including a group of instructions for causing a computer to perform the algorithms described with reference to the following drawings. The recording device 10 includes a control unit 20, a camera 31, a microphone 32, a recording unit 33, a sensor 34, a display unit 35, and a speaker 36. The control unit 20 and the camera 31, the microphone

[0015] 32, the recording unit 33, the sensor 34, the display unit 35, and the speaker 36 may be directly connected using a predetermined cable or the like, or may be connected via a CAN (Controller Area Network), which is an in-vehicle network. Further, the recording device 10 may be configured to include components implemented by the control unit 20. Specifically, the recording device 10 mainly includes a fetch realized by the control unit 20. Also, the recording device 10 may be configured to include components implemented by the control unit 20. Specifically, the recording device 10 mainly includes a It comprises an acquisition unit 21, an event detection unit 22, and a recording control unit 23.

[0016] Camera 31 generates image data that captures an area including at least the area around the vehicle. In the first implementation configuration, the camera 31 generates image data of the outside of the vehicle, but also captures images of the inside of the vehicle. Image data may be generated. The microphone 32 includes at least the area around the vehicle. It generates audio data by capturing sound in the region. In Embodiment 1, the microphone 32 is Audio data is generated by capturing sounds from inside and outside the vehicle. The recording unit 33 is a hard disk It may also be a card-type memory or the like, and it records image data and audio data.

[0017] Sensor 34 is, for example, an acceleration sensor, and when a vehicle equipped with recording device 10 is involved in an accident... In such cases, or if involved in an accident, the impact or other effects that occur may be detected. Sensor 34 detects the amount of operation of the brake, accelerator, or steering wheel, and the vehicle's speed It may also generate data and acceleration information. Furthermore, the sensor 34 may, for example, be a distance measuring sensor or a millimeter-wave radar. It may also detect the proximity of other vehicles or other objects. The display unit 35 is the recording unit 33 It may be a display that plays back image data recorded in the recording unit. Speaker 36 is a recording unit The audio data recorded in 33 is played back. Speaker 36 is shown in front of the input of speaker 36. This includes audio amplification and audio processing units, and even if referred to as speaker 36, these are not included. include.

[0018] Next, we will describe an example of the configuration of the control unit 20. The control unit 20 consists of an acquisition unit 21 and an event It includes a detection unit 22, a recording control unit 23, a buffer memory 24, and a playback control unit 25. Control units 20 such as acquisition unit 21, event detection unit 22, recording control unit 23, and playback control unit 25 Each component that makes up the processor executes a program stored in memory. Therefore, the processing may be performed by software or a module. Or, control Each component constituting part 20 may be hardware such as a circuit or a chip.

[0019] The acquisition unit 21 receives the image data generated by the camera 31 and the microphone 32. The generated audio data is obtained. The data, including image data and audio data, is processed by Mede. It may also be called data. In other words, the acquisition unit 21 acquires the camera 31 and microphone 3 This can be rephrased as obtaining media data from step 2. Image data is still image data. Alternatively, it may be video data. Image data may be in formats such as H.264 or H.265. It may also be generated using a formula. Furthermore, the audio data is PCM (Pulse Code Modulation). It may be generated using a method, etc., and is a video image data that includes image data and audio data. The media data is MPEG (Moving Picture Experts Group) 2-TS (Transport It may also be generated using a Stream or AVI (Audio Video Interleave) format.

[0020] The acquisition unit 21 stores media data, including image data and audio data, in the buffer memory 24. Output to [location]. Buffer memory 24 temporarily stores the output media data. The buffer memory 24 may also be referred to as the built-in memory that is built into the control unit 20. To store means, for example, that buffer memory 24 erases media data after a predetermined period of time has elapsed. Alternatively, temporarily storing means outputting from the acquisition unit 21. The data may also be stored by overwriting the data in buffer memory 24. In other words, temporarily storing means that the buffer memory 24 stores the media output from the acquisition unit 21. When media data is output to the recording control unit 23, the output media data is erased. That's fine.

[0021] Furthermore, the acquisition unit 21 uses positioning systems such as GNSS (Global Navigation Satellite System). The system receives vehicle location information from the system (not shown) and bundles the location information along with media data. It may be supplied to memory 24.

[0022] The event detection unit 22 receives image data from the camera 31 via the buffer memory 24. Audio data acquired from microphone 32, and measurement data output from sensor 34. At least one of the following is used to detect the occurrence of an event. Specifically, the event The detection unit 22 includes an ambient abnormality detection unit 220, a vehicle abnormality detection unit 221, and a determination unit 223. do.

[0023] The surrounding abnormality detection unit 220 detects the occurrence of an abnormality in the vehicle's surroundings from the media data. Specifically, the surrounding abnormality detection unit 220 detects the occurrence of an abnormality in the vehicle's surroundings from the audio data. Yes. Abnormalities around the vehicle may include not only abnormalities outside the vehicle but also abnormalities inside the vehicle. For example. The surrounding abnormality detection unit 220 analyzes the audio data and detects sounds related to abnormalities around the vehicle (abnormalities). It detects abnormal sounds (referred to as "sound"). Abnormal sounds may include non-verbal sounds and verbal sounds (speech). Non-verbal sounds This could be, for example, a collision sound or a braking sound. The speech could be, for example, a scream or "It's an accident." Phrases such as "They're instigating it" are acceptable.

[0024] As an example, the ambient anomaly detection unit 220 extracts characteristic quantities of the audio signal from the waveform of the audio signal. Physically, it is extracted from frequency, elapsed time since the start of vocalization, or volume, etc. (Ambient Anomaly Detection Unit) 220 is the relationship between the extracted features and the features of the pre-registered abnormal sound sample data. When the similarity level exceeds a predetermined threshold, the system detects the occurrence of an anomaly around the vehicle. Existing acoustic analysis and voiceprint analysis techniques can be used to calculate the trace values.

[0025] As another example, the ambient abnormality detection unit 220 includes data for normal sounds and data for abnormal sounds. Using an acoustic model trained with training data, it is possible to determine whether or not the audio data contains abnormal sounds. The acoustic model can use an existing acoustic model. For example, the acoustic model is It outputs a value indicating whether the audio data corresponding to the input contains abnormal sounds. Alternatively, it outputs an acoustic model. Dell outputs the probability that the audio data corresponding to the input contains an abnormal sound. Ambient Anomaly Detection Unit 22 0 means that if the probability of the audio data corresponding to the input containing abnormal sounds is greater than a predetermined value, the vehicle It detects the occurrence of an anomaly in the surroundings. The surrounding anomaly detection unit 220 is obtained from the waveform of the audio signal. These features may be used as input to the acoustic model.

[0026] Furthermore, certain utterances, such as screams or phrases like "It's an accident" or "They're provoking me," are not considered abnormal sounds. When defined in this way, the surrounding abnormality detection unit 220 further processes the utterance content using natural language processing. It is possible to estimate and determine whether or not it is an abnormal sound. Specifically, first, the ambient abnormality detection unit 220 It extracts phonemes from audio data based on a predetermined acoustic model. Then, the ambient anomaly detection unit... 220 determines whether or not speech components are present by comparing the extracted phonemes with a predetermined language model. The surrounding abnormality detection unit 220 determines, if speech components are present, by a predetermined language model. The content of the utterance is estimated, and it is determined whether or not it contains content defined as abnormal sound. The log contains a pre-trained speech recognition dictionary. The surrounding anomaly detection unit 220 estimates the speech content. If it is determined that the sound contains an abnormal noise, the system will detect an abnormality in the vehicle's surroundings.

[0027] Furthermore, the surrounding abnormality detection unit 220 analyzes image data in addition to or instead of audio data. Furthermore, abnormalities around the vehicle, such as collisions between other vehicles or between other vehicles and other objects, or the overturning of other vehicles. It may also detect things like fires, road rage, and other abnormal proximity between vehicles. In this case, the surrounding area The abnormality detection unit 220 learns image data from normal operation, when another vehicle malfunctions, and when its own vehicle malfunctions. An image recognition model trained as a test subject may be used to detect anomalies around the vehicle. For example, The image recognition model takes image data as input and outputs a value indicating whether it is normal or if there is an abnormality around the vehicle. It may have a convolutional neural network. The surrounding anomaly detection unit 220 uses image data In addition to or instead of analyzing the data, sensors such as distance measuring sensors and millimeter-wave radar 34 This allows the system to detect proximity between other vehicles or between other vehicles and other objects, and to detect abnormalities around the vehicle. It may be detected.

[0028] The surrounding abnormality detection unit 220 detects the occurrence of an abnormality around the vehicle, and then... Information indicating that an abnormality has occurred (surroundings abnormality information) is supplied to the determination unit 223. Surroundings abnormality information This includes the time when the anomaly around the vehicle occurred. Furthermore, the surrounding anomaly information includes the time when the anomaly occurred. It may include details of abnormalities.

[0029] The vehicle abnormality detection unit 221 detects abnormalities in the vehicle based on the measurement information output from the sensor 34. Its primary function is to detect abnormalities related to the vehicle's operation. For example, it can function as an acceleration sensor. If the impact level detected by the sensor 34 exceeds a predetermined value, the vehicle abnormality detection unit Unit 221 detects that an abnormality related to the vehicle has occurred. The impact level exceeds a predetermined value. This can be rephrased as the acceleration exceeding a predetermined value. Also, for example, a distance measuring sensor and When the distance between the vehicle and another vehicle detected by the sensor 34 operating in this manner is less than a predetermined value The vehicle abnormality detection unit 221 detects that an abnormality related to its own vehicle has occurred. If the detection unit 221 detects that an abnormality has occurred in the vehicle, it will indicate that an abnormality has occurred in the vehicle. The system supplies the system information (vehicle abnormality information) to the determination unit 223. The vehicle abnormality information includes information about abnormalities in the vehicle. The time of occurrence is included. Furthermore, the vehicle malfunction information may include the details of the malfunction that occurred. Good. The vehicle abnormality detection unit 221, in addition to or instead of the measurement information output from the sensor 34, The system then analyzes the image data to detect abnormalities in the vehicle, such as abnormal proximity between the vehicle and other vehicles. You may also detect live organisms.

[0030] The determination unit 223 combines the detection results of the surrounding abnormality detection unit 220 and the detection results of the vehicle abnormality detection unit 221. Based on the results, it is determined whether or not an event has occurred. In this embodiment 1, the vehicle If abnormalities are detected in the surroundings of both vehicles, and no abnormalities are detected in the vehicle (the vehicle itself), then the first event... This is called an event. The first event is, for example, when other vehicles in the vicinity of a vehicle collide with each other, or when vehicles are close together. One example is when other vehicles in the vicinity are being tailgated. The determination unit 223 detects abnormalities around the vehicle. Obtain information indicating that an issue has occurred, and obtain information indicating that an abnormality has occurred in your vehicle. If none of the above conditions are met, it is determined that the first event has occurred. The determination unit 223 determines that the first event has occurred in addition to the above conditions. A second event, in which a vehicle abnormality is detected, may also be detected.

[0031] The determination unit 223, in response to the detection of the occurrence of an event, determines that an event has occurred. Information indicating that an event has occurred (event occurrence information) is supplied to the recording control unit 23. The information indicating this includes the time the event occurred.

[0032] The recording control unit 23 processes the media data stored in the buffer memory 24 into a predetermined file. The data is recorded in the recording unit 33 in the specified format. The media data acquired from the buffer memory 24 is an image. This includes data and audio data. In other words, the recording control unit 23 is the buffer memory 24 or Then the media data is transferred to the recording unit 33. Specifically, the recording control unit 23 buffers the media data. From the media data stored in Mori24, video files including image and audio data A video is generated and the video file is recorded in the recording unit 33 as recording media data.

[0033] When the recording control unit 23 detects the occurrence of the first event, it stores it in the buffer memory 24. Restricted audio data is generated from the audio data of the period during which the first event occurred. The recording control unit 23 records the restricted audio data along with image data for the duration of the first event. Recorded in section 33. The occurrence period of the first event corresponds to the time the first event occurred. It may be a predetermined period. For example, the period for the occurrence of the first event is from the time the first event occurs. A predetermined period (the first predetermined period) that includes the time and the period before and after the time when the first event occurred. This may be the case. For example, during the period in which the first event occurs, before the time the first event occurs. The period may be the same as the period after the first event occurs, and at the time of the first event It may be longer or shorter than the period after the hour. Also, the period during which the first event occurs is the first It may be sufficient to include either a period before or after the time the event occurred. Furthermore, restricted audio data may be silent data, or audio data with the overall volume reduced. It may also be a case where the recording control unit 23 detects the occurrence of the first event. In total, from the audio data of the period during which the first event occurred, stored in buffer memory 24, the sound The recording control unit 23 generates restricted audio data that limits the audio contained in the voice data. Instead of audio data for the period of the first event, restricted audio data is used, and the occurrence of the first event Generate a video file containing image data for the period, and record the video file on media. The data is recorded in the recording unit 33.

[0034] When the recording control unit 23 records the generated recording media data to the recording unit 33, 1. Recording media data resulting from an event, i.e., image data and restricted audio data The recording media data, including the data used for recording, is treated as a record related to the event, and is protected from overwriting. The data may be recorded in the recording unit 33. For example, the recording control unit 23 may prohibit overwriting the data. Specify the address of the memory area within the recording unit 33 and record media data to the recording unit 33 It may also be recorded to 3. Alternatively, the recording control unit 23 may also record the header of the recording media data. Alternatively, flag information indicating overwrite prohibition may be set in the payload. The recording control unit 23 , recording media data including image and audio data resulting from the second event, The data related to the event may be recorded in the recording unit 33 as data that cannot be overwritten. .

[0035] Furthermore, the recording control unit 23 records media data for recording that is not caused by an event, i.e., images. The recording media data, including data and audio data, is discarded without being recorded in the recording unit 33. Alternatively, it may be recorded in the recording unit 33 as a regular record unrelated to the event. When recording to the recording unit 33 as a record, the recording media data is overwritable data. The data may be recorded in the recording unit 33. For example, the recording control unit 23 may record the data in the recording unit 33. Specify the address of the memory area that allows writing, and record the media data to the recording unit 3 It may also be recorded to 3. Alternatively, the recording control unit 23 may also record the header of the recording media data. Alternatively, you may set a flag in the payload to indicate that it can be overridden.

[0036] The recording unit 33 records the data output from the recording control unit 23, in other words, the recording control unit 23. The media data transferred from the buffer memory 24 is recorded via the recording unit 33. For example, recording media such as optical discs or card-type recording media.

[0037] The playback control unit 25 acquires the recording media data recorded in the recording unit 33, and The image data contained in the acquired recording media data is output to the display unit 35, and the acquired record The audio data contained in the recording media data is output to speaker 36, etc.

[0038] In Figure 1, the recording device 10 comprises a playback control unit 25, a display unit 35, and a speaker 36. The configuration shown includes, but a playback device, etc., different from the recording device 10, is included in the playback control unit 25, display It may also include section 35 and speaker 36. In other words, the recording device 10 is a playback control unit. 25, the display unit 35, and the speaker 36 do not need to be included. In other words, the playback control unit 25, the display unit 35, and the speaker 36 do not need to be included. The display unit 35 and the playback device including the speaker 36 are recorded in the recording unit 33 of the recording device 10. The data may be played back. For example, playback devices may use optical discs or card-type recording media. It may also be a device that plays back data recorded on a portable recording medium such as the human body. The data recorded in section 33 may be transferred to a portable recording medium.

[0039] Here, using Figure 2, we will show the data recorded in the recording unit 33 and the data recorded in the buffer memory 24. The relationship with the data being recorded will be explained. Figure 2 shows the data recorded in the recording unit 33 according to Embodiment 1. This figure shows an example of the relationship between the data being processed and the data recorded in buffer memory 24. The horizontal axis shown in Figure 2 represents the passage of time. Each of D-3 to D+4 is the first This shows media data taken during the event period, divided into predetermined time intervals. Yes. A predetermined period is sometimes called a timeframe, for example, a few seconds, tens of seconds, or a few minutes. Other options may also be used. In Figure 2, D-2 is the oldest media data captured. Therefore, D+4 is the most recently captured media data. Note that the middle section of Figure 2 shows the location. The data that was newly added to buffer memory 24 in between is shown. In other words, the buffer The buffer memory 24 contains data newly added to the buffer memory 24 during a predetermined time frame. Other data, such as undeleted data added before the relevant timeframe, is stored. It's okay to be there.

[0040] The media data acquired by the acquisition unit 21 is immediately output to the buffer memory 24. Therefore, in Figure 2, the media data acquired by the acquisition unit 21 is used as is. It is shown that it is stored in memory 24. In other words, in Figure 2, The timing at which the acquisition unit 21 acquires media data and the media data in the buffer memory 24 It has been shown that the timing of when the data is stored is substantially the same. This refers to the timing at which the acquisition unit 21 acquires media data and the buffer memory This includes cases where the timing of when media data is stored in 24 does not perfectly coincide. For example, if they are essentially the same, then the media data is stored in buffer memory 24. The timing may be delayed until after the acquisition unit 21 has acquired the media data. It is included. On the other hand, the media data recorded in the recording unit 33 is temporarily stored in buffer memory 2 After being stored in 4, it is recorded in the recording unit 33 by the recording control unit 23. Therefore, acquisition The timing at which the media data acquired by unit 21 is stored in buffer memory 24, and This is different from the timing at which the media data is recorded in the recording unit 33. Specifically, the timing at which the media data is recorded in the recording unit 33 The timing recorded is the timing when media data is stored in buffer memory 24. It's slower than G.

[0041] t-3 to t+3 and ti indicate time. The event detection unit 22 detects time t-3 to t+3 The system determines whether an event occurred within a predetermined period in the past. For example, event detection unit 22 This determines whether an event occurred between time t-1 and time t at time t. The event detection unit 22 determines whether the event occurred at other times as well. Determine.

[0042] For example, the event detection unit 22 detects from time t-3 to time t-2 at time t-2. During this time, it is determined that the first event has not occurred. In this case, the recording control unit 23 determines the time Between time t-2 and time t-1, media data stored in buffer memory 24 D-2 is either discarded without being recorded in the recording unit 33, or recorded as a normal record unrelated to the event. This may be recorded in the recording unit 33.

[0043] On the other hand, the event detection unit 22 detects that at time t, the period is from time t-1 to time t. At time ti, it is determined that the first event occurred. In this case, the recording control unit 23 determines that at time t During a predetermined period corresponding to i, for example, between time t and time t+1, in buffer memory 24 The audio data of stored media data D is replaced with restricted audio data, and the image data and The restricted audio data is then recorded in the recording unit 33 as media data D', which is a file.

[0044] In Figure 2, media data that has been stored in buffer memory 24 is stored in the recording unit This indicates that the data will be recorded in 33. In other words, the media data will be recorded in the recording unit 33. The timing of this is 1 It is delayed by the amount of time frame. However, the media data stored in buffer memory 24 The timing for recording the data to the recording unit 33 is not limited to this. The difference in timing between the two is It may be less than one timeframe or two or more timeframes. For example, The recording control unit 23 acquires the media data being stored in the buffer memory 24 and The acquired media data may be recorded to the recording unit 33. Alternatively, the recording control unit 23 may record the media data to the recording unit 33. Once the storage of media data to buffer memory 24 is complete, regardless of the time frame After a predetermined period has elapsed since the storage of the media data was completed, the media data is recorded. This may be recorded in section 33.

[0045] Furthermore, in Figure 2, the recording control unit 23 acquires data during the period including the time of the first event occurrence. Only the media data acquired in 21 is recorded to the recording unit 33 with audio restricted. This indicates that the recording period (event) of the media data subject to audio restrictions is the recording period (event) The occurrence period of the first event is limited to the timeframe that includes the time of the first event. The recording control unit 23 is not limited to this, and the acquisition unit 21 during the period including the time of the first event occurrence. In addition to the media data acquired, the period before and after the time the first event occurred is also included. During the period, the media data acquired by the acquisition unit 21 is also recorded to the recording unit 33 with audio restricted. This is also acceptable. In other words, the recording period for media data subject to audio restrictions is the first event In addition to the time frame including the time of occurrence, time frames before and after that time frame. It may include a timeframe, and the duration of the timeframe including the time of the first event can be arbitrarily set. For example, the recording control unit 23 may, in addition to the data D acquired by the acquisition unit 21, also record data Data D-1 is also recorded to the recording unit 33 as data D' and data D-1' with restricted audio. good.

[0046] In this case, the data recorded in the recording unit 33 and the data recorded in the buffer memory 24 The relationship with the data is shown in Figure 3. Figure 3 shows the data recorded in the recording unit 33 according to Embodiment 1. This figure shows another example of the relationship between the data recorded in buffer memory 24 and the recording control. Unit 23 captures each media data in the buffer memory 24. The first event occurs in either the timeframe corresponding to the period or the following timeframe. If detected, the audio of the media data is restricted and recorded in the recording unit 33.

[0047] Specifically, the event detection unit 22 detects the time t-2, and the time t-3 to time t-2 It is determined that no first event occurred in between, and at time t-1, time t-2 to hour It is determined that the first event did not occur during time t-1. At this time, the recording control unit 23 Between time t-1 and time t, media data D- stored in buffer memory 24 The audio data from step 2 is saved as a file without any restrictions and recorded to the recording unit 33.

[0048] Then, the event detection unit 22 detects that at time t, time t is between time t-1 and time t. The first event is determined to have occurred at i. At this time, the recording control unit 23 determines the previous time step Even if the first event has not occurred in the frame, a predetermined period corresponding to time ti, for example, time Between time t and time t+1, the sound of media data D-1 stored in buffer memory 24 The voice data was replaced with restricted audio data and compiled into a file containing the image data. It is recorded as 1' in the recording unit 33.

[0049] Next, the recording control unit 23 records the sound of media data D stored in buffer memory 24. The voice data was replaced with restricted voice data and filed together with the image data into a single file, data D'. This is recorded in the recording unit 33.

[0050] Next, the event detection unit 22 detects that at time t+1, between time t and time t+1, the first A It is determined that no vent has occurred. At this time, the recording control unit 23 checks the buffer memory 24 The media data D+1 stored in it is used as is without any restrictions on the audio data. The data may be converted to an ILU format and recorded in the recording unit 33.

[0051] Next, the processing of the control unit 20 of the recording device 10 will be explained using Figures 4 and 5. As shown in 2, the recording period of the media data subject to audio restrictions includes the time the event occurred. The example shown is limited to a timeframe, but it is not limited to this.

[0052] Figure 4 is a diagram showing the flow of event detection processing according to Embodiment 1. First, acquisition Unit 21 acquires media data including image data and audio data and stores it in buffer memory 2 Output to 4, and buffer memory 24 stores the media data (step S10). Next Furthermore, the surrounding abnormality detection unit 220 of the event detection unit 22 is stored in the buffer memory 24. The system determines whether or not abnormal ambient noises have been detected from the audio data contained in the media data. (Step S11). The ambient abnormality detection unit 220 detects an abnormal sound in the surroundings from the audio data. If this is the case (Yes in step S11), ambient abnormality information is supplied to the determination unit 223 and processing begins. Proceed to step S12. Meanwhile, the surrounding abnormality detection unit 220 detects abnormal sounds in the surroundings from the audio data. If no detection is made (No in step S11), the process returns to step S10.

[0053] In step S12, the vehicle abnormality detection unit 221 of the event detection unit 22 detects the sensor 34 Based on the measurement information output from the vehicle, it is determined whether or not an abnormality has occurred in the vehicle. The abnormality detection unit 221 detects the occurrence of an abnormality in the vehicle (Yes in step S12) Then, the vehicle abnormality information is supplied to the determination unit 223 and the process returns to step S10. Meanwhile, vehicle abnormal If no abnormality is detected in the vehicle (No in step S12), the detection unit 221 The process proceeds to step S13 without supplying vehicle abnormality information to the determination unit 223.

[0054] In step S13, the determination unit 223 of the event detection unit 22 acquires ambient abnormality information. Furthermore, if no vehicle malfunction information is obtained, it is determined that the first event has occurred. The determination unit 223 then generates event occurrence information and records the event occurrence information in the control unit. Supply to 23 (step S14). Then return to step S10, and from step S10 onwards. The process is executed repeatedly.

[0055] Next, Figure 5 is a diagram showing the flow of media data recording processing according to Embodiment 1. First, the acquisition unit 21 acquires media data including image data and audio data. The output is sent to buffer memory 24, and buffer memory 24 stores the media data (status (S20). Next, the recording control unit 23 checks the media stored in the buffer memory 24. Before starting to record data to the data recording unit 33, it is determined whether or not the first event has occurred. (Step S21). That is, the recording control unit 23 determines the event detection unit 22 From step 23, determine whether or not event occurrence information has been obtained.

[0056] If the recording control unit 23 determines that the first event has occurred (Yes in step S21), ), audio data from media data including the timing of the first event during the filming period The audio is extracted and restricted audio data is generated with the audio restricted (step S22). Then it is recorded. The control unit 23 generates a video file containing image data and restricted audio data, and the recording unit Record in 33 (step S23). Then return to step S20, and continue from step S20. The process is executed repeatedly.

[0057] On the other hand, if the recording control unit 23 determines that the first event has not occurred (step S (No. 21), media data taken during the period when the first event did not occur remains as is. The data is then saved as a file and recorded in the recording unit 33 (step S24). That is, the recording control unit 2 3. Without limiting the audio from the media data stored in buffer memory 24. The data is saved as a file and recorded in the recording unit 33. The recording control unit 23 detects when the first event occurs. If it is determined that there is no data, the recording to the recording unit 33 may not be performed. After that, step Return to step S20 and repeatedly execute the processes from step S20 onward.

[0058] In addition, as explained above, when the occurrence of the first event is detected, the recording control unit 23 will record audio The media data with restricted access is recorded in the recording unit 33. However, in addition to this, the recording system Unit 23, when it detects the occurrence of the first event, will send unrestricted audio to media devices. The data may also be recorded in the recording unit 33. For example, the recording unit 33 has a first recording area and It has a second recording area, and the first recording area contains normal records unrelated to event detection results. The media data stored in buffer memory 24 is recorded as is. On the other hand, In the second recording area, as an event record related to the detection of the first event, the first event is recorded. Audio is restricted from media data that includes the timing of the vent within the shooting period. It is acceptable to record "Ta".

[0059] As described above, the recording device 10 according to Embodiment 1 records when the first event occurs. For media data that includes the timing in the shooting period, the audio data of the media data will be... The audio can be replaced with restricted audio data and recorded to the recording unit 33. If an abnormal situation unrelated to its own vehicle occurs, the device 10 will receive a voice message from the driver of its own vehicle or a passenger. To avoid recording audio that may include conversations between staff members, we will not provide information to those who provide it as witnesses. In addition, the privacy of witnesses can be adequately protected. The recording device 10 records the first event. Regarding media data captured during periods when no incidents occurred, image data and audio data are included. This can be recorded in the recording unit 33. Therefore, if an abnormal situation related to the vehicle occurs, In such cases, the recorded media data can be used to investigate the cause of the accident.

[0060] Furthermore, when the first event occurs, the recording device 10 erases the audio data and the recording unit When recording to 33, compared to when recording media data including audio data, The amount of data to be recorded can be reduced. As a result, the recording unit 33 can reduce the media data Because the number of times the data is overwritten and recorded can be reduced, the recording unit 33 can record for a longer period of time. It can record media data.

[0061] <Embodiment 2> Next, Embodiment 2 will be described. In Embodiment 2, the recording control unit 23 records the first event If this occurs, distinguish the media data for the first event period from the case where no event occurred. The recording unit 33 stores the data. However, the recording control unit 23 distinguishes between cases where no event occurred and cases where no event occurred. This restricts the stored media data to only audio from a specific period.

[0062] For example, a specific period during which audio is restricted and recorded is the first event occurrence period (first predetermined period). The period may be a predetermined period (second predetermined period) prior to the occurrence of the first event. During the event and immediately afterward, there is a high probability that audio recordings that could serve as important evidence of the accident will be captured, This is because it is preferable that the audio be recorded without restriction. Therefore, the recording control unit 23 If the first event occurs, audio data from the audio data for a predetermined period prior to the occurrence of the first event will be used. The recording control unit 23 may generate restricted audio data. This, along with image data from a predetermined period (second predetermined period) before the occurrence of the first event, is recorded by the recording unit 3. The data may be recorded in a specific memory area of ​​3. The recording control unit 23 then processes the data after the occurrence of the first event. The audio data for the predetermined period (third predetermined period) is used as is, from the predetermined period after the occurrence of the first event. The image data for the specified period (third predetermined period) is recorded in a specific storage area of ​​the recording unit 33. Good. The second prescribed period may include a period prior to the first prescribed period, and the first prescribed period The period before the occurrence of the first event, which is included in the interval, does not need to be included. The second predetermined period is It is not limited to forms that strictly exclude the period during and immediately after the accident, and It may also include a portion of the period immediately following the occurrence. Similarly, the third prescribed period may be longer than the first prescribed period. This may also include a later period, and one of the periods after the occurrence of the first event included in the first predetermined period. It does not have to include the part. The third prescribed period does not necessarily include the part during and immediately after the accident. The format is not limited to this, and may include formats that do not include parts of the accident that occurred or immediately after it.

[0063] Figure 6 shows the data recorded in the recording unit 33 according to Embodiment 2 and the data in the buffer memory 24. This figure shows an example of the relationship with the data to be recorded. In this example, the recording unit 33 records the first event The first recording area is a normal recording area unrelated to the first event detection result, and the first event detection result is related to the first event detection result. It has a second memory area which is a continuous event recording area. And media data is recorded in the recording unit 3 The timing recorded in 3 is the timing when media data is stored in buffer memory 24. It's two timeframes slower than the ng.

[0064] Regardless of the first event detection result, the recording control unit 23 stores the data in the buffer memory 24. The media data is recorded in the first recording area of ​​the recording unit 33.

[0065] Furthermore, the recording control unit 23 processes each media data in the buffer memory 24 for the first event If a torrent is detected, the recording unit 3 will restrict the audio for a specific period of the media data. Record to the second memory area of ​​3.

[0066] Specifically, the event detection unit 22 detects when the first event occurs between time t-1 and time t. It is determined that... At this time, the recording control unit 23 determines the number stored in the buffer memory 24 1. The time frame from time t-1 when an event occurred to time t is the time frame immediately preceding time t. Place the audio data of media data D1 corresponding to time t-1 into the restricted audio data. The data is then recorded in the second storage area of ​​the recording unit 33 along with the image data. The recording control unit 23 then... Instead of or in addition to, the media corresponding to the time t1 in which the first event occurred from time t-1 The audio data of the audio data is replaced with restricted audio data, and recorded together with the image data in the recording unit 33. It may also be recorded in the second memory area.

[0067] At this time, the recording control unit 23 also records the first event stored in the buffer memory 24. The audio data of media data D corresponding to the time t-1 to time t when the event occurred is The image data is then recorded in the second storage area of ​​the recording unit 33. The recording control unit 23 then records the above Alternatively, or in addition to the above, media corresponding to the time t-1 to time t when the first event occurred. The audio data is replaced with restricted audio data, and together with the image data, the recording unit 33 It may also be recorded in two memory areas.

[0068] At this time, the recording control unit 23 also records the first event stored in the buffer memory 24. The time frame from time t-1 to time t, which is the time frame immediately following time t, is t. The audio data of media data D+1 corresponding to +1 is recorded directly along with the image data. Recorded in the second memory area of ​​section 33.

[0069] The recording unit 33, in lieu of or in addition to the above-mentioned recording area, records the audio during the period in which the first event occurred. A recording area that records only data, and a recording area that records only image data from the period of the first event. It may also have a recording area. The recording device 10 may receive voice messages from the user, for example, after driving. We accept requests for a period during which audio is restricted, and media data with restricted audio during the specified period will be restricted. It may be generated and recorded in the recording unit 33.

[0070] Furthermore, the recording unit 33 may, in lieu of or in addition to the above-mentioned recording area, record the audio during the first event occurrence period. Recording area for recording restricted media data and unrestricted audio media during the first event occurrence period. It may also have a recording area for recording data. And the recording device 10 receives from the user, For example, it accepts requests for a period of time to restrict voice activity after driving, and the voice restriction media for the specified period... A data and audio unrestricted media data may be combined and recorded in the recording unit 33.

[0071] Thus, the recording device 10 of Embodiment 2 provides the same effects as Embodiment 1, It is possible to record audio inside the vehicle at the time the first event occurs and after the first event occurs. It is possible to reliably record audio necessary for providing information while protecting the privacy of witnesses. Cut.

[0072] <Embodiment 3> Next, Embodiment 3 will be described. In Embodiment 3, the recording control unit 23 records the first event If this occurs, a media day will be held during the period of the first event, restricting only the specified audio. The system is characterized by storing the audio in the recording unit 33. The restricted predetermined audio is, for example, car audio. The voices are those of the occupants inside the vehicle. In the following, the restricted voices are assumed to be those of the occupants inside the vehicle. I will explain, but this is not the only example.

[0073] Figure 7 is a configuration diagram of the recording device 10a according to Embodiment 3. The recording device 10a is controlled It differs from the recording device 10 in that it has a control unit 20a instead of part 20. It differs from the control unit 20 in that it has a limited sound detection unit 26 in addition to the components of the control unit 20. do.

[0074] When the restricted sound detection unit 26 detects the occurrence of the first event, it puts the following into the buffer memory 24 The system detects the voices of occupants inside the vehicle from audio data contained in stored media data. It functions as a crew voice detection unit. For example, the restricted voice detection unit 26 detects the occurrence of the first event. Voiceprint analysis of the audio data for the period will be performed to determine whether the audio data includes the voices of pre-registered crew members. It is possible to determine whether or not. In addition, the restricted sound detection unit 26 uses beamforming processing to determine the occupant The sound coming from the direction in which the person is seated may be detected as the voice of the occupant. In this case, recording device 1 0 may have multiple microphones 32. The limited voice detection unit 26 detects that voice data is limited If it is determined that the recording includes the voice of a registered crew member, the recording control unit 23 records the information indicating the crew member's voice. It supplies to the following. In addition, the limited sound detection unit 26 connects the microphone installed inside the vehicle and the outside of the vehicle. The audio from microphones installed inside the vehicle is compared and cancellation is performed. It may also detect the voices of the crew members.

[0075] Then, when the occurrence of the first event is detected, the recording control unit 23 records information indicating the occupant's voice. Based on the report, restricted audio data is generated from the audio data during the period of the first event. Limited audio data is data from which the audio signals corresponding to the occupants' voices have been removed from the original audio signal. Alternatively, the data could consist only of attenuated audio signals corresponding to the crew's voices. The recording control unit 23 records the restricted audio data along with the image data for the period during which the first event occurred. Record in section 33.

[0076] Figure 8 is a diagram showing the flow of media data recording processing according to Embodiment 3. For steps similar to those in Figure 5, the same symbols are used.

[0077] The restricted voice detection unit 26, upon receiving event occurrence information from the determination unit 223, ( If Yes in step S21, determine whether or not the occupant's voice is detected from the audio data. Step S30).

[0078] If the restricted voice detection unit 26 detects a passenger's voice (Yes in step S30), Information indicating the employee's vocalization is supplied to the recording control unit 23, and the process proceeds to step S31. In step S31, the recording control unit 23, upon acquiring information indicating the occupant's voice, Audio data from media data including the timing when the first event occurred during the filming period. The audio data is extracted, and restricted audio data is generated from it, with the voices corresponding to the crew members' speech restricted. The recording control unit 23 then processes the video file containing the image data and restricted audio data. The data is generated and recorded in the recording unit 33 (step S32).

[0079] On the other hand, the restricted voice detection unit 26 will not detect any occupant's voice (in step S30, No ), the process proceeds to step S33. In step S33, the recording control unit 23 captures The media data, including the timing of the first event during the specified period, is saved as a file. Then, it is recorded in the recording unit 33. However, in this case, the media data that has been filed is the first If no event is detected, it is recorded separately from the filed media data. You may do so.

[0080] The restricted sound detection unit 26 may be configured integrally with the ambient abnormality detection unit 220.

[0081] Thus, the recording device 10a according to Embodiment 3, when a first event occurs, During the event period, only the specified audio is restricted to recording media data. For example, in the event of an accident, only private conversations inside the vehicle can be removed from the audio. By leaving, the impact of the accident and the screams and murmurs of people around can be recorded. This allows for eyewitness accounts. It is possible to reliably record the audio necessary for providing information while protecting the privacy of the person concerned.

[0082] In addition, in the explanation above, when the first event occurs, among the audio data, the passenger inside the vehicle The speech equivalent to that of the staff members was to be uniformly restricted. However, this was not limited to the first event If this occurs, among the voices of the occupants inside the vehicle, those related to the abnormality associated with the first event Speech equivalent to vocalization does not need to be subject to restriction. In other words, restricted speech detection unit 26 is derived from the audio data contained in the media data stored in buffer memory 24. In this case, it is permissible to detect vocalizations made by occupants inside the vehicle that do not relate to abnormalities. The limited voice detection unit 26 uses a predetermined language model to determine the voices of the occupants inside the vehicle that have been detected. Content related to the abnormality that was detected, such as screams or shouts like "It's an accident!" or "They're driving on the road!" It is permissible to determine whether or not to do so. This allows for a more favorable protection of the witness's privacy, This allows for more reliable recording of audio necessary for providing other information.

[0083] <Embodiment 4> Next, Embodiment 4 will be described. In Embodiment 4, the recording control unit 23 records the first event If this occurs, during the period of the first event, all sounds other than those corresponding to the type of anomaly will be suppressed. It is characterized by storing limited media data in the recording unit 33.

[0084] Figure 9 is a configuration diagram of the recording device 10b according to Embodiment 4. The recording device 10b is controlled It differs from the recording device 10a in that it has a control unit 20b instead of part 20a. And the control unit 2 0b is characterized by having an event detection unit 22b instead of the event detection unit 22, and the control unit 20a This differs from the previous statement.

[0085] The event detection unit 22b replaces the ambient abnormality detection unit 220 with the ambient abnormality detection unit 220b. It differs from the event detection unit 22 in that it includes [something].

[0086] The ambient anomaly detection unit 220b basically has the same function as the ambient anomaly detection unit 220, Includes an abnormality type determination unit 225.

[0087] The abnormality type determination unit 225 determines the abnormality around the vehicle from the audio data in which an abnormality has been detected around the vehicle. Determine the type of anomaly (anomaly type). Here, the anomaly type can be, for example, "accident" or "near miss". It can be classified as "aggressive driving" and "road rage." For example, if the audio data contains a "crash" If the sound includes a loud impact or an exclamation such as "It's an accident," the abnormality type determination unit 225 will The abnormality type is determined to be "accident". Additionally, the audio data contains a conversation saying, "There's a car tailgating." If it is included, the abnormality type determination unit 225 determines the abnormality type to be "aggressive driving". The abnormality type determination unit 225 then supplies information indicating the abnormality type to the determination unit 223.

[0088] If the determination unit 223 determines that the first event has occurred, it will add an abnormality to the event occurrence information. Information indicating the type is added, and event occurrence information is supplied to the restricted voice detection unit 26.

[0089] When the restricted voice detection unit 26 acquires event occurrence information, it determines the type of abnormality from the voice data. The system detects the corresponding audio as audio subject to restriction. For example, the restricted audio detection unit 26 detects the abnormality type If it is an "accident," the audio data will include conversations inside the vehicle such as "accident" or "collision." It detects the following. The restricted voice detection unit 26 also detects the voice data if the abnormality type is "aggressive driving". The system detects in-car conversations such as "tailgating," "dangerous," and "too close," and then restricts them. The voice detection unit 26 restricts voices other than the detected voice, and voices unrelated to the abnormality type. Information indicating the restricted sound is supplied to the recording control unit 23 as elephant sounds.

[0090] Then, when the first event occurs, the recording control unit 23 receives information indicating the audio subject to restriction. Based on this, audio data from the first event occurrence period is restricted according to the type of anomaly, It generates restricted audio data. In other words, the recording control unit 23 generates restricted audio data when the first event occurs. In addition, from the audio data during the first event occurrence period, without restricting the audio related to the type of anomaly, It generates restricted audio data that excludes audio unrelated to the usual type. Then the recording control unit 23 This refers to media data in which audio from the event period is restricted according to the type of anomaly. This is recorded in the recording unit 33.

[0091] Thus, according to the recording device 10b of Embodiment 4, when an abnormality occurs around the vehicle, In addition, by restricting audio unrelated to the anomaly that occurred, the privacy of witnesses can be better protected. However, since audio related to the anomaly that occurred will not be restricted, more audio necessary for providing information will be available. It can be recorded reliably.

[0092] The present invention is not limited to the embodiments described above, and may be adapted as appropriate without departing from the spirit of the invention. It is possible to change it. For example, ambient abnormality detection by ambient abnormality detection units 220, 220b Output processing, vehicle abnormality detection processing by vehicle abnormality detection unit 221, abnormality type determination unit 225 The classification determination process may be performed by an external device (not shown) instead of the recording device. The surrounding abnormality detection unit 220, 220b, vehicle abnormality detection unit 221, abnormality type determination unit 22 Item 5 does not need to be included in the recording device. In this case, the recording device will record various detection results or judgment results. The results are obtained from an external device via a communication means (not shown) and supplied to the determination unit 223. Similarly, the restricted voice detection unit 26 does not need to be included in the recording device. Information indicating restricted audio is obtained from an external device via a communication means (not shown), and the recording control unit It will be supplied to 23.

[0093] Furthermore, in embodiments 1 to 4, the ambient abnormality detection unit 220 has a small amount of audio data and image data. At least one of them must be normal or have an abnormality around the vehicle (i.e., at least one of your own vehicle and other vehicles). It was stated that it would determine whether the anomaly was related to the vehicle and detect the occurrence of an anomaly around the vehicle. Instead, the surrounding abnormality detection unit 220 detects from at least one of the audio data and image data that the abnormality is It may be determined whether the malfunction is normal, an abnormality in the vehicle itself, or an abnormality in another vehicle unrelated to the vehicle itself. In this case, instead of step S12 in Figure 4, the surrounding abnormality detection unit 220 uses the buffer memory 24 An abnormality in another vehicle, unrelated to the current vehicle, was detected from the media data stored in the system. It is possible to determine whether or not this is the case. The surrounding abnormality detection unit 220 then detects an abnormality in another vehicle. The determination unit 223 may be supplied with information indicating that an abnormality has been detected in another vehicle. Then, instead of step S13 in Figure 4, the determination unit 223, having acquired information about other vehicle abnormalities, Accordingly, it may be determined that the first event has occurred. In other words, step S12 in Figure 4 is It can be omitted.

[0094] Furthermore, some or all of the above embodiments may also be described as follows, but below It is not limited to that. (Note 1) Image data capturing an area including at least the area around the vehicle, and at least the area around the vehicle An acquisition unit that acquires audio data obtained by capturing sound in the region including, An event occurs in which an abnormality is detected around the vehicle, and no abnormality is detected in the vehicle itself. An event detection unit that detects, If the aforementioned event occurs, the first predetermined period corresponding to the time the event occurred The restricted audio data, which is obtained by restricting a predetermined audio from the recorded audio data, is defined as the first predetermined period. A recording control unit that records along with image data in the recording unit. A recording system equipped with the following features. (Note 2) The event detection unit, An ambient abnormality detection unit detects abnormalities around the vehicle from the aforementioned audio data, A vehicle abnormality detection unit detects abnormalities in the vehicle from the measurement information of the vehicle's sensors. has The recording system described in Appendix 1. (Note 3) When the event occurs, the recording control unit From the audio data of a second predetermined period including the period before the occurrence of the aforementioned event, a predetermined audio is obtained. The restricted audio data is recorded together with the image data for the second predetermined period in the recording unit. Record it in, The audio data for a third predetermined period, including the period after the occurrence of the event, is the second Recorded in the recording unit along with the image data for a predetermined period. The recording system described in Appendix 1 or 2. (Note 4) The vehicle includes a occupant voice detection unit that detects the voices of occupants inside the vehicle from the aforementioned audio data. When the event occurs, the recording control unit records the audio data for the first predetermined period. From the audio data of a second predetermined period including the period before the occurrence of the event, The system restricts the audio corresponding to the utterances made by the crew members and generates the restricted audio data. A recording system as described in any one of the items 1 to 3 of the appendix. (Note 5) The crew voice detection unit detects abnormal voices from the crew's voices. It is further equipped with a voice detection unit, When the event occurs, the recording control unit records the audio data for the first predetermined period. , or from the audio data of a second predetermined period including the period before the occurrence of the event, The restricted audio data is generated without restricting the voice corresponding to the crew member's vocalization regarding the aforementioned abnormality. do The recording system described in Appendix 4. (Note 6) The system includes an abnormality type determination unit that determines the type of abnormality from the aforementioned audio data. When the event occurs, the recording control unit records the audio data for the first predetermined period. From the audio data of a second predetermined period including the period before the occurrence of the event, The system restricts the audio according to the type of abnormality and generates the restricted audio data. A recording system as described in any one of the items 1 to 5 of the appendix. (Note 7) Image data capturing an area including at least the area around the vehicle, and at least the area around the vehicle The acquisition step involves obtaining audio data, which is audio collected from a region containing the audio, An event occurs in which an abnormality is detected around the vehicle, and no abnormality is detected in the vehicle itself. The event detection stage detects the event, If the aforementioned event occurs, the first predetermined period corresponding to the time the event occurred The restricted audio data, which is obtained by restricting a predetermined audio from the recorded audio data, is defined as the first predetermined period. A recording control stage that is recorded in the recording unit along with the image data. A recording method comprising the following features. [Explanation of Symbols]

[0095] 10, 10a, 10b Recording system (recording device) 20, 20a, 20b Control Unit 21 Acquisition Department 22,22b Event detection unit 23 Recording Control Unit 24 buffer memory 25 Regeneration Control Unit 26 Restricted voice detection unit 31 Camera 32 Microphones 33 Records Section 34 sensors 35 Display section 36 speakers 220,220b Ambient Anomaly Detection Unit 221 Vehicle abnormality detection unit 223 Judgment section 225 Anomaly Type Determination Unit

Claims

1. An acquisition unit that acquires audio data including vehicle-related voices, An event detection unit detects the occurrence of an event relating to an abnormality in the vehicle or an abnormality in the surrounding area of ​​the vehicle, and determines the type of abnormality of the detected event. When the aforementioned event occurs, a restricted voice detection unit identifies voices from the voice data other than those related to the type of anomaly as voices to be restricted. A control unit that generates restricted audio data by treating the restricted audio for a predetermined period prior to the occurrence of the event as silent data from the aforementioned audio data, A privacy protection system equipped with these features.

2. The event detection unit detects the occurrence of an anomaly around the vehicle by using the feature quantities of the audio data to determine the similarity with pre-registered sample data. The restricted speech detection unit considers speech other than that corresponding to a feature quantity whose similarity is equal to or greater than a threshold as speech to be restricted. The privacy protection system according to claim 1.

3. Acquisition step to acquire audio data including voice related to the vehicle, An event detection step that detects the occurrence of an event relating to an abnormality of the vehicle or an abnormality in the surrounding area of ​​the vehicle, and determines the type of abnormality of the detected event, If the aforementioned event occurs, the restricted voice detection step involves identifying the voices from the voice data other than those related to the type of anomaly as voices to be restricted. A control step of generating restricted audio data from the aforementioned audio data by making the restricted audio for a predetermined period prior to the occurrence of the event silent data, A privacy protection method that includes [unclear text].

4. The event detection step detects the occurrence of an anomaly around the vehicle by using the features of the audio data to determine the similarity with pre-registered sample data. The restricted speech detection step includes defining speech other than that corresponding to a feature whose similarity is equal to or greater than a threshold as the speech to be restricted. The privacy protection method according to claim 3.

Images