Privacy protection system and privacy protection method

Abstract

To provide a privacy protection system and a privacy protection method for appropriately protecting privacy of a witness when an abnormal event occurs.SOLUTION: A privacy protection system 10 includes: an acquisition unit 21 for acquiring voice data; an event detection unit 22 for detecting occurrence of an event in which abnormality occurs and determining a type of abnormality; and a control unit 20 for generating restricted voice data in which voice which is not related to the determined abnormality type is restricted from voice data when the event occurs.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to a privacy protection system and a privacy protection method. [Background technology]

[0002] In recent years, the number of vehicles equipped with drive recorders has been increasing. Alternatively, it is used as a recording device that captures images of the situation outside the vehicle and records the captured data. The data recorded in the drive recorder is used to investigate the cause of an accident or to It is used to verify the facts when a case arises.

[0003] For example, in Patent Document 1, audio around the vehicle is collected and a system is established to detect whether the vehicle is being tailgated. A recording device is disclosed that records images and sounds around the vehicle in a recording unit when a vehicle is in a stopped state. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2020-160630 A Summary of the Invention [Problem to be solved by the invention]

[0005] Data from drive recorders and the like may be provided as witness information to police, insurance companies, the media, cloud services, etc. Such data may contain personal conversation audio and the like that is related to the privacy of the witnesses themselves, and when providing such data as witness information, there is a need to protect the privacy of such witnesses.

[0006] The present invention has been made to solve the above-mentioned problems, and provides a privacy protection system and a privacy protection method that suitably protect the privacy of witnesses when an abnormal event occurs. [Means for solving the problem]

[0007] A privacy protection system according to one embodiment of the present invention includes an acquisition unit that acquires voice data, an event detection unit that detects the occurrence of an event in which an abnormality is detected and determines the type of abnormality, and a control unit that, when an event occurs, generates restricted voice data from the voice data in which voices unrelated to the determined type of abnormality are restricted.

[0008] A privacy protection system according to one embodiment of the present invention includes an acquisition unit that acquires voice data, an event detection unit that detects the occurrence of an event in which an abnormality is detected, a restricted voice detection unit that detects a person's vocalization when an event occurs, and a control unit that generates restricted voice data from the voice data by restricting a voice signal corresponding to the person's vocalization when an event occurs.

[0009] A privacy protection method according to one aspect of the present invention includes an acquisition step of acquiring voice data, an event detection step of detecting the occurrence of an event in which an abnormality is detected and determining the type of abnormality, and a control step of generating restricted voice data from the voice data in which voices unrelated to the determined type of abnormality are restricted when an event occurs.

[0010] A privacy protection method according to one aspect of the present invention includes an acquisition step of acquiring voice data, an event detection step of detecting the occurrence of an event in which an abnormality is detected, a restricted voice detection step of detecting a person's vocalization when the event occurs, and a control step of generating restricted voice data from the voice data by restricting a voice signal corresponding to the person's vocalization when the event occurs. Effect of the Invention

[0011] According to the present invention, it is possible to provide a privacy protection system and a privacy protection method that suitably protect the privacy of witnesses when an abnormal event occurs. [Brief description of the drawings]

[0012] [Figure 1] FIG. 1 is a configuration diagram of a recording apparatus according to a first embodiment. [Diagram 2] FIG. 4 is a diagram showing an example of the relationship between data recorded in a recording section and data recorded in a buffer memory according to the first embodiment. [Diagram 3] FIG. 4 is a diagram showing an example of the relationship between data recorded in a recording section and data recorded in a buffer memory according to the first embodiment. [Figure 4] FIG. 4 is a diagram illustrating an example of the flow of an event detection process according to the first embodiment. [Diagram 5] FIG. 4 is a diagram showing a flow of a recording process of media data according to the first embodiment. [Figure 6] FIG. 11 is a diagram showing an example of the relationship between data recorded in a recording section and data recorded in a buffer memory according to the second embodiment. [Figure 7] FIG. 11 is a diagram showing the configuration of a recording device according to a third embodiment. [Figure 8] FIG. 11 is a diagram showing a flow of a recording process of media data according to the third embodiment. [Figure 9] FIG. 13 is a configuration diagram of a recording device according to a fourth embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0013] The present invention will be described below through the embodiments of the invention. The present invention is not limited to the following embodiments. Furthermore, all of the configurations described in the embodiments do not solve the problems. It is not necessarily essential to solve the problem. For the sake of clarity, the following description and In the drawings, the same elements are omitted or simplified as appropriate. are given the same reference numerals.

[0014] <Embodiment 1> Hereinafter, an embodiment of the present invention will be described with reference to the drawings. An example of the configuration of such a recording system (hereinafter, referred to as a recording device) 10 will be described. FIG. 1 is a diagram showing the configuration of a recording device 10 according to a first embodiment. The recording device 10 is mounted on, for example, a vehicle. The recording device 10 may be used as a drive recorder in which a processor stores data in a memory. It may be a computer device that operates by executing a stored program. The processor may be, for example, a microprocessor, a MPU (Micro Processing Unit), or The memory may be a volatile memory or a CPU (Central Processing Unit). The memory may be a volatile or non-volatile memory, or a combination of a volatile memory and a non-volatile memory. The processor may be configured to execute an algorithm described with reference to the following drawings. Execute one or more programs that contain instructions for causing a computer to execute the program.

[0015] The recording device 10 includes a control unit 20, a camera 31, a microphone 32, a recording unit 33, and a sensor. The control unit 20 includes a camera 31, a microphone 34, a display unit 35, and a speaker 36. The microphone 32, the recording unit 33, the sensor 34, the display unit 35, and the speaker 36 are connected to a predetermined It may be directly connected using a cable or the like, or it may be connected via the in-vehicle network CAN (Controller Access Network). The recording device 10 may be connected via a network (rea Network). Specifically, the recording device 10 may be configured to include components that realize the above-mentioned. The system includes an acquisition unit 21, an event detection unit 22, and a recording control unit 23.

[0016] The camera 31 captures an area including at least the periphery of the vehicle and generates image data. In the first embodiment, the camera 31 generates image data of the outside of the vehicle, but does not generate image data of the inside of the vehicle. The microphone 32 may generate image data including at least the surroundings of the vehicle. In the first embodiment, the microphone 32 generates audio data by collecting audio from the area. The recording unit 33 records voices inside and outside the vehicle and generates voice data. The memory device may be a hard disk or a card-type memory, and records image data and audio data.

[0017] The sensor 34 is, for example, an acceleration sensor, and detects when the vehicle in which the recording device 10 is mounted has an accident. The sensor may detect an impact or the like that occurs when the vehicle is hit by a vehicle bumper or involved in an accident. The sensor 34 detects the operation amount of the brake, accelerator, or steering wheel, and controls the speed of the vehicle. The sensor 34 may generate, for example, a distance measuring sensor or a millimeter wave radar. The display unit 35 may be a vehicle driver and may detect the proximity of other vehicles or other objects. The speaker 36 may be a display that plays back image data recorded in the recording unit. The audio data recorded in the audio input device 33 is played back by the speaker 36. The speaker 36 includes an audio amplifier and an audio processor that do not include the speaker 36. include.

[0018] Next, a configuration example of the control unit 20 will be described. The control unit 20 includes an acquisition unit 21, an event It has a detection unit 22 , a recording control unit 23 , a buffer memory 24 , and a playback control unit 25 . A control unit 20 including an acquisition unit 21, an event detection unit 22, a recording control unit 23, and a playback control unit 25. Each component that makes up the system is controlled by the processor executing a program stored in memory. The processing may be performed by a software or module. Each of the components constituting the unit 20 may be hardware such as a circuit or a chip.

[0019] The acquisition unit 21 acquires image data generated by the camera 31 and a microphone 32. The data including the image data and the audio data is acquired from the media. In other words, the acquisition unit 21 acquires the image data from the camera 31 and the microphone 3. In other words, the media data is obtained from the image data storage device 2. Or video data. The image data is, for example, in a format such as H.264 or H.265. The audio data may be generated using a PCM (Pulse Code Modulation) format. The image data may be generated using a method such as the above, and may be video data including image data and audio data. The media data is MPEG (Moving Picture Experts Group) 2-TS (Transport It may be generated using a standard AVI (Audio Video Interleave) or a standard AVI (Audio Video Stream).

[0020] The acquisition unit 21 stores media data including image data and audio data in a buffer memory 24. The buffer memory 24 temporarily stores the output media data. The buffer memory 24 may be referred to as an internal memory built into the control unit 20. For example, the buffer memory 24 erases media data after a predetermined period of time has elapsed. Alternatively, the temporary storage may be the storage of the information output from the acquisition unit 21. The data may be stored by overwriting the data in the buffer memory 24. Or, to temporarily store means that the buffer memory 24 stores the media output from the acquisition unit 21. When the media data is output to the recording control unit 23, the output media data can be erased. may be also.

[0021] The acquisition unit 21 also acquires information on a positioning system such as a Global Navigation Satellite System (GNSS). The system receives vehicle position information from a vehicle control system (not shown) and buffers the position information together with the media data. The signal may be provided to the memory 24.

[0022] The event detection unit 22 receives image data acquired from the camera 31 via the buffer memory 24. The data, the voice data acquired from the microphone 32, and the measurement information output from the sensor 34 The occurrence of an event is detected using at least one of the following: The detection unit 22 includes a surrounding abnormality detection unit 220, a vehicle abnormality detection unit 221, and a determination unit 223. do.

[0023] The surrounding abnormality detection unit 220 detects the occurrence of an abnormality around the vehicle from the media data. Specifically, the surrounding abnormality detection unit 220 detects the occurrence of an abnormality around the vehicle from the voice data. The abnormality around the vehicle may include an abnormality inside the vehicle in addition to an abnormality outside the vehicle. For example, The surrounding abnormality detection unit 220 analyzes the voice data and detects sounds related to abnormalities around the vehicle (abnormal Abnormal sounds may include non-speech sounds and speech sounds (utterances). Non-speech sounds The utterances may be, for example, sounds of collisions or braking. The utterances may be, for example, screams, "There's an accident," It may be an utterance such as "You're provoking me."

[0024] As an example, the surrounding abnormality detection unit 220 detects the feature amount of the audio signal from the waveform of the audio signal, specifically, Specifically, the detection is based on the frequency, the time elapsed since the start of the speech, or the volume, etc. 220 is a function of detecting a difference between the extracted feature amount and the feature amount of sample data of abnormal sound registered in advance. When the degree of similarity is equal to or greater than a predetermined threshold, the occurrence of an abnormality around the vehicle is detected. The signature can be calculated using existing acoustic analysis technology or voiceprint analysis technology.

[0025] As another example, the surrounding abnormality detection unit 220 may detect a sound including normal sound data and abnormal sound data. The acoustic model trained using training data containing The acoustic model can be an existing acoustic model. For example, the acoustic model is The audio data corresponding to the input is output as a value indicating whether or not the audio data includes an abnormal sound. The controller 22 outputs the probability that the voice data corresponding to the input contains an abnormal sound. 0 means that if the probability that the voice data corresponding to the input contains an abnormal sound is equal to or greater than a predetermined value, the vehicle The surrounding abnormality detection unit 220 detects the occurrence of an abnormality in the surroundings. The features may be used as input for the acoustic model.

[0026] In addition, certain utterances, such as screams, "There's an accident," or "They're harassing me," are considered to be abnormal sounds. In this case, the surrounding anomaly detection unit 220 further processes the utterance contents by natural language processing. Specifically, first, the surrounding abnormality detection unit 220 The device extracts phonemes from the voice data based on a predetermined acoustic model. 220 judges whether or not a speech component is included by comparing the extracted phonemes with a predetermined language model. When a speech component is included, the surrounding anomaly detection unit 220 detects the speech component by using a predetermined language model. The content of the speech is estimated and judged as to whether it contains content that is defined as an abnormal sound. The file includes a learned voice recognition dictionary. If it is determined that the detected sound includes an abnormal sound, the occurrence of an abnormality around the vehicle is detected.

[0027] The surrounding anomaly detection unit 220 may analyze image data in addition to or instead of the voice data. and abnormalities around the vehicle, such as collisions between other vehicles or between other vehicles and other objects, or rollover of other vehicles. It is also possible to detect abnormal proximity between other vehicles, such as fire, tailgating, etc. The abnormality detection unit 220 converts image data obtained when the vehicle is normal, when another vehicle is abnormal, and when the vehicle is abnormal into learning data. The image recognition model trained as a learning algorithm may be used to detect anomalies around the vehicle. For example, The image recognition model takes image data as input and outputs a value indicating whether the surroundings of the vehicle are normal or abnormal. The surrounding anomaly detector 220 may include a convolutional neural network for detecting the surrounding anomaly. In addition to or instead of analyzing the data, sensors such as distance measuring sensors and millimeter wave radars34 This allows the system to detect the proximity of other vehicles to each other, or to other objects, and to detect abnormalities occurring around the vehicle. It may be detected.

[0028] When detecting an occurrence of an abnormality around the vehicle, the surrounding abnormality detection unit 220 The abnormality information generation unit 224 supplies information indicating that the abnormality has occurred (surrounding abnormality information) to the determination unit 223. The surrounding abnormality information includes the time when the abnormality occurred around the vehicle. The details of the abnormality may be included.

[0029] The vehicle abnormality detection unit 221 detects the occurrence of an abnormality in the host vehicle from the measurement information output from the sensor 34. It detects abnormalities mainly related to the running of the vehicle. For example, it acts as an acceleration sensor. When the impact level detected by the sensor 34 exceeds a predetermined value, the vehicle abnormality detection unit 221 detects that an abnormality related to the vehicle has occurred. In other words, the acceleration exceeds a predetermined value. When the distance between the vehicle and another vehicle detected by the sensor 34 operating in conjunction with the The vehicle abnormality detection unit 221 detects the occurrence of an abnormality related to the host vehicle. When the detection unit 221 detects an occurrence of an abnormality in the host vehicle, the detection unit 221 outputs a signal indicating that an abnormality has occurred in the host vehicle. The vehicle abnormality information includes information indicating an abnormality in the vehicle. The time of occurrence is included. Furthermore, the vehicle abnormality information may also include the details of the abnormality that occurred. The vehicle abnormality detection unit 221 may detect the abnormality of the vehicle in addition to or instead of the measurement information output from the sensor 34. The image data is analyzed to detect the occurrence of an abnormality in the vehicle, such as an abnormal proximity between the vehicle and another vehicle. It may also detect liveness.

[0030] The determination unit 223 determines whether or not the surrounding abnormality detection unit 220 and the vehicle abnormality detection unit 221 are abnormal. Based on the result, it is determined whether or not an event has occurred. When an abnormality is detected in the surroundings of both vehicles and no abnormality is detected in the vehicle (own vehicle), this is called the first event. The first event is, for example, a collision between two vehicles in the vicinity of the vehicle, or The determination unit 223 determines whether there is an abnormality around the vehicle. and acquiring information indicating that an abnormality has occurred in the host vehicle. If not, the determination unit 223 determines that the first event has occurred. Additionally, a second event in which an abnormality in the vehicle is detected may be detected.

[0031] In response to the detection of the occurrence of an event, the determination unit 223 determines that the event has occurred. The event occurrence information is supplied to the recording control unit 23. The information indicating the event includes the time when the event occurred.

[0032] The recording control unit 23 converts the media data stored in the buffer memory 24 into a predetermined file. The media data acquired from the buffer memory 24 is recorded in the recording unit 33 in the image In other words, the recording control unit 23 writes data from the buffer memory 24 to the Specifically, the recording control unit 23 transfers the media data from the buffer memory 31 to the recording unit 33. A moving image file including image data and audio data is extracted from the media data stored in the memory 24. The video file is then recorded in the recording unit 33 as recording media data.

[0033] When the occurrence of the first event is detected, the recording control unit 23 stores the first event in the buffer memory 24. The restricted voice data is generated from the voice data during the occurrence period of the first event. The recording control unit 23 records the restricted voice data together with the image data during the occurrence period of the first event. The period during which the first event occurs corresponds to the time at which the first event occurs. For example, the period during which the first event occurs may be a period from the time the first event occurs. A predetermined period including the time when the first event occurred and the period before and after the time when the first event occurred (a first predetermined period) As an example, in the occurrence period of the first event, before the occurrence time of the first event The period may be the same as the period after the first event occurrence time, The period during which the first event occurs may be longer or shorter than the period from the first time onward. It may simply include either the period before or after the time the event occurred. The restricted audio data may be silent data or audio data with the overall volume reduced. Specifically, when the occurrence of the first event is detected, the recording control unit 23 In this case, the sound is selected from the sound data during the occurrence period of the first event stored in the buffer memory 24. The recording control unit 23 generates restricted voice data by restricting the voice included in the voice data. , replacing the voice data during the occurrence period of the first event with restricted voice data, and A moving image file including image data of the period is generated, and the moving image file is recorded on a medium. The data is recorded in the recording unit 33.

[0034] When the recording control unit 23 records the generated recording media data in the recording unit 33, Media data for recording resulting from one event, i.e. image data and restricted audio data The media data for recording, including the event-related records, is treated as data that cannot be overwritten. For example, the recording control unit 23 may prohibit overwriting of data. The address of the memory area in the recording unit 33 is specified, and the media data for recording is written to the recording unit 33. Alternatively, the recording control unit 23 may record the header of the media data to be recorded. Alternatively, flag information indicating overwriting prohibition may be set in the payload. recording media data including image data and audio data resulting from the second event; As a record related to the event, the data may be recorded in the recording unit 33 as data that cannot be overwritten. .

[0035] The recording control unit 23 also controls the recording of media data that is not caused by an event, i.e., image The recording media data including the audio data is discarded without being recorded in the recording unit 33. Alternatively, the event may be recorded in the recording unit 33 as a normal record not related to the event. When recording to the recording unit 33 as a record, the media data for recording is treated as overwritable data. For example, the recording control unit 23 may The address of the memory area where writing is possible is specified, and the media data for recording is written to the recording unit 3. Alternatively, the recording control unit 23 may record the header of the media data to be recorded. Alternatively, flag information indicating that the payload can be overwritten may be set in the payload.

[0036] The recording unit 33 records the data output from the recording control unit 23, in other words, the data stored in the recording control unit 23. The recording unit 33 records the media data transferred from the buffer memory 24 via the For example, the recording medium may be an optical disk or a card-type recording medium.

[0037] The playback control unit 25 acquires the recording media data recorded in the recording unit 33 and The image data included in the acquired recording media data is output to the display unit 35, and the acquired recording media data is The audio data included in the media data for recording is output to the speaker 36 or the like.

[0038] In FIG. 1, the recording device 10 includes a playback control unit 25, a display unit 35, and a speaker 36. However, a playback device or the like different from the recording device 10 may include a playback control unit 25, a display The recording device 10 may include a playback control unit 35 and a speaker 36. 25, the display unit 35, and the speaker 36 may not be included. A display unit 35 and a playback device including a speaker 36 are recorded in the recording unit 33 of the recording device 10. For example, the playback device may play back the data stored in an optical disk or a card-type recording medium. The device may be a device for reproducing data recorded on a portable recording medium such as a portable telephone. The data recorded in unit 33 may be transferred to a portable recording medium.

[0039] Here, referring to FIG. 2, the data recorded in the recording unit 33 and the data recorded in the buffer memory 24 will be FIG. 2 shows the relationship between the data stored in the storage unit 33 according to the first embodiment. FIG. 13 is a diagram showing an example of the relationship between data to be read and data to be recorded in the buffer memory 24. The horizontal axis in FIG. 2 indicates the passage of time. Showing media data captured during the event period, divided into predetermined periods The predetermined period may be called a time frame, and may be, for example, a few seconds, tens of seconds, or minutes. In FIG. 2, D-2 is the oldest media data. D+4 is the most recently recorded media data. The data newly added to the buffer memory 24 during the period is shown. The buffer memory 24 stores data that has been newly added to the buffer memory 24 during a predetermined time frame. Data other than the above, for example, data that was added before the time frame and has not been erased, is stored. It's fine.

[0040] The media data acquired by the acquisition unit 21 is immediately output to the buffer memory 24. Therefore, in FIG. 2, the media data acquired by the acquisition unit 21 is directly backed up. It is shown that the data is stored in the flash memory 24. In other words, in FIG. The timing when the acquisition unit 21 acquires the media data and the time when the media data is stored in the buffer memory 24 are It is shown that the timing at which the data is stored is substantially the same. The timing at which the acquisition unit 21 acquires the media data and the buffer memory This includes cases where the timing of the media data being stored in the 24 does not match perfectly. For example, substantially matching means that the timing at which the media data is stored in the buffer memory 24 is substantially the same. The timing may be later than the timing when the acquisition unit 21 acquires the media data. On the other hand, the media data to be recorded in the recording unit 33 is temporarily stored in the buffer memory 2. 4, the recording control unit 23 records the acquired information in the recording unit 33. The timing at which the media data acquired by the unit 21 is stored in the buffer memory 24 and the storage Specifically, the timing at which the media data is recorded in the recording unit 33 is different from the timing at which the media data is recorded in the recording unit 33. The timing of recording the media data is the timing at which the media data is stored in the buffer memory 24. It is slower than .

[0041] The event detection unit 22 detects the time from t-3 to t+3. For example, the event detection unit 22 determines whether an event occurred during a predetermined period in the past. At time t, determine whether an event occurred between time t-1 and time t. The event detection unit 22 similarly determines whether an event has occurred at other times. Make a judgment.

[0042] For example, at time t-2, the event detection unit 22 In this case, the recording control unit 23 determines that the first event has not occurred during the time period. Media data stored in the buffer memory 24 from time t-2 to time t-1 D-2 is discarded without being recorded in the recording unit 33, or is discarded as a normal recording that is not related to the event. may be recorded in the recording unit 33 as the above.

[0043] On the other hand, at time t, the event detection unit 22 detects the event occurring during the period from time t-1 to time t. At time t i , the recording control unit 23 determines that the first event has occurred. During a predetermined period corresponding to i, for example, from time t to time t+1, the buffer memory 24 The audio data of the stored media data D is replaced with restricted audio data, and the image data and The restricted audio data is recorded in the recording unit 33 as a file of media data D′.

[0044] In FIG. 2, the media data that has been completely stored in the buffer memory 24 is That is, the media data is recorded in the recording unit 33. The timing of the transfer is one hour before the media data is stored in the buffer memory 24. However, the media data stored in the buffer memory 24 is delayed by one time frame. The timing of recording the data in the recording unit 33 is not limited to this. The difference between the two timings is It may be less than one time frame, or more than two time frames. For example, The recording control unit 23 acquires the media data being stored in the buffer memory 24 and The acquired media data may be recorded in the recording unit 33. Alternatively, the recording control unit 23 may When the storage of the media data in the buffer memory 24 is completed, regardless of the time frame, After a predetermined period of time has elapsed since the completion of storage of the media data, the media data is recorded. The information may be recorded in unit 33.

[0045] In addition, in FIG. 2, the recording control unit 23 controls the acquisition unit 24 to perform the acquisition during a period including the first event occurrence time. Only the media data acquired in step 21 is recorded in the recording unit 33 with audio restriction. In other words, the recording period (event) of the media data that is subject to audio restriction The period during which the first event occurs is limited to the time frame that includes the time of the first event. However, the recording control unit 23 is not limited to this, and may record the first event in the period including the first event occurrence time. In addition to the media data captured at the time of the first event, the media data captured at the time of the first event The media data acquired by the acquisition unit 21 during the above period is also recorded in the recording unit 33 with audio restriction. In other words, the recording period of the media data to be subject to the audio restriction may be the first event. In addition to the time frame that includes the time of the event, the time frames before and after that time frame are also included. The period of the time frame including the first event occurrence time may be arbitrarily set. For example, the recording control unit 23 may record data D in addition to the data D acquired by the acquisition unit 21. The data D-1 is also recorded in the recording unit 33 as data D' and data D-1' with the audio restricted. good.

[0046] In this case, the data recorded in the recording unit 33 and the data recorded in the buffer memory 24 are FIG. 3 shows the relationship between the data and the recording unit 33 according to the first embodiment. and data recorded in the buffer memory 24. The unit 23 captures and stores the media data in the buffer memory 24. The first event occurs on the time frame corresponding to the period or on the next time frame. When detected, the audio of the media data is restricted and recorded in the recording unit 33 .

[0047] Specifically, at time t-2, the event detection unit 22 It is determined that the first event has not occurred during the period from time t-2 to time t-3 at time t-1. It is determined that the first event has not occurred during the time t-1. At this time, the recording control unit 23 Between time t-1 and time t, the media data D- 2 is converted into a file without any restrictions on the audio data and recorded in the recording unit 33.

[0048] Then, at time t, the event detection unit 22 detects a time t between time t-1 and time t At this time, the recording control unit 23 determines that the first event has occurred at the previous time frame i. Even if the first event does not occur in the frame, the first event occurs during a predetermined period corresponding to the time ti, for example, during the time Between time t and time t+1, the sound of the media data D-1 stored in the buffer memory 24 is The voice data is replaced with restricted voice data and filed together with the image data. 1' is recorded in the recording unit 33.

[0049] Next, the recording control unit 23 performs a process of recording the audio of the media data D stored in the buffer memory 24. The voice data is replaced with restricted voice data and filed together with the image data. The result is recorded in the recording unit 33.

[0050] Next, at time t+1, the event detection unit 22 detects a first event occurring between time t and time t+1. At this time, the recording control unit 23 determines that a vent has not occurred. The media data D+1 stored in the Alternatively, the image may be encoded and recorded in the recording unit 33.

[0051] Next, the process of the control unit 20 of the recording device 10 will be described with reference to FIGS. As in 2, the recording period of the media data subject to audio restriction, including the time of the event occurrence, Although an example limited to a time frame is shown, the present invention is not limited to this.

[0052] FIG. 4 is a diagram illustrating a flow of an event detection process according to the first embodiment. The unit 21 acquires media data including image data and audio data and stores it in the buffer memory 2 4, and the buffer memory 24 stores the media data (step S10). The surrounding abnormality detection unit 220 of the event detection unit 22 detects the surrounding abnormality stored in the buffer memory 24. The present invention determines whether abnormal sounds are detected from audio data included in the media data. The surrounding abnormality detection unit 220 detects an abnormal sound in the surroundings from the voice data (step S11). If the abnormality is detected (Yes in step S11), the surrounding abnormality information is supplied to the determination unit 223 and the process is started. On the other hand, the surrounding abnormality detection unit 220 detects an abnormal sound in the surroundings from the voice data. If not detected (No in step S11), the process returns to step S10.

[0053] In step S12, the vehicle abnormality detection unit 221 of the event detection unit 22 detects the vehicle abnormality by detecting the vehicle abnormality in the vehicle From the measurement information output from the vehicle, it is determined whether or not an abnormality has occurred in the vehicle. When the occurrence of an abnormality in the host vehicle is detected (Yes in step S12), the abnormality detection unit 221 Then, the vehicle abnormality information is supplied to the determination unit 223, and the process returns to step S10. When the occurrence of an abnormality in the host vehicle is not detected (No in step S12), the detection unit 221 The process proceeds to step S13 without supplying the vehicle abnormality information to the judgment unit 223.

[0054] In step S13, the determination unit 223 of the event detection unit 22 acquires surrounding abnormality information. and if the vehicle abnormality information is not acquired, it is determined that the first event has occurred. Then, the determination unit 223 generates the event occurrence information and controls the recording control unit 223 to record the event occurrence information. Then, the process returns to step S10 and the steps after step S10 are The following process is repeated.

[0055] FIG. 5 is a diagram showing a flow of a recording process of media data according to the first embodiment. First, the acquisition unit 21 acquires media data including image data and audio data. The buffer memory 24 stores the media data (step Next, the recording control unit 23 reads the media data stored in the buffer memory 24. When starting to record data in the recording unit 33, it is determined whether or not a first event has occurred. That is, the recording control unit 23 determines whether the determination unit 2 23, it is determined whether event occurrence information has been acquired.

[0056] When the recording control unit 23 determines that the first event has occurred (Yes in step S21), ), audio data from media data including the timing of the first event occurring during the shooting period The audio is then restricted to generate restricted audio data (step S22). The control unit 23 generates a moving image file including image data and restricted audio data, and stores the generated moving image file in the recording unit. Then, the process returns to step S20 and the steps after step S20 are recorded. The following process is repeated.

[0057] On the other hand, if the recording control unit 23 determines that the first event has not occurred (step S 21 No), the media data captured during the period when the first event did not occur will be used as is. The recording control unit 2 then converts the recorded data into a file and records the file in the recording unit 33 (step S24). 3, the audio is recorded without any restriction from the media data stored in the buffer memory 24. The recording control unit 23 records the first event in a file. If it is determined that there is no such information, the information may not be recorded in the recording unit 33. The process returns to step S20, and the processes from step S20 onward are repeated.

[0058] In the above description, when the occurrence of the first event is detected, the recording control unit 23 The media data with the limited content is recorded in the recording unit 33. When the occurrence of the first event is detected, the control unit 23 controls the media device, which does not have audio restriction, to For example, the recording unit 33 may include a first recording area and The second recording area is provided, and the first recording area is used for normal recording that is not related to the event detection result. The media data stored in the buffer memory 24 is recorded as is. In the second recording area, the first event is recorded as an event record related to the detection of the first event. Audio-restricted data from media data that includes the timing of the event in the recording period The data may be recorded.

[0059] As described above, the recording device 10 according to the first embodiment detects when a first event occurs. For media data that includes the timing of the shooting period, the audio data of the media data, The voice can be replaced with restricted voice data and recorded in the recording unit 33. When an abnormality not related to the vehicle occurs, the device 10 detects the driver's utterance or the passenger's In order to prevent the recording of audio that may include conversations between personnel, In this case, the privacy of the witness can be appropriately protected. For media data taken during a period when no incident occurred, image data and audio data Therefore, when an abnormality occurs related to the vehicle, In such a case, the recorded media data can be used to investigate the cause of the accident.

[0060] Furthermore, the recording device 10 erases the audio data when the first event occurs and starts recording. 33, the recording time is shorter than when recording media data that includes audio data. This allows the amount of data to be recorded to be reduced. Since the number of times data is overwritten and recorded can be reduced, the recording unit 33 can store data for a longer period of time. It is possible to record media data.

[0061] <Embodiment 2> Next, a second embodiment will be described. In the second embodiment, the recording control unit 23 When an event occurs, the media data for the first event occurrence period is differentiated from the case where the event does not occur. The record control unit 23, however, distinguishes between cases where no event has occurred and cases where no event has occurred. Of the media data to be stored, only audio data within a specific period is restricted.

[0062] For example, the specific period during which audio is limited and recorded is a period during which a first event occurs (a first predetermined The period may be a predetermined period (a second predetermined period) before the occurrence of the first event. During live broadcasts and immediately after an incident, there is a high possibility that audio that could be important evidence of an accident will be captured. It is preferable to record audio without any restrictions. Therefore, the recording control unit 23 When a first event occurs, a voice signal is generated from voice data during a predetermined period before the occurrence of the first event. The recording control unit 23 may generate restricted audio data in which the restricted audio data is The image data is recorded in the recording unit 3 together with the image data for a predetermined period (second predetermined period) before the occurrence of the first event. The recording control unit 23 may record the first event in a specific memory area of ​​the first event recorder 21. The audio data for the predetermined period (third predetermined period) is stored as is as a predetermined period after the occurrence of the first event. The image data for the period (third predetermined period) is recorded in a specific storage area of ​​the recording unit 33. The second predetermined period may include a period prior to the first predetermined period, and the second predetermined period may include a period prior to the first predetermined period. The second predetermined period may not include a part of the period before the occurrence of the first event. , is not limited to a form that does not strictly include a part during and immediately after the accident, The third predetermined period may be longer than the first predetermined period. The first predetermined period may include a period after the occurrence of the first event, and the first predetermined period may include a period after the occurrence of the first event. The third specified period does not necessarily include the period during and immediately after the occurrence of the accident. The form is not limited to one that includes the period during and immediately after the accident, and may also include a form that does not include the period during and immediately after the accident.

[0063] FIG. 6 shows data recorded in the recording unit 33 and data in the buffer memory 24 according to the second embodiment. FIG. 1 is a diagram showing an example of a relationship between the first event and the second event. The first recording area is a normal recording area not related to the first event detection result, and the second recording area is a normal recording area not related to the first event detection result. The second storage area is an event recording area corresponding to the media data. The timing at which the media data is recorded in the buffer memory 24 is the same as the timing at which the media data is stored in the buffer memory 24. It is two time frames slower than the previous one.

[0064] The recording control unit 23 records the data stored in the buffer memory 24 regardless of the result of the first event detection. The stored media data is recorded in the first recording area of ​​the recording unit 33.

[0065] The recording control unit 23 also performs a first event recording for each media data in the buffer memory 24. When an event is detected, the audio of a specific period of the media data is restricted and the recording section 3 is 3 is recorded in the second memory area.

[0066] Specifically, the event detection unit 22 detects whether a first event occurs between time t-1 and time t. At this time, the recording control unit 23 determines that the first The time frame from time t-1 to time t where an event occurred is the time frame t- 2. The audio data of the media data D-1 corresponding to time t-1 is replaced with restricted audio data. The image data is then stored in the second storage area of ​​the recording unit 33 together with the image data. Instead of or in addition to the above, the media corresponding to the time t1 at which the first event occurred from the time t-1 The audio data of the media data is replaced with restricted audio data, and the audio data is recorded in the recording unit 33 together with the image data. The information may be recorded in the second storage area.

[0067] At this time, the recording control unit 23 also The audio data of the media data D corresponding to the period from time t-1 to time t where the event occurred is The recording control unit 23 records the image data in the second storage area of ​​the recording unit 33 together with the image data. Instead of or in addition to the above, media corresponding to time t-1 to time t when the first event occurs The voice data of the data is replaced with the restricted voice data, and the data is recorded in the recording unit 33 together with the image data. 2 storage area.

[0068] At this time, the recording control unit 23 also The time frame from time t to time t, which is one time frame after the time t-1 to time t when the event occurred. Media data corresponding to +1 D+1 audio data is recorded together with the image data. The information is recorded in the second storage area of ​​the section 33.

[0069] The recording unit 33 may record the voice during the first event occurrence period instead of or in addition to the above-mentioned recording area. A recording area for recording only the data and a recording area for recording only the image data during the first event occurrence period. The recording device 10 may have a recording area. Accepts the specification of the period during which audio is restricted, and restricts the media data for the specified period. The generated signal may be recorded in the recording unit 33.

[0070] The recording unit 33 may record the voice data during the first event occurrence period instead of or in addition to the above-mentioned recording area. a recording area for recording restricted media data and audio unrestricted media during the first event occurrence period; The recording device 10 may have a recording area for recording data. For example, the system can accept the specification of a period during which audio is restricted after driving, and provide audio restriction media for the specified period. The audio data and the unrestricted audio media data may be recorded in combination in the recording unit 33.

[0071] As described above, the recording device 10 of the second embodiment has the same effects as the first embodiment, and The audio in the vehicle cabin at the time when the first event occurs and after the first event occurs can be recorded; It is possible to reliably record audio necessary for providing information while protecting the privacy of witnesses. Cut.

[0072] <Embodiment 3> Next, a third embodiment will be described. In the third embodiment, the recording control unit 23 When the first event occurs, the media data is limited to the specified audio during the first event period. The characteristic of the present invention is that the data is stored in the recording unit 33. The predetermined voice to be restricted is, for example, a car In the following, it is assumed that the voice to be restricted is the voice of the passenger in the vehicle. However, the following is not limited to this.

[0073] FIG. 7 is a block diagram of a recording device 10a according to the third embodiment. The recording device 10 differs from the recording device 10 in that a control unit 20a is provided instead of the control unit 20. The control unit 20 differs from the control unit 20 in that it has a restricted voice detection unit 26 in addition to the components of the control unit 20. do.

[0074] When the occurrence of the first event is detected, the restricted voice detection unit 26 stores in the buffer memory 24 Detecting the voice of a passenger in the vehicle from the voice data included in the stored media data For example, the restricted voice detection unit 26 detects the occurrence of a first event. Perform voiceprint analysis of the voice data for a certain period to determine whether the voice data contains utterances of pre-registered passengers. In addition, the restricted voice detection unit 26 may determine whether the restricted voice is generated by the occupant by beam forming processing. The voice from the seating direction may be detected as the voice of the passenger. The input / output unit 20 may include a plurality of microphones 32. The restricted audio detector 26 detects whether audio data is available. If it is determined that the recorded information includes the utterance of the occupant, the recording control unit 23 The restricted voice detection unit 26 detects the restricted voice from a microphone installed in the vehicle interior and a microphone installed outside the vehicle interior. By comparing and canceling the voices from the microphones installed in the vehicle, The vocalization of the passenger may be detected.

[0075] When the occurrence of the first event is detected, the recording control unit 23 records information indicating an utterance of the passenger. Based on the information, restricted voice data is generated from the voice data during the occurrence period of the first event. The restricted voice data is data obtained by erasing the voice signals corresponding to the occupants' voices from the original voice signals. Alternatively, only the audio signal corresponding to the voice of the passenger may be attenuated. The recording control unit 23 records the restricted voice data together with the image data during the occurrence period of the first event. The signal is recorded in the recording unit 33.

[0076] FIG. 8 is a diagram showing a flow of a recording process of media data according to the third embodiment. In FIG. 5, the same steps as those in FIG. 5 are denoted by the same reference numerals.

[0077] In response to receiving the event occurrence information from the determination unit 223, the restricted voice detection unit 26 Step S21: Yes), and it is determined whether or not the utterance of the passenger is detected from the voice data ( Step S30).

[0078] When the voice of the passenger is detected (Yes in step S30), the restricted voice detection unit 26 The information indicating the member's utterance is supplied to the recording control unit 23, and the process proceeds to step S31. In step S31, in response to acquiring information indicating an utterance of an occupant, the recording control unit , audio data is extracted from the media data including the timing when the first event occurred during the shooting period. The voice data is extracted, and restricted voice data is generated by restricting the voice corresponding to the voice of the passenger. Then, the recording control unit 23 creates a moving image file including the image data and the restricted audio data. is generated and recorded in the recording unit 33 (step S32).

[0079] On the other hand, when the voice of the occupant is not detected (No in step S30), the restricted voice detection unit 26 ), and the process proceeds to step S33. The media data including the timing of the first event during the period is saved as a file. However, in this case, the filed media data is If no event is detected, the file is recorded separately from the media data. It is okay to do so.

[0080] The restricted sound detection unit 26 may be configured integrally with the surrounding abnormality detection unit 220.

[0081] In this way, when the first event occurs, the recording device 10a according to the third embodiment During the event occurrence period, only the specified audio is recorded as restricted media data. Therefore, for example, in the event of an accident, it is possible to mute only private conversations in the vehicle. The sound of the impact, screams and chatter of people in the vicinity can be recorded. This makes it possible to reliably record audio necessary for providing information while protecting the privacy of the person.

[0082] In the above description, when the first event occurs, the voice data of the passengers in the vehicle However, this is not the only restriction. When the first event occurs, the first event is related to an abnormality among the utterances of the occupants in the vehicle. The voice corresponding to the speech may not be subject to the restriction. 26 is a block diagram of a buffer memory 24 that stores audio data included in the media data. In addition, the vehicle occupant may be notified of any abnormality. The limited voice detection unit 26 uses a predetermined language model to convert the detected utterance of the passenger in the vehicle into a predetermined Content related to the abnormality that was detected, such as screams or utterances such as "It's an accident" or "They're harassing me" This can better protect the privacy of witnesses and This makes it possible to more reliably record audio necessary to provide other information.

[0083] <Embodiment 4> Next, a fourth embodiment will be described. In the fourth embodiment, the recording control unit 23 When an abnormality occurs, during the period when the first event occurs, sound other than the sound corresponding to the abnormality type is suppressed. The feature of the present invention is that the limited media data is stored in the recording unit 33.

[0084] FIG. 9 is a block diagram of a recording device 10b according to the fourth embodiment. The recording device 10b is The recording device 10 differs from the recording device 10a in that it includes a control unit 20b instead of the control unit 20a. 0b is different from the control unit 20a in that it has an event detection unit 22b instead of the event detection unit 22. is different from.

[0085] The event detection unit 22b includes a surrounding abnormality detection unit 220b instead of the surrounding abnormality detection unit 220. The event detection unit 22 differs from the event detection unit 22 in that it includes

[0086] The surrounding anomaly detection unit 220b basically has the same functions as the surrounding anomaly detection unit 220, but The abnormality type determination unit 225 is included.

[0087] The abnormality type determination unit 225 determines the abnormality type around the vehicle from the voice data in which an abnormality around the vehicle is detected. The type of abnormality (abnormality type) is determined. The abnormality type may be, for example, "accident," "near-miss," or "abnormality type." For example, if the audio data includes the sound "Gashaaan," When the abnormality type determination unit 225 detects an abnormality including an impact sound, an utterance of "It's an accident", etc. The type of abnormality is determined to be "accident." Also, the voice data contains a conversation such as "There is a car tailgating me." If included, the abnormality type determination unit 225 determines the abnormality type as "aggressive driving." The abnormality type determining unit 225 then supplies information indicating the abnormality type to the determining unit 223 .

[0088] When the determination unit 223 determines that the first event has occurred, the determination unit 223 writes an abnormal The event occurrence information is supplied to the restricted voice detection unit 26 with information indicating the type added thereto.

[0089] When the restricted voice detection unit 26 acquires the event occurrence information, it detects an abnormality type from the voice data. For example, the restricted voice detection unit 26 detects the voice corresponding to the abnormality type as a voice to be restricted. If it is an "accident," the voice data will be used to analyze conversations in the car, such as "accident" and "crash." In addition, when the abnormality type is "aggressive driving", the restricted voice detection unit 26 detects the voice data. The system detects conversations in the vehicle, such as "tailgating," "danger," and "coming close," and then restricts the The voice detection unit 26 restricts voices other than the detected voices, that is, voices that are not related to the abnormality type. The recording control unit 23 is supplied with information indicating the audio to be restricted as the audio of the elephant.

[0090] When the first event occurs, the recording control unit 23 Based on the result, the voice data during the first event occurrence period is restricted to a voice corresponding to the type of abnormality; In other words, when the first event occurs, the recording control unit 23 generates the restricted audio data. In this case, the voice data during the first event occurrence period is not restricted to voices related to the type of abnormality, and the The recording control unit 23 then generates restricted voice data by restricting voices that are not related to the normal type. is a media data in which the audio corresponding to the abnormality type is restricted from the audio during the event occurrence period. is recorded in the recording unit 33.

[0091] In this way, according to the recording device 10b of the fourth embodiment, when an abnormality occurs around the vehicle, In such cases, audio unrelated to the anomaly can be restricted to better protect the privacy of witnesses. However, audio related to the abnormality that has occurred is not restricted, so audio necessary for providing information can be more easily heard. It can be recorded reliably.

[0092] The present invention is not limited to the above-described embodiment, and may be modified as appropriate without departing from the spirit and scope of the present invention. For example, the surrounding abnormality detection by the surrounding abnormality detection units 220 and 220b can be changed. detection processing by the vehicle abnormality detection unit 221, abnormality type determination processing by the abnormality type determination unit 225 The type determination process may be performed by an external device (not shown) instead of the recording device. In other words, the surrounding abnormality detection units 220 and 220b, the vehicle abnormality detection unit 221, and the abnormality type determination unit 22 5 does not have to be included in the recording device. In this case, the recording device stores various detection results or judgment results. The result is obtained from an external device via a communication means (not shown) and is supplied to the determination unit 223. Similarly, the restricted voice detection unit 26 does not need to be included in the recording device. The recording control unit receives information indicating the audio to be restricted from an external device via a communication unit (not shown). Supply to 23.

[0093] In the first to fourth embodiments, the surrounding abnormality detection unit 220 detects a small amount of audio data and image data. At least one of the vehicles is normal or abnormal (i.e., the vehicle itself and / or other vehicles). The system was designed to detect abnormalities around the vehicle by determining whether the abnormality is related to the surroundings. Instead, the surrounding abnormality detection unit 220 detects abnormality from at least one of the voice data and the image data. It may be possible to determine whether the abnormality is a malfunction of the vehicle itself, an abnormality of the vehicle itself, or an abnormality of another vehicle that is not related to the vehicle itself. In this case, instead of step S12 in FIG. 4, the surrounding abnormality detection unit 220 An abnormality was detected in another vehicle that is not related to the vehicle itself from the media data stored in the If an abnormality in the surroundings of the other vehicle is detected, the surrounding abnormality detection unit 220 In addition, other vehicle abnormality information indicating that an abnormality in the other vehicle has been detected may be supplied to the determination unit 223. Then, instead of step S13 in FIG. 4, the determination unit 223 determines whether or not the abnormality information of the other vehicle has been acquired. In other words, step S12 in FIG. 4 is executed in response to the above. May be omitted.

[0094] In addition, a part or all of the above-described embodiments can be described as follows: is not limited to. (Appendix 1) Image data of an area including at least the surroundings of a vehicle, and An acquisition unit that acquires audio data obtained by collecting audio from an area including the The occurrence of an event in which an abnormality is detected around the vehicle, but an abnormality is not detected in the vehicle. an event detection unit for detecting When the event occurs, before a first predetermined period corresponding to the time when the event occurs The voice data is limited to a predetermined voice, and the limited voice data is generated by limiting a predetermined voice from the voice data. a recording control unit that records the image data in the recording unit; A recording system comprising: (Appendix 2) The event detection unit a surrounding abnormality detection unit that detects an abnormality around the vehicle from the voice data; a vehicle abnormality detection unit that detects an abnormality of the vehicle based on measurement information of a sensor of the vehicle; have 2. A recording system as described in appendix 1. (Appendix 3) When the event occurs, the recording control unit A predetermined voice is extracted from the voice data during a second predetermined period including a period before the occurrence of the event. The restricted voice data is recorded in the recording unit together with the image data for the second predetermined period. Record in The audio data for a third predetermined period including a period after the occurrence of the event is The image data for a predetermined period is recorded in the recording unit. 3. A recording system according to claim 1 or 2. (Appendix 4) an occupant speech detection unit that detects speech of an occupant in a cabin of the vehicle from the voice data; When the event occurs, the recording control unit records the audio data for the first predetermined period. or from the audio data for a second predetermined period including a period before the occurrence of the event, The voice corresponding to the utterance of the passenger is restricted, and the restricted voice data is generated. 4. A recording system according to any one of claims 1 to 3. (Appendix 5) The occupant utterance detection unit detects an utterance related to the abnormality from the utterance of the occupant. Further comprising an utterance detection unit, When the event occurs, the recording control unit records the audio data for the first predetermined period. or from the voice data for a second predetermined period including a period before the occurrence of the event, The restricted voice data is generated without restricting the voice corresponding to the utterance of the occupant regarding the abnormality. do 5. A recording system as described in Appendix 4. (Appendix 6) an abnormality type determination unit that determines a type of abnormality from the voice data; When the event occurs, the recording control unit records the audio data for the first predetermined period. or from the audio data for a second predetermined period including a period before the occurrence of the event, The voice corresponding to the type of the abnormality is restricted, and the restricted voice data is generated. 6. A recording system according to any one of claims 1 to 5. (Appendix 7) Image data of an area including at least the surroundings of a vehicle, and An acquisition step of acquiring voice data obtained by collecting voice in an area including the The occurrence of an event in which an abnormality is detected around the vehicle, but an abnormality is not detected in the vehicle. an event detection stage for detecting When the event occurs, before a first predetermined period corresponding to the time when the event occurs The voice data is limited to a predetermined voice, and the limited voice data is generated by limiting a predetermined voice from the voice data. a recording control step of recording the image data together with the recording unit; A recording method comprising: [Explanation of symbols]

[0095] 10, 10a, 10b Recording system (recording device) 20, 20a, 20b Control section 21 Acquisition Department 22, 22b Event detection section 23 Recording control section 24 Buffer Memory 25 Playback control section 26 Restricted Audio Detector 31 Camera 32 Microphone 33 Recording Department 34 Sensors 35 Display section 36 Speaker 220, 220b Surrounding abnormality detection unit 221 Vehicle Abnormality Detection Unit 223 Judgment section 225 Abnormality type determination unit

Claims

1. An acquisition unit that acquires voice data; an event detection unit that detects the occurrence of an event in which an abnormality is detected and determines a type of the abnormality; a control unit that generates, when the event occurs, restricted voice data from the voice data in which voices not related to the determined abnormality type are restricted; A privacy protection system comprising:

2. An acquisition unit that acquires voice data; an event detection unit that detects the occurrence of an event in which an abnormality is detected; a restricted voice detection unit that detects a person's voice when the event occurs; a control unit that generates, when the event occurs, limited voice data by limiting a voice signal corresponding to the person's voice from the voice data; A privacy protection system comprising:

3. An acquisition step of acquiring voice data; an event detection step of detecting an occurrence of an event in which an abnormality is detected and determining a type of the abnormality; a control step of generating, when the event occurs, restricted voice data from the voice data in which voices not related to the determined abnormality type are restricted; A privacy protection method comprising:

4. An acquisition step of acquiring voice data; an event detection step of detecting an occurrence of an event in which an anomaly is detected; a restricted voice detection step of detecting a person's voice when the event occurs; a control step of generating, when the event occurs, limited voice data by limiting a voice signal corresponding to the person's voice from the voice data; A privacy protection method comprising:

Images