Vehicle recording control device and program

Abstract

To appropriately perform recording by a voice command.SOLUTION: The control device 100 includes a captured data acquisition unit 111 that acquires captured data captured by a camera, a voice command reception unit 116 that receives a voice command for instructing still image recording, a voice recognition unit 115 that detects, when the voice command reception unit 116 receives the voice command for instructing still image recording, an utterance not matching the voice command for instructing still image recording and corresponding to the voice command for instructing still image recording before a predetermined period from a point in time when the voice command is received, and a recording control unit 122 that stores a still image at a point in time when the utterance corresponding to the voice command for instructing still image recording is detected when the voice recognition unit 115 detects the utterance corresponding to the voice command for instructing still image recording before the predetermined period from the point in time when the voice command for instructing still image recording is received.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present invention relates to a recording control device for a vehicle and a program. [Background technology]

[0002] Some vehicle recording devices, so-called drive recorders, record events using voice commands in addition to detecting impacts using acceleration sensors. Recording events using voice commands allows safe event recording without the need to operate a touch panel or the like while driving, such as when recording an accident in which the driver was not involved. Patent Document 1 discloses a drive recorder that records events by issuing voice commands in response to event detection based on acceleration. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2020-154904 Summary of the Invention [Problem to be solved by the invention]

[0004] When an event occurs that the driver of a vehicle wishes to record as an event, even though the driver is not a party to the accident, that is, when event recording based on acceleration detection is not performed, the driver may record the event using a voice command while driving. However, since different voice commands are used for event recording depending on the model and the voice command is used infrequently, the driver may not be able to immediately utter an accurate voice command. Therefore, when using a voice command to record an event, the timing of event recording may be delayed due to the driver being unable to immediately utter an accurate voice command.

[0005] The present disclosure has been made in view of the above, and aims to appropriately perform recording using voice commands. [Means for solving the problem]

[0006] In order to solve the above-mentioned problems and achieve the objectives, the recording control device of the present disclosure comprises: a shooting data acquisition unit that acquires shooting data captured by a camera; a voice command receiving unit that receives a voice command instructing to record a still image; a voice recognition unit that, when the voice command receiving unit receives a voice command instructing to record a still image, detects that an utterance that does not match the voice command instructing to record a still image and corresponds to the voice command instructing to record a still image has been made within a predetermined period of time from the time the voice command is received; and a recording control unit that, when the voice recognition unit detects that an utterance corresponding to the voice command instructing to record a still image has been made within a predetermined period of time from the time the voice command instructing to record a still image is received, saves the still image at the time the utterance corresponding to the voice command instructing to record a still image was detected.

[0007] The program according to the present disclosure causes a recording control device to execute processing including: a shooting data acquisition step for acquiring shooting data captured by a camera; a voice command reception step for receiving a voice command instructing still image recording; a voice recognition step for, if a voice command instructing still image recording is received in the voice command reception step, detecting that an utterance that does not match the voice command instructing still image recording and corresponds to the voice command instructing still image recording has been made within a predetermined period of time from the time the voice command was received; and a recording control step for saving the still image at the time the utterance corresponding to the voice command instructing still image recording was detected, if the voice recognition step detects that an utterance corresponding to the voice command instructing still image recording has been made within a predetermined period of time from the time the voice command instructing still image recording was received. [Effects of the Invention]

[0008] According to the present disclosure, it is possible to provide an effect that recording can be performed appropriately using a voice command. [Brief explanation of the drawings]

[0009] [Figure 1] FIG. 1 is a block diagram showing an example of the configuration of a vehicle recording device having a control device according to the first embodiment. [Figure 2] FIG. 2 is a diagram showing an example of a recording period of event data. [Figure 3] FIG. 3 is a flowchart showing an example of a processing flow in the control device according to the first embodiment. [Figure 4] FIG. 4 is a diagram showing an example of the recording time of a still image. [Figure 5] FIG. 5 is a flowchart showing an example of a processing flow in the control device according to the second embodiment. [Figure 6] FIG. 6 is a diagram showing another example of the recording time of a still image. [Figure 7] FIG. 7 is a diagram showing another example of the recording time of a still image. DETAILED DESCRIPTION OF THE INVENTION

[0010] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0023] The following describes in detail an embodiment of a vehicle recording control device and a recording control method according to the present disclosure with reference to the accompanying drawings. However, the present invention is not limited to the following embodiment.

[0011] [First embodiment] <Vehicle Recording Device> FIG. 1 is a block diagram showing an example of the configuration of a vehicle recording device 10 having a vehicle recording control device (hereinafter referred to as the "control device") 100 according to a first embodiment. The vehicle recording device 10 is a so-called drive recorder that records video and the like based on events that occur in the vehicle. When recording an event using a voice command and the voice command cannot be uttered immediately, the vehicle recording device 10 appropriately sets a period for recording the captured data as event data and saves the data.

[0012] The vehicular recording device 10 may be a device installed in a vehicle, or may be a portable device that can be used in a vehicle. The vehicular recording device 10 may also be realized by including the functions or configuration of a device pre-installed in the vehicle or a navigation device. The vehicular recording device 10 includes a camera 211, a microphone 212, a recording unit 213, an operation unit 214, an acceleration sensor 215, a GNSS (Global Navigation Satellite System) receiving unit 216, a display unit 217, and a control device 100. The recording device 10 may be a device that integrally includes the camera 211 and the microphone 212, or a device in which the camera 211 and the microphone 212 are configured separately.

[0013] The camera 211 captures images of the periphery of the vehicle. The camera 211 may be a group of multiple cameras. The camera 211 is arranged, for example, at a position in the front of the vehicle interior where it can capture images of the area in front of the vehicle. In this embodiment, the camera 211 constantly captures images while the accessory power of the vehicle is ON. The camera 211 outputs the captured image data to the image data acquisition unit 111 of the control device 100. The image data is, for example, a moving image composed of images at 27.5 frames per second.

[0014] The microphone 212 is a microphone that picks up voice commands indicating various operations for the vehicular recording device 10. The microphone 212 may also be used as a microphone that inputs audio in addition to video from the camera 211 to the image data acquisition unit 111. For example, the microphone 212 can accept an operation to store captured image data as event data in the recording unit 213. The microphone 212 outputs the picked-up audio data to the voice recognition unit 115 of the control device 100.

[0015] The recording unit 213 is used for temporary storage of data in the vehicle recording device 10. The recording unit 213 is, for example, a semiconductor memory element such as a random access memory (RAM) or a flash memory, or a recording medium such as a memory card. The recording unit 213 may be an external recording unit that is wirelessly connected via a communication device (not shown). The recording unit 213 records loop-recorded video data or event data based on a control signal output from the recording control unit 122 of the control device 100.

[0016] The operation unit 214 can accept various operations for the vehicular recording device 10. The operation unit 214 is, for example, a touch panel superimposed on the display screen of the display unit 217. For example, the operation unit 214 can accept an operation to manually save captured image data as event data in the recording unit 213. For example, the operation unit 214 can accept an operation to play back loop recorded video data or event data recorded in the recording unit 213. For example, the operation unit 214 can accept an operation to erase event data recorded in the recording unit 213. For example, the operation unit 214 can accept an operation to end loop recording. The operation unit 214 outputs operation information to the operation control unit 114 of the control device 100.

[0017] The acceleration sensor 215 is a sensor that detects acceleration occurring with respect to the vehicle. The acceleration sensor 215 outputs the detection result to the event detection unit 117 of the control device 100. The acceleration sensor 215 is a sensor that detects acceleration in, for example, three axial directions. The three axial directions are the front-rear direction, the left-right direction, and the up-down direction of the vehicle.

[0018] The GNSS receiving unit 216 is configured with a GNSS receiver that receives GNSS signals from GNSS satellites, etc. The GNSS receiving unit 216 outputs the received position information signal to the position information acquisition unit 118 of the control device 100.

[0019] The display unit 217 is, for example, a display device specific to the vehicular recording device 10, or a display device shared with other systems including a navigation system. The display unit 217 may be formed integrally with the camera 211. The display unit 217 is, for example, a display including a liquid crystal display or an organic EL (Electro-Luminescence) display. In this embodiment, the display unit 217 is disposed in front of the driver of the vehicle on a dashboard, an instrument panel, a center console, or the like. The display unit 217 displays an image based on a video signal output from the display control unit 119 of the control device 100. The display unit 217 displays an image captured by the camera 211 or an image recorded in the recording unit 213.

[0020] <Vehicle recording control device> The control device 100 controls each part of the vehicle recording device 10. The control device 100 is an arithmetic processing device (control device) configured with, for example, a CPU (Central Processing Unit) and an MPU (Micro Processing Unit), and has a storage device such as a RAM (Random Access Memory) or a ROM (Read Only Memory). The control device 100 loads a stored program into the memory and executes instructions included in the program. The control device 100 includes an internal memory such as the RAM described above, which is used for temporary storage of data in the control device 100. The control device 100 includes components such as functional blocks realized by executing the program, such as an image capture data acquisition unit 111, a buffer memory 112, an image capture data processing unit 113, an operation control unit 114, a voice recognition unit 115, a voice command reception unit 116, an event detection unit 117, a position information acquisition unit 118, a display control unit 119, a playback control unit 121, and a recording control unit 122.

[0021] The image data acquisition unit 111 acquires image data of the surroundings captured by the camera 211 that captures the surroundings of the vehicle. The image data acquisition unit 111 outputs the acquired image data to the buffer memory 112.

[0022] The buffer memory 112 is an internal memory such as a RAM provided in the control device 100, and is a memory that temporarily records the photographic data for a certain period of time acquired by the photographic data acquisition unit 111 while updating it.

[0023] The image capture data processing unit 113 converts the image capture data temporarily stored in the buffer memory 112 into an arbitrary file format, such as MP4 format, encoded using an arbitrary codec, such as H.264 or MPEG-4 (Moving Picture Experts Group). The image capture data processing unit 113 generates image capture data as files for a certain period of time from the image capture data temporarily stored in the buffer memory 112. As a specific example, the image capture data processing unit 113 generates 60 seconds of image capture data as files in the order of recording from the image capture data temporarily stored in the buffer memory 112. The image capture data processing unit 113 outputs the generated image capture data to the recording control unit 122. The image capture data processing unit 113 also decodes the generated image capture data via the playback control unit 121 and then outputs it to the display control unit 119. While the period of the image capture data generated as a file is 60 seconds as an example, it is not limited to this. The image capture data referred to here may be data including audio in addition to video captured by the camera 211.

[0024] The operation control unit 114 acquires operation information of various operations accepted by the operation unit 214. More specifically, the operation control unit 114 accepts operations on a physical interface such as a touch panel. For example, the operation control unit 114 acquires playback operation information indicating a playback operation or deletion operation information indicating an deletion operation of captured data, and outputs a control signal. For example, the operation control unit 114 acquires end operation information indicating an operation to end loop recording, and outputs a control signal.

[0025] The voice recognition unit 115 analyzes the voice input from the microphone 212 and recognizes the content of the utterance contained in the voice. The voice recognition unit 115 performs acoustic model analysis for each phoneme or each word on the voice input from the microphone 212 and recognizes the content of the utterance by comparing it with a phoneme model or a language model. The voice recognition unit 115 recognizes voice commands for the vehicular recording device 100. The voice recognition unit 115 also recognizes utterances corresponding to the occurrence of an event. The utterances corresponding to the occurrence of an event will be described later. When the voice recognition unit 115 recognizes a voice command for the vehicular recording device 100, a voice command instructing event recording, or an utterance corresponding to the occurrence of an event, it outputs the recognition result to the voice command receiving unit 116.

[0026] In this embodiment, when the voice command receiving unit 116 receives a voice command instructing event recording, that is, when the voice recognition unit 115 recognizes a voice indicating a voice command instructing event recording and outputs the result to the voice command receiving unit 116, the voice recognition unit 115 detects that an utterance of less than a predetermined number of syllables corresponding to the occurrence of an event has been made within a predetermined period T1, such as 5 seconds, from the time of receiving the voice command.

[0027] The voice command for instructing event recording is preset to accept a voice command such as "rokuga kaishi" (the first syllable of the series). A voice command is required to consist of a certain number of syllables to prevent misrecognition due to other voices. For example, "rokuga kaishi" consists of six syllables. Therefore, for example, the voice command with the fewest number of syllables is set as the predetermined syllable threshold.

[0028] An utterance corresponding to the occurrence of an event is an utterance uttered when an event is encountered. In other words, an utterance corresponding to the occurrence of an event is an utterance that infers the occurrence of an event. An utterance corresponding to the occurrence of an event is, for example, a short utterance of three or less than four syllables. An utterance corresponding to the occurrence of an event excludes a part of a continuous conversation. An utterance corresponding to the occurrence of an event is, for example, an utterance that expresses surprise such as "Ah," "Huh," "Wow," "Accident," "Terrible," or "Dangerous," or an utterance that expresses a negative emotion such as fear.

[0029] The utterances corresponding to the occurrence of an event exclude utterances that match voice commands that instruct various operations, such as "Recording." This prevents malfunctions such as consecutive event recording when consecutive voice commands are uttered.

[0030] In this embodiment, when the voice command receiving unit 116 receives a voice command, the voice recognition unit 115 detects that an utterance similar to a voice command instructing event recording has been made within a predetermined period T1 from the time the voice command was received.

[0031] An example of an utterance that is similar to the voice command to instruct an event record is an utterance that is similar to "rokuga kaishi." For example, it is an utterance in which part of the voice command to instruct an event record cannot be recognized, such as "rokuga kai*" or "rokuga*ishi." "*" indicates an unrecognizable sound. For example, it is an utterance that matches about 50% of the voice command to instruct an event record, such as "rokuga." For example, it is an utterance that is pre-set as a word with a meaning similar to the meaning of the voice command to instruct an event record, such as "rokuga kaishi" or "rokuga start."

[0032] The voice command receiving unit 116 receives the voice input from the microphone 212 as a voice command instructing various operations based on the recognition result of the voice recognition unit 115 for the voice input from the microphone 212. For example, the voice command receiving unit 116 receives a voice command instructing a playback operation or a voice command instructing an operation to erase captured data, and outputs a control signal. For example, the voice command receiving unit 116 receives a voice command instructing to end loop recording, and outputs a control signal. The voice command receiving unit 116 receives a voice command instructing to record an event, and outputs a control signal. For example, the voice command receiving unit 116 receives the voice command "Record record" as a voice command instructing to record an event, and outputs a control signal.

[0033] When the voice command receiving unit 116 receives from the voice recognition unit 115 that it has recognized an utterance instructing to record an event, it outputs a control signal instructing to record the event to the recording control unit 122. When the voice command receiving unit 116 receives from the voice recognition unit 115 that it has recognized an utterance instructing to perform a playback operation, it outputs a control signal instructing to perform a playback operation to the playback control unit 121.

[0034] Event detection unit 117 detects an event based on the acceleration applied to the vehicle. More specifically, event detection unit 117 detects an event based on the detection result of acceleration sensor 215. Event detection unit 117 detects that an event has occurred when acceleration information acquired by event detection unit 117 from acceleration sensor 215 is equal to or greater than a threshold value.

[0035] The position information acquisition unit 118 acquires position information indicating the current position of the vehicle. The position information acquisition unit 118 calculates the position information of the current position of the vehicle using a known method based on the GNSS signal received by the GNSS receiver unit 216. The position information acquisition unit 118 outputs the calculated position information to the recording control unit 122.

[0036] The display control unit 119 controls the display of the captured data on the display unit 217. The display control unit 119 outputs a video signal that causes the captured data to be output to the display unit 217. More specifically, the display control unit 119 outputs a video signal that displays the video captured by the camera 211, or the loop recorded video data or event data recorded in the recording unit 213 by playing back the video.

[0037] The playback control unit 121 controls playback of loop recorded video data or event data recorded in the recording unit 213 based on a playback operation control signal output from the operation control unit 114. The playback control unit 121 includes a decoder (not shown) and plays back various types of data by decoding the supplied compressed data.

[0038] The recording control unit 122 controls the recording unit 213 to record the shooting data filed by the shooting data processing unit 113. During the period when loop recording processing is being performed, such as when the vehicle accessory power is ON, the recording control unit 122 records the shooting data filed by the shooting data processing unit 113 as overwritable shooting data in the recording unit 213. More specifically, during the period when loop recording processing is being performed, the recording control unit 122 continues to record the shooting data generated by the shooting data processing unit 113 in the recording unit 213, and when the capacity of the recording unit 213 becomes full, it overwrites the oldest shooting data with new shooting data and records it.

[0039] When an event is detected by the event detection unit 117, the recording control unit 122 stores the photographed data corresponding to the detected event. The photographed data corresponding to the detected event is photographed data for a predetermined period of time in the photographed data generated by the photographed data processing unit 113. The recording control unit 122 stores the photographed data corresponding to the detected event in the recording unit 213 as event data that is prohibited from being overwritten.

[0040] When an event is detected by the event detection unit 117, the recording control unit 122 saves, as event data, photographed data for a predetermined period before and after the time point at which the event was detected. FIG. 2 is a diagram showing an example of a recording period for event data. As shown in FIG. 2, the recording control unit 122 saves, as event data, photographed data for a period from a time point P1 before the time point t1 at which the event was detected by the event detection unit 117 to a time point at which the time point P1 has elapsed since t1. When an event is detected by the event detection unit 117, the recording control unit 122 copies, from the buffer memory 112, photographed data for a predetermined period before and after the time point t1 at which the event was detected, such as approximately 10 seconds before and after the time point t1, and saves the copied data as event data.

[0041] The predetermined period before and after a certain point in time is, for example, 10 seconds, which is the sum of a period P1 (for example, 5 seconds) before a certain point in time and a period P1 (for example, 5 seconds) after the certain point in time. The period before a certain point in time and the period after the certain point in time may be different periods.

[0042] When the voice command receiving unit 116 receives a voice command instructing event recording, the recording control unit 122 saves, as event data, the captured image data for a period starting from the time the voice command was received. As shown in Fig. 2, the recording control unit 122 saves, as event data, the captured image data for a period starting from a time period P1 before the voice command reception time t2 to a time period P1 has elapsed since the voice command reception time t2. For example, the recording control unit 122 saves, as event data, the captured image data for 10 seconds before and after the voice command reception time.

[0043] When the voice command receiving unit 116 receives a voice command instructing event recording and the voice recognition unit 115 detects that an utterance corresponding to the occurrence of the event has been made, the recording control unit 122 saves, as event data, captured data for a period starting from the time when the utterance corresponding to the occurrence of the event was detected (hereinafter referred to as the "utterance detection time"). In this embodiment, the recording control unit 122 saves, as event data, captured data for a predetermined period before and after the utterance detection time. As shown in FIG. 2, when a voice command instructing event recording is received, if an utterance corresponding to the occurrence of the event has been detected within a predetermined period T1 from the voice command reception time t3, the recording control unit 122 saves, as event data, captured data for a period starting from a time P1 before the utterance detection time t4 to a time P1 has elapsed since the utterance detection time t4. For example, the recording control unit 122 saves, as event data, captured data for 10 seconds before and after the utterance detection time t4.

[0044] When an event needs to be recorded urgently, for example, it is highly likely that the voice command cannot be uttered accurately in an emergency. In such cases, it may take time for the correct voice command to be uttered. Therefore, if an utterance that suggests an event has occurred is detected before a voice command is received, the event data is saved starting from the time of the utterance detection, which is before the voice command was received. This allows event data for an appropriate period to be saved.

[0045] <Information processing in a vehicle recording control device> Next, the flow of processing in the control device 100 will be described with reference to Fig. 3. When the vehicle recording device 10 is started, the processing of the flowchart shown in Fig. 3 begins. While the vehicle recording device 10 is running, the control device 100 detects acceleration using the acceleration sensor 215 at a set acceleration threshold. The control device 100 starts event detection based on the detected acceleration using the event detection unit 117. A description of event detection based on acceleration detection will be omitted here. Furthermore, while the vehicle recording device 10 is running, the control device 100 performs recognition processing of voice input from the microphone 212.

[0046] When the process starts, the control device 100 starts loop recording, which is normal recording (step S101). More specifically, the recording control unit 122 starts loop recording to overwriteably record the file generated by the shooting data processing unit 113 in the recording unit 213. The loop recording by the recording control unit 122 and the event detection by the event detection unit 117 and the voice command reception unit 116 continue until the process ends. The control device 100 proceeds to step S102.

[0047] The control device 100 determines whether or not an event has been detected based on the detection result by the event detection unit 117 (step S102). If the acceleration detected by the event detection unit 117 is equal to or greater than a threshold, the control device 100 determines that an event has been detected (Yes in step S102) and proceeds to step S103. If the event detection unit 117 determines that the acceleration detected is not equal to or greater than the threshold, the control device 100 determines that an event has not been detected (No in step S102) and proceeds to step S104.

[0048] If it is determined that an event has been detected (Yes in step S102), the control device 100 causes the recording control unit 122 to store the photographed data for a predetermined period before and after the event detection time as event data (step S103). More specifically, the control device 100 causes the recording control unit 122 to store the photographed data taken from a time period P1 before the event detection time to a time period P1 after the event detection time as event data in the recording unit 213 while prohibiting overwriting. The control device 100 proceeds to step S108.

[0049] If it is determined that an event has not been detected (No in step S102), the control device 100 determines whether a voice command instructing event recording has been accepted (step S104). If the control device 100 determines that a voice command instructing event recording has been accepted by the voice command accepting unit 116 (Yes in step S104), the control device 100 proceeds to step S105. Alternatively, if the control device 100 does not determine that a voice command instructing event recording has been accepted by the voice command accepting unit 116 (No in step S104), the control device 100 proceeds to step S108.

[0050] When it is determined that a voice command instructing event recording has been received (Yes in step S104), the control device 100 determines whether or not there has been an utterance corresponding to the occurrence of the event within a predetermined period T1 (step S105). If the voice recognition unit 115 detects an utterance corresponding to the occurrence of the event within a predetermined period T1 from the time the voice command is received (Yes in step S105), the control device 100 proceeds to step S107. If the voice recognition unit 115 does not detect an utterance corresponding to the occurrence of the event within a predetermined period T1 from the time the voice command is received (No in step S105), the control device 100 proceeds to step S106.

[0051] If no utterance corresponding to the occurrence of an event is detected within a predetermined period T1 from the time the voice command is received (No in step S105), the control device 100 causes the recording control unit 122 to store the captured image data for a predetermined period before and after the time the voice command is received as event data (step S106). More specifically, the control device 100 causes the recording control unit 122 to store the captured image data captured during the period from the time period P1 before the time the voice command is received to the time period P1 after the time the voice command is received as event data in the recording unit 213 while prohibiting overwriting. The control device 100 proceeds to step S108.

[0052] If an utterance corresponding to the occurrence of an event is detected within a predetermined period T1 from the time the voice command is received (Yes in step S105), the control device 100 causes the recording control unit 122 to store, as event data, the captured data for a predetermined period before and after the time the utterance corresponding to the occurrence of the event was detected (step S107). More specifically, the control device 100 causes the recording control unit 122 to store, as event data, the captured data captured during the period P1 before the time the utterance was detected and the period P1 after the time the utterance was detected, in the recording unit 213, with overwriting prohibited. The control device 100 proceeds to step S108.

[0053] The control device 100 determines whether or not to end the process (step S108). For example, the control device 100 determines to end the process when the power or motive power of the vehicle is turned off or the operation unit 214 is operated. If the control device 100 determines to end the process (Yes in step S108), it ends this process. If the control device 100 does not determine to end the process (No in step S108), it executes the process of step S102 again.

[0054] <Effects> As described above, according to this embodiment, if an utterance corresponding to the occurrence of an event is made before the reception of a voice command, event data for a predetermined period before and after the time of the utterance detection can be saved. In this way, according to this embodiment, event data based on a voice command can be appropriately recorded.

[0055] In this embodiment, when a voice command is received, if an utterance that suggests an event has occurred is detected before that, event data can be saved starting from the time of the utterance detection, which is before the voice command is received. According to this embodiment, events for an appropriate period can be recorded.

[0056] In this embodiment, event data for a predetermined period before and after the time of speech detection can be saved, and event data for an appropriate period can be recorded.

[0057] In this embodiment, when a voice command is received, it is detected that an utterance of less than the predetermined number of syllables corresponding to the occurrence of an event has been made within a predetermined period of time from the time the voice command was received. According to this embodiment, even if a user is unable to immediately recall a voice command when an event occurs, it is possible to record event data for a period starting from an utterance of less than the predetermined number of syllables that was intentionally or unintentionally uttered when the event occurred.

[0058] In this embodiment, when a voice command is received, it is detected that an utterance similar to a voice command instructing to record an event has been made within a predetermined period of time from the time the voice command was received. According to this embodiment, even if a user cannot immediately recall a voice command when an event occurs, if an utterance similar to a voice command instructing to record an event has been made, it is possible to record event data for a period starting from the time when the utterance similar to the utterance for the event was made.

[0059] [Second embodiment] The vehicle recording device 10 according to this embodiment will be described with reference to FIGS. 4 to 7. FIG. 4 is a diagram showing an example of the recording time of a still image. FIG. 5 is a flowchart showing an example of the flow of processing in a control device according to a second embodiment. FIG. 6 is a diagram showing another example of the recording time of a still image. FIG. 7 is a diagram showing another example of the recording time of a still image. The basic configuration of the vehicle recording device 10 is similar to that of the vehicle recording device 10 according to the first embodiment. In the following description, components similar to those of the vehicle recording device 10 are denoted by the same or corresponding reference numerals, and detailed description thereof will be omitted. In this embodiment, the processing in the operation unit 214, operation control unit 114, voice recognition unit 115, voice command reception unit 116, and recording control unit 122 differs from that in the first embodiment.

[0060] In this embodiment, when recording a still image using a voice command, the vehicular recording device 10 saves a still image at an appropriate timing when the voice command cannot be uttered immediately.

[0061] The operation unit 214 can accept an operation to record a still image.

[0062] The operation control unit 114 acquires operation information indicating still image recording and outputs a control signal.

[0063] When the voice recognition unit 115 recognizes a voice command instructing still image recording and an utterance corresponding to a voice command instructing still image recording, the voice recognition unit 115 outputs the recognition result to the voice command receiving unit 116.

[0064] The speech corresponding to the voice command for instructing still image recording is, for example, a short speech of three or less than four syllables. The speech corresponding to the voice command for instructing still image recording does not include a part of a continuous conversation.

[0065] In this embodiment, when a voice command instructing to record a still image is received by the voice command receiving unit 116, that is, when the voice recognition unit 115 recognizes a voice indicating a voice command instructing to record a still image and outputs the result to the voice command receiving unit 116, the voice recognition unit 115 detects that an utterance similar to a voice command instructing to record a still image has been made within a predetermined period T1, such as 5 seconds, from the time of receiving the voice command.

[0066] An utterance similar to a voice command instructing still image recording is, for example, an utterance similar to "photograph." For example, it is an utterance in which part of the voice command instructing still image recording cannot be recognized, such as "photograph*" or "photograph*." For example, it is an utterance that matches about 50% of the voice command instructing still image recording, such as "photograph" or "photograph." For example, it is an utterance that is preset as a word with a meaning similar to the meaning of the voice command instructing still image recording, such as "photograph" or "photo record."

[0067] The utterances corresponding to the voice command to instruct still image recording exclude utterances that match voice commands instructing various operations, such as "take a picture." This prevents the malfunction of consecutive still image recording when consecutive voice commands are uttered.

[0068] The voice command in the drive recorder is preset so that it can accept a voice command such as "take a picture." A voice command is required to consist of a certain number of syllables to prevent misrecognition due to other voices. For example, "take a picture" consists of eight syllables. Therefore, for example, the smallest number of syllables among the voice commands is set as the predetermined number of syllables, which is the threshold value.

[0069] The voice command receiving unit 116 receives a voice command instructing still image recording. For example, the voice command receiving unit 116 receives the voice command "take a photo" as a voice command instructing still image recording, and outputs a control signal. When the voice command receiving unit 116 obtains from the voice recognition unit 115 that it has recognized an utterance instructing still image recording, it outputs a control signal instructing still image recording to the recording control unit 122.

[0070] When the voice command receiving unit 116 receives a voice command instructing recording of a still image, the recording control unit 122 saves the still image at the time of receiving the voice command. As shown in Fig. 4, for example, the recording control unit 122 saves the still image at the time t6 when the voice command was received.

[0071] When the voice recognition unit 115 detects that an utterance corresponding to a voice command instructing to record a still image has been received, the recording control unit 122 saves the still image at the time when the utterance corresponding to the voice command instructing to record a still image was detected (hereinafter referred to as the "time of utterance detection"). As shown in Fig. 4, when an utterance corresponding to the voice command is detected between time t7 when the voice command instructing to record a still image is received and time T1 before, the recording control unit 122 saves the still image at time t8 when the utterance was detected.

[0072] In this embodiment, when the voice recognition unit 115 detects that an utterance has been made corresponding to a voice command instructing recording of a still image, the recording control unit 122 saves multiple still images starting from the time the utterance was detected.

[0073] Next, the flow of processing in the control device 100 will be described with reference to Fig. 5. The processing in steps S111 and S118 shown in Fig. 5 is the same as that in steps S101 and S108 in the flowchart shown in Fig. 3.

[0074] The control device 100 determines whether or not there is a manual operation for still image recording (step S112). If operation information for still image recording is acquired by the operation control unit 114, the control device 100 determines that there is a manual operation for still image recording (Yes in step S112) and proceeds to step S113. If operation information for still image recording is not acquired by the operation control unit 114, the control device 100 determines that there is no manual operation for still image recording (No in step S112) and proceeds to step S114.

[0075] If it is determined that a manual operation for recording a still image has been performed (Yes in step S112), the control device 100 causes the recording control unit 122 to store the captured data at the time of receiving the manual operation as a still image (step S113). The control device 100 proceeds to step S118.

[0076] If it is determined that there is no manual operation for still image recording (No in step S112), the control device 100 determines whether or not a voice command instructing still image recording has been accepted (step S114). If the control device 100 determines that the voice command accepting unit 116 has accepted a voice command instructing still image recording (Yes in step S114), the process proceeds to step S115. Alternatively, if the control device 100 does not determine that the voice command accepting unit 116 has accepted a voice command instructing still image recording (No in step S114), the process proceeds to step S118.

[0077] When it is determined that a voice command instructing still image recording has been received (Yes in step S114), the control device 100 determines whether or not there has been an utterance corresponding to the voice command instructing still image recording within the predetermined period T1 (step S115). If the voice recognition unit 115 detects an utterance corresponding to the voice command instructing still image recording within the predetermined period T1 from the time the voice command was received (Yes in step S115), the control device 100 proceeds to step S117. If the voice recognition unit 115 does not detect an utterance corresponding to the voice command instructing still image recording within the predetermined period T1 from the time the voice command was received (No in step S115), the control device 100 proceeds to step S116.

[0078] If no utterance corresponding to the voice command instructing still image recording is detected within a predetermined period T1 from the time the voice command is received (No in step S115), the control device 100 causes the recording control unit 122 to store the captured data at the time the voice command is received as a still image (step S116). As shown in Fig. 4, for example, a still image at time t6 when the voice command is received is stored. The control device 100 proceeds to step S118.

[0079] If an utterance corresponding to a voice command instructing still image recording is detected within a predetermined period T1 from the time the voice command is received (Yes in step S115), the control device 100 causes the recording control unit 122 to store the captured data at the time the utterance corresponding to the voice command instructing still image recording was detected as a still image (step S117). As shown in FIG. 4, the captured data at time t8 at which the utterance corresponding to the voice command instructing still image recording was detected is stored as a still image within a predetermined period T1 before time t7 at which the voice command instructing still image recording was received. In this embodiment, as shown in FIG. 6, for example, multiple still images from a predetermined period before and after the time t8 at which the utterance was detected may be stored. For example, still images from times t8-a and t8+a, which are one second before and after the time t8 at which the utterance was detected, may be stored. In addition, in this embodiment, as shown in FIG. 7, for example, multiple still images from the time t8 at which the utterance was detected to time t7 at which the voice command was received may be stored. The control device 100 proceeds to step S118.

[0080] As described above, according to this embodiment, if an utterance corresponding to a voice command instructing to record a still image is made before the voice command is received, a still image at the time the utterance is detected can be saved. In this way, according to this embodiment, a still image can be saved at an appropriate timing.

[0081] In this embodiment, when a voice command is received, if an utterance corresponding to the voice command instructing to record a still image is detected before that, a still image can be saved starting from the time of the utterance detection, which is before the voice command is received. According to this embodiment, a still image can be saved at an appropriate timing.

[0082] In this embodiment, when a voice command is received, it is detected that an utterance of less than the predetermined number of syllables corresponding to the voice command instructing to record a still image has been made within a predetermined period of time from the time the voice command was received. According to this embodiment, even if you cannot immediately remember the voice command when you want to take a still image, it is possible to save a still image at the time when an utterance of less than the predetermined number of syllables, either intentionally or unintentionally uttered when you want to take a still image, is detected.

[0083] In this embodiment, when a voice command is received, it is detected that an utterance similar to a voice command instructing to record a still image has been made within a predetermined period of time from the time the voice command was received. According to this embodiment, even if you cannot immediately remember the voice command when you want to take a still image, you can save the still image at the time when an utterance similar to a voice command instructing to record a still image was made.

[0084] In this embodiment, when an utterance corresponding to a voice command instructing still image recording is detected, multiple still images are saved starting from the time point when the utterance was detected. According to this embodiment, events can be recorded appropriately.

[0085] The vehicle recording device 10 according to the present disclosure may be implemented in various different forms other than the above-described embodiment.

[0086] The components of the illustrated vehicle recording device 10 are conceptual and functional, and do not necessarily have to be physically configured as shown. In other words, the specific form of each device is not limited to that shown, and all or part of the devices may be functionally or physically distributed or integrated in any unit depending on the processing load and usage status of each device.

[0087] The configuration of the vehicle recording device 10 is realized, for example, as software, by a program loaded into a memory. In the above embodiment, the configuration has been described as functional blocks realized by the cooperation of these hardware and software. In other words, these functional blocks can be realized in various forms, using only hardware, only software, or a combination of both.

[0088] The above-described components include those that can be easily imagined by a person skilled in the art and those that are substantially the same. Furthermore, the above-described configurations can be appropriately combined. Furthermore, various omissions, substitutions, or modifications of the configurations are possible within the scope of the gist of the present invention. [Explanation of symbols]

[0089] 10 Vehicle recording device 100 Control device (vehicle recording control device) 111 Shooting data acquisition unit 112 buffer memory 113 Shooting data processing section 114 Operation control section 115 Voice Recognition Unit 116 Voice command reception unit 117 Event detection unit 118 Location information acquisition unit 119 Display control unit 121 Playback control unit 122 Recording control section 211 Camera 212 microphones 213 Recording Department 214 Operation section 215 Acceleration Sensor 216 GNSS receiver 217 Display section P1 period T1 period

Claims

1. an image data acquisition unit that acquires image data captured by the camera; a voice command receiving unit that receives a voice command instructing recording of a still image; a voice recognition unit that, when the voice command receiving unit receives a voice command instructing to record a still image, detects that an utterance has been made that does not match a voice command instructing to record a still image and that corresponds to a voice command instructing to record a still image during a predetermined period of time from the time the voice command receiving unit receives the voice command; a recording control unit that, when the voice recognition unit detects that an utterance corresponding to the voice command instructing to record a still image has been made within a predetermined period of time from the time the voice recognition unit receives the voice command instructing to record a still image, saves the still image at the time the utterance corresponding to the voice command instructing to record a still image has been detected; A recording control device comprising:

2. when the voice command receiving unit receives the voice command, the voice recognition unit detects that there has been an utterance of less than a predetermined number of syllables corresponding to the voice command instructing to record a still image, or an utterance that is approximate or similar to the voice command instructing to record a still image, within a predetermined period of time from the time the voice command was received. The recording control device for a vehicle according to claim 1.

3. When the voice recognition unit detects that an utterance corresponding to a voice command instructing to record a still image has been made, the recording control unit saves a plurality of still images starting from a point in time when the utterance corresponding to the voice command instructing to record a still image was detected. The recording control device for a vehicle according to any one of claims 1 to 3.

4. A recording control device a photographic data acquisition step of acquiring photographic data photographed by the camera; a voice command receiving step of receiving a voice command instructing recording of a still image; a voice recognition step of detecting, when a voice command instructing to record a still image is accepted by the voice command accepting step, whether or not an utterance corresponding to a voice command instructing to record a still image has been made within a predetermined period of time from the time the voice command was accepted; a recording control step of saving a still image at the time when the utterance corresponding to the voice command instructing to record a still image was detected, when the voice recognition step detects that an utterance corresponding to the voice command instructing to record a still image has been made within a predetermined period of time since the time when the voice command instructing to record a still image was received; A program that executes processing including

Images