Information processing device, information processing method and program for information processing

Abstract

To provide an information processing device or the like capable of storing a part corresponding to operation for storing a moving image in the case of storing the moving image photographed by an on-vehicle camera in the case of emergency and storing the moving image photographed by the on-vehicle camera by eliminating the part corresponding to the operation for storing the moving image in the case of storing the moving image in the case of not being emergency.SOLUTION: An information processing device temporarily stores a moving image being currently photographed by an on-vehicle camera, stores a moving image corresponding to a period in the case of satisfaction of a prescribed condition during the period from before a first prescribed time when storage start operation for starting storage a portion of the moving image is detected until a prescribed storage stop condition for stopping the storage is satisfied, and stores a partial moving image being a moving image obtained by eliminating a portion corresponding to at least storage start operation from a moving image corresponding to the period in the case that the prescribed condition is not satisfied in the period.SELECTED DRAWING: Figure 3

Description

Technical Field

[0001] The present application relates to the technical field of information processing devices and the like that save videos captured by in-vehicle cameras.

Background Art

[0002] Conventionally, videos captured by a drive recorder are saved as memory videos on an SD memory card or the like, and these are posted on SNS. However, in the video captured by the drive recorder, an operation for saving the video may be recorded in the video, and when posting to SNS, the editing work of deleting the part where the operation is recorded is troublesome.

[0003] Patent Document 1 discloses that during video recording when shooting a video, a predetermined motion of a subject, which is a series of temporally continuous motions, is detected, and the start position and end position in the video corresponding to the period during which the motion is detected are specified as a specific period, and it is disclosed that the specific period is deleted from the video.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0005] However, in the drive recorder, when saving a video in an emergency, it is required to save the video as it is without editing such as deleting a part of the video. However, in the invention of Patent Document 1, there is a risk that the part where the operation for saving the video is recorded will be deleted even in an emergency.

[0006] Therefore, one of the problems of the present invention is to be able to save a video captured by an in-vehicle camera including a part corresponding to an operation for saving the video when saving the video in case of an emergency, and to be able to save the video captured by the in-vehicle camera by deleting a part corresponding to the operation for saving the video when saving the video when there is no emergency, and to provide an information processing apparatus and the like that can do so.

Means for Solving the Problems

[0007] The invention according to claim 1 comprises: a storage means for temporarily storing a video being captured by an in-vehicle camera; a storage start operation detection means for detecting a storage start operation for starting storage of a part of the video stored in the storage means; and a storage means for, when a predetermined condition is satisfied during a period from a first predetermined time before the storage start operation is detected until a predetermined storage stop condition for stopping the storage is satisfied, storing the video corresponding to the period, and when the predetermined condition is not satisfied during the period, storing a partial video which is a video obtained by deleting at least a part corresponding to the storage start operation from the video corresponding to the period.

[0008] The invention according to claim 14 is an information processing method by an information processing apparatus comprising: a storage means for temporarily storing a video being captured by an in-vehicle camera; and a storage start operation detection means for detecting a storage start operation for starting storage of a part of the video stored in the storage means, the method including: a storage step for, when a predetermined condition is satisfied during a period from a first predetermined time before the storage start operation is detected until a predetermined storage stop condition for stopping the storage is satisfied, storing the video corresponding to the period, and when the predetermined condition is not satisfied during the period, storing a partial video which is a video obtained by deleting at least a part corresponding to the storage start operation from the video corresponding to the period.

[0009] The invention according to claim 15 causes a computer included in an information processing apparatus, which includes a storage means for temporarily storing a video being shot by an in-vehicle camera and a storage start operation detection means for detecting a storage start operation for starting storage of a part of the video stored in the storage means, to store the video corresponding to the period from a first predetermined time before the storage start operation is detected until a predetermined storage stop condition for stopping the storage is satisfied, when a predetermined condition is satisfied during the period, and to store a partial video, which is a video obtained by deleting at least a part corresponding to the storage start operation from the video corresponding to the period, when the predetermined condition is not satisfied during the period.

Brief Description of the Drawings

[0010]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Figure 12

Embodiments for Carrying Out the Invention

[0011] The embodiments for carrying out the present invention will be described with reference to FIG. 1.

[0012] As shown in FIG. 1, the information processing apparatus 100 includes a storage unit 101, a storage start operation detection unit 102, and a storage unit 103.

[0013] The storage unit 101 temporarily stores the video being shot by the in-vehicle camera.

[0014] The storage start operation detection unit 102, from a first predetermined time before the storage start operation is detected until a predetermined storage stop condition for stopping the storage is satisfied, if a predetermined condition is satisfied during this period, causes the video corresponding to this period to be stored, and if the predetermined condition is not satisfied during this period, stores a partial video that is a part of the video corresponding to this period from which at least the part corresponding to the storage start operation has been deleted.

[0015] According to the information processing apparatus 100, from a first predetermined time before the storage start operation is detected until a predetermined storage stop condition for stopping the storage is satisfied, if a predetermined condition is satisfied during this period, the video corresponding to this period shot by the in-vehicle camera is stored as it is, and if the predetermined condition is not satisfied during this period, a partial video from which at least the part corresponding to the storage start operation has been deleted from the video corresponding to this period shot by the in-vehicle camera is stored. That is, when a predetermined condition corresponding to an emergency is satisfied, the video shot by the in-vehicle camera can be stored as a recording video during an emergency, including the part corresponding to the operation for storing the video, and when the predetermined condition corresponding to an emergency is not satisfied, the video shot by the in-vehicle camera can be stored as a memory video after deleting the part corresponding to the operation for storing the video.

Example

[0016] The examples will be described with reference to FIGS. 2-10.

[0017] [1. Overview of In-vehicle Device 200] An overview of the in-vehicle device 200, which is an example of the information processing apparatus 100, will be described. The in-vehicle device 200 is mounted on a vehicle, temporarily stores videos captured by the outward-facing camera 219 and the inward-facing camera 220, and stores the videos based on a save operation by a passenger. Hereinafter, the vehicle on which the in-vehicle device 200 is mounted is referred to as the "own vehicle".

[0018] [2. Configuration of In-vehicle Device 200] The configuration of the in-vehicle device 200 will be described with reference to FIG. 2. FIG. 2 is a block diagram showing a configuration example of the in-vehicle device 200.

[0019] The in-vehicle device 200 includes a storage unit 212 composed of a non-volatile memory (e.g., an SD memory card, etc.), a communication unit 213, a display unit 214, a touch panel 215, an in-vehicle microphone 216, a speaker 217, a GPS (Global Positioning System) receiver 218, an outward-facing camera 219, an inward-facing camera 220, and a save button 221.

[0020] The control unit 211 is composed of a CPU 211a that controls the entire control unit 211, a ROM 211b in which a control program for controlling the control unit 211 and the like are stored in advance, and a RAM 211c that temporarily stores various data. The control unit 211 or the CPU 211a corresponds to a "computer".

[0021] The storage unit 212 stores various programs such as an OS (Operating System) and application programs related to video storage processing and the like described later, as well as data and information used in various programs. Note that the various programs may be acquired from, for example, a server device or the like via a network, or those recorded on a recording medium such as a USB memory may be read.

[0022] Also, the storage unit 212 has a dedicated continuous recording area for temporarily storing continuously recorded videos, a recorded video storage area for storing recorded videos described later, and a memorable video storage area for storing memorable videos described later. These areas do not necessarily have to be continuous areas of the storage unit 212, and files stored separately are managed as one file by the OS. Note that by the OS, the continuously recorded videos stored in the dedicated continuous recording area are registered in the continuous recording folder, the recorded videos stored in the recorded video storage area are registered in the recorded video folder, and the memorable videos stored in the memorable video storage area are registered in the memorable video folder.

[0023] The dedicated continuous recording area stores a video with audio (the video with audio may be referred to as a "video" in some cases) that combines moving images captured by the outward-facing camera 219 and the inward-facing camera 220 of the vehicle, and the audio input to the in-vehicle microphone 216. The control unit 211 stores the video in the dedicated continuous recording area during the startup of the vehicle-mounted device 200. When the capacity of the dedicated continuous recording area is full, the oldest part is deleted and continuous recording is continued. That is, the dedicated continuous recording area (and by extension, the storage unit 212) temporarily stores (buffers) the video.

[0024] The recorded video is a cut-out of a part of the constantly recorded video, which is saved by the passenger's saving operation in case of an emergency. The memory video is a cut-out of a part of the constantly recorded video, which is saved by the passenger's saving operation when there is no emergency. The memory video is, for example, a video saved by the passenger as a memory of a drive, and is a video with the part where the saving operation was recorded deleted. Note that when the capacities of the recorded video storage area and the memory video storage area are full, the control unit 211 warns the passenger to that effect and prompts the deletion of unnecessary videos among the saved videos.

[0025] The communication unit 213 has a wireless communication device or the like, and communicates with an information processing device such as a server or a smartphone equipped with an external communication function to mutually transmit and receive data.

[0026] The display unit 214 includes a graphics controller 214a and a buffer memory 214b composed of a memory such as VRAM (Video RAM). In this configuration, the graphics controller 214a controls the display unit 214 and the touch panel 215 based on the control information sent from the control unit 211. Also, the buffer memory 214b temporarily stores image data that can be immediately displayed on each touch panel 215. Then, an image is displayed on the touch panel 215 based on the image data output from the graphics controller 214a.

[0027] The touch panel 215 displays an image based on the image data received from the display unit 214. Also, the touch panel 215 detects the user's touch operation and transmits touch operation data indicating the touched position and the like to the control unit 211. The control unit 211 discriminates which operation has been performed based on the touch operation data and performs processing according to the operation content.

[0028] The in-vehicle microphone 216 is provided inside the own vehicle, and converts the voices of the passengers inside the own vehicle into electrical signals and outputs them to the control unit 211.

[0029] Speaker 217 is provided inside the host vehicle and outputs sound under the control of the control unit 211.

[0030] The GPS receiver 218 receives navigation radio waves from GPS satellites, acquires latitude, longitude, altitude data, absolute azimuth data of the traveling direction, GPS speed data, etc., which are the current position information of the vehicle-mounted device 200, as GPS positioning data, and outputs it to the control unit 211.

[0031] The outward-facing camera 219 is mounted on the host vehicle, captures the outside of the vehicle, and outputs a moving image to the control unit 211.

[0032] The inward-facing camera 220 is mounted on the host vehicle, captures the inside of the vehicle, and outputs a moving image to the control unit 211.

[0033] When the save button 221 is pressed by the operator, it detects a save start operation for starting the saving of the video stored in the dedicated continuous recording area and a save stop operation for stopping the saving of the video stored in the dedicated continuous recording area, and outputs a detection signal to the control unit 211.

[0034] [3. Video Saving Process] Next, the video saving process will be described with reference to FIGS. 3-10. When the vehicle-mounted device 200 is activated, the control unit 211 starts shooting videos by the in-vehicle microphone 216, the outward-facing camera 219, and the inward-facing camera 220, and continues shooting videos until the vehicle-mounted device 200 stops. The video shooting records in the dedicated continuous recording area a video that combines the video outside the vehicle captured by the outward-facing camera 219, the video inside the vehicle captured by the inward-facing camera 220, and the audio captured by the in-vehicle microphone 216.

[0035] When the control unit 211 detects a save start operation for starting the saving of the video recorded in the always-on recording dedicated area by the passenger and a save stop operation for stopping the saving of the video, it cuts out a part of the video recorded in the always-on recording dedicated area and saves it to the recorded video storage area or the memory video storage area. Whether the control unit 211 saves it to the recorded video storage area or the memory video storage area is determined according to whether a danger condition (an example of the "predetermined condition") described later is satisfied during the period from the time t1, which is the time before the first predetermined time (for example, 20 seconds before) from the time t3 when the save start operation is detected, to the time t6 when the save stop operation is detected (the period from the time t1 to the time t6 is referred to as the danger condition determination period (an example of the "period")). Specifically, when the danger condition is satisfied during the danger condition determination period, the control unit 211 causes the video obtained by cutting out a part of the video recorded in the always-on recording dedicated area to be saved as a recorded video in the recorded video storage area. When the danger condition is not satisfied during the danger condition determination period, the control unit 211 cuts out a part of the video recorded in the always-on recording dedicated area and deletes the part where the save start operation and the save stop operation are recorded, and saves the partial video as a memory video in the memory video storage area.

[0036] Examples of the above-mentioned danger conditions include the following (1)-(3). (1) Detection of a dangerous vehicle A dangerous vehicle is, for example, a vehicle that is swerving or a vehicle that is performing disturbing driving (tailgating) on the host vehicle. The control unit 211 detects these swerving vehicles and tailgating vehicles by analyzing, for example, the video captured by the outward-facing camera 219 or the inward-facing camera 220. (2) Detection of a terrified expression or a scream of the passenger in the host vehicle The control unit 211 detects, for example, a terrified expression of the passenger by analyzing the video captured by the inward-facing camera 220, and detects a scream of the passenger by analyzing the audio captured by the in-vehicle microphone 216. (3) Detection of an impact on the host vehicle The control unit 211 detects an impact on the host vehicle, for example, by receiving a detection signal indicating that an impact has been detected from an impact sensor (not shown).

[0037] In addition, in order to detect dangerous vehicles and the terrified expressions and screams of the passengers in the host vehicle through the above-mentioned image analysis (1) and (2), an AI (Artificial Intelligence) program is introduced into the in-vehicle device 200, and the control unit 211 executes the AI program, so as to learn the operation patterns of dangerous vehicles from a plurality of videos in which dangerous vehicles are photographed, or learn the expression patterns of the terrified expressions of passengers and the voice patterns during screams from a plurality of videos in which the terrified expressions and screams of passengers are photographed, and constantly analyze the videos stored in the dedicated area for constant recording (for example, by comparing with the above-mentioned patterns) to detect dangerous vehicles, the terrified expressions and screams of passengers.

[0038] Next, as an example of the case of cutting out a part of the video recorded in the dedicated area for constant recording and saving the recorded video and the memory video, five cases will be described.

[0039] [3.1. Case 1] Case 1 will be described with reference to FIGS. 3-4. In Case 1, during the dangerous condition determination period (the period from time t1 to time t6), if the dangerous condition is satisfied, the control unit 211 saves the video corresponding to the dangerous condition determination period from the video recorded (buffered) in the dedicated area for constant recording as a recorded video in the recorded video storage area.

[0040] On the other hand, during the dangerous condition determination period (the period from time t1 to time t6), if the dangerous condition is not satisfied, the control unit 211 saves a partial video (memory video), which is a video obtained by deleting the parts corresponding to the save start operation and the save stop operation from the video (recorded video) corresponding to the dangerous condition determination period among the videos recorded (buffered) in the dedicated area for constant recording, in the memory video storage area.

[0041] As parts corresponding to the save start operation, it includes at least a part corresponding to the preliminary operation from when the operator starts the operation to press the save button 221 until pressing, and a part corresponding to the subsequent operation from when the save button 221 is pressed until returning to the original posture. In Case 1, the period corresponding to the preliminary operation is set as the period from time t2, which is a second predetermined time before (for example, 3 seconds before) the time t3 when the save start operation is detected, to time t3. Also, the period corresponding to the subsequent operation is set as the period from time t3 when the save start operation is detected to time t4, which is a third predetermined time after (for example, 2 seconds after) time t3. Note that in Case 1, the part corresponding to the period from time t1 to time t2 is also deleted as a part related to the save start operation. That is, in Case 1, the control unit 211 deletes the part corresponding to the period from time t1 to time t4 as a part corresponding to the save start operation.

[0042] Also, as parts corresponding to the save stop operation, it includes at least a part corresponding to the preliminary operation from when the operator starts the operation to press the save button 221 until pressing. In Case 1, the period corresponding to the preliminary operation is set as the period from time t5, which is a fourth predetermined time before (for example, 3 seconds before) the time t6 when the save stop operation is detected, to time t6. That is, in Case 1, the control unit 211 deletes the part corresponding to the period from time t5 to time t6 as a part corresponding to the save stop operation.

[0043] That is, in Case 1, the control unit 211 saves the part corresponding to the period from time t4 to time t5 in the memory video storage area as a memory video among the videos (recorded videos) corresponding to the dangerous condition determination period.

[0044] Next, an example of the video saving process in Case 1 will be described using the flowchart of FIG. 4. Note that the control unit 211 executes a continuous recording process of recording, in a continuous recording dedicated area, a video that combines an external vehicle video captured by the outward vehicle camera 219, an internal vehicle video captured by the inward vehicle camera 220, and audio captured by the in-vehicle microphone 216, separately from the processes shown in this flowchart.

[0045] First, the control unit 211 determines whether or not a save start operation has been detected (step S101). If the control unit 211 determines that the save start operation has not been detected (step S101: NO), it repeats step S101 again. That is, the control unit 211 repeats step S101 until the save start operation is detected. On the other hand, if the control unit 211 determines that the save start operation has been detected (step S101: YES), it then determines whether or not a save stop operation has been detected (step S102).

[0046] If the control unit 211 determines that the save stop operation has not been detected (step S102: NO), it repeats step S102 again. That is, the control unit 211 repeats step S102 until the save stop operation is detected. On the other hand, if the control unit 211 determines that the save stop operation has been detected (step S102: YES), it then extracts (cuts out) a video corresponding to the period from a first predetermined time before the save start operation to the save stop operation (time t1 to time t6) from the videos stored in the recorded video storage area (step S103).

[0047] Next, the control unit 211 determines whether or not a danger condition has been satisfied during the danger condition determination period (step S104). If it is determined that the danger condition has been satisfied during the danger condition determination period (step S104: YES), the video extracted in the process of step S103 is saved in the recorded video storage area (step S105), and the video saving process ends.

[0048] On the other hand, if the control unit 211 determines that the danger condition has not been satisfied during the danger condition determination period (step S104: NO), a partial video (a video corresponding to the period from time t4 to time t5) obtained by deleting a portion corresponding to the period from a first predetermined time before the save start operation to a third predetermined time after the save start operation (time t1 to time t4) and a portion corresponding to the period from a fourth predetermined time before the save stop operation to the save stop operation (time t5 to time t6) from the video extracted in the process of step S103 is saved in the memory video storage area (step S106), and the video saving process ends.

[0049] [3.2. Case 2] Using FIGS. 5-6, Case 2 will be described. Here, the description of the same points as in Case 1 will be omitted, and the description will focus on the differences from Case 1.

[0050] In Case 1, the memory video is obtained by deleting from the recorded video (the video corresponding to the period from time t1 to time t6) the portion corresponding to the period from time t1 to time t4 and the portion corresponding to the period from time t5 to time t6. In contrast, as shown in FIG. 5, the memory video in Case 2 is obtained by deleting from the recorded video (the video corresponding to the period from time t1 to time t6) the portion corresponding to the period from time t2 to time t4 and the portion corresponding to the period from time t5 to time t6, and the portion A corresponding to the period from time t1 to time t2 is not deleted. That is, the control unit 211 stores, in the memory video storage area, as the memory video, a video obtained by joining the portion A corresponding to the period from time t1 to time t2 and the portion B corresponding to the period from time t4 to time t5. As a result, since the memory video including the portion corresponding to the period from time t1 to time t2 is stored, it is possible to include in the memory video a portion corresponding to, for example, the lively state inside the vehicle or the beautiful scenery outside the vehicle before the save start operation is performed.

[0051] Next, an example of the video saving process in Case 2 will be described using the flowchart of FIG. 6. Case 2 differs from Case 1 in that step S106 in Case 1 is changed to step S106-2. That is, when the control unit 211 determines that the danger condition is not satisfied during the danger condition determination period (step S104: NO), from the video extracted in the process of step S103, the part corresponding to the period from the second predetermined time before the save start operation to the third predetermined time after the save start operation, and the part corresponding to the period from the fourth predetermined time before the save stop operation to the save stop operation are deleted, and the partial video (the video obtained by joining the video corresponding to the period from time t1 to time t2 in FIG. 4 and the video corresponding to the period from time t4 to time t5) is saved in the memory video storage area (step S106-2), and the video saving process is terminated.

[0052] [3.3. Case 3] Case 3 will be described with reference to FIGS. 7-8. Here, the description of the same points as in Case 1 will be omitted, and the description will focus on the differences from Case 1.

[0053] In Case 1, the danger condition determination period was the period from time t1, which is the first predetermined time before (for example, 20 seconds before) the time t3 when the save start operation was detected, to time t6 when the save stop operation was detected. However, in Case 2, as shown in FIG. 7, the danger condition determination period is the period from time t1, which is the first predetermined time before (for example, 20 seconds before) the time t3 when the save start operation was detected, to time t7, which is the fifth predetermined time after (for example, 90 seconds after) the time t3 when the save stop operation was detected. That is, in Case 3, if the operator performs the save start operation, there is no need to perform the save stop operation, and the video corresponding to the period from the save start operation to the fifth predetermined time after (for example, 90 seconds after) is saved as the recorded video or the memory video. In Case 3, since the save stop operation is not performed, the partial video (the video corresponding to the period from time t4 to time t7) obtained by deleting the part corresponding to the save start operation from the recorded video corresponding to the danger condition determination period without deleting the part corresponding to the save stop operation is saved in the memory video storage area.

[0054] Next, using the flowchart of FIG. 8, an example of the video saving process in Case 3 will be described. In Case 3, it is different in that step S102 of Case 1 is changed to step S102-2, step S103 of Case 1 is changed to step S103-2, and step S106 of Case 1 is changed to step S106-3.

[0055] That is, when the control unit 211 determines that a saving start operation has been detected (step S101: YES), it then determines whether or not a fifth predetermined time has elapsed since the saving start operation (step S102-2).

[0056] When the control unit 211 determines that the fifth predetermined time has not elapsed since the saving start operation (step S102-2: NO), it repeats step S102 again. That is, the control unit 211 repeats step S102-2 until the fifth predetermined time elapses since the saving start operation. On the other hand, when the control unit 211 determines that the fifth predetermined time has elapsed since the saving start operation (step S102-2: YES), it then extracts (cuts out) a video corresponding to the period from the first predetermined time before the saving start operation to after the fifth predetermined time has elapsed since the saving start operation from the videos stored in the recorded video storage area (step S103-2).

[0057] Also, when the control unit 211 determines that a danger condition has not been satisfied during the danger condition determination period (step S104: NO), it saves a partial video (a video corresponding to the period from time t4 to time t7 in FIG. 7) in which a portion corresponding to the period from the first predetermined time before the saving start operation to the third predetermined time after the saving start operation has been deleted from the video extracted in the process of step S103-2 in the reminder video storage area (step S106-3), and ends the video saving process.

[0058] In case 3, saving is stopped when the condition that a fifth predetermined time has elapsed since the saving start operation is satisfied. Also, in case 1, saving is stopped when the condition that a saving stop operation is detected is satisfied. Therefore, these conditions are conditions for stopping saving and are an example of "predetermined saving stop conditions".

[0059] [3.4. Case 4] Case 4 will be described with reference to FIGS. 9-10. Here, descriptions of the same points as in case 1 will be omitted, and the description will focus on the differences from case 1.

[0060] In case 1, the control unit 211 detected a saving start operation or a saving stop operation based on a pressing operation by the operator on the saving button 221. However, in case 4, it is detected by a voice operation by the operator. Specifically, the control unit 211 detects a saving start operation or a saving stop operation by recognizing a keyword corresponding to the saving start operation (for example, "saving start") or a keyword corresponding to the saving stop operation (for example, "saving stop") via the in-vehicle microphone 216. In the case of a voice operation, as shown in FIG. 9, the part where the voice is emitted corresponds to the above-described preliminary operation, and there is no operation corresponding to the above-described subsequent operation. Therefore, in case 4, from the video recorded (buffered) in the dedicated area for continuous recording and corresponding to the dangerous condition determination period (recorded video), the period from time t2 to time t3 corresponding to the voice operation corresponding to the preliminary operation, and the part corresponding to the period from time t5 to time t6 are deleted. In FIG. 9, similar to case 1, the part corresponding to the period from time t1 to time t2 is also deleted as a part related to the saving start operation, and the partial video corresponding to the period from time t3 to time t5 is saved in the memory video storage area. However, similar to case 2, it is also possible to save in the memory video storage area a video obtained by joining the part corresponding to the period from time t1 to time t2 and the part corresponding to the period from time t3 to time t5 without deleting the part corresponding to the period from time t1 to time t2.

[0061] Note that the second predetermined time and the fourth predetermined time corresponding to the pre-operation in Case 1 may be different from the second predetermined time and the fourth predetermined time corresponding to the pre-operation (voice operation) in Case 4. Specifically, since the pre-operation from when the operator starts the operation to press the save button 221 until pressing is considered to be longer than the time when the operator vocalizes "save start" by voice, the second predetermined time and the fourth predetermined time corresponding to the pre-operation in Case 1 may be set longer than the second predetermined time and the fourth predetermined time corresponding to the pre-operation (voice operation) in Case 4.

[0062] Next, an example of the video saving process in Case 4 will be described using the flowchart of FIG. 10. Case 4 is different in that step S106 in Case 1 is changed to step S106-4.

[0063] That is, when the control unit 211 determines that the danger condition is not satisfied during the danger condition determination period (step S104: NO), the control unit 211 deletes from the video extracted in the process of step S103 the portion corresponding to the period from the first predetermined time before the save start operation to the save start operation and the portion corresponding to the period from the fourth predetermined time before the save stop operation to the save stop operation, and saves the partial video (the video corresponding to the period from time t3 to time t5 in FIG. 9) in the recall video storage area (step S106-4), and ends the video saving process.

[0064] [3.5. Case 5] In Cases 1-4, in order to delete the pre-operation and post-operation of the save start operation and the portion corresponding to the pre-operation of the save stop operation, the second predetermined time, the third predetermined time, and the fourth predetermined time with a slight margin time (margin) added to the average time related to these operations are set, and the portions corresponding to these predetermined times are deleted.

[0065] In contrast, in Case 5, the pre-operations and post-operations of the save start operation, and the parts corresponding to the pre-operation of the save stop operation are identified and deleted by analyzing the video recorded in the dedicated continuous recording area. Specifically, the control unit 211 learns the operation patterns from a plurality of videos that captured the pre-operations and post-operations when the save button 221 was pressed by executing the above-mentioned AI program. When the save start operation and the save stop operation are detected by the detection signal from the save button 221, the parts corresponding to the pre-operations and post-operations are identified and deleted from the video recorded in the dedicated continuous recording area.

[0066] Next, an example of the video saving process in Case 5 will be described using the flowchart of FIG. 11. Case 5 is different in that step S106 of Case 1 is changed to steps S110 - S111.

[0067] That is, when the control unit 211 determines that the danger condition is not satisfied during the danger condition determination period (step S104: NO), it identifies, from the video extracted in the process of step S103, the parts corresponding to the pre-operations and post-operations of the save start operation and the part corresponding to the pre-operation of the save stop operation by the function of the AI program (step S110).

[0068] Next, the control unit 211 saves the partial video obtained by deleting the parts identified in step S110 from the video extracted in the process of step S103 to the reminder video storage area (step S106-4), and ends the video saving process.

[0069] As described above, in the in-vehicle device 200 of the present embodiment, the storage unit 212 (an example of the "storage means") temporarily stores the videos being shot by the outward-facing camera 219 (an example of the "in-vehicle camera") and the inward-facing camera 220 (an example of the "in-vehicle camera"). The control unit 211 (an example of the "storage start operation detection means" and the "storage means") detects a storage start operation for starting the storage of a part of the videos stored in the storage unit 212. If a danger condition (an example of the "predetermined condition") is satisfied during the danger condition determination period (an example of the "period from before the first predetermined time when the storage start operation is detected until a predetermined storage stop condition for stopping the storage is satisfied"), the recorded video corresponding to the danger condition determination period is stored. If the danger condition is not satisfied during the danger condition determination period, a partial video, which is a video obtained by deleting at least the part corresponding to the storage start operation from the video corresponding to the danger condition determination period, is stored as a recall video.

[0070] Therefore, according to the in-vehicle device 200, if the danger condition is satisfied during the danger condition determination period, the recorded video corresponding to that period shot by the outward-facing camera 219 and the inward-facing camera 220 is stored as it is. If the danger condition is not satisfied, a recall video (an example of the "partial video") obtained by deleting at least the part corresponding to the storage start operation from the video corresponding to that period shot by the outward-facing camera 219 and the inward-facing camera 220 is stored. That is, when the danger condition corresponding to an emergency is satisfied, the videos shot by the outward-facing camera 219 and the inward-facing camera 220 can be stored including the part corresponding to the storage start operation as the recorded video during the emergency. When the danger condition corresponding to an emergency is not satisfied, the videos shot by the outward-facing camera 219 and the inward-facing camera 220 can be stored as recall videos after deleting the part corresponding to the storage start operation. In addition, the use of the in-vehicle device 200 as a drive recorder can be utilized not only for the "recording during an emergency" use but also for the "recording of memories" use more easily. Furthermore, since the data size of the recall video becomes smaller, the time and communication costs, etc. when transmitting the data to other devices such as a server or a smartphone can be reduced, and the storage area used when various devices store the data can also be reduced.

[0071] In addition, in the in-vehicle device 200 of this embodiment, the control unit 211 (an example of the "storage stop operation detection means") detects a storage stop operation for stopping the storage started based on the storage start operation, and the condition for stopping the storage (an example of the "predetermined storage stop condition") is that the control unit 211 detects the storage stop operation. When the danger condition is not satisfied during the danger condition determination period, the control unit 211 stores a memory video obtained by deleting the portions corresponding to the storage start operation and the storage stop operation.

[0072] Therefore, according to the in-vehicle device 200, when the danger condition is satisfied during the danger condition determination period, the recorded video corresponding to that period captured by the outward-facing camera 219 and the inward-facing camera 220 is stored as it is. When the danger condition is not satisfied, a memory video obtained by deleting the portions corresponding to the storage start operation and the storage stop operation from the video corresponding to that period captured by the outward-facing camera 219 and the inward-facing camera 220 is stored. That is, when the danger condition corresponding to an emergency is satisfied, the video captured by the outward-facing camera 219 and the inward-facing camera 220 can be stored as the recorded video during the emergency, including the portions corresponding to the storage start operation and the storage stop operation. When the danger condition corresponding to an emergency is not satisfied, the video captured by the outward-facing camera 219 and the inward-facing camera 220 can be stored as a memory video after deleting the portions corresponding to the storage start operation and the storage stop operation.

[0073] In case 2 of the video storage process in this embodiment, when the control unit 211 determines that the danger condition is not satisfied during the danger condition determination period, as a portion corresponding to the storage start operation, the control unit 211 stores a memory video obtained by deleting the portion from the second predetermined time before the storage start operation is detected to the third predetermined time after the storage start operation is detected. Thereby, it is possible to store a memory video obtained by deleting the portion where the pre-operation and the post-operation of the storage start operation are considered to be recorded.

[0074] Furthermore, in Case 1 of the video storage process in this embodiment, when the control unit 211 determines that the danger condition is not satisfied during the danger condition determination period, as a part corresponding to the storage start operation, it causes to store a memory video obtained by deleting a part from the time three predetermined times before the storage start operation is detected to the time three predetermined times after the storage start operation is detected. Thereby, it is possible to store a memory video obtained by deleting a part that is considered to record the pre-operation and post-operation of the storage start operation.

[0075] Furthermore, in Cases 1, 2, and 4 of the video storage process in this embodiment, when the control unit 211 determines that the danger condition is not satisfied during the danger condition determination period, as a part corresponding to the storage stop operation, it causes to store a memory video obtained by deleting a part from the time four predetermined times before the storage stop operation is detected to the time when the storage stop operation is detected. Thereby, it is possible to store a memory video obtained by deleting a part that is considered to record the pre-operation of the storage stop operation.

[0076] Furthermore, in Case 5 of the video storage process in this embodiment, the control unit 211 (an example of "specific means") analyzes the videos captured by the outward-facing camera 219 and the inward-facing camera 220, and identifies parts corresponding to the storage start operation and the storage stop operation in the videos stored in the dedicated always-recording area (step S110 in FIG. 11). When the danger condition is not satisfied during the danger condition determination period, as parts corresponding to the storage start operation and the storage stop operation, it causes to store a memory video obtained by deleting the parts identified in step S110 in FIG. 11.

[0077] Furthermore, in this embodiment, the danger condition is that the control unit 211 detects a dangerous vehicle. The control unit 211 (an example of "dangerous vehicle detection means") analyzes the videos captured by the outward-facing camera 219 and the inward-facing camera 220, and detects a dangerous vehicle that is performing dangerous driving around the own vehicle (an example of "a vehicle equipped with an in-vehicle camera"). Thereby, when a dangerous vehicle is detected, it is possible to store the recorded video.

[0078] Furthermore, in this embodiment, the dangerous condition is that the control unit 211 detects a frightened expression (an example of "the predetermined action by the passenger") or a scream (an example of "the predetermined voice by the passenger") of the passenger. The control unit 211 (an example of "detection means") analyzes the videos captured by the outward-facing camera 219 and the inward-facing camera 220 of the vehicle, and detects at least one of a frightened expression of the passenger in the own vehicle (an example of "the vehicle equipped with the in-vehicle camera") and a scream of the passenger. Thereby, the recorded video can be saved in a dangerous situation where a frightened expression or a scream of the passenger is detected.

[0079] Furthermore, in this embodiment, the dangerous condition is that the control unit 211 detects an impact on the own vehicle. Based on receiving a detection signal indicating that the control unit 211 (an example of "impact detection means") has detected an impact from an impact sensor (not shown), the control unit 211 detects an impact on the own vehicle. Thereby, the recorded video can be saved when an impact is applied to the own vehicle.

[0080] Furthermore, as shown in FIG. 12(A), in the in-vehicle device 200 of this embodiment, the control unit 211 saves the recorded video to be saved when the dangerous condition is satisfied during the dangerous condition determination period and the memory video to be saved when the dangerous condition is not satisfied during the dangerous condition determination period in a recorded video folder and a memory video folder, which are different folders in the same storage unit 212, respectively. Thereby, since the recorded video and the memory video are saved in different folders, it is easy to find a desired video when using the video.

[0081] [4. Modification Example] A modification example of this embodiment will be described. Note that the modification examples can be combined as appropriate.

[0082] [4.1. Modification Example 1] As Modification Example 1, the control unit 211 may save the recorded video to be saved when the dangerous condition is satisfied during the dangerous condition determination period and the memory video to be saved when the dangerous condition is not satisfied during the dangerous condition determination period in different storage units, respectively.

[0083] For example, the in-vehicle device 200 may be provided with a plurality of storage units, and each may store the recorded video and the memory video separately.

[0084] Also, as shown in FIG. 12(B), the control unit 211 may cause the recorded video to be stored in the storage unit 412 of the server 400 connected to the in-vehicle device 200 via a communication line. Thereby, the recorded video stored in the storage unit 212 is not erased due to a failure or incorrect operation of the in-vehicle device 200, and the recorded video can be preserved. Further, the control unit 211 may cause the memory video to be stored in the storage unit 412 of the server 400 instead of the recorded video, or may cause both the recorded video and the memory video to be stored in the storage unit 412 of the server 400. When storing in the storage unit 412 of the server 400, by also storing in the storage unit 212, it can be stored in both the in-vehicle device 200 and the server 400, and the video can be stored more securely.

[0085] [4.2. Modification Example 2] As a modification example 2, the control unit 211 may further store the recorded video when the danger condition is not satisfied during the danger condition determination period. That is, during the danger condition determination period, whether the danger condition is satisfied or not, the recorded video is to be stored. Specifically, the control unit 211 executes steps S106 in FIG. 4, step S106-2 in FIG. 6, step S106-3 in FIG. 8, step S106-4 in FIG. 10, and steps S110 - S111 in FIG. 11, after step S105 in the same figure respectively. Thereby, when the part that should not be deleted is included in the part deleted when storing the memory video, that part can be taken out from the recorded video.

Explanation of Reference Numerals

[0086] 100: Information Processing Apparatus 101: Storage Means 102: Storage Start Operation Detection Means 103: Storage Means 200: In-vehicle Device 211: Control Unit 211a: CPU 211b: ROM 211c: RAM 212: Memory unit 213: Communication unit 214: Display unit 214a: Graphics controller 214b: Buffer memory 215: Touch panel 216: In-vehicle microphone 217: Speaker 218: GPS receiver 219: Exterior-facing camera 220: Interior-facing camera 221: Save button 400: Server 412: Memory unit

Claims

1. A storage means for temporarily storing a video being shot by an in-vehicle camera; A storage start operation detection means for detecting a storage start operation for starting storage of a part of the video stored in the storage means; If a predetermined condition is satisfied during the period from a first predetermined time before the storage start operation is detected until a predetermined storage stop condition for stopping the storage is satisfied, the video corresponding to the period is stored. If the predetermined condition is not satisfied during the period, a partial video, which is a video obtained by deleting at least the part corresponding to the storage start operation from the video corresponding to the period, is stored; An information processing apparatus comprising the above.

2. The information processing apparatus according to Claim 1, comprising a storage stop operation detection means for detecting a storage stop operation for stopping the storage started based on the storage start operation, wherein the predetermined storage stop condition is that the storage stop operation detection means detects the storage stop operation, and the storage means stores the partial video obtained by deleting the parts corresponding to the storage start operation and the storage stop operation if the predetermined condition is not satisfied during the period. An information processing apparatus characterized by this.

3. The information processing apparatus according to Claim 1, wherein the storage means stores the partial video obtained by deleting, as the part corresponding to the storage start operation, the part from a second predetermined time before the storage start operation is detected until a third predetermined time after the storage start operation is detected if the predetermined condition is not satisfied during the period. An information processing apparatus characterized by this.

4. The information processing apparatus according to Claim 1, wherein the storage means stores the partial video obtained by deleting, as the part corresponding to the storage start operation, the part from a first predetermined time before the storage start operation is detected until a third predetermined time after the storage start operation is detected if the predetermined condition is not satisfied during the period. An information processing apparatus characterized by this.

5. The information processing apparatus according to Claim 2, When the predetermined condition is not satisfied during the period, the storage means stores, as a part corresponding to the storage stop operation, a partial video obtained by deleting a part from a fourth predetermined time before the storage stop operation is detected until the storage stop operation is detected. An information processing apparatus characterized by the above.

6. The information processing apparatus according to claim 1, comprising specifying means for analyzing a video captured by the in-vehicle camera and specifying a part corresponding to the storage start operation in the video; When the predetermined condition is not satisfied during the period, the storage means stores, as a part corresponding to the storage start operation, a partial video obtained by deleting the part specified by the specifying means. An information processing apparatus characterized by the above.

7. The information processing apparatus according to claim 2, comprising specifying means for analyzing a video captured by the in-vehicle camera and specifying a part corresponding to the storage stop operation in the video; When the predetermined condition is not satisfied during the period, the storage means stores, as a part corresponding to the storage stop operation, a partial video obtained by deleting the part specified by the specifying means. An information processing apparatus characterized by the above.

8. The information processing apparatus according to claim 1, comprising dangerous vehicle detection means for analyzing a video captured by the in-vehicle camera and detecting a dangerous vehicle performing dangerous driving around the vehicle on which the in-vehicle camera is mounted; The predetermined condition is that the dangerous vehicle detection means detects the dangerous vehicle. An information processing apparatus characterized by the above.

9. The information processing apparatus according to claim 1, comprising detection means for analyzing a video captured by the in-vehicle camera and detecting at least one of a predetermined action by a passenger of the vehicle on which the in-vehicle camera is mounted and a predetermined utterance by the passenger; The predetermined condition is that the detection means detects at least one of the predetermined action by the passenger and the predetermined utterance by the passenger. An information processing apparatus characterized by the above.

10. The information processing apparatus according to claim 1, comprising impact detection means for detecting an impact on the vehicle on which the in-vehicle camera is mounted; The predetermined condition is that the detection means detects the impact. An information processing apparatus characterized by the above.

11. The information processing apparatus according to claim 1, The storage means stores at least one of the video to be stored when the predetermined condition is satisfied during the period and the partial video to be stored when the predetermined condition is not satisfied during the period in an external storage means different from the storage means. An information processing apparatus characterized by this.

12. An information processing apparatus according to claim 1, wherein the storage means stores the video to be stored when the predetermined condition is satisfied during the period and the partial video to be stored when the predetermined condition is not satisfied during the period in different folders of the same storage means, respectively. An information processing apparatus characterized by this.

13. An information processing apparatus according to claim 1, wherein the storage means further stores the video corresponding to the period when the predetermined condition is not satisfied during the period. An information processing apparatus characterized by this.

14. An information processing method by an information processing apparatus including a storage means for temporarily storing a video being shot by an in-vehicle camera and a storage start operation detection means for detecting a storage start operation for starting storage of a part of the video stored in the storage means, a storage step of storing the video corresponding to the period when a predetermined condition is satisfied during the period from a first predetermined time before the storage start operation is detected until a predetermined storage stop condition for stopping the storage is satisfied, and storing a partial video, which is a video obtained by deleting at least a part corresponding to the storage start operation from the video corresponding to the period, when the predetermined condition is not satisfied during the period, characterized by including this.

15. A computer included in an information processing apparatus including a storage means for temporarily storing a video being shot by an in-vehicle camera and a storage start operation detection means for detecting a storage start operation for starting storage of a part of the video stored in the storage means, a storage means for storing the video corresponding to the period when a predetermined condition is satisfied during the period from a first predetermined time before the storage start operation is detected until a predetermined storage stop condition for stopping the storage is satisfied, and storing a partial video, which is a video obtained by deleting at least a part corresponding to the storage start operation from the video corresponding to the period, when the predetermined condition is not satisfied during the period, An information processing program characterized by causing it to function as

Images