Photographing apparatus, system, and program

Abstract

To provide a photographing apparatus or the like capable of executing appropriate processing when the photographing apparatus detects a predetermined trigger.SOLUTION: The photographing apparatus comprises: a photographing unit which photographs an image; a control unit which in a case of detecting a predetermined trigger, records an image photographed by the photographing unit in a predetermined recording destination; and a setting unit which sets a recording time. The control unit generates as a predetermined image an image based on the recording time on the basis of the image photographed by the photographing unit.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to an imaging device and the like. [Background technology]

[0002] As an example of an image capturing device, an image capturing device that is installed on a vehicle so as to capture the front of the vehicle is known.

[0003] The following inventions have been disclosed as imaging devices. For example, Patent Document 1 transmits vehicle status data to a server device. The server device determines whether to specify overwrite prohibition for video files that are being cyclically recorded by the vehicle based on the transmitted status data. Then, based on the result of this determination, the imaging device specifies overwrite prohibition for the video data. This discloses an invention that can reliably prohibit overwriting of video data that should be prohibited from being overwritten, while permitting overwriting of video data that does not necessarily need to be prohibited from being overwritten. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2018-136992 A Summary of the Invention [Problem to be solved by the invention]

[0005] For example, a first problem with the conventional technology was that when a photographing device was capable of recording video data onto multiple recording media, if the photographing device detected a specific trigger while recording video data, it was not possible to select an appropriate recording medium in response to the trigger.

[0006] Also, for example, a second problem with the conventional technology was that when a photographing device was connectable to another terminal device, etc., when the photographing device detected a trigger, it was not possible to send various notifications to the terminal device based on the video data.

[0007] In view of the above-mentioned problems, one object of the present invention is to provide an image capturing apparatus and the like that can execute appropriate processing when the image capturing apparatus detects a predetermined trigger.

[0008] The object of the present invention is not limited to this, and the applicant intends to obtain rights for configurations that aim to obtain effects from parts of the configurations disclosed in this specification and drawings, etc., by filing a divisional application, amendment, etc. For example, this specification discloses problems in which the parts described as "can" and "is possible" in this specification are read as "is the problem." The problems are described as being independent, and the applicant intends to obtain rights for the configurations for solving each problem separately by filing a divisional application, amendment, etc. Even if the problems are implicitly understood from the description in the specification, the applicant intends to include part of the configurations described in this specification in the scope of the patent claim by amendment or divisional application. In addition, the applicant has disclosed a configuration that solves a problem that combines these independent problems, and intends to obtain rights for it. [Means for solving the problem]

[0009] (1) In view of the above-mentioned problems, the photographing device of this embodiment is characterized by having an photographing unit that photographs video, and a control unit that records a first video in a first recording destination and, when a predetermined trigger is detected while recording the first video, records a second video in a second recording destination.

[0010] In this way, when the image capturing device detects a predetermined trigger while normally recording an image in a first recording destination in response to a trigger, the image capturing device can record a second image in a second recording destination. Therefore, the image capturing device can separate recording destinations or switch recording destinations based on the detection of a trigger.

[0011] (2) In the photographing device of this embodiment, the control unit detects a trigger based on the image.

[0012] In this way, the image capturing device can detect a trigger based on the captured image, and can separate or switch recording destinations based on the captured image.

[0013] (3) Furthermore, in the photographing device of this embodiment, the control unit is characterized in that it detects a trigger when a moving object is included in the image or when the movement of the moving object included in the image is a predetermined movement.

[0014] In this way, the image capturing device can recognize a moving object in the image and detect a trigger according to the movement of the moving object. For example, if the moving object is a vehicle, the image capturing device can detect a trigger based on the movement of a vehicle other than the captured vehicle.

[0015] (4) Furthermore, in the photographing device of this embodiment, the photographing unit is provided in a vehicle, and the control unit recognizes other vehicles included in the image and detects a trigger when the other vehicles approach the vehicle under specified conditions.

[0016] In this way, the image capturing device can detect the approach of another vehicle to the vehicle as a trigger, and can therefore detect dangerous driving such as tailgating as a trigger and switch or separate the recording destination.

[0017] (5) Furthermore, the photographing device of this embodiment is characterized in that it further includes a vehicle information acquisition unit that acquires vehicle information, and the control unit detects a trigger based on the acquired vehicle information.

[0018] In this way, for example, the image capturing device can detect a trigger when an abnormality occurs in the vehicle based on the vehicle information, and can switch or separate the recording destination.

[0019] (6) Furthermore, in the photographing device of this embodiment, the photographing device is installed in a vehicle, the vehicle information acquisition unit acquires at least one of information regarding speed, acceleration, and engine as vehicle information from the vehicle, and the control unit detects a trigger when the vehicle information satisfies a predetermined condition.

[0020] In this way, the image capturing device can obtain information about the vehicle, etc. in which the image capturing device is installed, and detect a trigger based on the information about the vehicle, etc. For example, the image capturing device can detect, as a trigger, when a speed is detected to be equal to or greater than a predetermined speed, when an acceleration occurs to be equal to or greater than a predetermined acceleration, when the engine state is a value indicating an abnormality, etc.

[0021] (7) Furthermore, the photographing device of this embodiment is characterized in that it further comprises a location information acquisition unit that acquires location information, and the control unit detects a trigger based on the acquired location information.

[0022] In this way, the image capturing device can detect a trigger such as when the image capturing device reaches a predetermined position or when information obtainable from the position information (for example, information related to speed, address, or facility) is used as a trigger.

[0023] (8) Furthermore, the photographing device of this embodiment has an operation unit that accepts operational input by a user, and the control unit is characterized in that it detects a trigger when the operation unit accepts operational input by the user.

[0024] In this way, it becomes possible to detect a trigger based on an operation input input by the user at any time. Therefore, when the user feels that the vehicle is being tailgated, the user can simply operate the operation unit at any time to easily record the video separately.

[0025] (9) Furthermore, in the photographing device of this embodiment, the operation unit has a plurality of operation buttons, and the control unit detects a trigger when an operation input is received from an operation button that is in a special state among the operation buttons.

[0026] In this way, in addition to the normal operation buttons, when the user wishes to detect a trigger, the user can easily notify the trigger by operating a dedicated operation button that is in a special state.

[0027] (10) Furthermore, in the photographing device of this embodiment, the control unit is characterized in that each time the operating unit in the special state is operated once, the control unit extends the recording time both before and after the trigger detection, and extends the forward time longer than the backward time.

[0028] In this way, even if the user is late in operating the operation unit in a special state, the video captured at a predetermined time point can be secondly recorded.

[0029] (11) Furthermore, in the photographing device of this embodiment, a setting unit is further provided for setting a recording time, and the control unit is characterized in that it generates an image based on the recording time as the second image based on the image photographed by the photographing unit.

[0030] In this way, it is possible to generate a second image based on the recording time as a different image from the image captured by the imaging section.

[0031] (12) In the imaging device of this embodiment, the setting unit sets a first time period that is set from the time a trigger is generated as the recording time.

[0032] In this way, the image capturing device can generate an image for a set first time period from the captured image, based on the trigger occurrence time. In addition, the generated image is an image for the first time period, but may have a smaller resolution or a smaller size than a normal image (image captured by the image capturing unit), for example.

[0033] (13) Also, in the photographing device of this embodiment, the setting unit is characterized in that it sets the recording time to the first time period from a time going back to before the occurrence of the trigger by the set second time period.

[0034] In this way, the image capturing device records video before detecting the trigger, which makes it possible to also record the behavior or the like that caused the actual trigger to be detected.

[0035] (14) In addition, the photographing device of this embodiment is characterized in that it further comprises a communication unit that communicates with a terminal device, and the second recording destination is the terminal device.

[0036] In this way, the image capturing device can transmit an image to the terminal device when the trigger is detected. Also, the user can check the image transmitted from the image capturing device on the terminal device.

[0037] (15) In addition, in the photographing device of this embodiment, the photographing device according to claim 1 further includes a communication unit that communicates with a terminal device, and when the control unit detects the trigger, the photographing device notifies the terminal device via the communication unit.

[0038] In this way, when a trigger is detected, it is possible to notify the terminal device of the video, and the terminal device can therefore perform, for example, a notification operation based on the notification.

[0039] (16) Furthermore, in the photographing device of this embodiment, a first recording medium and a second recording medium are connected to record the image, and the first recording destination is the first recording medium and the second recording destination is the second recording medium.

[0040] In this way, the image capturing device can record the image on a plurality of recording media. When the image capturing device detects a trigger, the image capturing device can record the image on the second recording medium. Here, the image may be recorded by switching from the first recording medium to the second recording medium, or the image may be recorded on the second recording medium while recording the image on the first recording medium.

[0041] (17) In the photographing device of this embodiment, the control unit is characterized in that, when reading out a different image from the recording medium on which the image is recorded, the control unit switches the recording medium on which the image is recorded.

[0042] In this way, when the image capturing device reads out further images from the recording medium on which the image is recorded, the recording medium on which the image is recorded can be switched, thereby enabling the image capturing device to record images stably.

[0043] (18) In the system of this embodiment, the system includes an imaging device and a terminal device, wherein the imaging device includes an imaging unit that captures video, a control unit that records the video on a recording medium, a trigger detection unit that detects a trigger, and a transmission unit that transmits a command to the terminal device when the trigger is detected, and the terminal device includes a receiving unit that receives commands from the terminal device, and a control unit that performs notification based on the command.

[0044] In this way, a command can be transmitted to the terminal device based on the trigger detected by the image capture device. The terminal device can perform a notification based on the command received from the image capture device. Therefore, the user can understand, on the terminal device, the content based on the trigger detected by the image capture device.

[0045] (19) In the system of this embodiment, the terminal device is provided with a display unit, and the control unit causes the display unit to display based on the command.

[0046] In this way, the terminal device can display information based on the command, and the user can understand the trigger detected by the image capture device, the contents of the warning, and the like by looking at the display content on the terminal device.

[0047] (20) Also, in the system of this embodiment, the command includes the image captured when the trigger is detected, and the control unit displays the image included in the command on the display unit.

[0048] In this way, the image when the trigger is detected can be confirmed on the terminal device. Also, the image can be saved on the terminal device or on the cloud.

[0049] (21) Furthermore, in the system of this embodiment, the system further includes a server device, and the control unit of the terminal device is characterized in that when a transmission condition to the server is matched based on the command, the control unit transmits information based on the command to the server device.

[0050] In this way, information based on the command can be sent to a server device or service to which the terminal device is connected. For example, video can be stored in a server device or automatically posted to an SNS service.

[0051] (22) The system of this embodiment is a system including a photographing device having a first control unit and a server device having a second control unit, wherein the photographing device has a photographing unit that photographs video and a recording unit that records the video on a recording medium, the first control unit transmits log data to the server device, the second control unit of the server device receives the log data from the photographing device, analyzes the log data, and determines whether or not the log data meets a required condition, and if the required condition is met, transmits a request command to the photographing device, and when the first control unit of the photographing device receives a request command from the server device, it executes processing according to the request command.

[0052] In this way, the server device can determine whether or not it is necessary to request processing based on the log data transmitted from the image capture device. If the server device needs to make the image capture device perform processing, it can transmit a request command. In other words, the server device can detect the trigger.

[0053] (23) Also, in the system of this embodiment, the second control unit of the server device sends a request command to the imaging device requesting the transmission of previously recorded footage based on the satisfaction of the request conditions, and the first control unit of the imaging device sends the footage identified in accordance with the request command to the server device.

[0054] In this way, the server device can request the image capture device to transmit the image as a trigger. For example, when an administrator of the server device judges it necessary based on the log data, or when the server device automatically judges it necessary to store the image data based on the log data, the server device can transmit a request command to the image capture device.

[0055] (24) Furthermore, in the system of this embodiment, the photographing device is connected to a first recording medium and a second recording medium in order to record the image, the recording unit records the image on the first recording medium or the second recording medium, and the first control unit switches the recording destination to another recording medium when the image is recorded on an image specified in response to the request command.

[0056] In this way, when transmitting video in response to a transmission request from the server device, the camera device can separate the recording medium from which the video is read and the recording medium to which the captured video is recorded. In this way, the camera device reads from the recording medium and records to the recording medium on different recording media, which can prevent, for example, dropped frames.

[0057] (25) Furthermore, in the system of this embodiment, the system further includes a terminal device having a third control unit connectable to the imaging device and the server device, and the second control unit of the server device transmits the request command to the terminal device, and the third control unit of the terminal device transmits a transmission request command to transmit video to the terminal device based on the request command.

[0058] This allows the server device to transmit a request command to the photographing device via the terminal device, so that a user can establish communication between the server device and the terminal device by connecting the terminal device to the server device and then connecting the terminal device to the photographing device.

[0059] (26) Also, in the system of this embodiment, the request command includes content for establishing a call line, and the first control unit of the photographing device executes a process for establishing a call line with the server device in response to the request command.

[0060] This allows a call line to be established between the server device and the photographing device, so that, for example, a call can be made between an administrator using the server device and a user using the photographing device.

[0061] (27) Furthermore, in the system of this embodiment, the photographing device is capable of acquiring vehicle information, the log data includes at least the vehicle information, and the required conditions are conditions related to the vehicle information included in the log data.

[0062] This allows the server device to send a request command to the image capture device based on conditions related to the vehicle information included in the log data. For example, the server device can detect dangerous driving from the vehicle information or determine that the user is experiencing aggressive driving, and then call the user.

[0063] A program is provided for causing a computer to realize the functions of the above-mentioned imaging device.

[0064] The inventions shown in (1) to (27) above can be arbitrarily combined. For example, the invention shown in (1) may be combined with at least a portion of the configuration of at least one of the inventions shown in (2) and after. In particular, the invention shown in (1) may be combined with at least a portion of the configuration of at least one of the inventions shown in (2) and after. Any configuration may be extracted from the inventions shown in (1) to (27) and the extracted configurations may be combined. The applicant of this application intends to obtain rights to the inventions including these configurations. In addition, even if there is a description such as "in the case of" or "when", this is not intended to describe the configuration as being limited to that case or time. These are examples of better configurations, and the applicant intends to obtain rights to configurations other than these cases or times. In addition, the parts described in order are not limited to this order. Configurations in which some parts have been deleted or the order has been changed are also disclosed, and the applicant intends to obtain rights. Effect of the Invention

[0065] According to the system etc. of the present invention, when the imaging device detects a predetermined trigger, it is possible to execute an appropriate process.

[0066] The effects of the invention of this application are not limited to this, and effects achieved from the configuration disclosed in the specification and drawings are also disclosed, and the applicant intends to obtain rights to the configuration achieving said effects through divisional applications, amendments, etc. For example, in this specification, statements such as "can" and "is possible" are statements that clearly indicate the effects achieved, and there are also parts that show effects even without statements such as "can" and "is possible." Furthermore, there are effects that can be understood from the configuration even without such statements. [Brief description of the drawings]

[0067] [Figure 1] FIG. 1 is a diagram for explaining an overview of a system according to a first embodiment. [Diagram 2] FIG. 2 is a diagram for explaining the functional configuration of an imaging device in the first embodiment. [Diagram 3] 4 is a diagram showing an example of a data configuration stored in the imaging device in the first embodiment. FIG. [Figure 4] FIG. 2 is a diagram for explaining the functional configuration of a terminal device in the first embodiment. [Diagram 5] FIG. 4 is a diagram showing an example of a data configuration stored in a terminal device in the first embodiment. [Figure 6] FIG. 2 is a sequence diagram for explaining the overall processing in the first embodiment. [Figure 7] 5 is an operational flow for explaining processing in the imaging device in the first embodiment. [Figure 8] 5 is an operational flow for explaining a process in the terminal device in the first embodiment. [Figure 9] FIG. 4 is a diagram for explaining an operation example in the first embodiment. [Figure 10]FIG. 4 is a diagram for explaining an operation example in the first embodiment. [Figure 11] FIG. 11 is a diagram for explaining an overview of a system according to a second embodiment. [Figure 12] FIG. 13 is a diagram for explaining part of the functional configuration of an imaging device in a third embodiment. [Figure 13] FIG. 13 is a diagram for explaining a process in a fourth embodiment. [Figure 14] FIG. 13 is a sequence diagram for explaining the overall processing in the fifth embodiment. [Figure 15] FIG. 13 is a sequence diagram for explaining the overall processing in the fifth embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0068] Hereinafter, an embodiment of the present invention will be described with reference to the drawings. Note that the embodiment shown below is one embodiment of the present invention, and the contents of the present invention should not be interpreted as being limited based on the following description.

[0069] In the following embodiments, the term "video" is a concept that includes moving images and still images. Here, video may include a plurality of still images and audio data. In other words, video files include moving image files, moving image files, still image files, and still image files. Furthermore, various files such as video files and text files may be referred to as content.

[0070] Furthermore, "notification" includes the concepts of "report" and "alarm." For example, a "report" may be sent to an external system or other device. An "alarm" may be sent using a device within the system, such as a photographing device or a display or speaker of a terminal device.

[0071] Furthermore, although the video is recorded on a recording medium, it may also be expressed as "recording." For example, it may also be expressed as recording the video captured by the image capture device 10 on a recording medium.

[0072] [1. First embodiment] [1.1 System Overview] 1(a) is a schematic diagram showing a system 1 in this embodiment. The system 1 includes an imaging device 10 and a terminal device 20. The system 1 may further include an external server device 30. The terminal device 20 and the server device 30 are connected via a network NW.

[0073] The photographing device 10 can be connected to the terminal device 20. The photographing device 10 and the terminal device 20 are connected to each other by communication using a wireless LAN such as WiFi, communication using Bluetooth (registered trademark), wireless USB, or communication using ZigBee (registered trademark).

[0074] The photographing device 10 has a removable memory card 190. Video data photographed by the photographing device 10 may be recorded on the memory card 190 or transmitted to the terminal device 20. The photographing device 10 may also transmit the video data to the server device 30 via the terminal device 20 and the network NW. If the photographing device 10 is equipped with a communication module capable of LTE / 4G / 5G communication, the video data may be transmitted directly to the server device 30 via the NW and recorded therein.

[0075] The memory card 190 is a removable recording medium capable of recording video data, log data, and the like. For example, a CF card, an XQD memory card, a D memory card, an SD card (micro SD / mini SD), an SDHC card, an SDXC card, an SDUC card, and other such recording media can be used as the memory card 190. Depending on the installation environment of the image capturing device 10, the SD card is preferably, for example, an MLC (Multi Level Cell) card, but may be, for example, an SLC (Single Level Cell) or TLC (Triple Level Cell) SD card. Since the memory card 190 is only required to be capable of recording video data, and the like, it may be a recording medium such as a USB memory.

[0076] The image capturing device 10 can record log data together with video data in the memory card 190, or transmit (record) the log data to the terminal device 20 or the server device 30. Here, the log data is data related to a log based on the operation of the image capturing device 10. The log data includes necessary information from among vehicle information, position information, driving information, event information, and trigger information.

[0077] The imaging device 10 may be configured as an imaging system consisting of multiple devices, such as an observation device, a control device, and a recording device. The imaging system may be attached to a stationary object that does not move, but it is preferable that a part or the whole of the imaging system is attached to a moving object.

[0078] Furthermore, when a part of the imaging system is attached to a fixed object or a moving object, it is particularly preferable that an observation device, such as a camera, for observing the behavior of the moving object can be attached to the fixed object or the moving object.

[0079] The control device for controlling the imaging system may be provided at a location away from the fixed object or moving object to which the observation device is attached. The imaging system may also have a function as a so-called drive recorder (DVR) that records images during operation or at the moment of a traffic accident. Examples of fixed objects that do not move include posts or traffic lights installed on or beside the road.

[0080] Furthermore, the moving body to which a part or the whole of the imaging system is attached may be not only a vehicle such as an automobile or an electric vehicle, but also an object other than a vehicle, such as a ship or an airplane.

[0081] The vehicle is not limited to a four-wheeled automobile, but may be, for example, a two-wheeled vehicle such as a motorcycle, or a large transport vehicle with four or more wheels, and in particular, a four-wheeled automobile capable of observing the outside of the vehicle from inside the vehicle. The vehicle may be, for example, a transportation vehicle (for example, a truck or a forklift), a commercial vehicle (for example, a taxi or a bus), a general vehicle, or a vehicle for more versatile purposes. In this embodiment, the imaging system is described as an imaging device (drive recorder) that can be mounted on a vehicle.

[0082] Fig. 1(b) is an example of a perspective view of the image capturing device 10 (e.g., a drive recorder) seen obliquely from behind. As shown in Fig. 1(b), a memory card insertion slot 11 is provided on one side of the housing of the image capturing device 10. A display 12 and a plurality of operation members (in the example shown in Fig. 1(b), a plurality of operation buttons 13, 14) are provided on the rear surface of the housing. A joint rail 15 is provided on the top surface of the housing.

[0083] Although not shown in Fig. 1(b), the camera lens, which is the imaging means, is provided on the front of the case. A DC jack is provided on the side not shown in Fig. 1(b), and a speaker and HD output terminal are provided on the bottom.

[0084] A camera (one example of an imaging means) having a lens captures, for example, an image in front of the vehicle. The DC jack is a jack for connecting to a DC power source via a power cable. The memory card insertion slot 11 is an insertion slot for inserting a memory card. The speaker outputs sound such as voice. The HD output terminal is a terminal for connecting to other information devices via a cable. The joint rail 15 is for attaching a joint member for mounting the imaging device 10 on a vehicle. The display 12 displays various images. The operation buttons 113 and 14 are operated by the user to input various commands to the imaging device 10.

[0085] In this specification, the user may be, for example, a driver of a vehicle in which the system is installed, or may be a person other than the driver, for example, a passenger.

[0086] FIG. 1(c) is a diagram showing an example of the imaging device 10, the windshield 1010, the dashboard 1020, and the like, which are mounted so that the camera can capture the front of the vehicle. In the example shown in FIG. 1(c), the imaging device 10 equipped with a front camera is disposed at a position on the passenger side adjacent to the room mirror 1030, which is located at the upper part of the inside of the vehicle's windshield 1010 and near the center in the left-right direction. The imaging device 10 is attached and fixed to the windshield 1010 by a mounting member such as double-sided tape. The mounting position of the front camera is preferably the above position, but is not limited to this, and may be any position as long as it is a position that can capture the front of the vehicle. For example, the mounting position of the front camera may be any position on the ceiling, on the dashboard 1020, or on the sun visor. For example, the mounting position of the front camera may be any position on the front bumper, or may be a frame part of the front license plate, etc. The front camera is mounted at any position by the user.

[0087] Also, the DC jack of the photographing device 10 is connected to a cigarette lighter socket 1040 via a power cable 16. When an accessory power source of a vehicle or the like is turned on, for example, power is supplied from the cigarette lighter socket 1040 to the photographing device 10. Therefore, when the engine of the vehicle or the like is turned off, power is not supplied from the cigarette lighter socket 1040 to the photographing device 10. However, this is not essential, and various mechanisms may be used to supply power to the photographing device 10 even when the engine of the vehicle or the like is turned off. For example, photographing by the camera may be performed even when the engine of the vehicle or the like is turned off.

[0088] The terminal device 20 may be connectable to other devices via the network NW. For example, the terminal device 20 of the system 1 may be connectable to the server device 30 via the network NW. The terminal device 20 may be a so-called smartphone.

[0089] The network NW is a communication network to which the terminal device 20 can be connected. In general, the network NW can be connected by wireless communication, and is a LAN (Local Area Network) that connects via an access point, a communication network that uses the Internet, or a mobile wireless communication network that connects via a base station device.

[0090] The server device 30 is one or more devices. For example, it is a server that analyzes the video transmitted from the terminal device 20, a server that provides a video distribution service, a server that provides a social networking service (SNS), a server that receives emergency calls, etc. These server devices 30 may be installed by one or more businesses, or may be installed by different businesses for each service.

[0091] [1.2 Functional configuration] [1.2.1 Imaging Device] The functional configuration of the photographing device 10 will be described with reference to FIG.

[0092] The control unit 100 is a functional unit for controlling the entire photographing device 10. The control unit 100 realizes various functions by reading and executing various programs stored in the storage unit 110, and is configured, for example, by one or more arithmetic units (for example, CPUs (Central Processing Units)).

[0093] Moreover, the control unit 100 reads out and executes a program from the storage unit 110, thereby functioning as a trigger detection unit 102, a video processing unit 104, a trigger video data generation unit 106, and a trigger video data recording time determination unit 108. Note that the trigger detection unit 102, the video processing unit 104, the trigger video data generation unit 106, and the trigger video data recording time determination unit 108 may each be realized as a hardware functional unit.

[0094] The trigger detection unit 102 detects a trigger. Here, a trigger indicates that some condition is met. Triggers include events. An event is something that is determined in advance, and generally, a trigger that can lead to an accident, such as a sudden impact or sudden braking, is called an event. Note that although the term "trigger" is used in this embodiment, it may also be called an event.

[0095] The trigger detection unit 102 may automatically detect a trigger when values ​​acquired from various sensors of the image capturing device 10 or various pieces of information meet predetermined conditions (trigger detection conditions). The trigger detection unit 102 may also detect a trigger manually in response to a user's operation. The trigger detection unit 102 may also detect a trigger based on a trigger signal received via the communication unit 150.

[0096] The trigger detection unit 102 may detect, as a trigger, the inclusion of an object for detecting a trigger from the captured video (image). The trigger detection unit 102 may detect, as a trigger, a change or movement of an object included in the captured video (image). Here, the object may be a "moving object" or a "fixed object". The moving object may be, for example, any moving object such as a vehicle (such as a passenger car, a truck, or a bus, or a two-wheeled vehicle such as a motorcycle, or a light vehicle such as a bicycle) or a pedestrian. The fixed object may be a fixed object such as a sign, a building, or a traffic light. Note that the fixed object is not necessarily fixed to the land, and may include, for example, a construction site, a broken-down vehicle, an emergency vehicle, or other movable but stopped objects.

[0097] Furthermore, the trigger detection unit 102 outputs the detected trigger to the control unit 100 as trigger information. The trigger information may include the type of the detected trigger, the date and time, and may include parameters at the time of detection (e.g., vehicle information, location information, etc.). The control unit 100 may include the trigger information in log data and record it in the memory card 190 via the recording unit 160. Furthermore, the control unit 100 may include the trigger information in log data and transmit it to the terminal device 20 or the server device 30 via the communication unit 150.

[0098] The video processing unit 104 processes the video (image) captured by the imaging device 10. For example, the video processing unit 104 can execute a process of outputting the video (image) captured by the camera unit 120 as video data. The control unit 100 records the video data output from the video processing unit 104 in a memory card 190. Note that the control unit 100 may record the video data in a local recording destination such as the memory card 190, or in a remote recording destination such as the terminal device 20 or the server device 30 connected via the communication unit 150.

[0099] In this embodiment, the image processor 104 may continuously capture images and record the image data while the image capturing device 10 is operating (while the power is on). In this manner, the image data that is normally recorded may be called normal image data.

[0100] Furthermore, the video processing unit 104 records the video data in a predetermined format. For example, the video processing unit 104 outputs the video data based on set parameters regarding the video data recording method (e.g., MPG, MP4, WMV, etc.), resolution (e.g., HD, FHD (Full-HD), WQHD (Wide Quad-HD), 4K), transfer rate, number of colors, etc.

[0101] The trigger video data generation unit 106 generates trigger video data when the trigger detection unit 102 detects a trigger. The trigger video data generation unit 106 generates and outputs trigger video data from a video captured by the camera unit 120 or video data that has been recorded once.

[0102] The trigger video data generating unit 106 generates trigger video data based on the settings stored in the trigger video data setting area 116. The trigger video data is video data that is generated when the trigger detection unit 102 detects a trigger. Note that the trigger video data generating unit 106 may output the captured video data as is. In this case, the trigger video data generating unit 106 does not perform any particular processing.

[0103] Furthermore, when the trigger video data generating unit 106 generates trigger video data separately from video data, it is preferable that the size of the trigger video data be smaller than that of normal video data.

[0104] For example, when generating trigger video data, the trigger video data generating unit 106 generates and outputs video data with a lower resolution, a changed file format, a lower transfer rate, etc., compared to normal video data. The setting contents (parameters) for generating the trigger video data may be arbitrarily set by the user, or may be predetermined entertainment contents.

[0105] The trigger video data recording time determination unit 108 determines the time at which the trigger video data generation unit 106 outputs (generates) the trigger video data. The trigger video data recording time determination unit 108 stores the determined trigger video data recording time in the trigger video data setting area 116.

[0106] The trigger video data recording time determination unit 108 determines the timing to start generating the trigger video data (timing to start recording) and the time to output the trigger video data. For example, the start timing may be from the time of trigger detection or may go back a predetermined time. The trigger video data recording time determination unit 108 may be configured to be able to easily change the timing by an operation button.

[0107] Here, the operation button detected by the trigger video data recording time determination unit 108 may be a button that generates a trigger (trigger button), or may be a button such as a recording start button, or may be a touch operation on a touch panel.

[0108] For example, the trigger video data recording time determination unit 108 may be configured to extend the recording time to 15 seconds when the user presses the button once, and to 30 seconds when the user presses the button twice.

[0109] Furthermore, the trigger video data recording time determination unit 108 may change both the recording start timing and the recording time by operating one button.

[0110] for example, Button operation once: 15 seconds before and after trigger detection Button operation twice: 30 seconds before trigger detection to 15 seconds after trigger detection Button operation 3 times: 1 minute before trigger detection to 30 seconds after trigger detection Four button presses: 2 minutes before trigger detection to 45 seconds after trigger detection For example, each time the button is pressed, the previous time will be doubled and the next time will be added by 15 seconds.

[0111] Furthermore, the trigger video data recording time determination unit 108 may change the time range to be recorded. For example, the time determined by the trigger video data recording time determination unit 108 is initially 30 seconds, 15 seconds before and after the trigger occurrence. Here, the trigger video data recording time determination unit 108 may determine the time as from 30 seconds before the trigger occurrence to the trigger occurrence time when the button is pressed once, and as from 1 minute before the trigger occurrence to 30 seconds before the trigger occurrence when the button is pressed twice.

[0112] In this way, the trigger video data recording time determination unit 108 can change the recording time (for example, lengthen the recording time) each time the button is pressed, or can change the recording time so that the recording time is expanded both before and after the trigger detection time and the expanded time is longer toward the front than toward the back. In this way, even if a button is pressed late after dangerous driving occurs, for example, the video captured at the time of the dangerous driving can be reliably saved.

[0113] The time at which the trigger video data is output (generated) may be held as a parameter by the trigger video data generating unit 106. In this case, the time at which the trigger video data is output (trigger video data time) may be a predetermined time. The trigger video data time may be a time that cannot be changed.

[0114] The storage unit 110 is a functional unit that stores various programs and various data necessary for the operation of the imaging device 10. The storage unit 110 is configured, for example, with a solid state drive (SSD) or a hard disk drive (HDD) that is a semiconductor memory. The storage unit 110 also reserves the following storage areas to store various information and the like.

[0115] The communication information storage area 112 stores information (communication information) about devices with which the image capturing device 10 communicates via the communication unit 150. For example, as shown in Fig. 3(a), the name of the terminal device 20 (e.g., "Terminal Device A") and connection destination information (e.g., "192.168.11.1") are stored in association with each other.

[0116] Here, the communication information includes, for example, information related to the terminal device 20 (for example, unique identification information such as the IP address, MAC address, and Bluetooth pairing information of the terminal device 20).

[0117] In addition, the communication information may include information regarding the server device 30 (for example, unique identification information of the server device 30, such as the domain name, URL, and IP address of the server device 30, account information for connecting to the service, and user information regarding the server device 30, such as authentication information).

[0118] The trigger detection condition storage area 114 stores trigger detection conditions that are conditions when the trigger detection unit 102 detects a trigger. The trigger detection conditions are conditions that are referred to when the trigger detection unit 102 detects a trigger, and include one or more conditions, thresholds, etc.

[0119] For example, as shown in FIG. 3(b), the trigger detection condition storage area 114 stores one or more types of triggers (trigger types) and conditions for detecting the triggers (trigger detection conditions) in association with each other.

[0120] For example, when the trigger detection unit 102 refers to the condition of "Trigger 1," if the vehicle speed (vehicle speed) acquired as vehicle information becomes 30 km / h or more higher than the speed limit (regulated speed) indicated on a sign acquired by image recognition, the trigger detection unit 102 detects the trigger "speed limit + 30 km / h or more."

[0121] The trigger detection condition storage area 114 may store one or more trigger detection conditions in advance, or may store trigger detection conditions set by the user.

[0122] The trigger video data setting area 116 is referred to when the trigger video data generating unit 106 generates trigger video data. For example, as shown in FIG. 3(c), the trigger video data generating unit 106 includes, as the range to be generated (output) as trigger video data, a start time point (e.g., "trigger occurrence time +0 seconds") and a time to be generated (output) as trigger video data (e.g., "10 seconds"). The trigger video data setting area 116 may also include a file format (e.g., "mp4") to be output as trigger video data. The file format may also include other information. For example, the trigger video data setting area 116 can set the resolution, encoding method, and number of frames of the video data. The setting contents for generating trigger video data may also be stored for each trigger type.

[0123] The operation information storage area 118 stores information (operation information) indicating how the control unit 100 operates when a trigger is detected by the trigger detection unit 102. For example, as shown in Fig. 3(d), the operation information storage area 118 stores a trigger type (e.g., "speed limit + 30km / h or more") and an operation flag (e.g., "recording ON, notification ON, transmission ON").

[0124] The trigger type is information for identifying the trigger detected by the trigger detection unit 102 . Here, whether or not to execute the "notification process," "trigger video data recording process," and "trigger video data transmission process" is stored as a flag.

[0125] It is possible to store one or more pieces of operation information. That is, the operation information storage area 118 may store operation information for each type of detected trigger, or may store one piece of operation information as the overall operation (common operation) of the imaging device 10.

[0126] Camera unit 120 is a photographing unit that photographs an image. Camera unit 120 is a general camera device, and includes, for example, a lens and an image sensor (for example, an image sensor using a CCD (Charge Coupled Device) or a CMOS (Complementary MOS)).

[0127] The acceleration detection unit 130 detects the acceleration applied to the image capturing device 10. For example, the acceleration detection unit 130 is a gyro sensor. For example, the acceleration detection unit 130 can detect acceleration in three directions of the X, Y and Z axes. The control unit 100 may output the acceleration detected by the acceleration detection unit 130 as one piece of vehicle information.

[0128] Furthermore, when the acceleration detection unit 130 detects an acceleration exceeding a predetermined threshold or an acceleration showing a predetermined time series change, the control unit 100 may detect it as an event and output event information. The control unit 100 detects sudden braking such as sudden braking, sharp turning, and sudden starting from the acceleration detected by the acceleration detection unit as an event, and outputs or records information related to the event as event information.

[0129] The control unit 100 may detect an external impact, such as a rear-end collision, as an event and output it as event information.

[0130] The vehicle information acquisition unit 132 acquires vehicle information. The vehicle information is information about the vehicle in which the image capturing device 10 is installed. The vehicle information may be acquired from an EUC (Electrical Control Unit) of the vehicle using, for example, OBD2 (On-Board Diagnostics second generation), or may be acquired from an image captured by the camera unit 120.

[0131] Furthermore, the vehicle information acquisition unit 132 may acquire the speed and the like based on the position information acquired from the position information acquisition unit 134. Alternatively, the information may be acquired using a unique CAN (Controller Area Network). Furthermore, the vehicle information acquisition unit 132 may acquire the relationship with other vehicles in the vicinity of the vehicle and the behavior of the other vehicles.

[0132] As a method for measuring the distance to another vehicle, the vehicle information acquisition unit 132 may acquire the distance to another vehicle by irradiating electromagnetic waves such as infrared laser or millimeter waves and receiving the reflection from the other vehicle. Here, the vehicle information acquisition unit 132 may include a sensor capable of measuring the distance with light or ultrasonic waves, and for example, a CMOS laser sensor, a TOF (Time of Flight) distance sensor, a two-dimensional laser displacement sensor, or the like can be used.

[0133] Here, the vehicle information that can be acquired includes, for example, the following: Information that can be obtained from the vehicle itself, such as speed, acceleration, engine RPM, water temperature, headlight status, steering angle, throttle position, and turn signal status Information that can be obtained from the vehicle's surroundings, such as the lane the vehicle is traveling in, the distance between the vehicle in front and behind, the vehicle in front starting status indicating that the vehicle in front has started moving, and road signs such as speed limits and stop signs. The vehicle information may include the above-mentioned acceleration and position information, which will be described later.

[0134] Road signs also include hazard warning signs, priority signs, prohibition and restriction signs, obligation signs, special regulation signs, information, facility and service signs, direction, location and instruction signs, etc.

[0135] The position information acquisition unit 134 acquires the position of the imaging device 10. For example, the position information is acquired using a global positioning satellite system (GNSS: Global Navigation Satellite System) such as GPS (Global Positioning System), GLONASS (Global Navigation Satellite System), Galileo, or Quasi-Zenith Satellite System (QZSS). The position information acquisition unit 134 may also acquire position information acquired by the terminal device 20.

[0136] The location information acquisition unit 134 may output the latitude and longitude of the image capturing device 10, the prefecture name, city / ward / town / village name, address such as the town name and number, and the name of a general road or expressway.

[0137] The operation unit 140 accepts operation input from a user. The operation unit 140 may be a hardware switch provided on the image capturing device 10, or may be a touch panel (software keys) formed integrally with the display unit 145.

[0138] The display unit 145 displays various states of the image capturing device 10 and the state of operation input. For example, it is configured with a liquid crystal display (LCD), an organic EL panel, electronic paper using an electrophoretic method, or the like. The display unit 145 also displays a display screen. Here, the display screen is what is displayed on the display unit 145, and may be the whole displayed on the display of the display unit 145, or a part of the area may be called the display screen. For example, a window display or a dialog displayed on the display unit 145 may be called the display screen, or the whole including them may be called the display screen. The display screen may be a screen displayed in a certain area.

[0139] The display unit 145 may be a display device connected to the image capturing device 10. For example, the display unit 145 may be a car navigation device connected to a DVR device, which is an example of the image capturing device 10, or a terminal device such as a smartphone.

[0140] The sound input / output unit 148 inputs and outputs sounds including voices, etc. For example, it is composed of a microphone and a speaker.

[0141] The communication unit 150 communicates with other devices, and communicates with other devices via a network. For example, it is a communication module capable of wireless communication such as Bluetooth (registered trademark) or wireless LAN. The communication unit 150 includes a communication module for connecting to a mobile communication network such as LTE (Long Term Evolution) / 4G / 5G. The communication unit 150 has one or more communication modules, and uses the communication modules as necessary.

[0142] The recording unit 160 writes data to and reads data from a memory card 190, which is a recording medium. The recording unit 160 is configured so that the memory card can be detachably attached. The recording unit 160 may be a so-called memory card reader.

[0143] Here, memory card 190 records video data in video data recording area 192 and log data in log data recording area 194. Video data recording area 192 is divided into one or more areas, and multiple pieces of video data and trigger video data may be recorded in each area.

[0144] Furthermore, the log data recording area 194 records log data corresponding to the video data. As described above, the log data includes one or more of vehicle information, event information, location information, and trigger information. The log data records the vehicle information, event information, location information, and trigger information in association with the time of the video data. Furthermore, by including the time in the information included in the log data, it can be referenced when outputting (playing back) the video data or the trigger video data.

[0145] Furthermore, the control unit 100 may record the video data and log data directly onto the memory card 190 , or may record them onto the memory card 190 after temporarily storing them in the storage unit 110 .

[0146] In addition to the configuration shown in Fig. 2, the photographing device 10 may further include configurations that can be used in the photographing device 10. For example, the photographing device 10 may include configurations such as a plurality of camera units and an illuminance acquisition unit. Furthermore, the terminal device 20 in Fig. 3 is required to include at least the control unit 100, the storage unit 110, the camera unit 120, and the communication unit 150, and configurations can be added or deleted or replaced with other devices as necessary.

[0147] 1.2.2 Terminal Equipment The functional configuration of the terminal device 20 will be described with reference to FIG.

[0148] The control unit 200 is a functional unit for controlling the entire terminal device 20. The control unit 200 realizes various functions by reading and executing various programs stored in the storage unit 210, and is configured, for example, by one or more arithmetic units (for example, CPUs (Central Processing Units)).

[0149] Moreover, the control unit 200 functions as a trigger detection unit 202 and a cooperation processing unit 204 by reading and executing a program from the storage unit 210 .

[0150] The trigger detection unit 202 detects a trigger. The trigger detection unit 202 may automatically detect a trigger when values ​​acquired from various sensors of the terminal device 20 or various pieces of information match predetermined conditions (trigger detection conditions).

[0151] Furthermore, the trigger detection unit 202 outputs the detected trigger as trigger information to the control unit 200. The trigger information may include the type of the detected trigger, the date and time, and may also include parameters at the time of detection (for example, the inclination, position, brightness, etc. of the terminal device 20).

[0152] The trigger information is transmitted to the image capturing apparatus 10 by the cooperative processing unit 204. That is, the trigger detection unit 202 detects a trigger in the same manner as the trigger detection unit 102 of the image capturing apparatus 10.

[0153] The cooperation processing unit 204 performs various cooperative processes after the terminal device 20 is connected to the photographing device 10. For example, the cooperation processing unit 204 is realized by the control unit 200 executing a cooperation application downloaded and stored in the storage unit 210 via the communication unit 250.

[0154] The cooperation processor 204 provides various functions as necessary. For example, the cooperation processor 204 can process video data received from the terminal device 20 and execute login processing for services provided by the server device 30. The functions realized by the cooperation processor 204 will be described as appropriate.

[0155] The storage unit 210 is a functional unit that stores various programs and various data necessary for the operation of the terminal device 20. The storage unit 210 is configured, for example, with a solid state drive (SSD) or a hard disk drive (HDD) that is a semiconductor memory. The storage unit 210 also reserves the following storage areas to store various information and the like.

[0156] The communication information storage area 212 stores information (communication information) of devices with which the terminal device 20 communicates via the communication unit 250. For example, as shown in Fig. 5(a), the communication information storage area 212 stores the name of the image capturing device 10 and information (unique identification information) related to the image capturing device 10 as communication information.

[0157] The unique identification information may also be, for example, information related to the photographing device 10 (for example, unique identification information such as the IP address, MAC address, and Bluetooth pairing information of the photographing device 10).

[0158] The communication information may also store information about the server device 30 (for example, unique identification information of the server device 30, such as the domain name, URL, and IP address of the server device 30, and user information about the server device 30, such as account information for connecting to the service and authentication information).

[0159] The trigger detection condition storage area 214 stores trigger detection conditions that are conditions when the trigger detection unit 202 detects a trigger. The trigger detection conditions are conditions that are referred to when the trigger detection unit 202 detects a trigger, and include one or more conditions, thresholds, etc.

[0160] For example, as shown in FIG. 5(b), the trigger detection condition storage area 114 stores one or more types of triggers (trigger types) and conditions for detecting the triggers (trigger detection conditions) in association with each other.

[0161] For example, when referring to the condition of "trigger 1", the trigger detection unit 202 detects the trigger "it becomes dark" when the illuminance detected by the illuminance sensor becomes less than 50% of the maximum value.

[0162] The trigger detection condition storage area 114 may store one or more trigger detection conditions in advance, or may store trigger detection conditions set by the user.

[0163] In this embodiment, the trigger detection unit 202 detects the trigger, but the cooperation processing unit 204 may have a function of detecting the trigger.

[0164] The transmission information storage area 216 stores the trigger type and the transmission destination when the terminal device 20 transmits trigger video data to another device or service. For example, as shown in Fig. 5(c), the control unit 200 stores the trigger type (e.g., "speed limit + 30km / h or more") and the transmission destination (e.g., "server device A"). When the transmission information is stored, the control unit 200 transmits the trigger video data, etc. to the set transmission destination.

[0165] It is possible to store one or more pieces of transmission information. That is, the transmission information storage area 216 may store transmission information for each type of detected trigger, or may store one piece of transmission information as the overall operation (common operation) of the terminal device 20.

[0166] The acceleration detection unit 230 detects the acceleration applied to the terminal device 20. For example, the acceleration detection unit 230 is a gyro sensor. For example, the acceleration detection unit 230 can detect acceleration in three directions of the X, Y and Z axes.

[0167] The location information acquisition unit 234 acquires the location of the terminal device 20. For example, the location information is acquired using a Global Positioning System (GPS), a Global Navigation Satellite System (GLONASS), Galileo, a Quasi-Zenith Satellite System (QZSS), or the like, which is a Global Navigation Satellite System (GNSS).

[0168] The location information acquisition unit 234 may also acquire location information from, for example, a base station device of a communication destination. For example, the location information may be acquired from a base station device of a mobile communication network, or from an access point of a wireless LAN.

[0169] The location information acquisition unit 234 may output the latitude and longitude of the terminal device 20, the prefecture name, city / ward / town / village name, address such as the town name and number, and the name of a general road or expressway.

[0170] The operation unit 240 accepts operation input from a user. The operation unit 240 may be a hardware switch provided in the terminal device 20, or may be a touch panel (software keys) formed integrally with the display unit 245.

[0171] The illuminance acquisition unit 236 acquires the brightness of the location where the terminal device 20 is placed. The illuminance acquisition unit 236 is a general illuminance sensor. For example, the illuminance acquisition unit 236 may acquire what percentage of brightness is detected among the brightness that can be acquired by the illuminance sensor. The illuminance acquisition unit 236 may also acquire illuminance (lux, lumens).

[0172] The display unit 245 displays various states of the terminal device 20 and displays the state of operation input. For example, it is configured by a liquid crystal display (LCD) or an organic EL panel. The display unit 245 displays a display screen. Here, the display screen is displayed on the display unit 245, and may be the whole displayed on the display of the display unit 245, or a part of the area may be called the display screen. For example, a window display or a dialog displayed on the display unit 245 may be called the display screen, or the whole including them may be called the display screen. The display screen may be a screen displayed in a certain area. The display unit 245 may be a display device connected to the terminal device 20.

[0173] The sound input / output unit 248 inputs and outputs sounds including voices, etc. For example, it is composed of a microphone and a speaker.

[0174] The communication unit 250 communicates with other devices, and communicates with other devices via a network. For example, it is a communication module capable of wireless communication such as Bluetooth (registered trademark) or wireless LAN. The communication unit 250 includes a communication module for connecting to a mobile communication network such as LTE (Long Term Evolution) / 4G / 5G. The communication unit 250 has one or more communication modules, and uses the communication modules as necessary.

[0175] In addition to the configuration shown in Fig. 3, the terminal device 20 may further include configurations that can be used in the terminal device 20. For example, the terminal device 20 may include configurations such as a camera unit and a recording unit. Furthermore, the terminal device 20 in Fig. 3 only needs to include at least the control unit 200, the storage unit 210, and the communication unit 250, and configurations can be added or deleted or replaced with other devices as necessary.

[0176] [1.2.3 Server device] The server device 30 is a server device that provides various services. The server device 30 includes at least a control unit, a storage unit, and a communication unit. In addition, the server device 30 may include an operation unit, a display unit, etc., as necessary.

[0177] For example, the server device 30 can provide the following services. In this case, the server device 30 may be constructed by various service providers (businesses), or may be constructed by a single business. That is, in this system, an existing service may be used, or a business that provides the image capturing device 10 may provide some or all of the services.

[0178] (1)SNS(Social Networking Service) A social networking service is a service that provides a community among users. For example, a social networking service displays received messages in chronological order, in a state called a timeline. In addition, a social networking service may display not only messages on the timeline, but also content such as images (still images and moving images) and sounds. Examples of such services include Twitter, Facebook, and Weibo.

[0179] (2) Video streaming services A video distribution service is a service that accepts video submissions and distributes them by streaming to terminal devices connected via a network. Examples of such services include YouTube (registered trademark) and TikTok.

[0180] (3) Analysis services The analysis service is a service that performs analysis based on, for example, log data received from the image capture device 10 or the terminal device 20. For example, the analysis service analyzes and determines whether a user is driving dangerously, tailgating, or problematic from the user's log data. The analysis service may use, for example, artificial intelligence and store the results of machine learning (learning dictionary).

[0181] (4) Cloud services A cloud service is a service that stores one or more pieces of data. For example, the image capturing device 10 records video data on the memory card 190, but the video data may be stored on a cloud service, such as Dropbox or Gloogle drive.

[0182] The above-mentioned configuration of the server device 30 is merely an example, and the system may include a server that stores various data. Also, the system may not include the server device 30.

[0183] [1.3 Processing flow] [1.3.1 System startup process] 6 is a sequence diagram showing the process that is started first in the system 1. First, the power of the image capturing device 10 is turned on (S1002). Here, the timing when the power of the image capturing device 10 is turned on is the timing when a user performs an operation to turn on the power or the timing when the engine of the vehicle in which the image capturing device 10 is installed starts.

[0184] When the photographing device 10 is powered on, it executes an initialization process (S1004) and starts a connection to the terminal device 20 (S1006). For example, the photographing device 10 starts a connection to a terminal device 20 that is linked in advance, or connects to a terminal device 20 within a connectable range of the photographing device 10. In addition, the photographing device 10 and the terminal device 20 may be connected to each other by any method that allows the two devices to communicate with each other, such as wireless LAN or short-range wireless communication such as Bluetooth.

[0185] Here, when the connection process between the terminal device 20 and the photographing device 10 is completed (S1104), the connection between the photographing device 10 and the terminal device 20 is completed (S1008). This enables the photographing device 10 and the terminal device 20 to transmit and receive various information and data.

[0186] The image capturing device 10 may record the video according to the recording mode (S1010). The recording mode may be, for example, the following modes.

[0187] Continuous recording mode: Images are always recorded based on the same image quality data. Event recording mode: When an event occurs (e.g., a collision, sudden braking, etc.), video is recorded.

[0188] An event is one type of trigger. However, the conditions for an event are the same or stricter than those for a trigger. In other words, an event is often a reason that is directly connected to an accident or trouble, but a trigger is not limited to that.

[0189] In this embodiment, it is assumed that the image capturing device 10 captures video in the continuous recording mode and records the video on the memory card.

[0190] Furthermore, the photographing device 10 may transmit the log data to the terminal device 20 (S1012). When the terminal device 20 receives the log data (S1014), it can record the log data or transmit it to a server.

[0191] [1.3.2 Processing of imaging modalities] Fig. 7 is a flowchart illustrating the flow of processing executed by the control unit 100 of the photographing device 10. Note that the processing in Fig. 7 is processing that is mainly executed by the control unit 100 when the trigger detection unit 102 detects a trigger.

[0192] When executing the process of FIG. 7, the image capturing device 10 may constantly record the image captured by the camera unit 120 in the image data recording area 192 of the memory card 190 as image data.

[0193] First, the trigger detection unit 102 (control unit 100) detects a trigger (step S102). Here, the triggers detected by the trigger detection unit 102 include a trigger automatically detected by the image capture device 10, a trigger input by a user operation, and a trigger transmitted from another device (for example, the terminal device 20).

[0194] When the trigger detection unit 102 detects a trigger, the control unit 100 stores the trigger information (step S104). That is, the control unit 100 records the vehicle information, position information, acceleration information, etc. at the time of occurrence of the trigger in association with the type of trigger as trigger information (trigger history). The trigger information may be included in the log data or may be recorded separately from the log data. The trigger information may be recorded in the log data recording area 194 of the memory card 190, or may be transmitted to the terminal device 20. The timing at which the control unit 100 records or transmits (records, etc.) the trigger information may be when the trigger occurs, continuously, or at a predetermined interval.

[0195] If the control unit 100 is set to perform a notification operation (step S106; Yes), the control unit 100 executes notification processing (step S108). Here, the following processing may be considered as the notification processing.

[0196] (1) The photographing device 10 executes a notification process. For example, the control unit 100 displays a notification message on the display unit 145 of the photographing device 10, or outputs a notification message from the sound input / output unit 148. The notification message may include notification content (type of trigger), a cause of occurrence, etc.

[0197] (2) The terminal device 20 executes the notification process. The photographing device 10 transmits a notification command (notification message, notification signal) to the terminal device 20. When the terminal device 20 receives the notification command (notification signal), the terminal device 20 executes the notification process.

[0198] The control unit 100 may transmit the log data together with the notification command, or may transmit the log data included in the notification command. The control unit 100 may also transmit trigger information to the terminal device 20 in addition to the notification command. The control unit 100 may generate a notification message including the contents to be notified at the terminal device 20 or a notification command, and transmit the notification message to the terminal device 20.

[0199] If the setting is such that trigger video data is to be recorded (step S110; Yes), control unit 100 executes trigger video data recording processing (step S112). Here, video data captured by camera unit 120 is always recorded to memory card 190, which is the first recording destination. Furthermore, when control unit 100 executes trigger video data recording processing, it records the trigger video data to a second recording destination. Here, the second recording destination is terminal device 20.

[0200] When the control unit 100 executes the trigger video data recording process, the trigger video data generated by the trigger video data generating unit 106 is recorded in the video data recording area 192 of the memory card 190 set as the second recording destination. Furthermore, the control unit 100 may record the trigger video data in an area different from that of the normal video data in the video data recording area 192 of the memory card 190. For example, when a plurality of partitions are generated in the memory card 190, the control unit 100 may record the normal video data and the trigger video data in different partitions. Furthermore, when the video data is recorded in a virtual file, the control unit 100 may record the normal video data and the trigger video data in different virtual files.

[0201] Furthermore, when the control unit 100 is set to transmit trigger video data (step S114; Yes), it executes trigger video data transmission processing (step S116). In this case, the control unit 100 may identify the terminal device 20 to be the transmission destination based on the communication information stored in the communication information storage area 112, and transmit the trigger video data to the identified terminal device 20. Furthermore, the control unit 100 may transmit the trigger video data to the currently connected terminal device 20.

[0202] At this time, when the control unit 100 executes the trigger video data transmission process, the size of the trigger video data may be further reduced. For example, the control unit 100 may convert the trigger video data once generated by the trigger video data generation unit 106 into low-resolution, low-bitrate trigger video data by the video processing unit 104 and transmit the converted data to the terminal device 20.

[0203] 1.3.3 Terminal Equipment FIG. 8 is a flowchart illustrating the flow of processing executed by the control unit 200 of the terminal device 20. As shown in FIG.

[0204] When the terminal device 20 detects a trigger in its own device, the terminal device 20 may transmit trigger information to the photographing device 10 (step S202; Yes->step S204). That is, when the trigger detection unit 202 matches the trigger detection condition stored in the trigger detection condition storage area 214, the terminal device 20 generates trigger information and transmits it to the photographing device 10.

[0205] Although the control unit 200 transmits trigger information including the type of trigger, it may simply notify a signal indicating that a trigger has occurred.

[0206] At this time, possible triggers detected by the terminal device 20 are as follows, for example.

[0207] (1) The fact that the terminal device 20 is lifted is detected as a trigger by detecting that the acceleration detected by the acceleration detection unit 230 exceeds a predetermined threshold in a predetermined direction or by detecting a predetermined change pattern of acceleration. For example, the trigger may be a scene in which the user operates the terminal device 20 or a scene in which sudden braking occurs while driving.

[0208] (2) When a turn is detected based on the acceleration or direction detected by the acceleration detection unit 230, the vehicle turning or the user turning the terminal device is detected as a trigger. For example, the trigger may be a scene where the user explicitly operates the terminal device 20, or a scene where there is a sharp curve or a scene where there are successive sharp curves.

[0209] (3) When the brightness detected by the illuminance acquisition unit 236 becomes equal to or lower than a threshold value, or when it becomes equal to or higher than a threshold value, or when the amount of change becomes equal to or higher than a predetermined threshold value, this is detected as a trigger. In this way, "a sudden darkening" or "a sudden brightening" can be used as a trigger. For example, a scene in which the vehicle suddenly enters a tunnel or a scene in which the vehicle is running toward the setting sun or the morning sun can be a trigger.

[0210] Furthermore, when the terminal device 20 receives a notification from the photographing device 10 (step S206; Yes), the terminal device 20 executes a terminal device notification process (step S208). That is, when the control unit 200 receives a notification command from the photographing device 10 via the communication unit 250, the control unit 20 executes a notification process in the terminal device 20.

[0211] When the control unit 200 executes the terminal notification process, it notifies the user of various information based on the notification command. For example, when the control unit 200 receives log data or trigger information as a notification command, it displays information based on the type of trigger included in the trigger information on the display unit 245 and outputs sound from the sound input / output unit 248.

[0212] The control unit 200 may output a predetermined message based on the trigger information, or may output the contents included in the notification command. For example, if the trigger type is related to vehicle speed, the control unit 200 may output a predetermined message such as "Exceeding speed." Also, if the notification command includes "This is a tourist spot," the control unit 200 may simply output the message "This is a tourist spot."

[0213] Furthermore, when the control unit 200 receives trigger video data from the photographing device 10 (step S210; Yes), it executes trigger video data processing (step S212). Note that receiving trigger video data in step S210 may include, for example, transmitting the trigger video data in a notification command, and the terminal device 20 may receive the trigger video data from the photographing device 10 in response to the notification command. Alternatively, the trigger video data may be transmitted from the photographing device 10 and received directly by the terminal device 20.

[0214] In the trigger video data processing, the control unit 200 may store the trigger video data in the storage unit 210, or may display the trigger video data on the display unit 245. In addition, when the terminal device 20 stores data using a cloud service, the received trigger video data may be stored in the cloud service.

[0215] In addition, the control unit 200 refers to the transmission information stored in the transmission information storage area 216, and if the conditions for transmission to the server (server transmission conditions) are met (step S214; Yes), it transmits various data (e.g., log data (trigger information), trigger video data, etc.) to the server device 30 (step S216).

[0216] The control unit 200 may transmit various data to the server device 30 only when the vehicle is traveling or when communication is established with the image capturing device 10. For example, when the vehicle is not traveling or communication is not established with the image capturing device 10, the power consumption of the terminal device 20 can be reduced by not transmitting data.

[0217] Here, the server device 30 to which the terminal device 20 transmits may provide, for example, the following services.

[0218] (1) Analysis services The control unit 200 transmits the log data and the trigger video data to the server device 30 that provides an analysis service. When the server device 30 receives the trigger video data, it analyzes the trigger video data. This allows the server device 30 to analyze the driving situation, for example, whether the driving is dangerous or eco-friendly. In this case, for example, the server device 30 may constantly receive the log data and perform analysis based on the log data. Furthermore, the server device 30 may analyze the log data and request the terminal device 20 and the imaging device 10 for the trigger video data and the video data as necessary.

[0219] In addition, the server device 30 can analyze the received trigger image data and correct the location and surroundings. For example, when the server device 30 determines that the user is in a specific tourist spot by analyzing the trigger image data, the server device 30 may notify the terminal device 20 and the photographing device 10 of the fact.

[0220] Furthermore, the server device 30 may analyze the received trigger image data and / or log data to detect vehicle trouble or accident. When the server device 30 detects vehicle trouble or accident, the server device 30 may inquire of the user or automatically notify the police or a hospital.

[0221] (2) Social networking services The control unit 200 transmits the trigger video data to the server device 30 that provides, for example, a video distribution service or an SNS service that displays a timeline. The server device 30 posts the received trigger video data.

[0222] For example, examples of SNS services include Twitter (registered trademark), Facebook (registered trademark), LINE (registered trademark), Weibo (registered trademark), TikTok (registered trademark), and the like. In addition to the trigger video data, other moving images or still images may be included as materials and transmitted, or music may be remixed and transmitted. In addition, the control unit 200 may transmit the data to be used as materials to the server device 30, and the server device 30 may generate data to be posted, or the terminal device 20 may generate data to be posted in advance and transmit the data. In addition, the control unit 100 of the imaging device 10 may generate data to be posted and transmit it to the terminal device 20.

[0223] [1.4 Example of operation] A specific example of the operation will be described below.

[0224] (First operation example) As a first operation example, a case will be described in which a notification is given as a trigger when the speed limit is exceeded by 30 km / h, and the image at that point in time is recorded as trigger image data.

[0225] Fig. 9 is a diagram for explaining the first operation example. Fig. 9(a) shows the trigger detection condition stored in the trigger detection condition storage area 114 of the photographing device 10, Fig. 9(b) shows the operation information stored in the operation information storage area 118 of the photographing device 10, and Fig. 9(c) shows the transmission information stored in the transmission information storage area 216 of the terminal device 20. Fig. 9(d) is a diagram typically showing the speed change of the photographing device 10 (or the vehicle on which the photographing device 10 is installed).

[0226] For example, as shown in the trigger detection condition in FIG. 9(a), the trigger detection unit 102 detects a trigger when the moving speed of the photographing device 10 (or the vehicle speed of the vehicle in which the photographing device 10 is installed) becomes 30 km / h or more higher than the speed limit (Step S102 in FIG. 7; Yes).

[0227] The speed limit may be determined by the control unit 100 automatically recognizing a speed limit (regulated speed) sign from an image acquired by the camera unit 120, or by acquiring information about the road on which the vehicle is traveling from the position information acquisition unit 134 and obtaining the corresponding speed limit (regulated speed).

[0228] Furthermore, when a trigger is detected, the control unit 100 records trigger information (step S104 in FIG. 7). The control unit 100 needs to record at least the type of trigger and the time of occurrence as the trigger information. The control unit 100 may also record vehicle information and location information. The control unit 100 records the trigger information in the memory card 190 by including it in the log data, but may record it in a file separate from the log data that records the normal driving state, or may record it in a separate area. The control unit 100 may also transmit the trigger information or the log data including the trigger information to another device, for example, the terminal device 20, via the communication unit 150.

[0229] Furthermore, the trigger video data generation unit 106 may generate trigger video data when a trigger is detected by the trigger detection unit 102. The trigger video data generation unit 106 temporarily stores the generated trigger video data in the storage unit 110.

[0230] 9(d) is a graph showing time on the horizontal axis and speed on the vertical axis, where the speed limit is 40km / h.

[0231] At time t1, the vehicle speed exceeds 70 km / h, so the speed limit is increased by 30 km / h. Therefore, the trigger detection unit 102 detects a trigger at time t1. Here, the fact that the trigger has been detected at time t1 is recorded as trigger information. The trigger information includes "vehicle speed is speed limit + 30 km / h" as a type of trigger. It may also include vehicle information including the date and time and vehicle speed at that time, and location information. Since the trigger information includes the date and time, the image capture device 10 and the terminal device 20 may acquire vehicle information, location information, etc. at the time of the trigger occurrence by referring to the log data.

[0232] In addition, when the trigger video data setting is the content stored in the trigger video data setting area 116 in Fig. 3(c), the trigger video data generating unit 106 generates trigger video data for 10 seconds from the trigger occurrence. That is, the trigger video data is output as an mp4 format video file based on the video captured during the time t2 in Fig. 9(d).

[0233] Furthermore, referring to the operation information in FIG. 9(b), since notification is ON, the control unit 100 executes notification processing (Step S106 in FIG. 7; Yes->Step S108).

[0234] For example, when the terminal device 20 is set as the notification destination, the control unit 100 transmits a notification command to the terminal device 20 via the communication unit 150. The notification command includes necessary information such as the time when the trigger occurred, the type of the detected trigger, and vehicle information.

[0235] When the terminal device 20 receives the notification command from the photographing device 10 (step S206 in FIG. 8; Yes), it executes a terminal device notification process (step S208 in FIG. 8). As a result, the display unit 245 of the terminal device 20 may display a message such as "You are significantly exceeding the speed limit!". The terminal device 20 may also output the same content as sound from the sound input / output unit 248.

[0236] In addition, since the recording flag in the operation information is ON, the control unit 100 records the trigger video data (step S110 in FIG. 7; Yes->step S112). That is, the control unit 100 records the trigger video data generated by the trigger video data generation unit 106 in the memory card 190.

[0237] Furthermore, since the transmission flag in the operation information is ON, the control unit 100 transmits the trigger video data to the terminal device 20 (Step S114; Yes->Step S116 in FIG. 7).

[0238] 9(c), the destination is not stored in the transmission information of the terminal device 20. Therefore, the terminal device 20 determines that the server transmission condition is not met, and does not transmit the received trigger video data to the server device 30 (step S214; No).

[0239] (Second operation example) The second operation example is an operation example in which a user gives a trigger. For example, a "tailgating dedicated button" is provided in a position different from the normal operation buttons on the image capture device 10. FIG. 10(a) is a diagram showing a configuration in which a tailgating dedicated button 19 is provided on the image capture device 10 separately from the normal operation buttons 13, 14, etc. The tailgating dedicated button 19 may be configured to be easier for the user to understand than the normal operation buttons. For example, it may be located in a position or arrangement different from the other operation buttons. In this operation example, the tailgating dedicated button 19 is provided large on the lower side of the housing of the image capture device 10.

[0240] That is, the tailgating button 19 is a button in a special state compared to other operation buttons. Here, the special state may be, for example, that the size is different from other operation buttons, or that the button is located in a different place. Also, the special state may be that the button has a different color, shape, material, etc., or that the operation method is different from other operation buttons.

[0241] The special state may be a button to which a function of instructing to record a second video in the video data recording area 192 (second recording destination) of the memory card 190 is pre-assigned. The special state may be provided outside the housing of the image capturing device 10, unlike other operation buttons. In this case, the tailgating dedicated button 19 may be connected to the image capturing device 10 via a wired or wireless communication path, and may be provided within reach of the driver from the driver's seat, such as on the dashboard. In this way, the driver can easily operate the tailgating dedicated button 19.

[0242] In addition, the tailgating dedicated button 19 does not have to be a dedicated button. For example, the control unit 100 can realize a function equivalent to the tailgating dedicated button 19 by detecting that the image capture device 10 is touched with a predetermined force or more, or by detecting an operation on the touch panel that is different from the normal operation (e.g., a double tap, a triple tap operation, etc.).

[0243] When the user presses the tailgating button 19, the control unit 100 detects this as a trigger.

[0244] Figure 10(b) shows the trigger detection conditions of the photographing device 10, Figure 10(c) shows the trigger video data settings of the photographing device 10, Figure 10(d) shows the operation information of the photographing device 10, and Figure 10(e) shows the transmission information of the terminal device 20.

[0245] When the user selects the tailgating dedicated button 19 of the image capturing device 10, the trigger detection unit 102 detects a trigger. As a result, the control unit 100 records trigger information. In addition, the trigger video data generation unit 106 generates trigger video data.

[0246] As shown in FIG. 10(c), the trigger video data generating unit 106 generates trigger video data for 60 seconds starting from 10 seconds before the trigger occurs (that is, 50 seconds after the trigger occurs) as the recording start point.

[0247] Here, since the recording flag included in the operation information is ON, the control unit 100 records the trigger video data generated by the trigger video data generating unit 106 in the memory card 190 .

[0248] Furthermore, since the transmission flag included in the operation information is ON, the control unit 100 transmits the trigger video data to the terminal device 20.

[0249] The terminal device 20 that received the trigger image data finds that the trigger image data matches the trigger type included in the transmission information. In addition, when the trigger type is the "tailgating dedicated button," the transmission information stores that the transmission destination is "server device A." Therefore, the terminal device 20 (control unit 200) transmits the trigger image data to the server device 30.

[0250] The control unit 100 may change the recording time (for example, lengthen the recording time) each time the tailgating button 19 is operated, or may change the recording time so that the recording time is expanded both before and after the trigger detection time, and the expansion time is longer toward the front than toward the rear. In this way, even if the tailgating button is operated late after recognizing that tailgating has occurred, the video captured at the time of the tailgating can be reliably saved.

[0251] For example, the storage unit 110 may further store a table of conditions for changing the recording time (change condition table). For example, the change condition table may store conditions such as the recording time to be added each time the tailgating dedicated button is pressed (for example, adding 30 seconds each time) and the recording time to be changed (for example, doubling the recording start time and adding 15 seconds to the recording end time each time the button is pressed).

[0252] The control unit 100 may refer to the change condition table and change the recording time every time the tailgating driving dedicated button 19 is operated. Also, the control unit 100 may be realized as a process instead of the change condition table.

[0253] Furthermore, the control unit 100 may change the recording time when a predetermined operation is performed on the tailgating button 19. For example, when the tailgating button 19 is pressed within a predetermined time (for example, within one second), the control unit 100 may change the recording time. Furthermore, the control unit 100 may change the recording time when the tailgating button 19 and another operation button are operated together.

[0254] [2. Second embodiment] A second embodiment will be described. In addition to the above-mentioned embodiment, the second embodiment is an embodiment in which the range of time that can be recorded as trigger video data can be changed. Explanations of parts that have the same configuration, function, and process as the above-mentioned embodiment will be omitted, and the differences in this embodiment will be mainly described.

[0255] This embodiment describes the operation of the trigger video data recording time determination unit 108. This embodiment is an embodiment in which a plurality of imaging devices 10 (camera units 120) serving as observation devices are provided.

[0256] 11 is a diagram showing an outline of the image capturing device 10 in the system of the third embodiment. In the third embodiment, the system has a three-camera configuration, and has cameras according to the image capturing direction. For example, the image capturing device 10A is a device for capturing an image of the front of the vehicle.

[0257] In addition, as similar photographing devices, there are photographing device 10B that photographs the rear of the vehicle, and photographing device 10C that photographs the interior of the vehicle (DMS: driver monitoring system). Here, any of the photographing devices 10 (for example, photographing device 10A) may have a role as a control device that controls the entire photographing device 10. In other words, photographing device 10A becomes the photographing device 10 shown in FIG. 2.

[0258] For example, the photographing device 10A is supplied with power via a power cable 16. Moreover, the photographing devices 10B and 10C are connected to the photographing device 10A, and are supplied with power via the photographing device 10A. The photographing device 10 may have a control device separate from the photographing device 10A. In this case, each photographing device is connected to the control device.

[0259] The photographing device 10A, the photographing device 10B, and the photographing device 10C each include a camera device capable of photographing an image. In addition, the photographing device 10C only needs to recognize the state of the user, so it may be equipped with, for example, an infrared camera and photograph the state of the user (for example, the driver).

[0260] In this embodiment, the trigger video data generating unit 106 uses the video captured by either the image capturing device 10A or the image capturing device 10B as the trigger video data. For example, different trigger video data may be generated from the video captured by each image capturing device, or only one of the cameras may be used. Furthermore, the videos from multiple image capturing devices may be synthesized into one video data and recorded.

[0261] 11, the photographing device 10A can recognize information on the vehicle ahead, lane information, and road signs (such as road signs indicating speed limits and stop signs, regulatory signs, warning signs, and guide signs) from the image photographed by the camera. The photographing device 10A can recognize information on the vehicle ahead, such as the distance from the vehicle ahead, starting and stopping, and the departure timing of the vehicle ahead.

[0262] Furthermore, the photographing device 10 can recognize information on rear vehicles and lane information from the image captured by the camera of the photographing device 10B. As a rear vehicle, the photographing device 10 can recognize the distance to a vehicle traveling in the same lane and the distance to a vehicle traveling in a different lane. The photographing device 10 may recognize the information by the photographing device 10B alone, or may be recognized by another device (for example, the photographing device 10A) based on the image captured by the photographing device 10C.

[0263] Furthermore, the photographing device 10 can recognize information about the user from the image captured by the camera of the photographing device 10C. For example, the photographing device 10 can recognize that the user is dozing off or looking away from the user's line of sight. Furthermore, the photographing device 10 can recognize the user's actions, such as operating a smartphone or smoking a cigarette.

[0264] The image capturing device 10 may collect the recognition results from the images captured by each image capturing device or the recognition results from each image capturing device into one piece of trigger information, or may store them as separate trigger information. If the image capturing device 10 has set the above-mentioned trigger in the trigger detection condition storage area 114, it executes processing according to the trigger.

[0265] Although the system of the second embodiment is configured with three image capturing devices, it can be realized by a combination of one or more image capturing devices. For example, the camera of the image capturing device 10 may be a camera with a viewing angle of 360 degrees. In this case, the image capturing device 10 is installed in the center of the vehicle (for example, near the center of the roof of the automobile) so that the inside and outside of the vehicle can be captured by one image capturing device. Furthermore, the camera with a viewing angle of 360 degrees of the image capturing device 10 may be a combination of either a celestial sphere camera or a hemispherical camera.

[0266] The photographing device 10 may use an in-vehicle camera that is installed in advance in a vehicle. For example, the system may use a backup camera installed in a vehicle instead of the photographing device 10B. The system may use a camera of a terminal device connected to the system instead of the photographing device 10.

[0267] Furthermore, the user may set the photographing device to be used among the photographing devices 10. For example, even if the photographing device 10C is included in the system, it is possible to set whether to use it or not.

[0268] [3. Third embodiment] A third embodiment will be described. In addition to the above-mentioned embodiments, the third embodiment is an embodiment in which the photographing device 10 can use a plurality of memory cards 190. Explanations of parts that have the same configuration, functions, and processes as the above-mentioned embodiments will be omitted, and the explanation will focus on the differences between the first embodiment and this embodiment.

[0269] 13 is a diagram for explaining the configuration of the memory card 190 in this embodiment. In this embodiment, two memory cards, a first memory card 190A and a second memory card 190B, are attached to the recording unit 160. Note that the technology for providing multiple memory cards may utilize, for example, the technology disclosed in Japanese Patent Application Laid-Open No. 2018-41259.

[0270] For example, the control unit 100 of the imaging device 10 may record the constantly recorded video data and the trigger video data in separate memory cards. For example, it is assumed that the constantly recorded video data (normal video data) is recorded in the video data recording area 192A of the first memory card 190A.

[0271] At this time, when trigger detection unit 102 detects a trigger, trigger video data generation unit 106 generates trigger video data. When control unit 100 records the trigger video data, it may be recorded in a memory card different from that for normal video data, for example, in video data recording area 192B.

[0272] Furthermore, the control unit 100 may record the normal video data in a different memory card at the timing when the process is executed due to the occurrence of a trigger or the occurrence of a process. For example, when the control unit 100 transmits the trigger video data to the terminal device 20 at the timing when the trigger occurs, the control unit 100 records the normal video data in a memory card different from the memory card in which the normal video data has been recorded or the memory card being processed.

[0273] For example, while normal video data is being recorded in the first memory card 190A, the control unit 100 receives a request to transmit video data from the terminal device 20. In this case, if normal video data is being recorded in the memory card (e.g., the first memory card 190A) in which the requested video data is recorded, the control unit 100 immediately switches the recording of the normal video data to a different memory card (e.g., the second memory card 190B).

[0274] As a result, the video processing unit 104 records the normal video data in the second memory card 190B. The control unit 100 can read the video from the first memory card 190A containing the video data requested by the terminal device 20. Note that the same process may be performed when the image capturing device 10 detects a trigger and transmits trigger video data.

[0275] That is, the photographing device 10 cannot stop recording (recording video) while recording (recording video) on the memory card 190, which is a recording medium. Therefore, the photographing device 10 can execute a process (for example, transmit a video to a server device) while continuing recording on the memory card 190.

[0276] [4. Fourth embodiment] A fourth embodiment will be described below. The fourth embodiment is an embodiment in which, in addition to the third embodiment, video data and log data are constantly transmitted from the image capturing device 10 to the terminal device 20, and communication is interrupted.

[0277] For example, Fig. 14(a) is a diagram for explaining the operation of this embodiment. Fig. 14(a) shows a state in which video is constantly being captured and the video processor 104 is constantly outputting video data.

[0278] The video data is divided in time series and recorded onto the first memory card 190A and the second memory card 190B. That is, the video data is recorded alternately onto the first memory card 190A and the second memory card 190B.

[0279] Furthermore, the control unit 100 may also record trigger video data together in the memory card 190 that is the recording target. Furthermore, the control unit 100 may also record log data together in the memory card that is the recording target.

[0280] The image capturing device 10 constantly transmits video data and / or log data to the terminal device 20. The terminal device 20 may also transmit the received video data and / or log data to the server device 30. That is, the video data and / or log data is transmitted from the image capturing device 10 to the terminal device 20 as a real-time transfer.

[0281] Fig. 14(b) is a diagram showing a state in which communication is temporarily cut off. For example, in Fig. 14(b), communication is cut off between time t10 and time t12. Similarly, in Fig. 14(b), communication is cut off between time t14 and time t16.

[0282] While the communication is disconnected, the photographing device 10 cannot transmit the video data and / or log data recorded in the memory card 190 to the terminal device 20. Therefore, when communication with the terminal device 20 is resumed, the photographing device 10 transmits the video data.

[0283] For example, during the period from time t10 to time t12, the control unit 100 does not transmit to the terminal device 20 the data D10A recorded in the second memory card 190B and the data D12A recorded in the first memory card 190A.

[0284] Therefore, at time t12, after the communication state is recovered, the control unit 100 transmits data D10A at the timing of data D10B, and data D12A at the timing of data D12B. In this case, the control unit 100 may transmit the data multiplexed with the data normally transmitted. In other words, after the communication is recovered, the control unit 100 may transmit the data that is currently being transmitted and the data that could not be transferred in real time at the same time when the communication state is recovered.

[0285] At this time, it is preferable that the data transmitted by the control unit 100 is data not currently being recorded in the memory card 190. For example, while the control unit 100 is recording video data in the first memory card 190A, the control unit 100 transmits video data recorded in the second memory card 190B as video data that cannot be transmitted.

[0286] In this way, the video data may be recorded on the memory card in a time-division manner. Recording the video data on the memory card in a time-division manner has the advantage that the data can be used evenly, taking into consideration the lifespan of the data.

[0287] [5. Fifth Embodiment] A fifth embodiment will be described below. In the fifth embodiment, in addition to the above-mentioned embodiments, a trigger is transmitted from the server device 30.

[0288] In this embodiment, the server device 30, the terminal device 20, and the photographing device 10 can be connected to each other. However, the server device 30 and the photographing device 10 may be directly connected to each other. For example, the photographing device 10 may be equipped with a communication module capable of 4G / 5G communication and may directly communicate with the server device 30.

[0289] The server device 30 may store the learned data and the condition table in a storage unit. For example, the control unit of the server device 30 may refer to the learned data when referring to various information or analyzing log data to transmit a request command in a process described later.

[0290] (call request) 15 is a sequence diagram showing the flow of processing of the system 1. First, the image capturing device 10 acquires log data (S2002). Note that the log data here includes the information in the above-mentioned embodiment. For example, the log data may include latitude and longitude data, G sensor data, ADAS, driver information, the occurrence or non-occurrence of a DMS event, vehicle speed, brake, and blinker data as driving log data. The log data may further include trigger information and event information.

[0291] The log data may also include simplified video data, such as data including successive thumbnail images at predetermined time intervals, or video data that is smaller in size than normal video data and trigger video data.

[0292] Furthermore, when multiple memory cards can be attached to the image capturing device 10 as in the fourth embodiment, the log data may include information on the memory card or card slot in which video data corresponding to the video is recorded.

[0293] Next, the camera device 10 transmits the log data to the terminal device 20 (S2004). The camera device 10 may transmit the log data at any time, when an event occurs, or when a trigger is detected. Furthermore, when an event occurs or a trigger is detected, the camera device 10 may also perform a warning operation or a notification operation. That is, based on the log data transmitted from the camera device 10 to the server device 30, the server device 30 requests the camera device 10 to transfer (transmit) a video.

[0294] When transmitting the log data received from the image capturing device 10 to the server device 30, the terminal device 20 may use a normal tethering function or a dedicated application.

[0295] The server device 30 analyzes the received log data (S2008). The server device 30 analyzes the log data to determine whether or not to issue a request to the image capturing device 10. Specifically, the server device 30 performs the following operations.

[0296] (1) The server device 30 determines whether the information included in the received log data matches a predetermined condition, and if so, detects a trigger. For example, the server device 30 detects a trigger when the vehicle speed is equal to or greater than a predetermined speed, or when the deviation between the vehicle speed and the speed limit is equal to or greater than a predetermined threshold. Also, the server device 30 detects a trigger based on information such as acceleration and sway.

[0297] Furthermore, the server device 30 detects actions corresponding to the possibility of a collision, such as dangerous driving or tailgating, as a trigger for an area where the distance changes in the image based on the received video. The server device 30 may determine that tailgating is in progress when a car is present within a predetermined distance for a predetermined period of time or more in an area where the distance changes in the image, and detect the trigger. In particular, the server device 30 may detect that tailgating is in progress when a car is present within a predetermined distance for a predetermined period of time or more in an area where the distance changes in the image, even if the vehicle is traveling at a predetermined speed or more.

[0298] In addition, in the case of a system equipped with a plurality of image capturing devices 10, the log data may include images captured from a plurality of different directions. For example, a camera other than a front camera is provided at the rear, and images of other moving objects, etc. are captured by the two cameras, the front camera and the rear camera, are included. When the size (for example, at least one of width, height, and area) of an area that can be regarded as a moving object, such as a vehicle, in an image captured by the rear camera becomes large enough to be determined as approaching, the server device 30 may determine that the moving object behind is possibly driving dangerously, and detect a trigger.

[0299] (2) The server device 30 detects a trigger from the received log data using an AI program. For example, the server device 30 detects a trigger using a trained model that the AI ​​program has generated in advance from one or more parameters included in the log data. For example, the server device 30 selects multiple parameters from the location information, vehicle information, trigger information, and event information included in the above-mentioned log data. In addition, the server device 30 inputs all the parameters into the trained model, and outputs whether or not a trigger has been detected.

[0300] In the present embodiment, the server device 30 may detect, as a trigger, tailgating, vehicle trouble, the occurrence of an accident, etc. Also, the server device 30 may detect, as a trigger, that the user is driving recklessly.

[0301] (3) The server device 30 may transmit a trigger manually after confirmation by an administrator. For example, the administrator checks the log data (vehicle information, event information, etc.) transmitted to the server device 30. If the administrator considers that the log data indicates a worrisome state, the administrator may manually detect a trigger.

[0302] In such a case, in order for the administrator to contact the user (driver), the server device 30 makes an alert request (for example, transmits an alert request command, an alert request message, or an alert request signal) to the terminal device 20 (S2010).

[0303] Here, the alert request may be, for example, a request to provide a mechanism for a system administrator to talk to the user (driver). For example, a telephone line is connected from the server device 30 to the terminal device 20 (specifically, a call is made using a public line such as an IP phone or a mobile communication network). The administrator can talk to the user by using this communication line.

[0304] At this time, it is desirable that the terminal device 20 is in a state where a hands-free conversation can be performed. Also, if the terminal device 20 and the photographing device 10 are capable of communicating with each other, the administrator and the user may have a conversation using the photographing device 10.

[0305] For example, the terminal device 20 makes a call connection request (for example, a call connection request command, a call connection request message, or a call connection request signal) to the photographing device 10 (S2012). If the photographing device 10 approves the call connection, it responds with a call connection (for example, a call connection response message or a call connection response signal) (S2014). As a result, a call line is established between the server device 30, the terminal device 20, and the photographing device 10 (S2016).

[0306] Here, the communication line refers to a line used for communication. For example, it may be a telephone line using a public line network, or a data line using an IP phone. Moreover, when each device establishes a communication line, it is sufficient that the administrator and the user (driver) can make a call, for example.

[0307] For example, the server device 30 or a device connected to the server device 30 and the terminal device 20 or the photographing device 10 may be connected by IP telephone to enable a call between the administrator and the user. The server device 30 also transmits information about the call destination to the terminal device 20 or the photographing device 10. The terminal device 20 or the photographing device 10 makes a call to the destination indicated in the information about the call destination. As a result, a line is connected between each device (between the photographing device 10 and the server device 30, between the terminal device 20 and the server device 30, or between the photographing device 10, the terminal device 20, and the server device 30).

[0308] When a call line is established between the devices, the photographing device 10 can use an IP phone or the like to communicate between the user of the photographing device 10 and the administrator. In addition to the IP phone, the photographing device 10 and the terminal device 20 may be connected using Bluetooth. In this case, hands-free conversation can be realized using the sound input / output unit 148 of the photographing device 10. Furthermore, when the terminal device 20 receives an alert request from the server device 30, it may directly use a mobile communication system to communicate with the administrator.

[0309] That is, in this embodiment, the server device 30 makes a call request to the photographing device 10 and / or the terminal device 20. The photographing device and / or the terminal device 20 that receive the call request provide a mechanism for enabling a conversation between the administrator and the user, for example, using an IP phone or a public line. At this time, the user may use either the photographing device 10 or the terminal device 20 as the device to use when making the call.

[0310] (Request to send photo data) Also, the server device 30 may request the photographed data from the photographing device 10. For example, Fig. 16 is a diagram replacing Fig. 15. Since the processes in S2002 to S2008 in which the server device 30 detects the trigger are the same, a description thereof will be omitted.

[0311] The server device 30 requests the image capture device 10 to transmit video data via the terminal device 20 (S2502, S2504). Upon receiving the video data transmission request, the image capture device 10 executes a video identification process (S2506). Then, the image capture device 10 transmits the video data identified by the video identification process to the server device 30 via the terminal device 20 (S2508, S2510).

[0312] Here, in the video identification process, for example, information for identifying the video data (identification information) such as the file name of the video data to be transmitted to the server device 30 and the shooting date and time of the video data is acquired from the video data transmission request. Then, based on the identification information, the image capturing device 10 searches for (identifies) the video data.

[0313] Here, when a plurality of memory cards 190 are inserted in the photographing device 10 as shown in the third embodiment, the photographing device 10 reads and transmits video data from a memory card 190 on which no video data is recorded.

[0314] Specifically, the photographing device 10 identifies the video data based on the identification information, and if the video data is being recorded to the memory card 190 in which the identified video data is recorded, the photographing device 10 switches the memory card to which the video data is to be recorded.

[0315] For example, as shown in Fig. 13, it is assumed that control unit 100 is currently recording video data in video data recording area 192A of first memory card 190A. At this time, control unit 100 receives a video data transmission request from terminal device 20 via communication unit 150. It is assumed that control unit 100 identifies, from the identification information included in the video data transmission request, that the requested video data is recorded in first memory card 190A. In this case, control unit 100 switches the memory card for recording the video data from first memory card 190A to second memory card 190B.

[0316] It is preferable that the control unit 100 switches the recording of the video data based on an I frame in the video data. In other words, it is preferable that the switching is based on a key frame included in the video data. For example, if the video data is 30 fps, a key frame is inserted every 10 frames. If possible, the control unit 100 should switch the recording of the video data so that a P frame is not at the beginning.

[0317] Then, control unit 100 switches to record the video data in video data recording area 192B of second memory card 190B, and then reads the video data to be transmitted from video data recording area 192A of first memory card 190A. Then, control unit 100 transmits the read video data to terminal device 20.

[0318] In addition, when the memory card currently recording the video data and the video data identified based on the identification information are recorded on different memory cards, the control unit 100 does not need to switch the memory card on which the video data is recorded.

[0319] The information indicating which memory card the video data is recorded on may be determined by the server device 30 and included in the video data transmission request. In other words, if the server device 30 manages which memory card the video data is recorded on, the server device 30 may include information identifying the memory card or information identifying the card slot in the video data transmission request. Here, the information identifying the memory card may be included in the log data, or may be transmitted from the image capture device 10 to the server device 30 as separate information. For example, a tag with information identifying the memory card may be added to the log data (event information, vehicle information).

[0320] Furthermore, the image capturing device 10 may have history data as a history record that serves as a table of contents in addition to the video data recorded. The history data may record information such as information based on GPS information (latitude and longitude information), time, vehicle information (vehicle speed, brake, blinker operation), G sensor value, and OBD information as history. The history data may also include, in addition to these histories, where the saved video data is recorded. For example, in the case of a memory card format that can record association with video data in the history, the history data may further include information for identifying the memory card in which the video data is recorded.

[0321] Furthermore, the history record may be transmitted to the server device 30 at any timing. For example, the history record may be transmitted from the image capturing device 10 periodically (every 10 seconds), may be transmitted for each data amount, or may be transmitted when an event or trigger is detected.

[0322] Also, when the format of the memory card is continuous in a video chain, an area for recording video may be reserved in advance so as to span the memory cards. For example, even when switching between multiple memory cards for recording, the image capturing device 10 may manage the video data recording area that switches for each memory card to be one continuous virtual area. Also, when switching between multiple memory cards (for example, switching between slot A and slot B), the data will be discontinuous as it is. Therefore, by forming one area with the discontinuous parts, a smooth search can be performed.

[0323] In addition, the image capturing device 10 may specify which memory card the video data is recorded in. For example, the image capturing device 10 may specify the memory card by referring to the log data recorded in the log data recording area 194, or may store management information in the storage unit 110 and specify the memory card by referring to the management information.

[0324] [6. Application Examples] Specific application examples of the systems described in the above embodiments will be described below.

[0325] [6.1 First application example] The trigger detection unit 102 detects a trigger when an event button provided on the image capturing device 10 is selected (e.g., pressed or touched) by a user. This allows the user to transmit an image (e.g., trigger image data) to the terminal device 20 at any timing.

[0326] For example, the event button may be an event button provided in advance in the image capturing device 10, or may be a trigger detection button different from the event button. Also, the event button may be, for example, a button dedicated to aggressive driving.

[0327] Here, when the user selects the event button, the photographing device 10 may transmit the generated trigger video data to the terminal device 20. In addition, the photographing device 10 may transmit the trigger video data to the server device 30.

[0328] In this case, the trigger video data generating unit 106 may generate video data (trigger video data) for the event button (button dedicated to tailgating) that is different from the video data generated when a conventional event button is selected.

[0329] Furthermore, when the control unit 100 records the trigger video data, the file name may be different from that of other video data (normal video data and video data when an event occurs), and the trigger video data may be recorded in a different folder from that of other video data. Furthermore, the control unit 100 may be set to record video data for a longer period of time when the tailgating dedicated button is selected compared to when the normal event button is selected.

[0330] [6.2 Second application example] The image capturing apparatus 10 may output a notification or an alarm based on the trigger detected by the trigger detection unit 102.

[0331] For example, the trigger detection unit 102 detects a trigger when a trigger detection condition is met. At this time, the control unit 100 may output an alarm when the trigger is detected. For example, an alarm may be displayed on the display unit 145 of the image capturing device 10, or an alarm sound may be output from the sound input / output unit 148.

[0332] In addition, the control unit 100 may report to other terminal devices 20 and the server device 30 via the communication unit 150.

[0333] Based on the received report, the terminal device 20 may issue an alarm on the terminal device 20. For example, the terminal device 20 may display an alarm on the display unit 245 or output an alarm sound from the sound input / output unit 248.

[0334] Furthermore, when making a report, the image capturing device 10 may report one or more pieces of information including vehicle information, position information, trigger information, and event information.

[0335] The trigger detection unit 102 may detect aggressive driving or dangerous driving as a trigger. The image capture device 10 may change the content of the warning or notification or the notification destination depending on the type of aggressive driving detected.

[0336] For example, the trigger detection unit 102 detects triggers based on tailgating such as "when it detects the approach of a following vehicle," "when it detects the approach of a leading vehicle," "when a vehicle with a large speed difference is approaching from behind," and "when it detects erratic driving."

[0337] Furthermore, the trigger detection unit 102 may detect a trigger as an irritation alarm when a rear vehicle is approaching after the departure of the preceding vehicle is detected by the preceding vehicle departure notification function.

[0338] The trigger detection unit 102 may set priorities between the forward signal notification function and the preceding vehicle departure notification function. In this case, the trigger detection unit 102 may detect the function with the higher priority as a trigger.

[0339] The trigger detection unit 102 may also detect dangerous driving as a trigger based on the movement of surrounding vehicles. For example, the trigger detection unit 102 may detect a sudden cut-in in front, an abnormal lighting pattern of the brake lights of the vehicle ahead, or a sudden opening of the door of the vehicle ahead as a trigger.

[0340] The control unit 100 may also set a limit, for example, as the level at which the warning / report is issued. For example, when the control unit 100 is set to "not issue a report if the signal detection indicates a red light," if the control unit 100 detects a red light and detects the approach of a following vehicle, it will not issue a report. In other words, when the vehicle is simply waiting at a traffic light, the approach of a following vehicle is not tailgating, so no warning or report is issued.

[0341] [6.3 Third application example] The trigger detection unit 102 may detect a trigger from the surroundings of the image being captured.

[0342] For example, the control unit 100 recognizes the license plate numbers of each vehicle captured in the video captured by the camera unit 120. If the license plate number of the same vehicle continues to be recognized, the control unit 100 (trigger detection unit 102) recognizes the vehicle as a specific target. If the vehicle recognized as a specific target is captured for a predetermined period of time or longer, the trigger detection unit 102 detects a trigger.

[0343] Furthermore, when the trigger detection unit 102 recognizes from the captured image of the front that there is a vehicle approaching from the front, it detects this as a trigger.

[0344] In addition, the trigger detection unit 102 detects a trigger when it recognizes from the captured video that the truck door (bed door) is open, or detects a trigger when it recognizes that luggage is protruding from the bed of the truck.

[0345] Furthermore, the trigger detection unit 102 may detect a trigger when it recognizes from the captured video that the trunk of the vehicle is left open or the fuel filler opening is left open.

[0346] [6.4 Fourth Application Example] The trigger detection unit 102 may detect the trigger based on information obtainable from the vehicle information.

[0347] When an abnormality is detected from the vehicle information, the trigger detection unit 102 detects the abnormality as a trigger. For example, the trigger is when the detected voltage is an abnormal value (lower or higher than a specified value) or when the tire pressure or the like (obtained by TPMS (Tire Pressure Monitoring System), OBD2, or Bluetooth from a sensor) is detected.

[0348] [6.5 Fifth Application Example] The trigger detection unit 102 may obtain the current location from the location information and detect the current location as a trigger. For example, the trigger detection unit 102 may detect a trigger when the location (location information) of a tourist spot stored in the storage unit 110 matches the current location.

[0349] Furthermore, the trigger detection unit 102 may detect a trigger when the vehicle passes through a place with a beautiful view based on the position information. Furthermore, the trigger detection unit 102 may detect a trigger when it recognizes that the view is beautiful from the captured image. For example, the trigger detection unit 102 may detect a trigger when the image captured by the camera unit 120 includes one or more images of the set road, a close-up view of the area around the road, clouds, etc.

[0350] Furthermore, the trigger detection unit 102 may recognize characters included in the video captured by the camera unit 120, and detect a trigger when a predetermined character is included. Furthermore, the trigger detection unit 102 may recognize a character string indicating a destination displayed on an electronic bulletin board (destination display board) at the rear of a bus moving together with the vehicle, and detect a trigger. Furthermore, the trigger detection unit 102 may recognize characters included in the video separately from character strings on the electronic bulletin board of the bus, character strings included in a signboard, and character strings included in a sign.

[0351] The trigger detection unit 102 may detect a trigger when the vehicle is traveling on a road different from the road that the vehicle usually travels on. In this case, the trigger video data generation unit 106 generates trigger video data including a section where the vehicle is traveling on a road different from the road that the vehicle usually travels on. The control unit 100 then transmits the trigger video data to the terminal device 20.

[0352] The trigger detection unit 102 may determine the road that is usually traveled based on the driving history (log data), or may be registered in advance by the user. The trigger detection unit 102 may determine the road that was traveled immediately before as the road that is usually traveled, or may determine the road based on the number of times the road was traveled within a predetermined period.

[0353] Furthermore, the trigger detection unit 102 may detect a trigger when a specific sign is recognized in the image captured by the camera unit 120. For example, the trigger detection unit 102 detects a trigger when a road sign (regulation sign, national road sign, highway IC / JCT sign, etc.) is recognized in the image. Furthermore, the trigger detection unit 102 may set a sign to be detected as a trigger from among the signs in advance.

[0354] The trigger detection unit 102 may also recognize the state of an electronic display board for autonomous vehicles from the captured video and detect it as a trigger. It may also recognize the light-emitting pattern of a light-emitting part provided separately from the character display part of the electronic display board or a specific design for this purpose to detect the presence of an autonomous driver information notification device as a trigger.

[0355] In addition, the trigger detection unit 102 detects a trigger when a queue or a crowd of people is detected in the photographed area and the number of people counted reaches a predetermined value or more by an image recognition (headcount) function. For example, a crowd of people may indicate that there is an event, and in the case of an event, the photographing device 10 can upload the event information to the service provided by the server device 30 as witness information. Also, for example, if the photographed location is found to be a popular store, this can be helpful when the user visits the store again.

[0356] Furthermore, the trigger detection unit 102 detects a trigger when, for example, a specific car is recognized from the captured image. The specific car may be, for example, a "itasha" (painted car) or a specific classic car. This allows the image capturing device 10 to automatically record the user's sighting information in the terminal device 20 based on the detected trigger. The terminal device 20 can put the recorded image in the camera roll or upload it to a private area of ​​an SNS, etc.

[0357] Furthermore, the trigger detection unit 102 may detect a trigger when it determines by image recognition that a specific license plate is included in the video data captured by the camera unit 120. In particular, the trigger detection unit 102 may register a number plate, such as "8888," that is ranked high as being obtained using a system that allows the selection of vehicle license plates.

[0358] The trigger detection unit 102 may detect a trigger when it recognizes an image of a license plate from a specific region. The trigger detection unit 102 may register regions with rare local license plates and detect a trigger when it recognizes a license plate from that region.

[0359] In addition, the trigger detection unit 102 may distinguish between local numbers and normal numbers, and detect a trigger when a local number is recognized.

[0360] The trigger detection unit 102 may also detect a trigger by recognizing a character string or a logo written on a vehicle (truck or commercial vehicle). In this case, the trigger video data generation unit 106 can generate trigger video data for a section in which the vehicle is captured. For example, while the image capture device 10 is recognizing a truck with "ABC Fish Market" written on it, the image capture device 10 can transmit the video data captured while recognizing the truck to the terminal device 20 or the server device 30.

[0361] Furthermore, the trigger detection unit 102 may detect a trigger when it recognizes from the video data that the rotating light is on. Furthermore, the trigger video data generation unit 106 may generate a video while the rotating light is on as trigger video data. Note that the trigger detection unit 102 may generate a trigger by associating the recognition of the rotating light with color information.

[0362] Furthermore, when detecting a trigger, the trigger detection unit 102 may recognize an image of a traffic light and detect the trigger. For example, the trigger detection unit 102 may detect a trigger when a vehicle is traveling despite the light being recognized as red. This allows the image capture device 10 to transmit trigger video data of a vehicle traveling through a red light to the terminal device 20. Furthermore, the image capture device 10 may delete video data of a vehicle traveling through a red light. Furthermore, the image capture device 10 may prohibit deletion of video data of a vehicle traveling through a red light.

[0363] [6.6 Sixth Application Example] In addition, the trigger detection unit 102 may obtain information about the driver, and the trigger detection unit 102 may detect the trigger.

[0364] For example, the trigger detection unit 102 acquires the seat belt fastening state of the driver by the camera unit 120 or the vehicle information acquisition unit 132. Then, the trigger detection unit 102 detects a trigger when the seat belt fastening state changes.

[0365] Furthermore, the trigger detection unit 102 detects the vital signs of the driver and passengers based on the camera unit 120 and other sensors (for example, a biological information acquisition unit). The trigger detection unit 102 detects a trigger when there is a change in the vital signs of the driver and passengers. At this time, the trigger video data generation unit 106 generates trigger video data based on the video of the driver etc. captured when there is a change in the vital signs.

[0366] At this time, the trigger detection unit 102 may also acquire biometric information of the driver or the like acquired by another device, for example, a terminal device such as a smart watch or a smartphone.

[0367] The trigger detection unit 102 may also detect a trigger when there is a change in the driver's emotions.

[0368] [6.7 Seventh Application Example] The trigger detection unit 102 may also detect a trigger based on various other information. For example, it may detect that a settlement process (e.g., a settlement process by NFC or a settlement process by displaying a two-dimensional code) has been performed by the terminal device 20, and detect the settlement as a trigger. At this time, the trigger video data generation unit 106 generates trigger video data of the point where the settlement has been performed. The control unit 100 also transmits position information of the point where the settlement has been performed, the trigger video data, etc. to the terminal device 20. As a result, video of the place where the shopping has been performed is automatically recorded.

[0369] The trigger detection unit 102 may detect a trigger when the vehicle is driving autonomously or when another vehicle that is driving autonomously is recognized. This allows the image capture device 10 to generate trigger video data based on the video during the autonomous driving period and transmit the trigger video data to the terminal device 20.

[0370] The trigger detection unit 102 may detect the trigger by setting the point where the engine starts (the point where the image capture device 10 is started) as the start point, and the point where the engine stops (the point where the image capture device 10 is no longer supplied with power from the outside, or the point where the power of the image capture device 10 is cut off) as the stop point and finish point. This enables the image capture device 10 to transmit an image (trigger image data) including the start point and the stop point (finish point) to the terminal device 20.

[0371] The image capturing device 10 may generate trigger video data from a point (a time slightly before) before the point where the engine stops, and transmit the trigger video data to the terminal device 20. If the image capturing device 10 can be started by a battery, the image capturing device 10 may generate trigger video data from the time when the external power supply is stopped.

[0372] In addition, if the vehicle in which the photographing device 10 is installed is a shared vehicle used for services such as rental cars, car sharing, or MaaS (Mobility as a Service), the photographed video may be transmitted to a terminal device 20 used by a user of the service.

[0373] For example, information on a link destination (e.g., a URL or store number) where an application that functions as the collaboration processing unit 204 can be installed on the photographing device 10, and identification information (e.g., a QR code (registered trademark), which is a two-dimensional code) containing information for connecting to the photographing device 10 (e.g., an SSID and password if the photographing device 10 functions as an access point) are displayed on the photographing device 10 or in the vehicle.

[0374] A user of the service can install an application or connect to the photographing device 10 by reading the identification information with a camera provided on a terminal device 20 (for example, a smartphone or a tablet device). This allows the user of the service to easily use the contents described in this specification.

[0375] [6.8 Eighth Application Example] The image capturing device 10 can be installed in multiple locations, such as the front and rear, or a dummy image capturing device can be installed. For example, the image capturing device 10 is sold together with a mock-up having a common housing.

[0376] When installing the camera in a vehicle, the user installs a dummy camera together with the camera 10. This allows a third party to believe that multiple locations are being photographed, and thus discourages aggressive driving and dangerous driving by other vehicles.

[0377] For example, in the case of vehicles such as large cars and buses, installing the devices not only on the front and rear but also on the sides can be expected to have a deterrent effect on those around.

[0378] [7. Modifications] The present invention is not limited to the above-described embodiments, and various modifications are possible. In other words, the technical scope of the present invention also includes embodiments obtained by combining technical means that are appropriately modified within the scope of the gist of the present invention.

[0379] In addition, although the above-mentioned embodiments are described separately for convenience of explanation, they can be combined and executed to the extent possible. For example, the operation of the trigger detection unit 102 executed in each embodiment may be any process when it is described as a single operation.

[0380] In the above embodiment, the image capturing device 10 has been described as constantly recording images, but may also record events. When performing event recording, the image capturing device 10 may record the images in the same area as the images recorded continuously, or may record the images in a different area. The image capturing device 10 may record the event recording in the same slot as the memory card recording continuously, or may record the event recording in a slot different from the slot in which the memory card recording continuously is located.

[0381] Furthermore, when the photographing device 10 has multiple camera units, the images may be recorded on the memory card in the same slot or on different slots. For example, the photographing device 10 may record only images captured in the front direction on the memory card in the first slot, and record images captured in other directions on the memory card in the second slot.

[0382] In the above-described system, the image capturing device 10 may have a memory card detached. When the memory card is detached, the image capturing device 10 records video only on the currently attached memory card. When a transfer request (transmission request) for video data in the detached memory card is received from the server device 30, the image capturing device 10 may return an error command. Note that when there is a mismatch with the history record recorded in the server device 30 (for example, when the memory cards have been replaced, or when only one memory card has been replaced, etc.), the image capturing device 10 may return an error in the same manner.

[0383] Furthermore, when the photographing device 10 has multiple memory cards and can only read one of them, it may indicate an error, or may display only the information (image) of the memory card that can be read. In this case, the photographing device 10 may display that only one card is being displayed. Furthermore, the photographing device 10 may not display all image data on the memory card when an error occurs.

[0384] Furthermore, the photographing device 10 may temporarily store the history record in the storage unit 110. For example, if the memory card is replaced, the photographing device 10 may update the information recorded on the memory card or the server device 30 based on the history record stored in the storage unit 110.

[0385] In addition, the programs that run on each device in each embodiment are programs that control the CPU and the like (programs that make a computer function) so as to realize the functions of the above-mentioned embodiments. Information handled by these devices is temporarily stored in a temporary storage device (e.g., RAM) during processing, and is then stored in various ROMs and HDDs, and is read, modified, and written by the CPU as necessary.

[0386] Here, the recording medium for storing the program may be any of semiconductor media (e.g., ROM, non-volatile memory card, etc.), optical recording media / magneto-optical recording media (e.g., DVD (Digital Versatile Disc), CD (Compact Disc), BD, etc.), magnetic recording media (e.g., magnetic tape, flexible disk, etc.), etc.

[0387] In addition, when distributing the program on the market, the program can be stored in a portable recording medium and distributed, or transferred to a server computer connected via a network such as the Internet. In this case, the storage device of the server device is of course included in the present invention.

[0388] Furthermore, the above-mentioned data may be stored in an external device and called up as needed, rather than being stored within the device. For example, the data may be stored in a network attached storage (NAS) or on the cloud.

[0389] The scope of the present invention is not limited to the configurations explicitly described in the specification, but includes combinations of various aspects of the present invention disclosed in this specification. The configurations of the present invention that are to be patented are specified in the attached claims, but it is our intention to include configurations disclosed in this specification in the claims in the future, even if they are not currently specified in the claims.

[0390] The present invention is not limited to the configuration described in the above-mentioned embodiment. The components of each of the above-mentioned embodiments and modifications may be arbitrarily selected and combined. Any components of each of the embodiments and modifications may be arbitrarily combined with any components described in the means for solving the invention or any components that embody any components described in the means for solving the invention. We intend to acquire rights to these as well through amendments to this application or divisional applications. Even if there is a description such as "in the case of" or "when", this is not intended to describe a configuration that is limited to that case or time. We also disclose configurations that are not in these cases or times, and we intend to acquire rights. Furthermore, the parts described in order are not limited to this order. We also disclose configurations in which some parts are deleted or the order is changed, and we intend to acquire rights.

[0391] In addition, we intend to obtain rights to the overall design or partial design by converting to a design registration application. The drawings depict the entire device in solid lines, but they include not only the overall design but also partial designs claimed for a part of the device. For example, some parts of the device may be partial designs, and the drawings include some parts of the device as partial designs regardless of the parts. A part of the device may be a part of the device, or a part of that part. We intend to obtain rights to the overall design, as well as partial designs in which any part of the solid line part of the drawing is shown as a broken line part. In addition, the modules, parts, and components inside the device's casing, all of which are shown in the drawings, are subject to trade independently, and we intend to obtain rights to them by converting to a design registration application. [Explanation of symbols]

[0392] 1 System 10. Imaging Device 100 Control section 102 Trigger detection unit 104 Video Processing Unit 106 Trigger image data generation unit 108 Trigger image data recording time determination unit 110 Storage section 112 Communication information storage area 114 Trigger detection condition storage area 116 Trigger image data setting area 118 Operation information storage area 120 Camera Division 130 Acceleration detection unit 132 Vehicle Information Acquisition Unit 134 Location information acquisition unit 140 Operation section 145 Display section 148 Sound input / output section 150 Communications Department 160 Recording Section 190 Memory Card 192 Video data recording area 194 Log data recording area 20 Terminal Equipment 200 Control section 202 Trigger detection unit 204 Collaboration Processing Unit 210 Storage section 212 Communication information storage area 214 Trigger detection condition storage area 216 Transmission information storage area 230 Acceleration detection unit 234 Location information acquisition unit 236 Illuminance acquisition section 240 Operation section 245 Display section 248 Sound input / output section 250 Communications Department 30 Server device

Claims

1. A filming unit that shoots video; a control unit that records the image captured by the image capture unit in a predetermined recording destination when a predetermined trigger is detected; A setting unit for setting a recording time is further provided, The control unit generates an image based on the recording time as the predetermined image based on the image captured by the imaging unit. An imaging device characterized by:

2. 2. The photographing apparatus according to claim 1, wherein the setting unit sets, as the recording time, a first time period that is set from the occurrence of a trigger.

3. 3. The photographing apparatus according to claim 2, wherein the setting unit sets the first time period as the recording time from a time going back by a set second time period before the occurrence of the trigger.

4. A communication unit that communicates with a terminal device, 4. The photographing apparatus according to claim 1, wherein the predetermined recording destination is the terminal device.

5. A communication unit that communicates with a terminal device, The photographing apparatus according to claim 1 , wherein the control unit notifies the terminal device via the communication unit when the trigger is detected.

6. a first recording medium and a second recording medium are connected to record the video; The first recording destination of the image captured by the imaging unit is the first recording medium, and the second recording medium is the predetermined recording destination.

6. The imaging device according to claim 1, wherein the imaging device is a single lens.

7. 7. The photographing apparatus according to claim 6, wherein the control unit switches the recording medium on which the video is recorded when a different video is to be read from the recording medium on which the video is recorded.

8. A filming unit that shoots video; a control unit that records the image captured by the image capture unit in a predetermined recording destination when a predetermined trigger is detected; A communication unit that communicates with a terminal device, The imaging device, wherein the predetermined recording destination is the terminal device.

9. A filming unit that shoots video; a control unit that records the image captured by the image capture unit in a predetermined recording destination when a predetermined trigger is detected; A communication unit that communicates with a terminal device, The control unit notifies the terminal device via the communication unit when the trigger is detected.

10. A filming unit that shoots video; a control unit that records the image captured by the image capture unit in a predetermined recording destination when a predetermined trigger is detected; a first recording medium and a second recording medium are connected to record the video; The first recording destination of the image captured by the imaging unit is the first recording medium, and the second recording medium is the predetermined recording destination. An imaging device characterized by:

11. 11. The photographing apparatus according to claim 10, wherein the control unit switches the recording medium on which the video is recorded when a different video is read from the recording medium on which the video is recorded.

12. A system including an imaging device and a terminal device, The imaging device is A filming unit that shoots video; a control unit that records the video on a recording medium; A trigger detection unit that detects a trigger; a transmission unit that transmits a command to the terminal device when the trigger is detected; Equipped with The terminal device A receiving unit for receiving a command from the terminal device; the terminal device has a control unit that performs a notification based on the command; A system comprising:

13. The terminal device includes a display unit, The system according to claim 12 , wherein the control unit causes the display unit to display a message based on the command.

14. The command includes the image captured when the trigger is detected, The system according to claim 13 , wherein the control unit displays an image included in the command on the display unit.

15. The system further includes a server device. The control unit of the terminal device 11. The system according to claim 9, wherein when a transmission condition to the server is met based on the command, information based on the command is transmitted to the server device.

16. A system including an imaging device having a first control unit and a server device having a second control unit, The imaging device is A filming unit that shoots video; a recording unit that records the video on a recording medium; Equipped with The first control unit transmits log data to the server device, The second control unit of the server device receiving log data from the imaging device; Analyzing the log data and determining whether the required conditions are met; If the request condition is met, a request command is sent to the image capture device. When a request command is received from the server device, the first control unit of the photographing device executes a process according to the request command. A system characterized by:

17. a second control unit of the server device transmitting a request command to the imaging device to request transmission of the recorded video based on the fact that the request condition is satisfied; A first control unit of the photographing device transmits an image specified in response to the request command to the server device.

17. The system of claim 16.

18. The imaging device is a first recording medium and a second recording medium are connected to record the video; the recording unit records the video on a first recording medium or a second recording medium; When the video is recorded in the video specified in response to the request command, the first control unit switches the recording destination to another recording medium.

18. A system according to claim 16 or 17.

19. the system further includes a terminal device including a third control unit connectable to the imaging device and the server device, the second control unit of the server device transmits the request command to the terminal device; The third control unit of the terminal device transmits a transmission request command for transmitting a video to the terminal device based on the request command.

19. The system according to any one of claims 16 to 18, characterized in that

20. The request command includes a command for establishing a telephone line, The first control unit of the photographing device executes a process of establishing a communication line with the server device in response to the request command.

20. The system according to any one of claims 16 to 19.

21. The photographing device is capable of acquiring vehicle information, The log data includes at least vehicle information, The required condition is a condition regarding the vehicle information included in the log data.

21. The system according to any one of claims 16 to 20.

22. A program for causing a computer to realize the functions of a control unit of the image capturing device according to any one of claims 1 to 11, or the functions of the image capturing device in the system according to any one of claims 12 to 21.

Images