Information recording device, information recording method, and information recording program

Abstract

To provide an information recording device capable of recording an image or the like such that, in such a case of confirming a surrounding situation and the like after an incident, the situation can be confirmed together with an operational state of an accessory of a vehicle.SOLUTION: The information recording device includes: an interface 1 that acquires a circumferential image obtained by imaging the periphery of a vehicle, and acquires state information indicating an operational state of an accessory of the vehicle; and an image processing unit 3 that, based on the circumferential image and the state information, generates display image data for displaying horn display or the like indicating an operational state at a time when the circumferential image is captured together with the circumferential image, and records this on a memory SD.SELECTED DRAWING: Figure 2

Description

[Technical Field]

[0001] The present application relates to the technical fields of an information recording device, an information recording method, and an information recording program, and more particularly to the technical fields of an information recording device, an information recording method, and a program for the information recording device that record display image information corresponding to an ambient image captured from a moving body such as a vehicle. [Background technology]

[0002] In recent years, so-called drive recorders have become common for capturing and recording images of, for example, the area in front of a moving vehicle, for the purpose of later verifying the situation when an accident, sudden acceleration or deceleration, or sudden steering occurs while the vehicle is moving.

[0003] An example of prior art related to a drive recorder that captures images used for the verification is the prior art described in Patent Document 1. In this prior art, when the vehicle acceleration exceeds a threshold for determining whether an accident has occurred, altitude data and gradient data acquired at the same time as the image capture time for a predetermined period of time before the accident occurs are superimposed on the image and recorded in an image memory.

[0004] On the other hand, when determining the allocation of fault in an accident, for example, based on the results of the above-mentioned verification, in addition to the captured images, it is necessary to verify the operating status of the equipment of the vehicle involved in the accident (for example, electrical equipment such as headlights, wipers, or turn signals) and the behavior of the other vehicle. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] Japanese Patent Application Laid-Open No. 2013-206417 Summary of the Invention [Problem to be solved by the invention]

[0006] In this case, images (video images) of the accident captured by the prior art described in Patent Document 1 are useful in determining the share of fault in the accident vehicle or its driver. However, as mentioned above, in addition to the driving condition of the accident vehicle, the operating status of the vehicle's equipment (for example, whether the headlights were on at the time of the accident) also affects the share of fault in the accident. However, the prior art described in Patent Document 1 does not mention recording the operating status of the equipment of the accident vehicle. Therefore, there is a need for a drive recorder that allows the operating status of the equipment as well as the surrounding conditions to be checked after the fact.

[0007] Therefore, the present application has been made in consideration of the above-mentioned demand, and one example of its objective is to provide an information recording device, an information recording method, and a program for the information recording device that are capable of recording images, etc. so that when checking the surrounding conditions of a vehicle, etc. after the fact, the operating status of the equipment can be confirmed, etc. [Means for solving the problem]

[0008] In order to solve the above problem, the invention described in claim 1 comprises an image information acquisition means for acquiring surrounding image information corresponding to a surrounding image captured from the moving body around the moving body, a status information acquisition means for acquiring status information indicating the operating status of equipment of the moving body, a display information acquisition means for acquiring display information for displaying an operating status image indicating the operating status at the time the surrounding image was captured together with the surrounding image based on the surrounding image information and the status information, and a recording means for recording display image information corresponding to the surrounding image information and the display information on a recording medium.

[0009] In order to solve the above problem, the invention described in claim 10 is an information recording method executed in an information recording device equipped with an image information acquisition means, a status information acquisition means, a display information acquisition means, and a recording means, and includes an image information acquisition step of acquiring surrounding image information corresponding to a surrounding image captured from a moving body around the moving body by the image information acquisition means, a status information acquisition step of acquiring status information indicating the operating status of equipment of the moving body by the status information acquisition means, a display information acquisition step of acquiring display information by the display information acquisition means based on the surrounding image information and the status information, for displaying an operating status image indicating the operating status at the time the surrounding image was captured together with the surrounding image, and a recording step of recording display image information corresponding to the surrounding image information and the display information on a recording medium by the recording means.

[0010] In order to solve the above problem, the invention described in claim 11 causes a computer included in an information recording device to function as an image information acquisition means for acquiring surrounding image information corresponding to a surrounding image captured from a moving body around the moving body, a status information acquisition means for acquiring status information indicating the operating status of equipment of the moving body, a display information acquisition means for acquiring display information for displaying an operating status image indicating the operating status at the time the surrounding image was captured together with the surrounding image based on the surrounding image information and the status information, and a recording means for recording display image information corresponding to the surrounding image information and the display information on a recording medium. [Brief explanation of the drawings]

[0011] [Figure 1] 1 is a block diagram showing a schematic configuration of an information recording apparatus according to an embodiment. [Figure 2] 1 is a block diagram showing a schematic configuration of a drive recorder according to an embodiment; [Figure 3]10A and 10B are flowcharts showing the recording process of display image data in a drive recorder according to an embodiment, in which (a) is a flowchart showing the entire recording process, (b) is a flowchart showing details of the situation detection process within the recording process, and (c) is a flowchart showing details of the display image data generation process within the recording process. [Figure 4] 1A and 1B are diagrams illustrating examples of images recorded by a recording process performed by a drive recorder according to an embodiment, where FIG. 1A is a diagram illustrating a first example, and FIG. 1B is a diagram illustrating a second example. DETAILED DESCRIPTION OF THE INVENTION

[0012] Next, an embodiment of the present invention will be described with reference to Fig. 1. Fig. 1 is a block diagram showing a schematic configuration of an information recording apparatus according to the embodiment.

[0013] As shown in Figure 1, the information recording device S of the embodiment is configured to include an image information acquisition means 1, a status information acquisition means 2, a display information acquisition means 3, and a recording means 4 connected to a recording medium SD.

[0014] In this configuration, the image information acquisition means 1 acquires surrounding image information corresponding to a surrounding image captured from the moving body around the moving body.

[0015] On the other hand, the state information acquisition means 2 acquires state information indicating the operating state of the accessories of the moving object.

[0016] Then, the display information acquisition means 3 acquires display information for displaying an operating status image showing the operating status of the equipment at the time the surrounding image is captured together with the surrounding image, based on the surrounding image information acquired by the image information acquisition means 1 and the status information acquired by the status information acquisition means 2.

[0017] As a result, the recording means 4 records the surrounding image information acquired by the image information acquiring means 1 and the display image information corresponding to the display information acquired by the display information acquiring means 3 onto the recording medium SD.

[0018] As described above, according to the operation of the information recording device S of the embodiment, display information for displaying an operation state image indicating the operation state of the equipment at the time the surrounding image was captured together with the surrounding image is obtained based on surrounding image information corresponding to a surrounding image captured from the moving body and status information indicating the operation state of the equipment, and display image information corresponding to the display information and surrounding image information is recorded on the recording medium SD. Thus, when checking the situation around the moving body after the fact, it is possible to record display image information that enables checking the situation together with the operation state of the equipment. [Example]

[0019] Next, specific examples corresponding to the above-described embodiments will be described with reference to Figures 2 to 4. The examples described below are examples in which the embodiments are applied to recording processing of image data and the like in a drive recorder mounted on a vehicle, which corresponds to an example of a moving body.

[0020] Fig. 2 is a block diagram showing the general configuration of a drive recorder according to an embodiment, Fig. 3 is a flowchart showing the recording process of display image data in the drive recorder, and Fig. 4 is a diagram showing an example of an image recorded by the recording process by the drive recorder. In Fig. 2, the same component numbers as those of the information recording device S according to the embodiment shown in Fig. 1 are used for the components of the embodiment corresponding to the components of the information recording device S.

[0021] The drive recorder according to the embodiment is installed in the interior of a vehicle so as to be able to capture the scenery ahead of the vehicle in which the drive recorder is installed. In the following description, the vehicle in which the drive recorder according to the embodiment is used will be simply referred to as the "own vehicle." As shown in Fig. 2, the drive recorder DR according to the embodiment includes an operation unit 11 including operation buttons, a touch panel, etc., a display 18 that outputs various information, and a speaker 19 that emits necessary operation guidance voices, etc. In addition to the above, the drive recorder DR according to the embodiment is configured with a processing unit 9 including a CPU, a ROM (Read Only Memory), a RAM (Random Access Memory), etc., and controlling the entire drive recorder DR to perform its functions, an image data recording unit 10 including an SSD (Solid State Drive), etc., a camera 12 including, for example, a CMOS (Complementary Metal-Oxide-Semiconductor) imaging element, etc., a map data recording unit 13 including an SSD, etc., a GPS (Global Positioning Sensor) sensor 14, an acceleration sensor 15, a microphone 16, a vehicle interface 17, a memory SD such as a removable SD (Secure Digital) card, etc., and an interface 1 connecting the camera 12, the map data recording unit 13, the GPS sensor 14, the acceleration sensor 15, the microphone 16, and the vehicle interface 17 to the processing unit 9. The processing unit 9 is also configured with an image processing unit 3 and a recording unit 4. The image processing unit 3 and recording unit 4 may be realized by a hardware logic circuit including the CPU constituting the processing unit 9, or may be realized by software by the CPU reading and executing a program corresponding to the recording process of the display image data in the embodiment described below.

[0022] In this case, the interface 1 corresponds to an example of the image information acquisition means 1 and an example of the status information acquisition means 2 according to the embodiment, and the image processing unit 3 corresponds to an example of the display information acquisition means 3 according to the embodiment. Furthermore, the recording unit 4 corresponds to an example of the recording means 4 according to the embodiment, and the memory SD corresponds to an example of the recording means SD according to the embodiment. As shown by the dashed line in Fig. 2, the interface 1, the image processing unit 3, and the recording unit 4 constitute an example of the information recording device S according to the embodiment. Furthermore, the interface 1 corresponds to an example of the "rule information acquisition means" according to the present application, and the image processing unit 3 corresponds to an example of the "status detection means" and the "determination means" according to the present application.

[0023] In the above configuration, the operation unit 11 is configured as part of the drive recorder DR and includes operation buttons, a touch panel, etc., and receives operations by the user and outputs operation signals corresponding to the operations to the processing unit 9. Furthermore, under the control of the processing unit 9, the display 18 displays information to be presented to the user as functions of the drive recorder DR using, for example, images or icons. Furthermore, under the control of the processing unit 9, the speaker 19 emits the above-mentioned operation guidance voices, etc., necessary for the drive recorder DR to perform its functions.

[0024] Next, the camera 12 has an imaging range that covers the surroundings including the area ahead in the direction of travel of the vehicle. The camera 12 generates imaging data corresponding to an image of the surroundings captured within the imaging range and outputs the imaging data to the image processing unit 3 of the processing unit 9 via the interface 1. Meanwhile, the map data recording unit 13 records rule data indicating the details of traffic rules or traffic regulations for each road or intersection, etc., as map data, in addition to general road data and intersection data. In the following description, the traffic rules or traffic regulations will be simply referred to as "traffic rules, etc." The map data recording unit 13 then outputs the rule data, etc. to the image processing unit 3 via the interface 1 in response to a request from the image processing unit 3.

[0025] On the other hand, the GPS sensor 14 outputs position data indicating the current position of the drive recorder DR to the image processing unit 3 via the interface 1 based on the results of receiving navigation radio waves from a navigation satellite (not shown). Here, the current position of the drive recorder DR is, in other words, the current position of the vehicle. Next, the acceleration sensor 15 detects accelerations applied to the vehicle, for example, in the traveling direction, left and right directions, and vertical directions of the vehicle, and outputs the acceleration data as the detection results to the image processing unit 3 via the interface 1.

[0026] On the other hand, the microphone 16 collects sounds or voices, for example, inside the vehicle, and outputs the collected voice data to the image processing unit 3 via the interface 1. The microphone 16 may also collect sounds or voices outside the vehicle. The vehicle interface 17 acquires status data indicating the operating status of the equipment (particularly electrical equipment) provided in the vehicle via an in-vehicle network such as a CAN (Controller Area Network), and outputs the status data to the image processing unit 3 via the interface 1. The electrical equipment includes, for example, the vehicle's horn, turn signals, wipers, brakes, etc. Regarding the turn signals, status data indicating the operating status of the right and left turn signals are acquired separately. The image data recording unit 10 pre-records sign image data for displaying traffic signs corresponding to the traffic regulations, etc., and status image data indicating the operating status of each of the above-mentioned equipment. The image data recording unit 10 then outputs the sign image data and the status image data in response to a request from the image processing unit 3.

[0027] As a result, the image processing unit 3 and the recording unit 4 use the imaging data and status data, etc., respectively acquired via the interface 1, and the sign image data and status image data recorded in the image data recording unit 10 to perform recording processing of display image data according to the embodiment based on the operation content of the operation unit 11. At this time, the recording unit 4 records the display image data output from the image processing unit 3 in the memory SD. In this case, the recording unit 4 records the display image data in the memory SD in a general-purpose format. Note that the general-purpose format is, for example, the MP4 (Moving Picture 4) format, the AVI (Audio video Interleave) format, or the MOV format. In addition, in parallel with recording the display image data in the memory SD, the image processing unit 3 and the recording unit 4 also record the audio data in the memory SD in synchronization with the corresponding display image data. The display image data and audio data recorded in the memory SD can then be displayed or played back by an external playback device (not shown), for example, during post-accident investigations.

[0028] Next, a recording process of display image data according to the embodiment, which is executed mainly by the image processing unit 3 in the drive recorder DR according to the embodiment having the above-described configuration, will be described with reference to FIGS.

[0029] The display image data recording process according to the embodiment starts, for example, when the power switch of the drive recorder DR is turned on. As shown in FIG. 3A, in the display image data recording process according to the embodiment, the image processing unit 3 first acquires the imaging data and the status data via the interface 1 and, based on the acquired data, detects the situation ahead of the vehicle, the vehicle's current location, and other conditions (step S10). Based on the conditions detected in step S10, the image processing unit 3 then generates display image data to be recorded in the memory SD (step S20). The image processing unit 3 then uses the recording unit 4 to record the display image data generated in step S20 in the memory SD in the general-purpose format (step S30). In this case, the recording unit 4 may be configured to record the imaging data, the status data, and the sign image data as separate layers of display image data, or may be configured to record display image data in which the status data and the sign image data are embedded in the imaging data. Thereafter, the image processing unit 3 determines whether or not the recording process of the display image data according to the embodiment is completed by, for example, turning off the power switch of the drive recorder DR (step S40). If the determination in step S40 is that the recording process is to be completed (step S40: YES), the image processing unit 3 terminates the process. On the other hand, if the determination in step S40 is that the recording process is to be continued (step S40: NO), the image processing unit 3 returns to step S1 and repeats the above-described processes. Note that the image processing unit 3 may be configured to cyclically execute the processes of steps S10 to S30 at predetermined intervals (for example, every one to several minutes) while erasing the previous display image data, etc.

[0030] Next, the details of the state detection process in step S10 will be specifically described with reference to FIG.

[0031] As shown in FIG. 3(b), as the state detection process of step S10, the image processing unit 3 first acquires, via the interface 1, imaging data corresponding to the imaging results within the imaging range using the camera 12 and audio data corresponding to the sound collection results using the microphone 16 (step S11). Next, based on the imaging data acquired in step S11, the image processing unit 3 detects whether or not another vehicle is present ahead of the vehicle using, for example, a predetermined image analysis method. In the following description, the other vehicle captured in the imaging data will be simply referred to as the "other vehicle." In addition, the image processing unit 3 detects the illumination status of the headlights of the other vehicle and the speed of the other vehicle based on the imaging data (step S12).

[0032] Next, based on the rule data from the map data recording unit 13, the image processing unit 3 detects traffic rules, etc. for the roads and intersections whose corresponding road data and intersection data are recorded in the map data recording unit 13 (step S13). At this time, the image processing unit 3 may use the position data from the GPS sensor 14 to detect traffic rules, etc. for the roads and intersections ahead of the host vehicle, or may detect traffic rules, etc. that apply at the current time. Furthermore, based on the state (e.g., speed, etc.) of the other vehicle detected in step S12 and the traffic rules, etc. detected in step S13, the image processing unit 3 detects whether the other vehicle is violating traffic rules for the road on which it is traveling (step S14). In step S14, for example, the image processing unit 3 detects that the other vehicle is violating traffic rules if the speed at which the other vehicle enters an intersection where a stop sign is specified is a significant value greater than zero kilometers per hour, or if the other vehicle traveling on the road intersecting ahead of the host vehicle is traveling at a speed faster than the maximum speed for that road.

[0033] Next, the image processing unit 3 detects the current position and speed of the vehicle using the position data, and detects sudden acceleration, sudden deceleration, and abrupt steering of the vehicle based on the acceleration data from the acceleration sensor 15 (step S15). Next, the image processing unit 3 detects the operating state of each of the electrical components of the vehicle based on the state data acquired via the vehicle interface 17 (step S16). Thereafter, the image processing unit 3 proceeds to step S20 shown in FIG. 3(a).

[0034] Next, the display image data generation process in step S20 will be described in detail with reference to FIG.

[0035] 3(c), as part of the display image data generation process of step S20, the image processing unit 3 first acquires, from the image data recording unit 10, the sign image data for displaying traffic signs for roads or intersections captured in the imaging range corresponding to the imaging data acquired in step S11, and the status image data indicating the operating status detected in step S16 (step S21). Next, the image processing unit 3 deforms the shape of the sign image data acquired in step S21 on the display, based on the status of the road or other features captured in the imaging data acquired in step S11 (step S22). More specifically, the image processing unit 3 displays, for example, a traffic sign indicating the maximum speed for the road on which the vehicle is traveling (the road is typically captured within the imaging range of the camera 12, extending from the front to the back), as viewed from the front of the vehicle. For example, traffic signs and stop signs indicating the maximum speed for the road that intersects with the road on which the vehicle is traveling at an intersection ahead (the intersecting road is usually captured within the imaging range of camera 12, extending from the left or right toward the center) are transformed so that they are displayed in an oblique angle from the vehicle, depending on the position of the intersecting road and its relationship to the road on which the vehicle is traveling.

[0036] Next, for each traffic sign whose shape on the display has been deformed in step S22, the image processing unit 3 adjusts the display position within the display image and acquires a symbol image corresponding to the traffic sign, etc. (step S23). More specifically, for example, if another vehicle is captured within the imaging range, the image processing unit 3 adjusts the display position of the traffic sign, etc. so that the traffic sign, etc. is displayed outside the display position of the other vehicle within the display image, and acquires a symbol image corresponding to the traffic sign, etc. Thereafter, the image processing unit 3 generates display image data including the traffic sign, etc. whose display position has been adjusted in step S23, based on the state of the traffic rules detected in step S14, and outputs the generated display image data to the recording unit 4 (step S24). The image processing unit 3 then proceeds to step S30.

[0037] Next, an image recorded in the memory SD as a result of the recording process of the display image data according to the embodiment described with reference to FIG. 3 will be described with reference to FIG.

[0038] First, as shown in FIG. 4(a), in the display image G corresponding to the case where the host vehicle is traveling on a road with a crossroads ahead, lane markings L and R corresponding to the road the host vehicle is traveling on are displayed superimposed on the image of the road ahead captured by camera 12. Furthermore, when another vehicle C approaching the intersection ahead from the right is captured (see step S12 in FIG. 3(b)), a vehicle marking 23 indicating the presence and position of the other vehicle C is displayed. Furthermore, for the road on which the host vehicle is traveling and the road that intersects with the host vehicle at the intersection, traffic sign marks 20 and 21 corresponding to traffic signs indicating the respective maximum speeds, and traffic sign marks 22 indicating traffic rules, etc. for the intersecting road (in the example shown in FIG. 4(a), a stop sign is displayed) are displayed at positions within the display image G corresponding to the positions of the respective roads. Furthermore, at this time, traffic sign marks 21 and 22 corresponding to the intersecting roads are displayed obliquely from the host vehicle (see steps S13, S22, and S23 in FIG. 3).

[0039] In addition to these, a speed display 30 showing the speed of the vehicle is displayed. At this time, if the speed is equal to or less than the maximum speed limit for the road on which the vehicle is traveling (see steps S13 and S14 in FIG. 3), the frame 30A and leader line 30B of the speed display 30 are displayed in a color (e.g., green) that indicates that the vehicle is not violating traffic rules. Note that the image data for displaying the speed display 30, frame 30A, and leader line 30B are pre-recorded in the image data recording unit 10.

[0040] On the other hand, when another vehicle C is present within the imaging range, a speed display 31 showing the speed of the other vehicle C is displayed. At this time, if the speed is faster than the maximum speed (30 kilometers per hour in the example shown in FIG. 4) for the road on which the other vehicle is traveling (i.e., if the other vehicle is speeding; see steps S13 and S14 in FIG. 3), the frame 31A and leader line 31B of the speed display 31 are displayed in a color (e.g., red) indicating a violation of traffic rules. Note that the image data for displaying the speed display 31, frame 31A, and leader line 31B are also pre-recorded in the image data recording unit 10.

[0041] Next, the display image G will be described with reference to Fig. 4(b) when the host vehicle moves further from the state illustrated in Fig. 4(a) and approaches the intersection where another vehicle C is entering from the right and the other vehicle C enters the intersection without stopping. That is, in this case, as illustrated in Fig. 4(b), the lane markings L and R and the traffic sign markings 20, 21, and 22 shown in Fig. 4(a) continue to be displayed in positions within the display image G corresponding to the positions of the respective roads (see steps S13, S22, and S23 in Fig. 3). At this time, the traffic sign markings 21 (displayed on the right side of the display image G) and 22 for the road onto which the other vehicle C is entering are adjusted so as not to overlap with the image of the other vehicle C (see step S23 in Fig. 3).

[0042] In addition, if it is detected that another vehicle C is entering the intersection without temporarily stopping (see step S12, step S13, and step S14 in FIG. 3), a warning display 32 indicating this is displayed together with a frame 32A and a leader line 32B in a color (e.g., red) indicating that this is a traffic violation. Note that the image data for displaying the warning display 32, frame 32A, and leader line 32B are also pre-recorded in the image data recording unit 10. Furthermore, in the case shown in FIG. 4(b), if it is detected that the horn of the vehicle itself has been sounded in conjunction with the entry of another vehicle C into the intersection (see step S16 in FIG. 3), a horn display K indicating this is displayed, for example, at the bottom edge of the display image G at the time the horn was sounded.

[0043] 4(b), when it is detected that the turn signals of the vehicle are operating (see step S16 in FIG. 3), turn signal display WL and turn signal display WR indicating this are displayed separately on the left and right, for example, at the bottom edge of the display image G at the time the turn signals are operated. Similarly, when it is detected that the headlights of the vehicle are turned on (see step S16 in FIG. 3), a headlight display LT indicating this is continuously displayed, for example, at the bottom edge of the display image G while the headlights are turned on.

[0044] Moreover, the horn display K, the turn signal display WL and the turn signal display WR, and the headlight display LT are displayed at positions within the display screen G that do not interfere with the recognition of the situation ahead of the vehicle and do not overlap with other traffic sign displays 20 or warning displays 32 (step S23 in FIG. 3). Furthermore, each image data for displaying the horn display K, the turn signal display WL and the turn signal display WR, and the headlight display LT is also pre-recorded in the image data recording unit 10.

[0045] As described above, according to the operation of the embodiment, based on a surrounding image captured from the vehicle including the area in front of it and the operational state of the equipment of the vehicle, display image data for displaying a horn display K, etc., indicating the operational state of the equipment at the time the surrounding image was captured, together with the surrounding image is recorded in the memory SD.Therefore, when checking the situation around the vehicle after the fact, it is possible to record display image data in the memory SD that allows the situation to be checked together with the operational state of the equipment.

[0046] In addition, when generating display image data by embedding a horn display K or the like in a position within the corresponding surrounding image, the display image data can be recorded in memory SD to easily correlate and display the operating status of the equipment with the surrounding situation, etc., in a manner that allows for easy confirmation.

[0047] Furthermore, display image data is recorded for displaying traffic sign displays 20 and the like indicating the contents of traffic rules related to the surroundings of the vehicle or its movement at corresponding positions within the surrounding image, so that the operating status of the equipment can be easily correlated with the surrounding situation, including the contents of the related traffic rules, and the display image data can be recorded in the memory SD for displaying them in a manner that allows easy confirmation.

[0048] Furthermore, when displaying traffic sign display 20 indicating the contents of the traffic rules related to the road on which the vehicle is traveling, traffic sign display 20 is displayed in a manner viewed from the front of the vehicle, and when displaying traffic sign display 21 and traffic sign display 22 indicating the contents of the traffic rules related to intersecting roads, traffic sign display 21 and traffic sign display 22 are displayed in a manner viewed obliquely from the vehicle (see FIG. 4). Thus, display image data for distinguishing and displaying the traffic rules related to the road on which the vehicle is traveling and the traffic rules related to intersecting roads in an easily visible manner can be recorded in memory SD.

[0049] In addition, display image data is recorded for displaying the vehicle display 23 and warning display 32, etc., which indicate the status of the other vehicle C shown in the surrounding image, at the corresponding positions (see Figure 4), so that the display image data can be recorded in the memory SD for easily correlating and confirming the operating status of the equipment with the surrounding situation, including the status of the other vehicle C, etc.

[0050] Furthermore, it is determined whether the state of the other vehicle C violates traffic rules (see step S14 in Figure 3), and the speed display 31 (frame 31A and leader line 31B) and warning display 32 (frame 32A and leader line 32B) indicating a state determined to violate traffic rules are displayed in a manner that makes them distinguishable from displays indicating a state determined not to violate traffic rules (for example, speed display 30 including frame 30A and leader line 30B).This makes it possible to record display image data in the memory SD to easily correlate and confirm the operating state of the equipment with the surrounding conditions, including whether the state of the other vehicle C violates traffic rules.

[0051] Furthermore, when a moving image of the surroundings of the vehicle is obtained from the vehicle itself as a surrounding image, when the situation around the vehicle is to be checked after the fact, display image data can be recorded in the memory SD, which allows the situation to be checked as a moving image along with the operating status of the equipment.

[0052] In addition, since the equipment of the vehicle whose operating status is detected is at least one of the electrical equipment such as the horn, lights, turn signals or wipers, when checking the situation around the vehicle after the fact, the display image data can be recorded in the memory SD so that the situation can be checked along with the operating status of the electrical equipment such as the horn.

[0053] Furthermore, since the display image data is recorded in the memory SD using a general-purpose format, the versatility of the display image data itself in terms of reproduction or display can be improved.

[0054] In addition to the horn display K in the above-described embodiment, a wiper display showing the operation status of the wipers may be displayed on the display screen G. In this case, display image data useful for post-accident investigation of an accident that occurred in rainy weather can be recorded in the memory SD. Furthermore, a display showing the headlight illumination status of the other vehicle, detected based on the imaging data (see step S12 in Figure 3), may be displayed on the display screen G. In this case, the headlight illumination status of the other vehicle can also be recorded in the memory SD so as to be usable for the post-accident investigation.

[0055] Furthermore, the timing for starting recording of display image data to the memory SD may be configured to start recording of display image data corresponding to display image G that has been captured and temporarily stored in ROM or the like in image processing unit 3 to memory SD, for example, from the time when it is determined that the state of any other vehicle captured in the surrounding image violates a traffic rule (see step 14 in FIG. 3). In this case, by recording the minimum amount of display image data necessary for subsequent confirmation, it is possible to record necessary display image data while saving memory SD. Furthermore, as another example of the timing for starting recording, it may be configured to start recording of display image data corresponding to display image G that has been stored in ROM or the like in image processing unit 3 to memory SD from the time when sudden deceleration, sudden acceleration, or abrupt steering of the vehicle is detected based on the acceleration data from acceleration sensor 15.

[0056] Furthermore, in the above-described embodiment, the sign image data, etc. are recorded in advance in the image data recording unit 10, and the display image data is generated by acquiring the data. However, it is also possible to generate the traffic sign display 20, etc. whenever necessary and superimpose it on the surrounding image.

[0057] In the above-described examples, the embodiment is described as being applied to a drive recorder DR mounted on a vehicle, but it is also possible to apply the embodiment to a drive recorder mounted on a motorcycle or a bicycle.

[0058] Furthermore, a program corresponding to the flowcharts shown in FIG. 3 may be recorded on a recording medium such as an optical disk or a hard disk, or may be obtained via a network such as the Internet, and then read out and executed by a general-purpose microcomputer or the like, thereby causing the microcomputer or the like to function as the image processing unit 3 according to the embodiment. [Explanation of symbols]

[0059] 1. Image information acquisition means (interface) 2. Means of obtaining status information 3. Display information acquisition means (image processing section) 4. Recording means (recording unit) 12 Camera 13 Map data recording section 14 GPS sensor 15 Acceleration sensor 16. Mike 17 Vehicle Interface 20, 21, 22 traffic sign display 23 Vehicle Display 30, 31 speed display 30A, 31A, 32A frames 31B, 31B, 32B leader line 32 Warning display S Information recording device G Display image L and R lane markings C Other vehicles K Horn display DR Drive Recorder SD recording medium (recording means) WL, WR turn signal display LT headlight display

Claims

[Claim 1] image information acquisition means for acquiring surrounding image information corresponding to a surrounding image captured from the moving body around the moving body; a status information acquisition means for acquiring status information indicating an operational status of an accessory of the moving object; a display information acquisition means for acquiring, based on the surrounding image information and the status information, display information for displaying an operation status image indicating the operation status at the time the surrounding image is captured together with the surrounding image; a recording means for recording display image information corresponding to the surrounding image information and the display information on a recording medium; An information recording device comprising:

Images