Imaging device and program
The imaging device addresses installation challenges by providing on-device guidance and adhesive options, ensuring compliance with legal and functional constraints, enhancing user-friendliness and versatility.
Patent Information
- Application Number
- JP2025125991
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2025-07-29
- Publication Date
- 2025-12-05
AI Technical Summary
Existing imaging devices for vehicles, such as drive recorders, face installation challenges due to legal and functional constraints, and require user-friendly guidance to ensure proper placement, especially when installed by non-professionals.
An imaging device equipped with a guide function that provides installation instructions through a notifying means, such as a display or audio output, to help users adhere to legal and functional constraints, including temporary and permanent adhesive options for easy repositioning.
Facilitates user-friendly installation by informing users of proper placement directly on the device, reducing the need for instruction manuals and minimizing reinstallation difficulties, while enabling multiple uses beyond accident recording.
Smart Images

Figure 2025178240000001_ABST
Abstract
Description
[Technical Field]
[0001] The present invention relates to an imaging device and a program that can be installed in a vehicle. [Background technology]
[0002] One type of imaging device that can be installed in a vehicle is a drive recorder that captures and stores images of the area in front of the vehicle, but there are various restrictions on where these devices can be installed. For example, a known legal restriction is that drive recorders must be installed within the top 20% of the windshield. [Prior art documents] [Patent documents]
[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2014-220803 Summary of the Invention [Problem to be solved by the invention]
[0004] Although the above constraints are generally explained in instruction manuals, there are cases where users perform installation work without reading the instruction manual or without reading it carefully. Even if users do read the instruction manual, it is not easy to install the equipment in a way that satisfies the various installation constraints. Furthermore, the mere necessity of reading the instruction manual is inconvenient for users.
[0005] Furthermore, because dashcams may be used to record images in the event of an accident, they must be firmly installed, and are often attached to the windshield with strong double-sided adhesive tape. Therefore, once attached, even if it is later discovered that the position does not satisfy any of the constraints, it is difficult to remove. Even if it is possible to remove it, the adhesive strength decreases, making it difficult to reattach.
[0006] Therefore, it is desirable to provide a guide for installing an imaging device that is easier to understand and more user-friendly. It is also desirable to utilize images captured by an imaging device such as a drive recorder in more ways than just recording images of accidents, etc. This application discloses inventions that address, for example, all or part of the above problems or other problems. [Means for solving the problem]
[0007] This application discloses, for example, the inventions described in the following configuration examples.
[0008] <Configuration example 1> The invention of configuration example 1 is an imaging device that can be installed in a vehicle, The photographing device is characterized by having a first guide function of informing a guide regarding installation of the photographing device from a notifying means.
[0009] In this way, the first guide function notifies the user of the installation guide by the notifying means, so that the user can install the photographing device according to the guide. Furthermore, since the photographing device itself notifies the guide, rather than the instruction manual, convenience for the user is improved.
[0010] The "photographing device" may be a device that captures images, such as a device having a camera. A drive recorder is particularly preferable. This is because drive recorders have many restrictions on installation location and require guidance, and users highly need guidance on installation. In particular, the "photographing device" may be a photographing device that is retrofitted to a vehicle by a user, such as a driver, after purchasing the vehicle. As a device having a camera, a so-called integrated drive recorder that is equipped with a standalone camera and the function of recording the video captured by the camera on a recording medium or the like is particularly preferable.
[0011] "Installation" may refer to fixing, mounting, or adhering to a vehicle, for example, by using double-sided adhesive tape. This is because double-sided adhesive tape is difficult to remove or reattach once attached, and it is highly necessary to avoid situations where reinstallation is required. This is particularly effective for configurations where the installation work is performed by an ordinary vehicle user, rather than by the vehicle manufacturer or a professional installer.
[0012] The notification means may be, for example, a display means and / or an audio output means. The display means and audio output means may be configured with multiple units (for example, two screens). Similarly, each means described in this specification may be configured with multiple units. For example, the control means may be configured by connecting multiple computers via communication.
[0013] The "guide" may be, for example, a guide or explanation. The "guide" may be displayed as an image on a display means. If the image contains text information (e.g., a written explanation), the content can be logically conveyed to the user, and if the image contains graphic information (e.g., illustrations, photographs, etc.), the content can be easily understood. The guide may be displayed by audio output from an audio output means. The imaging device may have a display means, and may have, for example, an image display device (e.g., an LCD monitor) and / or an audio output device (e.g., a speaker) for displaying the guide.
[0014] The configuration for "notifying" may be, for example, a process or control content in which the control means causes a notification means directly or indirectly connected to the control means to notify, and the configuration for "displaying" may be, for example, a configuration in which the control means performs drawing processing for display on the display means.
[0015] <Configuration example 2> The invention of configuration example 2 is the photographing device characterized in that the first guide function has a function of causing a notifying means to notify a guide regarding the installation position of the photographing device.
[0016] In this way, the user can refer to the guide when deciding on the installation position of the image capturing device based on the content of the notification by the notification means.
[0017] The "guide regarding installation location" may be information that allows recognition of guidance or explanation regarding desirable installation locations, undesirable installation locations, restrictions regarding installation locations, and the like.
[0018] <Configuration example 3> The invention of configuration example 3 is an image capturing device characterized in that the guide includes information on restrictions regarding installation of the image capturing device.
[0019] In this way, the user can recognize the installation constraints based on the notification from the camera itself, and can install the camera so as to satisfy the constraints without referring to anything other than the camera, such as an instruction manual. The installation constraints should preferably be constraints on the installation location.
[0020] The inventors of the present application have found that when the device is a drive recorder, it is advisable to provide the following as installation constraints, for example. [1] Legal restrictions. For example, if the device is installed on a windshield, it must be installed within the top 20% of the windshield. [2] The constraint that the device must be installed so as not to hit any movable objects inside the vehicle (especially movable objects originally equipped on the vehicle, such as sun visors and rearview mirrors). [3] The restriction that the device must be installed so as not to interfere with safety equipment such as safety driving assistance brake systems (for example, sensors for collision avoidance systems such as EyeSight (registered trademark)), airbags, head-up displays, ETC, and other vehicle-installed or aftermarket devices near the windshield. [4] The camera must be installed in a position that allows it to capture the entire area in front of the windshield. [5] Restrictions on installation within the wiper's wiping range [6] For models with GPS functionality, the location where the GPS can be received is restricted. [7] The location must be such that there is no radio wave interference with other devices such as terrestrial digital broadcasting receivers. [8] The location must be such that the cigarette lighter cable can be reached and can be routed in a way that does not interfere with driving. [9] Restrictions to avoid tinted windshields and vehicle registration stickers
[0021] In the invention of configuration example 3, the guide may include textual information or graphic information explaining all or part of the above-mentioned constraints, and for example, with regard to constraint [1], an explanation such as "Install within the top 20% of the windshield" may be displayed on the display device. All constraints may be displayed on one screen or on multiple screens.
[0022] <Configuration Example 4> The invention of configuration example 4 is the photographing device, wherein the guide includes information on precautions regarding installation of the photographing device.
[0023] In this way, the user can know the matters requiring attention during installation without referring to anything other than the imaging device, such as an instruction manual. The points to note regarding installation may include points to note regarding the installation location and points to note regarding installation constraints. The points to note regarding installation constraints may include, for example, matters that the user should do to satisfy the constraints and points to note when performing the matters.
[0024] The notice of the cautions may be displayed, and may include text and / or graphic information. For example, regarding the constraint [2], an explanation such as "Please move the sun visor or rearview mirror to make sure they do not hit the camera," or regarding the constraint [6], an explanation such as "To check whether GPS reception is possible, move the car away from a location with an obstacle above, such as a covered garage," may be included. The notices may be displayed all on one screen, or on multiple screens.
[0025] <Configuration example 5> The invention of configuration example 5 is an imaging device characterized in that the guide distinguishes between information about areas where installation of the imaging device is prohibited and information about areas where installation is not prohibited but undesirable, and notifies the information in a manner that can be recognized by the user.
[0026] In the past, there was no concept of clearly distinguishing between areas where installation is possible but not desirable and areas where installation is prohibited, so there was a risk that the two would be seen as the same and the device would be installed in a prohibited location.However, with this method, users can recognize areas where installation is prohibited and areas where installation is possible but not desirable, reducing the possibility of confusing the two and installing the device in an area where installation is prohibited.
[0027] <Configuration Example 6> The invention of configuration example 6 includes a temporary installation instruction function that instructs a user to temporarily install the imaging device according to the guide; a movable object operation instruction function that instructs the vehicle to operate movable objects after temporary installation; The imaging device is characterized by comprising:
[0028] This makes it easy to prevent situations where, after installation, a movable object on the vehicle is operated and it is discovered that the object is in an inappropriate position, requiring the object to be re-installed.
[0029] The movable parts of the vehicle may be, for example, parts that can actually be moved physically, such as sun visors, rearview mirrors, windshield wipers, etc. The movable parts of the vehicle may also be parts that can be electrically moved using electricity, such as digital terrestrial broadcasting reception functions and GPS reception functions.
[0030] <Configuration Example 7> The invention of configuration example 7 includes a temporary installation determination function that determines whether a temporary installation position of the image capturing device is inappropriate when the image capturing device is temporarily installed; The photographing device is characterized by having a second guide function that notifies information that the temporary installation determination function has determined that the installation may be inappropriate.
[0031] In this way, the user can know that the temporary installation position may be inappropriate, and can easily check whether the position is truly inappropriate before the actual installation, and if it is inappropriate, can change the temporary installation position of the imaging device to a position different from the position indicated as possibly inappropriate, or can actually install the imaging device.
[0032] In particular, the photographing device may be configured to have both the second guide function and the first guide function, and in particular, may be configured to execute the second guide function after executing the first guide function.
[0033] The display of the possibility of inappropriateness may include the reason for inappropriateness and instructions to move the installation location. This is preferable because it makes it easier for the user to understand where to move the device. The display of the possibility of inappropriateness may include textual information or graphic information. For example, if it is determined that the device is likely to be inappropriate with respect to constraint [1], it may include an explanation such as "It is not installed within the top 20% of the windshield. Please move the installation location." If it is determined that the device is likely to be inappropriate with respect to constraint [2], it may include an explanation such as "Please move the installation location so that it does not hit the sun visor or rearview mirror." The display of the possibility of inappropriateness may be displayed using images and / or audio.
[0034] Furthermore, for example, the image capture device may have a temporary installation instruction function that instructs the user to temporarily install the image capture device, and the temporary installation determination function may perform the determination after the instruction by the temporary installation instruction function. In this way, it is possible to determine whether the temporary installation location is inappropriate after the user actually performs the temporary installation. The instruction by the temporary installation instruction function may be provided by image and / or audio. The temporary installation instruction function may instruct the user to temporarily install the image capture device according to guidance by the first guide function. This increases the likelihood that the user will perform the temporary installation in an appropriate location, reducing the number of temporary installations. The temporary installation instruction function may display cautions for temporary installation. For example, with regard to the constraint [6], cautions may be displayed such as: check whether GPS reception is possible after moving the car from a location with obstacles above, such as a covered garage; and, since GPS reception takes a certain amount of time even in a location where reception is possible, check whether GPS reception is possible after that time has passed.
[0035] <Configuration Example 8> The invention of configuration example 8 has a situation input instruction function that instructs a user to input a situation at the time of temporary installation into an operation means, The temporary installation determination function performs the determination based on an operation on the operation means.
[0036] In this way, it is possible to determine whether there is a possibility of inappropriate behavior that would be difficult to detect directly by the imaging device itself, such as interference from the imaging device affecting the operation of other devices (e.g., terrestrial digital broadcasting receivers, etc.).
[0037] In particular, the image capture device may be configured to have a temporary installation determination function and a second guide function in addition to the situation input instruction function. In particular, the temporary installation determination function and the second guide function may be configured to be executed after the situation input instruction function is executed.
[0038] The operation means may be, for example, a push button or a touch panel.
[0039] The situation at the time of temporary installation may be a situation regarding the possibility that the temporary installation position is inappropriate, or more preferably, a situation regarding whether a problem will occur in relation to the movement or operation of the device equipped or retrofitted to the vehicle. For example, if the device equipped or retrofitted to the vehicle is a movable object, the situation may be a situation regarding whether the device will hit the temporarily installed imaging device when actually moved. If the device equipped or retrofitted to the vehicle is an electrical or electronic device, the situation may be a situation regarding whether a problem will occur in the operation of the device when actually operated. The instructions issued by the situation input instruction function may include instructions to move or operate the device equipped or retrofitted to the vehicle. For example, the instructions may include all or part of the following instructions: (a) Instructions to move the sun visor or rearview mirror and input whether they hit the camera. (b) Instructions to input whether there is interference with devices such as airbags, head-up displays, ETC, etc., especially with aftermarket devices. (c) Instructions to input whether other devices are turned on and functioning normally (for example, whether terrestrial digital television devices can receive all channels, whether devices with GPS functionality can perform GPS positioning, whether remote control keys function normally, etc.)
[0040] When giving instructions under (a), it is advisable to also caution and warn drivers to pay particular attention to the passenger side sun visor and / or that the position of the rearview mirror may change depending on the driver.
[0041] Furthermore, for example, if the photographing device is provided with a temporary installation judgment function that judges whether the photographing device has been temporarily installed, and the temporary installation judgment function is characterized in that it makes the judgment when it judges that the photographing device has been temporarily installed, then it is possible to judge whether the installation is possibly inappropriate after judging that the installation has been temporarily installed.
[0042] In particular, the imaging device may be configured to have a temporary installation determination function, a temporary installation judgment function, and a second guide function, in addition to the temporary installation determination function. In particular, the temporary installation determination function and the second guide function may be configured to be executed after the temporary installation determination function is executed.
[0043] The determination of temporary installation may be made, for example, by instructing the user to perform a predetermined operation on the operation means of the image capture device after temporary installation, and determining that temporary installation has been completed when the predetermined operation has been completed. It is even more preferable that the image capture device further includes a function for determining the shaking of the image capture device, and determines that temporary installation has been completed when the shaking of the image capture device falls below a certain level, since this automatically determines that temporary installation has been completed. The shaking of the image capture device may be determined, for example, based on the image captured by the image capture device.
[0044] <Configuration Example 9> The invention of configuration example 9 is the photographing device, wherein the temporary installation determination function has a function of making the determination based on image recognition using an image photographed by the photographing device.
[0045] In this way, the user can temporarily install the camera and let the camera itself determine whether the position is appropriate, reducing the difficulty of the user having to try to place the camera while adhering to all the information displayed in the guide. This can significantly reduce the burden on the user, especially when there are multiple constraints, especially four or more. The image recognition-based judgment can be configured to make a judgment based on the image captured at the time of temporary installation, for example.
[0046] The temporary installation determination function may recognize from the captured image whether any objects or parts that may obstruct photography are included, and if so, determine that the position of the imaging device may be inappropriate. Examples of objects or parts that may obstruct photography include stickers on vehicle inspection certificates, tinted parts of the windshield, and parts outside the wiper wiping range. If the temporary installation determination function determines that the position is inappropriate, the second guide function may display a notification that the relevant object or part is included in the photography range and an instruction to change the installation position.
[0047] When recognizing whether the captured image includes an area outside the wiper's wiping range, the image capture device may have a function to instruct the user to move the wiper, and the temporary installation determination function may recognize the movement of the wiper from the captured image after the instruction and determine whether the captured image includes an area outside the wiper's wiping range or the possibility of inappropriateness based on the size of that area. If the image capture device further has a function to display the real-time captured image captured by the image capture device on a display device and to display the wiper's wiping range recognized by image recognition superimposed on the real-time captured image, for example, by AR (Augmented Reality) display, this makes it easier for the user to recognize an appropriate installation position in relation to objects inside and outside the vehicle that are actually captured in the image.
[0048] The temporary installation determination function may recognize the positional relationship between a specific structure in the vehicle (e.g., the windshield) and the temporary installation position based on image recognition, and may determine the possibility that the temporary installation position is inappropriate based on the recognized positional relationship. For example, with regard to constraint [1], the possibility that the temporary installation position is inappropriate may be determined based on whether the temporary installation position is within the top 20% of the windshield. If the temporary installation determination function determines that the installation position is inappropriate, the second guide function may display the reason why the installation position is inappropriate and instructions to change the installation position.
[0049] The positional relationship between a specific structure in a vehicle and the camera can be recognized by comparing a reference image including the specific structure captured by the camera with the image captured during temporary installation. The reference image can be a still image. For example, a user can be instructed to press a camera button at the top of the windshield, and when the button is pressed, an image of the top position can be recorded. A user can be instructed to press the camera button at the bottom of the windshield, and when the button is pressed, an image of the bottom position can be recorded. These top and bottom position images can be used as the reference images. It is even more advantageous to use an image of the entire windshield (or a certain portion thereof) captured from a rear seat or the like as the reference image, as this reduces the effort required to obtain the reference image.
[0050] <Configuration Example 10> The invention of configuration example 10 has a safety equipment discrimination function for discriminating the type of safety equipment installed in a vehicle, The photographing device is characterized in that the temporary installation determination function makes the determination depending on the type of the safety equipment determined by the safety equipment determination function.
[0051] In this way, even if the user does not know the specific safety equipment of the vehicle, it is possible to determine whether the temporary installation position is inappropriate, and the need for the user to check the relationship between the safety equipment and the imaging device in advance is reduced, which is particularly effective for ordinary citizen users and drivers who are not vehicle manufacturers or sellers.
[0052] The safety equipment may be, for example, equipment having a prohibited installation area, such as a safety driving support brake system or an airbag. The prohibited installation area may be an area where installation of an image capture device is prohibited or undesirable.
[0053] The safety equipment discrimination function may directly discriminate the type of safety equipment, but for example, in the case of a vehicle model that is equipped with safety equipment as standard, the type of safety equipment may be discriminated based on the vehicle model. Also, for example, the imaging device may simply be provided with a vehicle model discrimination function that discriminates the vehicle model, and the temporary installation determination function may make the determination according to the vehicle model discriminated by the vehicle model discrimination function. It is preferable to make the determination based on information acquired from the vehicle side, but a configuration that focuses on safety equipment as in <Configuration Example 10> is particularly preferable.
[0054] The safety equipment identification function may, for example, identify the type of safety equipment based on a user's operation on an operation means. For example, the imaging device may display a list of safety equipment on a display means and instruct the user to operate the operation means to select the type of safety equipment installed in the user's vehicle from the list, and the safety equipment identification function may identify the type of safety equipment based on the operation on the operation means. The safety equipment identification function may identify the type of safety equipment based on information acquired from the vehicle side. For example, automatically identifying the type of safety equipment based on a signal from an OBD-II (II is the Roman numeral "2", hereinafter referred to as "OBD") connector may reduce the user's workload.
[0055] In particular, the photographing device may be configured to have a temporary installation determination function and a second guide function in addition to the safety equipment determination function. In particular, the temporary installation determination function and the second guide function may be configured to be executed after the safety equipment determination function is executed.
[0056] The photographing device may further include a prohibited installation range storage means for storing a prohibited installation range for each type of safety equipment, and the temporary installation determination function may determine the possibility that the temporary installation position is inappropriate based on the prohibited installation range stored in the prohibited installation range storage means for the type of safety equipment identified by the safety equipment identification function. The prohibited installation ranges are published on the websites or catalogs of manufacturers of vehicles and safety equipment, and this information may be stored in the prohibited installation range storage means.
[0057] For example, if the prohibited installation range includes an area on a specific structure within the vehicle (e.g., the windshield), the temporary installation determination function can recognize the positional relationship between the specific structure within the vehicle and the temporary installation position based on image recognition, and automatically determine whether the installation position is inappropriate based on whether the temporary installation position is within the prohibited installation range for safety equipment, thereby reducing the user's workload.
[0058] <Configuration Example 11> The invention of configuration example 11 is an imaging device characterized by having an installation position candidate display function for displaying installation position candidates.
[0059] In this way, installation location candidates are displayed, allowing the user to more easily decide on an installation location.
[0060] In particular, if the imaging device is configured to have a first guide function in addition to an installation position candidate display function, the user can check whether the installation position candidate matches the installation guide.
[0061] Candidate installation locations should be locations that are appropriate as installation locations. For example, areas that do not satisfy all or certain of the constraints [1] to [9] above (for example, safety constraints such as constraints [1] and / or [3]) should be considered inappropriate areas, and areas other than inappropriate areas should be considered as candidate installation locations.
[0062] The installation position candidate display function may display installation position candidates based on information previously stored in a storage means of the image capture device. For example, with respect to constraint [1], information on the upper 20% of the windshield may be previously stored in the storage means, and the upper 20% of the windshield may be displayed as installation position candidates based on the information. The information may be stored as coordinate information. Furthermore, with respect to constraint [3], if the image capture device has the safety equipment discrimination function of configuration example 10, the installation position candidate display function may display installation position candidates based on the type of safety equipment identified by the safety equipment discrimination function. The image capture device may further have installation prohibited area storage means that stores installation prohibited areas for each type of safety equipment, and the temporary installation determination function may display areas outside the installation prohibited area stored in the installation prohibited area storage means for the type of safety equipment identified by the safety equipment discrimination function as installation position candidates.
[0063] Alternatively, the installation location candidates may be divided into multiple small regions with different priorities, and the candidate display function may display each small region so that its priority is clear. The priorities may be set, for example, based on whether each small region satisfies installation constraints. For example, the priorities may be set based on the type or number of constraints each small region satisfies. For example, the installation location candidate regions may be divided into small regions that satisfy only specific constraints (e.g., safety constraints such as constraints [1] and / or [3]) and small regions that simultaneously satisfy the specific constraints and other constraints (e.g., all or part of [2], [4] to [9]), and the latter may be set to a higher priority than the former. Priorities may also be set based on criteria other than whether each small region satisfies installation constraints. For example, the regions that satisfy constraints [1] and [3] may be divided into a small region on the driver's seat side and a small region on the passenger's seat side, and the passenger's seat side may be set to a higher priority than the small region on the driver's seat side. This is because it is more desirable to set the imaging device in a position that does not obstruct the driver's field of view.
[0064] The installation location candidate display function may display the installation location candidate images. If the photographing device further has a function of displaying real-time photographed images photographed by the photographing device on the display device, and the installation location candidate display function has a function of displaying the installation location candidate images superimposed on the real-time photographed images, for example, by AR display, it is even more preferable because this makes it easier for the user to recognize the installation location candidate images.
[0065] The installation location candidate display function may display candidate installation location areas in a different color. For example, the candidate installation location areas may be displayed in a different color from the inappropriate areas. For example, the candidate installation location areas may be displayed in green, and the inappropriate areas may be displayed in red. The candidate installation location areas may be divided into multiple small areas with different priorities, and each small area may be displayed in a different color depending on the priority, which makes it easier for the user to understand the priority of each small area. For example, small areas with high priority may be displayed in green, small areas with low priority may be displayed in yellow, and inappropriate areas may be displayed in red.
[0066] <Configuration Example 12> The invention of configuration example 12 is a device in which a temporary installation adhesive member and a permanent installation adhesive member are packaged together, The imaging device is characterized in that the temporary installation adhesive member has a weaker adhesive strength than the permanent installation adhesive member.
[0067] In this way, the adhesive member for temporary installation has a weaker adhesive strength than the adhesive member for permanent installation, so when the photographing device is installed using the adhesive member for temporary installation, even if the installation position is inappropriate, it is easy to remove the photographing device.
[0068] It is also advisable to provide a function that notifies the user that the installation will be performed in the order of temporary installation followed by permanent installation, which will prevent the user from accidentally performing permanent installation straight away and then having difficulty re-installing the device.
[0069] Furthermore, it is preferable to have a function of instructing the user to use the temporary installation adhesive member during temporary installation and the permanent installation adhesive member during permanent installation. In particular, it is preferable that the temporary installation adhesive member and the permanent installation adhesive member are structured so that they can be recognized as different members, and the informing function notifies the user of the structure so that the difference between the temporary installation adhesive member and the permanent installation adhesive member can be recognized.
[0070] The adhesive strength of the temporary installation adhesive member should be strong enough to prevent the camera from falling off when temporarily installed, but strong enough to allow it to be removed by pulling with a hand. This allows the camera to be easily installed and confirmed to be in the correct installation position, and allows it to be removed after temporary installation. If the temporary installation adhesive member has adhesive strength that allows it to be installed multiple times, the user can easily find the appropriate installation position by repeatedly installing the camera. If the installation adhesive member has strong adhesive strength that prevents it from being removed by pulling with a hand, more stable and / or reliable photography is possible.
[0071] <Configuration Example 13> The invention of configuration example 13 is an imaging device characterized in that the temporary installation adhesive member and the permanent installation adhesive member are laminated together.
[0072] In this way, because the temporary installation adhesive member and the permanent installation adhesive member are laminated, for example, a user can temporarily install the imaging device using the laminated temporary installation adhesive member, and then remove the temporary installation adhesive member and permanently install the imaging device using the permanent installation adhesive member, which improves user convenience and / or simplifies the installation work. The temporary installation adhesive member and the permanent installation adhesive member may be packaged together with the imaging device in a laminated state. The temporary installation adhesive member and the permanent installation adhesive member may be laminated with an adhesive strength that allows the user to easily remove the temporary installation adhesive member.
[0073] The permanent installation adhesive member may be laminated on the imaging device closer to the temporary installation adhesive member, and the temporary installation adhesive member may be laminated on the permanent installation adhesive member with an adhesive strength that does not cause the imaging device to peel off from the permanent installation adhesive member due to its own weight, but allows the temporary installation adhesive member to be peeled off when an attempt is made to peel it off by hand. The permanent installation adhesive member may be adhered to the imaging device with an adhesive strength that does not cause the temporary installation adhesive member to peel off from the imaging device when an attempt is made to peel it off by hand.
[0074] <Configuration Example 14> The invention of configuration example 14 is an image capturing device characterized in that the temporary installation adhesive member has transfer ink that is transferred to the installation location when the image capturing device is installed using the temporary installation adhesive member.
[0075] In this way, for example, when the photographing device is installed using the temporary installation adhesive member, the photographing device can be permanently installed using the transfer ink transferred to the installation location as a marker, which makes the installation work easier.
[0076] The transfer ink may be an ink that can be wiped off with a tissue or the like, so that the transfer ink can be easily erased even if the installation location of the image capture device is inappropriate when the image capture device is installed using the temporary installation adhesive member. The transfer ink may be, for example, a water-based ink.
[0077] <Configuration Example 15> The invention of configuration example 15 is a program for causing a computer to realize the functions of the photographing device according to any one of configuration examples 1 to 14.
[0078] The temporary installation judgment function described above may be provided with a function that utilizes images captured by an imaging device such as a drive recorder, rather than simply using the images to record footage of accidents, etc., such as a function that makes the judgment based on image recognition using images captured by the imaging device.
[0079] In particular, since drive recorders are equipped with cameras and image recognition engines for functions such as lane departure detection and forward vehicle detection, we discovered that these could be used for purposes other than their original purpose of recording accidents and safe driving.
[0080] (A) It is preferable to have a function of controlling the vehicle state during warm-up by the engine starter based on the transmission state of the windshield, which is based on an image captured by the imaging device of the windshield.
[0081] This configuration allows the user to more reliably depart immediately with the windshield open.
[0082] Conventional engine starters have the function of controlling the engine to stop when a predetermined time has elapsed since the engine was started, and of having a temperature sensor that stops the engine when the temperature reaches a predetermined temperature.
[0083] However, the purpose of warming up the engine using an engine starter is not only to raise the temperature inside the vehicle before starting to drive, but also to start the vehicle before setting off to remove any frozen, frosted, or snowy conditions on the windshield of the vehicle and ensure visibility ahead so that the vehicle can depart immediately.However, whether or not such a condition has been met is determined indirectly by sensors or the duration of warm-up, and there is a problem in that it is not possible to know whether the windshield is in a state where visibility is truly sufficient until the user actually gets in the vehicle.However, with this configuration, the user can more reliably depart immediately with the windshield clear.
[0084] Depending on the transparency of the windshield, for example, it may be determined that warm-up can be terminated if the windshield is transparent. Depending on the transparency of the windshield, for example, it may be determined that warm-up should not be terminated if the windshield is not transparent. For example, the vehicle state (engine off, air conditioning adjustment) during warm-up by the engine starter may be controlled depending on whether the forward view (windshield) is clear (transparent) using a camera, and the engine may be stopped when the view is clear.
[0085] To control the vehicle state during warm-up, it is preferable to turn off the engine if it is determined that warm-up can be completed, or to send a signal to the vehicle to adjust the air conditioner temperature according to the transparency. For example, it is preferable to control at least one of the following: air conditioner (e.g., temperature, air outlet position, etc.), window (e.g., slightly open window), and wiper (e.g., intermittent, fast, slow), via an in-vehicle LAN or direct connection to each part of the vehicle, such as via an OBD adapter. It is preferable to obtain information about the current environment, such as the vehicle's engine state, interior temperature, exterior temperature, and air conditioner setting temperature, and control the warm-up state based on that information.
[0086] Furthermore, for example, instead of providing the engine starter with conventional sensors or functions, the imaging device may be electrically connected to the engine starter, and the vehicle state during warm-up may be controlled based on the actual state of the windshield.
[0087] The engine starter may be, for example, one that starts an internal combustion engine, but is not limited to this and may also include one that starts the warm-up of an electric vehicle.
[0088] It is preferable to determine whether the fog on the windshield is caused by snow or frost based on the image of the windshield captured by the imaging device, and control the warm-up state accordingly.
[0089] The amount and / or extent of snow or frost on the windshield may be determined based on the image of the windshield captured by the imaging device and the degree of fogging on the windshield, and the warm-up state may be controlled accordingly.
[0090] For example, a camera can be used to determine whether the fog on the windshield is due to snow or frost (and it is also advisable to determine the amount and extent of snow or frost) and control the warm-up state.
[0091] (B) It is preferable to provide a function for determining or recording the rain conditions based on the captured image of the windshield wiper operation area captured by the imaging device. This makes it possible to more reliably determine or record the gradual rain conditions. Conventional methods for detecting the wiper operation status include detecting it directly from the wiper signal line, obtaining it from the wiper operation lever, obtaining it via an ECU connection, or obtaining it via an in-vehicle LAN such as OBD. However, all of these methods have the problem of requiring wiring to the vehicle. However, this system does not require such wiring and is extremely easy to install. This is particularly useful in configurations where the wiper operation status is recorded to the cloud for big data analysis processing.
[0092] The rainy conditions can be determined, for example, by using the state of the wipers moving across the image captured by a drive recorder or the like as an imaging device.
[0093] The rain condition can be determined, for example, by providing a function for determining the intensity of rain from the interval between wiper operations. It is also desirable to provide a function for recording changes in the interval between wiper operations in a distinguishable manner. It is particularly desirable to record the wiper operation status together with GPS information (time, location, etc.). It is also desirable to record the information so that it can be played back in sync with the video recording. The recording location can be the imaging device itself or a recording medium detachable from the imaging device, but it is particularly desirable to have a configuration in which information is uploaded to the cloud as needed.
[0094] (C) It is preferable to have a function to determine or record the headlight illumination status based on an image captured by the imaging device of the area in front of the windshield. This function does not require wiring or the like, and is extremely easy to install.
[0095] It is preferable to provide a function for using the determination result of the headlight lighting state to detect the timing of lighting the headlights, for example.
[0096] The headlight status can be determined, for example, to determine whether the vehicle's own lights are on, or whether the vehicle in front has its lights on, or to determine whether a dimmer is on to change the brightness of a display device.
[0097] For example, it is preferable to have a function for recording the state of the headlights together with GPS information (time, location, etc.).
[0098] Furthermore, it is advisable to detect the amount of ambient light around the vehicle from the image captured by the imaging device or from another sensor and record the information together with the state of the ambient light. The recording location may be the imaging device itself or a recording medium detachable from the imaging device, but it is particularly advisable to have the information uploaded to the cloud as needed for recording.
[0099] These functions may be provided in a device external to the imaging device and implemented by electrically connecting the device to the external device, but it is preferable to provide them inside the imaging device.
[0100] It is preferable to provide a sensor (e.g., a temperature sensor, a humidity sensor, an illuminance sensor, a proximity sensor, a gesture sensor, etc.) in the portion attached to the windshield, and to make the judgment or recording based on the sensor information and an image captured by the imaging device of the area in front of the windshield.
[0101] The determination or recording may be performed based on vehicle type information obtained from a connector such as an OBD provided on the vehicle.
[0102] It is preferable to provide a function for feeding back the result of the determination to the vehicle via an OBD adapter.
[0103] It is preferable to provide a function that allows the judgment or the recorded content to be viewed and / or controlled from a smartphone or the like.
[0104] The functions of the imaging device described above may be configured as a program for causing a computer to implement the functions.
[0105] The configurations described in the above-mentioned configuration examples may be combined to the extent that no contradictions occur. Furthermore, the components described in the configuration examples may be arbitrarily combined to the extent that no contradictions occur to create a new configuration example. [Brief explanation of the drawings]
[0106] [Figure 1] 1 is a perspective view showing the external appearance of the front side of a drive recorder according to a first embodiment. [Figure 2] 1 is a perspective view showing the appearance of the rear side of a drive recorder according to a first embodiment. [Figure 3] FIG. 2 is a diagram showing the appearance of a bracket. [Figure 4] FIG. 1(a) is a diagram showing the structure of the adhesive tape, and FIG. 1(b) is a diagram showing the surface of the gel sheet. [Figure 5] FIG. 2 is a block diagram showing the hardware configuration of the drive recorder. [Figure 6] 10 is a flowchart of an installation guide process. [Figure 7] FIG. 2 is a diagram showing an example of a first guide screen 100. [Figure 8] FIG. 10 is a diagram showing an example of an installation location candidate screen 110. [Figure 9] FIG. 10 is a diagram showing an example of a display of a temporary installation instruction screen 120. [Figure 10] FIG. 10 is a diagram showing an example of a message screen 130. [Figure 11] FIG. 10 is a diagram showing an example of a movable object operation instruction screen 140. DETAILED DESCRIPTION OF THE INVENTION
[0107] (First embodiment) A drive recorder 1 will be described below as an example of an image capturing device according to the present invention. The drive recorder 1 is installed on the windshield of a vehicle. It has been found that the installation of the drive recorder 1 has the following constraints, and as will be described below, the drive recorder 1 has processing, functions, and configurations that address these constraints. [1] Legal restrictions. For example, if the device is installed on a windshield, it must be installed within the top 20% of the windshield. [2] The constraint that the device must be installed so as not to hit any movable objects inside the vehicle (especially movable objects originally equipped on the vehicle, such as sun visors and rearview mirrors). [3] The restriction that the device must be installed so as not to interfere with safety equipment such as safety driving assistance brake systems (for example, sensors for collision avoidance systems such as EyeSight (registered trademark)), airbags, head-up displays, ETC, and other vehicle-installed or aftermarket devices near the windshield. [4] The camera must be installed in a position that allows it to capture the entire area in front of the windshield. [5] Restrictions on installation within the wiper's wiping range [6] For models with GPS functionality, the location where the GPS can be received is restricted. [7] The location must be such that there is no radio wave interference with other devices such as terrestrial digital broadcasting receivers. [8] The location must be such that the cigarette lighter cable can be reached and can be routed in a way that does not interfere with driving. [9] Restrictions to avoid tinted windshields and vehicle registration stickers
[0108] 1 and 2 show the drive recorder 1 from the front and rear. The drive recorder 1 is an electronic device that houses an electronic circuit board (not shown) inside a generally rectangular housing 2. A CCD camera lens 3 for capturing images is located on the front of the housing 2, and an LCD screen 4 of a liquid crystal display 12 (see FIG. 5) for displaying images and various operation buttons 5 (up button 5a, down button 5b, MODE button 5c, and MENU button 5d) are located on the rear. A capture button 6a for capturing images and a power button 6b are located on the top surface of the housing 2, as well as a screw hole 7 for attaching a bracket 20 (see FIG. 3). A connection terminal 8 for supplying power and a card slot 9 for inserting a microSD card as a recording medium are located on the side of the housing 2. Power is supplied to the connection terminal 8 from the vehicle's cigarette lighter socket via a cigarette lighter cable (not shown), but in vehicles with an OBD connector, it is also possible to connect the connection terminal 8 to the OBD connector via an OBD connection cable (not shown) so that power is supplied to the connection terminal 8 from the OBD connector.
[0109] 3 shows a bracket 20 for installing and fixing the drive recorder 1 to the windshield 40 of a vehicle. The bracket 20 includes an attachment stay 21 that is attached to the windshield 40 by the adhesive force of an adhesive tape 30 (double-sided adhesive tape 31 or gel sheet 32) described below, and a base 22 that includes screws 22a that correspond to the screw holes 7 of the drive recorder 1.
[0110] As shown in Figure 3, the attachment stay 21 is a component having a curved arm portion 21b extending from the back surface of an approximately rectangular attachment plate 21a that is attached to the glass surface of the windshield 40, and a spherical sliding ball 21c at the tip of the arm portion 21b.
[0111] The base 22 is a member having a screw 22a standing on its lower surface and a recess (not shown) on its upper surface for accommodating the sliding ball 21c. An outer circumferential screw 22b into which the outer circumferential nut 23 is screwed is provided on the outer periphery of the recess. When the outer circumferential nut 23 is tightened with the sliding ball 21c accommodated in the recess, the sliding ball 21c can be tightened and fixed, thereby fixing the angle of the attachment stay 21 relative to the base 22, etc. When the outer circumferential nut 23 is loosened, the sliding ball 21c can be loosened and swung.
[0112] FIG. 4(a) shows the adhesive tape 30 included with the drive recorder 1. The adhesive tape 30 is composed of a laminate of a double-sided adhesive tape 31 and a gel sheet 32, and has approximately the same shape and size as the attachment plate 21a. The double-sided adhesive tape 31 has such strong adhesive strength that, once attached to the windshield 40, it cannot be peeled off by simply pulling it with one hand. The gel sheet 32 has weaker adhesive strength than the double-sided adhesive tape 31, and can be attached to the windshield 40 with enough strength to prevent the drive recorder 1 from falling under its own weight and to allow it to be easily peeled off by pulling it with one hand. The gel sheet 32 can be easily removed (or peeled off) from the double-sided adhesive tape 31. The adhesive tape 30 is included with the drive recorder 1 with a lower protective film 33 covering the surface of the double-sided adhesive tape 31 and an upper protective film 34 covering the surface of the gel sheet 32 attached.
[0113] FIG. 4(b) shows the surface of the gel sheet 32 with the upper protective film 34 removed. As shown in the figure, a position mark 32a is printed on the surface of the gel sheet 32 using water-based ink. As shown in FIG. 4(b), the position mark 32a has sides parallel to the outer edges of the adhesive sheet 30, which has approximately the same shape and size as the attachment plate 21a, and is printed so that the intersections of the sides are visible. The positions of these sides are printed at positions equal inward from the outer edges of the adhesive sheet 30 in both the left and right directions. The positions of the sides are also printed at positions equal inward from the outer edges of the adhesive sheet 30 in both the up and down directions. In the example of FIG. 4, the positions are printed at equal inward distances on both the up and down and left and right sides. When the gel sheet 32 is adhered to a windshield 40 or the like and then peeled off, the position mark 32a is transferred to the windshield 40 or the like. The position mark 32a transferred to the windshield 40 can be easily removed by wiping it with a tissue or the like.
[0114] Because the adhesive tape 30 has a two-layer structure consisting of the double-sided adhesive tape 31 and the gel sheet 32, the user can install the drive recorder 1 on the windshield 40 using the gel sheet 32, check whether the installation position is appropriate, and then temporarily detach the drive recorder 1 from the windshield 40, remove the gel sheet 32 from the adhesive tape 30, and then install the drive recorder 1 using the double-sided adhesive tape 31. (Hereinafter, installing the drive recorder 1 using the gel sheet 32 will be referred to as "temporary installation," and installing the drive recorder 1 using the double-sided adhesive tape 31 will be referred to as "full installation.") Because the position mark 32a remains on the windshield 40 during temporary installation, the user can use the position mark 32a as a guide for permanently installing the drive recorder 1. For example, the user can permanently install the drive recorder 1 by aligning it with the position mark 32a transferred to the windshield 40 or the like during temporary installation. For example, the alignment may be performed so that each side of the double-sided adhesive tape 31 (or the attachment plate 21a) is parallel to and roughly aligned with each side of the transferred position mark 32a. More precisely, "roughly aligned" refers to alignment such that the left and right sides of the position mark 32a are positioned equidistant to the right and left from the left and right sides of the double-sided adhesive tape 31 (or the attachment plate 21a), respectively, and that the top and bottom sides of the position mark 32a are positioned equidistant to the bottom and top from the top and bottom sides of the double-sided adhesive tape 31 (or the attachment plate 21a). This approach makes it easy to minimize deviations between the temporary installation position and the actual installation position. Minimizing deviations reduces the possibility of installing the drive recorder 1 in a restricted location.
[0115] 5 shows the hardware configuration of the drive recorder 1. The drive recorder 1 includes a control unit 10, a CCD camera 11, an LCD display 12, a speaker 13, a GPS receiver 14, an acceleration sensor 15, an SD card reader 16, a storage unit 17, and an operation reception unit 18.
[0116] The control unit 10 is a computer having a CPU, memories such as ROM and RAM, a timer, etc., and controls the CCD camera 11, LCD display 12, speaker 13, GPS receiver 14, acceleration sensor 15, SD card reader 16, storage unit 17, operation reception unit 18, etc. In addition to an OS (Operating System), the ROM stores various programs such as an image recognition program that recognizes objects in the captured image by performing image processing (contour extraction, pattern matching, etc.) using the image captured by the CCD camera 11, and an installation guide program for executing the installation guide process described below.
[0117] The CCD camera 11 is an imaging means that acquires data of an image of the area ahead of the vehicle through the lens 3. The CCD camera 11 inputs data to the control unit 10 via an interface that is capable of performing data compression and digital conversion. Images captured by the CCD camera 11 can be displayed on the liquid crystal display 12 and can also be stored on an SD card inserted into the card slot 9. The CCD camera 11 is capable of capturing both moving and still images.
[0118] The liquid crystal display 12 is a device that displays images under the control of the control unit 10, and the speaker 13 is a device that outputs sound under the control of the control unit 10. The liquid crystal display 12 and the speaker 13 serve as notification means that notify the user of a guide regarding installation of the drive recorder 1.
[0119] The GPS receiver 14 receives GPS signals from GPS satellites and outputs current position (longitude and latitude) information to the control unit 10.
[0120] The acceleration sensor 15 is a three-axis type sensor that measures acceleration and tilt in each of three directions (X, Y, Z).
[0121] The SD card reader 16 reads and writes data from and to an SD card inserted into the card slot 9 under the control of the control unit 10 .
[0122] The storage unit 17 is configured with a memory such as an EEPROM. The storage unit 17 stores at least notification data 171 and installation prohibition area data 172 as various data used in the installation guide process described below. The storage unit 17 also stores a power-on flag 173.
[0123] The notification data 171 is data for making a notification using notification means such as the liquid crystal display 12, the speaker 13, etc. The notification data 171 includes first guide data 171a, second guide data 171b, movable object operation instruction data 171c, and installation position candidate display data 171d.
[0124] The first guide data 171a is data for notifying the user of installation guidance in step S1, which will be described later. The first guide data 171a includes text data, image data, etc. for notifying the user of the above constraints [1] to [9]. The first guide data 171a includes text data for displaying the following sentences (1) to (9) corresponding to the above constraints [1] to [9]. (1) Install the unit within 20% of the windshield from the top. (2) Install the unit in a location that will not be hit by the rearview mirror. (3) Install the product so that it does not interfere with devices near the windshield, such as safety driving assistance brake systems and airbags. (4) Install the camera in a position that allows it to capture the entire area in front of the windshield, from left to right and above to below. (5) Install within the wiper's wiping range. (6) Install the device in a location where GPS signals can be received. To check whether GPS signals can be received, move the car away from any obstacles above, such as a covered garage. (7) Install the device in a location that does not cause radio wave interference with other devices such as terrestrial digital broadcasting receivers. (8) Install the unit in a location where the cigarette lighter cable can reach and where it can be routed without interfering with driving. (9) When installing, avoid the tinted parts of the windshield and the vehicle inspection certificate sticker.
[0125] The second guide data 171b is data for notifying the second guide in steps S8a, S9a, S10a, S12a, and S14a, which will be described later. The second guide data 171b is made up of text data, image data, etc. The second guide data 171b has data corresponding to steps S8a, S9a, S10a, S12a, and S14a, respectively.
[0126] More specifically, the second guide data 171b includes text data for displaying the sentence "You may be outside the installation prohibited area. Please change your position" in step S8a, the sentence "You may be outside the wiper wiping range. Please change your position" in step S9a, the sentence "A black screen or vehicle inspection certificate may be included in the shooting range. Please change your position" in step S10a, and the text "You may not be able to receive a GPS signal. Please change your position" in step S12a. The second guide data 171b also includes data for displaying second guides corresponding to each of the multiple movable object operation instruction screens 140. For example, the data corresponding to the movable object operation instruction screen 140 shown in FIG. 10 includes text data for displaying the sentence "Please change your position so that it does not hit the sun visor or rearview mirror."
[0127] The movable object action instruction data 171c is data for displaying the movable object action instruction screen 140 in step S12, which will be described later. The movable object action instruction data 171c is composed of text data, image data, etc. The movable object action instruction data 171c includes, for example, data for displaying the following sentence: (a) Move the sun visor, rearview mirror, etc. to make sure they do not hit anything. Pay particular attention to the sun visor on the passenger side. Please be aware that the position of the rearview mirror may change depending on the driver. (b) Check that there is no interference with devices such as head-up displays and ETCs, especially with aftermarket devices. (c) Turn on other devices and check that they are operating normally (i.e., terrestrial digital television devices can receive all channels, devices with GPS functionality can perform GPS positioning, and remote control keys work normally).
[0128] The installation position candidate display data 171d is data for displaying the installation position candidate screen 110 described below. The installation position candidate screen 110 is a screen that displays an area on the windshield where it is desirable to install the drive recorder 1. The installation position candidate display data 171d is created in advance, taking into consideration the constraints [1] to [9] above, etc.
[0129] The installation prohibited range data 172 is data that specifies the range in which installation of the drive recorder 1 on the windshield 40 is prohibited. The installation prohibited range data 172 includes information (common installation prohibited range data) that specifies a common installation prohibited range, which is the range in which installation is prohibited for all vehicles, and information (individual installation prohibited range data) that specifies individual installation prohibited ranges, which are the ranges in which installation is prohibited depending on the type of vehicle and the type of safety equipment (safety driving assist brake system, etc.) installed in the vehicle. The common installation prohibited range data is created based on laws and regulations, safety considerations, etc. The individual installation prohibited range data is created based on information provided by vehicle manufacturers and safety equipment manufacturers, and the individual installation prohibited range data includes a list of names of vehicles and safety equipment and data indicating the range in which installation is prohibited, specified corresponding to each of the vehicles and safety equipment included in the list.
[0130] The power-on flag 173 can store a flag value of "0" or "1." In the factory default state, the flag value of the power-on flag 173 is set to "0." When the drive recorder 1 is powered on by operating the power button 6a, the flag value of the power-on flag 173 is rewritten to "1."
[0131] When the operation reception unit 18 detects that the operation button 5, the photograph button 6a, or the power button 6b shown in FIGS.
[0132] The drive recorder 1 has a GPS data acquisition function, a captured image display function, an image recognition function, and an installation guide function. These functions are realized by the control unit 10 executing various programs stored in the ROM of the control unit 10.
[0133] The GPS data acquisition function is a function in which the control unit 10 uses GPS to acquire information on the current position of the drive recorder 1. To realize the GPS position data acquisition function, the control unit 10 receives signals from the GPS receiver 14 at predetermined time intervals (for example, every second) and calculates the current position of the drive recorder 1 based on the received signals. To realize the image recognition function, the control unit 10 analyzes images captured by the CCD camera 11 using image processing techniques such as contour extraction and pattern matching, and recognizes pedestrians, vehicles ahead, buildings, terrain, etc. contained in the captured images.
[0134] The photographed image display function is a function in which the control unit 10 causes the liquid crystal display 12 to display the photographed image photographed by the CCD camera 11 .
[0135] The image recognition function is a function in which the control unit 10 executes an image recognition program stored in ROM to perform image processing on the image captured by the CCD camera 11 and recognize objects (pedestrians, vehicles ahead, buildings, terrain, etc.) in the captured image.
[0136] The installation guide function is realized by the control unit 10 executing an installation guide program stored in the ROM, and is a function for executing an installation guide process described later.
[0137] The installation guide function includes a first guide function, a temporary installation instruction function, a movable object operation instruction function, a temporary installation determination function, a second guide function, a vehicle / safety equipment discrimination function, and an installation location candidate function.
[0138] The first guide function is a function in which the control unit 10 uses the first guide data 171a to notify the first guide (step S1) described below.
[0139] The temporary installation instruction function is a function in which the control unit 10 prompts the user to temporarily install the drive recorder 1 by causing the liquid crystal display 12 to display a temporary installation instruction screen 120 (described later) (step S6).
[0140] The movable object operation instruction function is a function in which the control unit 10 uses the movable object operation instruction data 171c to display the movable object operation instruction screen 140 described below (step S13), thereby requesting the user to operate a movable object inside the vehicle.
[0141] The temporary installation determination function is a function in which the control unit 10 determines whether the temporary installation position when the drive recorder 1 is temporarily installed is possibly inappropriate in steps S8, S9, S10, S12, and S14 described below.
[0142] The second guide function is a function in which the control unit 10 uses the second guide data 171b to notify the second guide in steps S8a, S9a, S10a, S12a, and S14a, which will be described later. The second guide function notifies the second guide in each of steps S8a, S9a, S10a, S12a, and S14a, using data corresponding to each step in the second guide data 171b.
[0143] The vehicle / safety equipment discrimination function is a function in which the control unit 10 determines the type of vehicle and safety equipment based on the user's operation in step S4, which will be described later.
[0144] The installation position candidate display function is a function in which the control unit 10 uses the installation position candidate display data 171d to display an installation position candidate screen 110 displaying installation position candidates on the liquid crystal display 12 in step S5 described later.
[0145] The installation guide process executed by the installation guide function will be described below with reference to Fig. 6. The installation guide process can be used by the user when installing the drive recorder 1 in the vehicle. When the drive recorder 1 is first powered on after being shipped from the factory, Alternatively, it is executed when the power is turned on with the MENU button 5c pressed.
[0146] That is, when the power is turned on, the control unit 10 checks the power-on flag 173 of the storage unit 17, and if the flag value is "0", it determines that the device is in the factory-shipped state, and if the flag value is "1", it determines that the device is not in the factory-shipped state. Then, if it determines that the device is in the factory-shipped state, the control unit 10 rewrites the flag value of the power-on flag 173 to "1" and then executes the installation guide process.
[0147] Furthermore, when the power is turned on with the MENU button 5c pressed, the control unit 10 executes the installation guide process regardless of the flag value of the power-on flag 173. Therefore, if the user wants to reinstall the drive recorder 1, the user can reinstall the drive recorder 1 according to the installation guide process by operating the power button 6a while pressing the operation button 5.
[0148] As shown in the figure, when the installation guide process starts, in step S1, the control unit 10 notifies the first guide based on the first guide data 171a. Fig. 7 shows an example of a first guide screen 100 that the control unit 10 causes the liquid crystal display 12 to display in step S1. As shown in the figure, the first guide screen 100 explains installation restrictions, precautions, etc. using text, illustrations, etc.
[0149] The first guide screen 100 is made up of multiple pages that each explain different restrictions, precautions, etc., and when the user operates the operation button 5 that corresponds to the instruction mark 101 displayed on the first guide screen 100 (among the operation buttons 5 on the back of the housing 2, the operation button 5 that is located at the position indicated by the instruction mark 101 on the LCD screen 4; same below. The operation button 5 that corresponds to the instruction mark 101 on the first guide screen 100 in Figure 7 is the MODE button 5c), the next page of the first guide screen 100 is displayed. When the first guide screens 100 for all pages have been displayed, step S1 ends and the process moves to step S2.
[0150] In step S2, the control unit 10 executes a process of acquiring a reference image. Specifically, the control unit 10 displays on the liquid crystal display 12 an instruction requesting the user to place the entire windshield 40 in the shooting range from a rear seat or the like of the vehicle and press the shooting button 6a, and temporarily stores the still image captured by the CCD camera 11 when the shooting button 6a is pressed in the RAM of the control unit 10 as the reference image.
[0151] In the following steps S3 and S4, the control unit 10 executes a process of setting an installation prohibited area for the drive recorder 1. The installation prohibited area is an area that combines the common installation prohibited area and the individual installation prohibited area.
[0152] In step S3, the control unit 10 acquires data on the common installation prohibited area from the installation prohibited area data 172, and stores the acquired common installation prohibited area in the RAM of the control unit 10 as temporary data.
[0153] In step S4, the control unit 10 sets an individual installation prohibited range. Specifically, the control unit 10 displays a list of the names of vehicles and safety equipment stored in the installation prohibited range data 172 on the liquid crystal display 12, and also displays a message on the liquid crystal display 12 requesting the user to select the corresponding vehicle or safety equipment from the list by operating the operation button 5. In accordance with this message, the user selects the vehicle or safety equipment in which to install the drive recorder 1 from the list using the up button 5a and the down button 5b, and then presses the MODE button 5c. The control unit 10 reads out the individual installation prohibited range corresponding to the vehicle model or safety equipment selected when pressing the MODE button 5c is detected from the installation prohibited range data 172, and stores it as temporary data in the RAM of the control unit 10.
[0154] In step S4, the control unit 4 displays a "Not Applicable" option on the liquid crystal display 12 along with the list of vehicles and safety equipment. If the vehicle or vehicle equipment does not have an individual installation prohibited range, the user can select "Not Applicable." If "Not Applicable" is selected, the control unit 10 ends step S4 without performing a process of storing the individual installation prohibited range in RAM.
[0155] In step S5, the control unit 10 uses the installation location candidate display data 171d to cause the liquid crystal display to display an installation location candidate screen 110 displaying installation location candidates. FIG. 8 shows an example of the installation location candidate screen 110 displayed in step S5. As shown in the figure, the installation location candidate screen 110 displays candidate installation location areas in an illustration. In the example shown, the candidate area on the windshield is divided into multiple small areas 111 to 113 with different priorities and displayed. In the example shown, the small area 111 (the area with diagonal lines slanting downward to the right) is an area that satisfies a safety constraint (e.g., constraint [1]), and the small area 112 (the area with diagonal lines slanting upward to the right) is an area that satisfies not only the safety constraint (e.g., constraint [1]) but also other constraints (e.g., constraint [5]). In the figure, the small area 113 is an inappropriate area that does not satisfy the safety constraint (e.g., constraint [1]).
[0156] On the installation location candidate screen 110, the small areas 111 to 113 are displayed in different colors so that the priority can be determined, with the small area 111 being displayed in yellow, the small area 112 being displayed in green, and the small area 113 being displayed in red. By looking at the installation location candidate screen 110, the user can easily understand the candidate areas that are suitable for installation.
[0157] Step S5 ends when the user operates the operation button 5 (MODE button 5c) corresponding to the instruction mark 114 displayed on the installation location candidate screen 110, and then the process proceeds to step S6.
[0158] In step S6, the control unit 10 displays on the liquid crystal display 12 a temporary installation instruction screen that prompts the user to temporarily install the drive recorder 1. FIG. 9 shows an example of the temporary installation instruction screen 120 that is displayed in step S6. As shown in the figure, the temporary installation instruction screen 120 provides instructions, such as text and illustrations, that prompt the user to peel off the lower protective film 33, attach the double-sided adhesive tape 31 to the attachment plate 21a, and then peel off the upper protective film 34 and temporarily install the drive recorder 1 on the windshield 40 with the gel sheet 32. The temporary installation instruction screen 120 also displays an instruction mark 121. When the user operates the operation button 5 (MODE button 5c) that corresponds to the instruction mark 121 displayed on the temporary installation instruction screen 120, the control unit 10 determines that the temporary installation is complete, ends step S6, and proceeds to step S7.
[0159] In step S7, the control unit 10 executes a process of recognizing the temporary installation position of the drive recorder 1. Specifically, the recognition of the temporary installation position of the drive recorder 1 is performed by utilizing an image recognition function to compare the real-time captured image of the CCD camera 11 with the reference image acquired in step 2. More specifically, the control unit 10 recognizes the windshield 40 from the reference image, and further extracts common objects (e.g., buildings and terrain) from the images of the front of the windshield 40 included in both the reference image and the real-time captured image, and calculates which part of the windshield 40 the temporary installation position of the drive recorder 1 corresponds to based on the positional relationship of the common objects in both images.
[0160] In steps S8 to S14, the control unit 10 determines whether the temporary installation position of the drive recorder 1 is likely to be inappropriate as an installation position. In the explanation of steps S8 to S14, the control unit 10's determination that "there is a possibility that the installation position is inappropriate" is simply referred to as determining "inappropriate," and its determination that the installation position is not inappropriate is simply referred to as determining "appropriate."
[0161] In step S8, the control unit 10 makes a determination (first determination) regarding the installation prohibited range. Specifically, the control unit 10 compares the temporary installation position of the drive recorder 1 recognized in step S7 with the installation prohibited range temporarily stored in RAM in S3 and S4, and determines the temporary installation position of the drive recorder 1 as "appropriate" if it is outside the installation prohibited range, and otherwise determines it as "inappropriate." If the determination in step S7 is "appropriate," the process proceeds to step S8.
[0162] On the other hand, if the determination in step S8 is "inappropriate," the process proceeds to step S8a, and the control unit 10 notifies the second guide based on the data corresponding to step S7a in the second guide data 171b. Specifically, the control unit 10 causes the liquid crystal display 12 to display a warning message saying, "There is a possibility that you are in an area where installation is prohibited. Please change your position."
[0163] In step S9, the control unit 10 makes a determination (second determination) regarding the wiper wiping range. Specifically, the control unit 10 displays a message on the liquid crystal display 12 requesting the user to turn on the vehicle's wiper switch, and uses an image recognition program to perform image recognition processing on images captured by the CCD camera 11 over a certain period of time thereafter, thereby recognizing the area in the captured image where the wiper has moved. For example, the control unit 10 calculates the optical flow of a moving object in the captured image, and recognizes an area where the optical flow of the moving object corresponds to the previously calculated optical flow of the wiper as the area where the wiper is moving. Since wiper movement has a certain pattern, the control unit 10 recognizes an area where an optical flow corresponding to the pattern exists as the area where the wiper is moving. If the proportion of the area in the captured image that the area occupies is equal to or greater than a certain value (preferably occupying the majority, which is 80% or greater in this embodiment), the control unit 10 determines the area as "appropriate." Otherwise, the control unit 10 determines the area as "inappropriate." If the determination in step S9 is "appropriate," the control unit 10 proceeds to step S10.
[0164] On the other hand, if the determination in step S9 is "inappropriate," the process proceeds to step S9a, and the control unit 10 notifies the second guide based on the data corresponding to step S9a in the second guide data 171b. Specifically, the control unit 10 displays a warning message on the liquid crystal display 12 saying, "You may be outside the wiping range of the wiper. Please change your position."
[0165] In step S10, the control unit 10 makes a determination (third determination) as to whether or not the captured image contains any objects or parts that may obstruct photography. Specifically, the control unit 10 uses an image recognition function to recognize colored parts (e.g., black ceramic) or stickers (e.g., vehicle inspection certificates) on the windshield 40 from the captured image of the CCD camera 11, and if these are not included in the captured image, it determines that the temporary installation position is "appropriate," otherwise it determines that it is "inappropriate." If the determination in step S10 is "appropriate," the process proceeds to step S11.
[0166] On the other hand, if the determination in step S10 is "inappropriate," the process proceeds to step S10a, and the control unit 10 notifies the second guide based on the data corresponding to step S10a in the second guide data 171b. Specifically, a warning message saying "Black ceramic or a vehicle inspection certificate may be included in the shooting range. Please change your position" is displayed on the liquid crystal display 12.
[0167] In step S11, the control unit 10 displays a message screen 130 as shown in FIG. 10. The message screen 130 displays a confirmation message such as "Checking the GPS reception status. Please move the vehicle from a location with an obstacle above, such as a covered garage. Once the movement is complete, please press the complete button." along with an instruction mark 131. The user can move the vehicle by following this instruction. Then, when the user operates the operation button 5 (MODE button 5c) corresponding to the instruction mark 131, the control unit 10 detects the operation and causes the process to proceed to step S12.
[0168] In step S12, the control unit 10 makes a determination (fourth determination) regarding the reception status of the GPS signal of the GPS receiver 14. Specifically, the control unit 10 checks the reception status of the GPS signal of the GPS receiver 14, and determines the temporary installation position to be "appropriate" if the GPS signal can be received normally, and determines the temporary installation position to be "inappropriate" if the GPS signal cannot be received normally for a specified time. The reason why the temporary installation position is determined to be "inappropriate" if the GPS signal cannot be received normally for a specified time is because it takes a certain amount of time for the GPS signal to become receivable. If the determination in step S12 is "appropriate," the process proceeds to step S13.
[0169] On the other hand, if the determination in step S12 is "inappropriate", the process proceeds to step S12a, and the control unit 10 notifies the second guide based on the data corresponding to step S12a in the second guide data 171b. Specifically, the warning message "GPS signals may not be received. Please change your position" is displayed on the liquid crystal display 12.
[0170] In step S13, the control unit 10 uses the movable object operation instruction data 171c to display a movable object operation instruction screen 140 as shown in Fig. 11. The movable object operation instruction screen 140 displays a message instructing the user to operate a movable object of the vehicle and prompting the user to input whether or not operating the object will cause any problems. Examples of movable objects of the vehicle include those whose physical positions are actually movable, such as sun visors, rearview mirrors, and windshield wipers, and those that are electrically operated using power, such as terrestrial digital broadcasting reception functions and GPS reception functions.
[0171] The movable object operation instruction screen 140 is made up of multiple pages, each having a message 141 with different content. FIG. 11 shows the movable object operation instruction screen 140 on which the message 141 corresponding to (a) of the movable object operation instruction data 171c is displayed. On each page, indication marks 142 and 143 are displayed, indicating the positions of the operation buttons 5 to be operated when the user judges that there is no problem with the message 141 on each page and when the user judges that there is a problem. On each page, when the user operates the operation button 5 (down button 5b) corresponding to the "no problem" indication mark 142, the movable object operation instruction screen 140 of the next page is displayed.
[0172] In step S14, the control unit 10 makes a determination (fifth determination) regarding the situation when the movable object of the vehicle is operated. Specifically, when the operation button 5 corresponding to the "no problem" instruction mark 142 is operated on the movable object operation instruction screen 140 of all pages, the control unit 10 determines that the temporary installation position is "appropriate," and when the operation button 5 (MODE button 5c) corresponding to the "problem" instruction mark 143 is operated on the movable object operation instruction screen 140 of any page, the control unit 10 determines that the temporary installation position is "inappropriate" at that time. If the determination in step S14 is "appropriate," the process proceeds to step S15.
[0173] On the other hand, if the determination in step S14 is "inappropriate," the process proceeds to step S14a, and the control unit 10 notifies the second guide based on data corresponding to step S14a in the second guide data 171b, which corresponds to the page of the movable object operation instruction screen 140 when the operation button 5 corresponding to the instruction mark 143 "problem" is operated. For example, when the operation button 5 corresponding to the instruction mark 143 is operated on the movable object operation instruction screen 140 of the page shown in Fig. 11, a warning message saying "Please change the position so that it does not hit the sun visor or rearview mirror" is displayed on the liquid crystal display 12.
[0174] In step S15, the control unit 10 displays a success message on the liquid crystal display 12, informing the user that the temporary installation was successful and including instructions to the user to temporarily remove the drive recorder 1, remove the gel sheet 32, and then perform the permanent installation by aligning it with the position mark 32a transferred to the windshield 40. For example, an instruction such as "The temporary installation position appears to be appropriate. We will perform the permanent installation at the temporary installation position, so please temporarily remove the drive recorder from the windshield. Once removed, peel off the gel sheet to expose the adhesive tape for permanent installation. Please attach it to the windshield at the temporary installation position, aligning it with the position mark transferred to the windshield." is displayed.
[0175] The installation guide process ends when step S15 is executed or when steps S8a, S9a, S10a, S12a, and S14a are executed.
[0176] In the drive recorder 1 of this embodiment, the first guide notification (step S1) in the installation guide process allows the user to view a guide on installation restrictions, precautions, and the like, without relying on an instruction manual or the like. Furthermore, if the control unit 10 determines that the temporary installation location of the drive recorder 1 is likely to be inappropriate, the second guide notification is issued (steps S8a, S9a, S10a, S12a, and S14a). This allows the user to know that the temporary installation location is likely to be inappropriate. Therefore, the user can easily check whether the location is truly inappropriate before actual installation. If the location is likely to be inappropriate, the user can change the temporary installation location of the drive recorder 1 to a location different from the location indicated as possibly inappropriate, or actually install the drive recorder 1. Furthermore, if a success message (step S15) is displayed, the user can know that the drive recorder 1 (control unit 10) has determined the location to be "appropriate."
[0177] In the drive recorder 1 of this embodiment, the possibility that the temporary installation position is inappropriate is determined based on image recognition using images captured when the drive recorder 1 is temporarily installed (steps S8 to S10). This allows the user to temporarily install the drive recorder 1 and have the drive recorder 1 determine for itself whether the position is appropriate, thereby reducing the difficulty of the user having to try to place the drive recorder 1 while following all the information notified by the first guide.
[0178] In the drive recorder 1 of this embodiment, temporary installation can be performed using a gel sheet 32 with weak adhesive strength, so the user can easily remove the drive recorder 1 from the windshield 40 after performing the temporary installation in accordance with the installation guide process.
[0179] The gel sheet 32 can be used multiple times. Therefore, for example, when the second guide notification (steps S8a, S9a, S10a, S12a, and S14a) is performed in the installation guide process, the user can execute the installation guide process again and redo the temporary installation of the drive recorder 1. Even if a success message (step S15) is displayed, if the user wants to install the drive recorder 1 in a better position, the user can execute the installation guide process again and redo the temporary installation.
[0180] Furthermore, the position mark 32a is transferred and remains at the temporary installation position on the windshield 40. Therefore, the user can permanently install the drive recorder 1 using the position mark 32a as a landmark when the success message (step S15) is displayed. Furthermore, when the second guide notification (steps S8a, S9a, S10a, S12a, and S14a) is performed, the user can use the position mark 32a at that time as a landmark to avoid the user from repeatedly performing the temporary installation at the same position. Note that the position mark 32a may be made of ink or the like that can be transferred multiple times.
[0181] The position marks 32a are made of water-based ink and can be easily wiped off with tissue, etc. Therefore, even if temporary installation needs to be redone, cleaning afterwards is easy.
[0182] The above describes preferred embodiments, but the shapes, dimensions, materials, functions, operation modes, control modes, control parameters, operation modes, etc. of the devices, systems, and programs or their elements and components in the above embodiments are described as examples and may be changed.
[0183] For example, the order in which each step in the installation guide process is performed and the contents displayed on the liquid crystal display 12 can be changed as appropriate as long as the desired functions can be achieved.
[0184] Furthermore, in the first embodiment, a case has been described in which a photographed image including the entire windshield 40 is acquired as the reference image in step S2, but a different photographed image can also be used as the reference image. For example, the control unit 10 can be configured to instruct the driver to press the photographing button 6a at the top edge of the windshield 40, record the top edge position image when the photographing button 6a is pressed, and to instruct the driver to press the photographing button 6a at the bottom edge position, record the bottom edge position image when the photographing button 6a is pressed, and use these top edge position images and bottom edge position images as the reference images.
[0185] Furthermore, in the first embodiment, in step S4, the control unit 10 determines the vehicle type and type of safety equipment based on the user's operation. However, the drive recorder 1 is connected to the OBD connector, and the control unit 10 determines the vehicle type and type of safety equipment based on the signal from the OBD connector, and stores the determined vehicle type and safety equipment as individual installation prohibition ranges for the vehicle in the RAM of the control unit 10 as temporary data.
[0186] Furthermore, in the first embodiment, the case where candidate installation locations are displayed by displaying image data created in advance as the candidate installation location screen 110 in step S5 has been described. However, it is also possible to display candidate installation locations by having the control unit 10 display a real-time image captured by the CCD camera 11 on the liquid crystal display 12, and superimposing the candidate installation locations on the real-time captured image, for example, by AR display.
[0187] In the first embodiment, the case has been described in which the temporary installation is deemed to be completed when a user operates the operation button 5 corresponding to the instruction mark 121 in step S6, and the process of step S6 is terminated. However, the control unit 10 may determine the shaking of the drive recorder 1 by performing image recognition on the image captured by the CCD camera 11, and when the shaking becomes equal to or less than a certain level, the control unit 10 may determine that the temporary installation is completed and terminate the process of step S6. The shaking may be determined based on the detection signal of the acceleration sensor 15.
[0188] In the first embodiment, in step S7, common features (e.g., buildings and terrain) are extracted from the images of the area in front of the windshield 40 included in both the reference image and the real-time captured image, and the temporary installation position of the drive recorder 1 is recognized based on the positional relationship of the common features in both images. However, for example, after step S6 is executed, the drive recorder 1 may be temporarily removed from the windshield 40 and the temporary installation position of the drive recorder 1 may be recognized by using the position mark 32a transferred to the windshield 40 as a marker, which makes it easier to recognize the temporary installation position. For example, after step S6 is completed, the control unit 10 displays a message on the liquid crystal display 12 requesting the user to temporarily remove the drive recorder 1 and move the drive recorder 1 to a position where the entire windshield 40 is within the capture range. The control unit 10 then attempts to perform image recognition of the windshield 40 and the position mark 32a transferred onto the windshield 40 from the real-time captured image of the CCD camera 11. If the image recognition is successful, the control unit 10 recognizes the temporary installation position based on the positional relationship between the recognized windshield 40 and the position mark 32a. The control unit 10 then displays a message on the LCD display 12 requesting the user to temporarily reinstall the drive recorder 1 in accordance with the position mark 32a on the windshield 40 and to operate the operation button 5 (e.g., the MODE button 5c) once the temporary installation is complete. When the operation of the operation button 5 (e.g., the MODE button 5c) is detected, step S7 is completed and the process proceeds to step S8. It is preferable to display a message requesting the user to move to the same position as when the reference image was acquired in step S2, so that the entire windshield 40 is within the capture range. Performing image recognition using an image captured from the same position and angle as in step S2 facilitates the process of recognizing the temporary installation position.
[0189] The length of the power cable through which the drive recorder 1 receives power from the vehicle should be long enough to allow recording from the back seat. It is also recommended that the drive recorder be equipped with a battery or the like so that it can continue to operate for a certain period of time even if the power supply from the vehicle is cut off. This reduces the possibility of power being cut off when acquiring a reference image from the back seat or when recognizing the temporary installation position.
[0190] The drive recorder 1 may have an AR display function. For example, in step S9, the image captured in real time by the CCD camera 11 is displayed on the liquid crystal display 12, and the wiper wiping range recognized by the image recognition in step S9 is displayed superimposed on the real-time captured image on the liquid crystal display 12. This makes it easier for the user to recognize the appropriate installation position in relation to the objects inside and outside the vehicle that are actually captured.
[0191] In the first embodiment, a case has been described in which the first guide is notified in step S1 without particularly distinguishing between an area where installation of the drive recorder 1 is prohibited and an area where installation is not prohibited but undesirable, but the first guide may be notified in a manner that distinguishes between these areas and is recognizable by the user. Conventionally, there has been no concept of clearly distinguishing between an area where installation is possible but undesirable and an area where installation is prohibited, so there is a risk that the two will be perceived as the same and the drive recorder will be installed in a prohibited location. However, in this way, the user can recognize an area where installation is prohibited and an area where installation is possible but undesirable, and the possibility of confusing the two and installing the drive recorder in an area where installation is prohibited can be reduced.
[0192] In the first embodiment, the drive recorder 1 is described as being installed on the windshield 40, but the drive recorder 1 may also be installed in a ceiling light or dashboard of the vehicle, for example.
[0193] In the first embodiment, the imaging device of the present invention was described using a drive recorder 1 as an example, but the present invention can also be applied to other devices that are mounted on a vehicle and have the function of capturing images, such as a backup camera, a rear camera, etc.
[0194] (Second embodiment) The drive recorder according to the second embodiment has the same hardware configuration as the drive recorder 1 according to the first embodiment, except that the connection terminal 8 is connected to the OBD connector of the vehicle. Hereinafter, the drive recorder according to the second embodiment will be referred to as "drive recorder 1a." In addition, in the description of the second embodiment, the drive recorder 1a is described as being attached to the vehicle so that the CCD camera 11 can capture images of the outside of the vehicle through the windshield, and the vehicle has an engine starter function that starts the engine from a location away from the vehicle, such as indoors, by operating a remote control key or the like.
[0195] The ROM of the control unit 10 of the drive recorder 1a stores a program for realizing a transmission state determination function and a vehicle control function in place of or together with the installation guide program. The transmission state determination function and the vehicle control function are realized by the control unit 10 executing the program.
[0196] The transmission state determination function is a function in which the control unit 10 determines the transmission state of the windshield 40 from the image captured by the CCD camera 11. Specifically, the control unit 10 uses an image recognition program to perform image recognition on the image captured by the CCD camera 11, thereby determining whether the forward field of view through the windshield 40 is clear (transparent).
[0197] The vehicle control function is a function in which the control unit 10 controls the warm-up state of the vehicle according to the determination result of the transmission state determination function. Specifically, if the transmission state determination function determines that the windshield 40 is clear (transparent), the control unit 10 determines that the warm-up can be terminated and sends a control signal to the vehicle side via the OBD to stop the engine. Upon receiving this signal from the vehicle control function, the vehicle stops the engine.
[0198] According to the second embodiment, the degree of fogging of the windshield 40 can be determined based on the images captured by the drive recorder 1a, so the user can depart with good visibility ahead of the vehicle. In addition, the engine can be stopped when the windshield 40 becomes clear, which prevents unnecessary warm-up and saves fuel.
[0199] Although the second embodiment has been described above, the second embodiment can be modified in various ways.
[0200] For example, the transmission state determination function may determine whether the fogging is due to snow or frost, or may further determine the amount or extent of snow or frost, based on the degree of fogging on the windshield 40 based on the image captured by the CCD camera 11. In this case, the vehicle control function may control the warm-up state depending on the vehicle state, based on whether the fogging is due to snow or frost, or the amount or extent of snow or frost.
[0201] For example, the vehicle control function may execute at least one of the following controls: air conditioning, window drive, and wipers, depending on the results of the determination by the transparency state determination function (transparency state, transparency, whether the cloudiness is due to snow or frost, the amount or extent of snow or frost, etc.).
[0202] The air conditioner operation control can be at least one of turning the air conditioner on / off, or controlling the temperature setting, air volume, and windshield heating intensity using the air outlet, etc. The window drive control can be controlling the window to open slightly. The wiper control can be controlling the wiper on / off or wiper speed (switching between fast, slow, and intermittent).
[0203] The air conditioner, window drive device, wipers, etc. may be controlled via an in-vehicle LAN, such as via an OBD adapter, or the drive recorder 1 may be directly connected to the air conditioner, window drive device, wipers, etc. to control them.
[0204] Information about the current environment, such as the vehicle's engine status, cabin temperature, exterior temperature, and air conditioner temperature setting, may be acquired via an in-vehicle LAN connection, such as via an OBD adapter, or by direct connection, and the warm-up state may be controlled based on that information. Controlling the warm-up state based on information about the current environment can more reliably eliminate freezing and other problems.
[0205] Furthermore, for example, the engine starter may not be provided with conventional sensors or functions, but the drive recorder 1 and the engine starter may be electrically connected, and the vehicle state during warm-up may be controlled based on the actual state of the windshield 40.
[0206] The engine starter may be, for example, one that starts an internal combustion engine, but is not limited to this and may also include one that starts the warm-up of an electric vehicle. In this embodiment, the engine starter is connected to the OBD connector and transmits a control signal for starting and stopping the engine to the vehicle side via the in-vehicle LAN, but it may also be configured to start and stop the engine by connecting it in a way that interrupts the engine start / stop switch operated by the push start button or engine key.
[0207] (Third embodiment) The drive recorder according to the third embodiment has the same hardware configuration as the drive recorder 1 according to the first embodiment. Hereinafter, the drive recorder according to the third embodiment will be referred to as a "drive recorder 1b."
[0208] The ROM of the control unit 10 of the drive recorder 1b stores a program for realizing a rain information acquisition function and a rain information storage function instead of or together with the installation guide program. The rain information acquisition function and the rain information storage function are realized by the control unit 10 executing the program.
[0209] The rain detection function is a function in which the control unit 10 recognizes the intensity of rain from the image captured by the CCD camera 11. Specifically, the control unit 10 uses an image recognition program to recognize the image of the wipers from the image captured by the CCD camera 11, and determines the intensity of rain from the interval between wiper movements, thereby obtaining information about rain (rain information).
[0210] The rain information storage function is a function in which the control unit 10 stores the rain information acquired by the rain information acquisition function in the SD card inserted into the card slot 9. Specifically, the control unit 10
[0211] Users can use the rain information stored by the rain information storage function in various ways, including for personal use. For example, users can upload the rain information to the cloud. The uploaded rain information can be used as big data.
[0212] Conventional methods for obtaining the wiper operation status include detecting it directly from the wiper signal line, obtaining it from the wiper operation lever, obtaining it by connecting to the ECU, and obtaining it via an in-vehicle LAN such as OBD. However, all of these methods have the problem of requiring separate wiring to be installed in the vehicle. According to the third embodiment, it is possible to recognize the wiper operation status without installing wiring in the vehicle. It is possible to obtain information about the intensity of rain based on the wiper operation status.
[0213] Although the third embodiment has been described above, the third embodiment can be modified in various ways.
[0214] For example, the rain information acquisition function can acquire the change points of the wiper operation interval as rain information, and the rain information storage function can store the change points in an SD card in an identifiable manner.
[0215] The rain information storage function can also store the wiper operation status in the SD card along with GPS information such as the time and location obtained from the GPS receiver 14. The wiper operation status can be the wiper operation interval (fast, slow, intermittent, etc.) after the change when the operation interval has been changed.
[0216] The drive recorder 1b may further have hardware and software for connecting to a network and an upload function for uploading the rain information stored in the SD card to the cloud. The upload function is realized by the control unit 10 executing a program stored in a ROM or the like. The upload function may be configured to upload the rain information to the cloud at any time.
[0217] (Fourth embodiment) The drive recorder according to the fourth embodiment has the same hardware configuration as the drive recorder 1 according to the first embodiment. Hereinafter, the drive recorder according to the fourth embodiment will be referred to as a "drive recorder 1c."
[0218] The ROM of the control unit 10 of the drive recorder 1c stores a program for realizing a light state detection function and a light state storage function in place of or together with the installation guide program. The light illumination state detection function and the light state storage function are realized by the control unit 10 executing the program.
[0219] The light state detection function is a function that detects the on / off state of headlights by the control unit 10. Specifically, the control unit 10 uses an image recognition program to detect whether the headlights of the vehicle are on and / or off from the image captured by the CCD camera 11 as light information.
[0220] The light state storage function is a function in which the control unit 10 stores, in an SD card inserted into the card slot 9, light information about the headlights of the vehicle detected by the light state detection function.
[0221] Users can use the lighting information stored by the lighting status storage function in various ways, including for personal use. For example, users can upload lighting information to the cloud. The uploaded lighting information can be used as big data.
[0222] Although the fourth embodiment has been described above, the fourth embodiment can be modified in various ways.
[0223] For example, in the fourth embodiment, the light state detection function and the light state storage function detect and store the fact that the headlights are turned on and / or off as light information, but the light state detection function may detect and store the timing of turning on and / or turning off the headlights. The light state detection function may detect the turning on and / or turning off of the headlights of a vehicle in front (or the timing of turning them on and / or turning them off) instead of the vehicle itself.
[0224] Furthermore, the light status storage function can store light information together with GPS information such as time and location obtained from the GPS receiver 14 in an SD card.
[0225] The drive recorder 1c may further include hardware and software for connecting to a network and an upload function for uploading the write information stored in the SD card to the cloud. The upload function is realized by the control unit 10 executing a program stored in a ROM or the like. The upload function may be configured to upload the write information to the cloud at any time.
[0226] The drive recorder 1c may further have a function of adjusting the brightness of the liquid crystal display 12 based on the detection result of the light state detection function.
[0227] The amount of light around the vehicle is detected from the image of the CCD camera 11 or from another sensor, and the light status storage function preferably records the light information together with the state of the amount of light around the vehicle.
[0228] In the drive recorders 1a to 1c according to the second to fourth embodiments, sensors (e.g., temperature sensor, humidity sensor, proximity sensor, gesture sensor, etc.) are provided at the attachment position of the attachment plate 21a on the windshield 40, and the functions of the drive recorders 1a to 1c can be controlled in an integrated manner based on information obtained from these sensors and sensors within the drive recorders 1a to 1c (e.g., acceleration sensor 15, recognition results of images captured by a CCD camera using an image recognition program, etc.). The functions of the drive recorders 1a to 1c can be controlled based on vehicle model information acquired from an OBD or the like. Information detected, determined, stored, etc. in the drive recorders 1a to 1c can be fed back to the vehicle via the OBD connector. The information detected, determined, stored, etc. in the drive recorders 1a to 1c can be configured to be viewable and controllable from a smartphone or the like.
[0229] In the third and fourth embodiments, the rain information and light information are stored in the SD card, but they may be stored in the main body of the drive recorder 1 (for example, the storage unit 17).
[0230] (Fifth embodiment) Conventional DMRs and the like obtain data such as acceleration from sensors in vehicle equipment, and if the data meets predetermined criteria such as dangerous driving or eco-driving, record the data as data to be analyzed, or mark the data that is constantly being recorded and record it as data to be analyzed. For example, when a drive recorder detects acceleration corresponding to a collision, it records video and acceleration data for several seconds before and after the collision as data to be analyzed. This recorded data to be analyzed is then read by a PC or the like and displayed (e.g., as a graph).
[0231] However, with this method, if the predetermined "criteria" such as dangerous driving standards or eco-driving standards do not meet the customer's needs, it is necessary to change the program on the in-vehicle device. In other words, there is a problem in that the "criteria" for dangerous driving, etc. cannot be flexibly changed.
[0232] The system of the fifth embodiment is a system having the following (1) and (2). (1) An in-vehicle device that acquires at least one of the vehicle or driver status multiple times at different times (without determining whether the criteria are met) and (simply) records the acquired status in an identifiable manner. (2) An analytical device separate from the on-board device of (1) above that acquires the state recorded in (1) above, analyzes the acquired state, and identifies time periods that meet the criteria for determining predetermined dangerous driving standards or eco-driving standards, etc.
[0233] The in-vehicle device is, for example, the drive recorder 1 described in the first to fifth embodiments, and the analysis device is, for example, a personal computer.
[0234] In this way, the in-vehicle device does not make a judgment based on a predetermined dangerous driving standard or eco-driving standard, and therefore the judgment standard can be flexibly changed on the analysis device side.
[0235] In the fifth embodiment, the following variations are possible.
[0236] In the above system, the on-board device (1) further has a function of issuing an alarm when the state satisfies a predetermined alarm issuance criterion, and the analysis device (2) analyzes the state using the same criteria as the predetermined alarm issuance criterion of the on-board device (1) and identifies the time period during which the on-board device issued the alarm.
[0237] In this way, the alarm notification interval can be identified by the analysis device without increasing the amount of data to be recorded.
[0238] (2) The analysis device marks the time interval for the acquired data.
[0239] (2) With respect to the data acquired by the analysis device, only the data in the time interval is set as the data to be saved. By configuring in this way, the problem of an increase in the amount of data can be avoided.
[0240] The analysis device (2) evaluates dangerous driving or eco-driving based on data from the acquired state data for a time period that matches the judgment criteria, such as the predetermined dangerous driving standard or eco-driving standard.
[0241] (1) The on-board device records the acquired status at regular intervals in a manner that allows the time series to be identified, and the recording interval is 1 second or less.
[0242] The present invention is not limited to the configurations described in the above-described embodiments. The components of the above-described embodiments may be arbitrarily selected and combined within a range of possible combinations. Any components of the embodiments may be arbitrarily combined. Furthermore, any components of the embodiments may be arbitrarily combined within a range of possible combinations with any components described in the Summary of the Invention or components embodying any components described in the Summary of the Invention.
[0243] Below is a copy of the claims as filed. <Document Name> Claims <Claim 1> A photographing device that can be installed in a vehicle, The photographing device has a first guide function of informing a user of a guide for setting up the photographing device from a notification means. <Claim 2> 2. The photographing device according to claim 1, wherein the first guide function comprises a function of causing a notifying unit to notify a guide regarding an installation position of the photographing device. <Claim 3> 3. The photographing device according to claim 1, wherein the guide includes information about restrictions on installation of the photographing device. <Claim 4> 4. The photographing device according to claim 1, wherein the guide includes information about precautions to be taken when installing the photographing device. <Claim 5> The photographing device described in any one of claims 1 to 4, characterized in that the guide distinguishes between information about areas where installation of the photographing device is prohibited and information about areas where installation is not prohibited but is undesirable, and notifies the information in a manner that is recognizable to the user. <Claim 6> a temporary installation instruction function for instructing a user to temporarily install the imaging device in accordance with the guide; a movable object operation instruction function that instructs the vehicle to operate movable objects after temporary installation; 6. The photographing device according to claim 1, further comprising: <Claim 7> a temporary installation determination function that determines whether the temporary installation position of the imaging device when temporarily installed is inappropriate; 7. The photographing device according to claim 1, further comprising a second guide function that notifies information indicating that the temporary installation determination function has determined that the installation may be inappropriate. <Claim 8> a situation input instruction function for instructing a user to input a situation at the time of temporary installation into an operation means; 8. The photographing device according to claim 7, wherein the temporary installation determination function makes the determination based on an operation on the operation means. <Claim 9> 9. The photographing device according to claim 7, wherein the temporary installation determination function comprises a function of making the determination based on image recognition using an image photographed by the photographing device. <Claim 10> It is equipped with a safety equipment identification function that identifies the type of safety equipment installed in the vehicle. 10. The photographing device according to claim 7, wherein the temporary installation determination function makes the determination depending on the type of the safety equipment determined by the safety equipment determination function. <Claim 11> 11. The photographing device according to claim 1, further comprising an installation position candidate display function for displaying candidates for the installation position. <Claim 12> Adhesive materials for temporary installation and adhesive materials for permanent installation are included in the package. 12. The imaging device according to claim 1, wherein the temporary-installation adhesive member has a weaker adhesive strength than the permanent-installation adhesive member. <Claim 13> 13. The photographing device according to claim 12, wherein the temporary-installation adhesive member and the permanent-installation adhesive member are laminated together. <Claim 14> 14. The photographing device according to claim 12, wherein the temporary installation adhesive member has transfer ink that is transferred to an installation location when the photographing device is installed using the temporary installation adhesive member. <Claim 15> A program for causing a computer to realize the functions of the photographing device according to any one of claims 1 to 14. [Explanation of symbols]
[0244] 1. Drive recorder 2. Housing 3. CCD camera lens 4. LCD screen 5 Operation buttons 6a Recording button 6b Power button 7···Screw hole 8 Connection terminal 9 card slots 10. Control section 11. CCD camera 12. LCD display 13. Speaker 14. GPS receiver 15. Acceleration sensor 16. Card reader 17...Storage section 18 Operation reception section 20 Bracket 21. Adhesive stay 22...Base 23...Peripheral nut 30···Adhesive tape 31 Double-sided adhesive tape 32 Gel sheet 32a···Position mark 33 Bottom protective film 34···Top protective film 40. Windshield 171 Notification data 171a···First Guide Data 171b···Second Guide Data 171b Guide data storage unit 171c···Moving object operation instruction data 171d···Data for displaying installation location candidates 172...Prohibited installation area data
Claims
1. A photographing device that can be installed in a vehicle, The system has a function of controlling the vehicle state during warm-up by the engine starter based on the transmittance state of the windshield, which is captured by the imaging device.
2. The system according to claim 1 , further comprising a function of determining or recording the state of rain based on an image captured by the image capture device of an operating area of a windshield wiper.
3. 3. The system according to claim 1, further comprising a function of determining or recording a headlight illumination state based on an image of a front area of a windshield captured by the image capturing device.
4. 4. The system according to claim 1, further comprising a function of detecting the amount of ambient light around the vehicle from the image from the image capturing device or from another sensor, and recording the amount of ambient light together with the state of the amount of ambient light.
5. The system according to any one of claims 1 to 4, further comprising a sensor attached to the windshield, and a function of making the determination or recording based on the sensor information and an image of the area in front of the windshield captured by the imaging device.
6. The system according to claim 1 , further comprising a function of making the determination or recording based on vehicle model information acquired from an OBD connector provided in the vehicle.
7. The system according to claim 6, further comprising a function of feeding back the result of the determination to the vehicle side via the OBD.
8. The system according to claim 1 , further comprising a function that enables the contents of the determination or the recording to be viewed and / or controlled from a smartphone or the like.
9. A program for causing a computer to realize the functions of the system according to any one of claims 1 to 8.
Citation Information
Patent Citations
Device for detecting poor visibility of vehicle window
JP1999139262A
Automatic defroster device
JP2000025575A
Remote starting system
JP2009067154A
Sight state detector and sight ensuring device
JP2010096604A
Onboard camera system
JP2012228916A