Imaging device

WO2025046688A1PCT designated stage expired Publication Date: 2025-03-06MITSUBISHI ELECTRIC MOBILITY CORP
View PDF 5 Cites 0 Cited by

Patent Information

Application Number
PCT/JP2023/030937
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Filing Date
2023-08-28
Publication Date
2025-03-06

Smart Images

  • Figure JP2023030937_06032025_PF_FP_ABST
    Figure JP2023030937_06032025_PF_FP_ABST
Patent Text Reader

Abstract

The purpose of the present invention is to provide a technique capable of appropriately changing an imaging area of an imaging device in a vehicle. This imaging device is provided with a camera that includes an imaging unit that images an occupant of a vehicle, an irradiation unit that irradiates the occupant with light, a rod-shaped variable holding member that has a first end part fixed to the vehicle and a second end part connected to the camera and the irradiation unit, and that holds the camera in such a manner that the position and posture of the camera with respect to the occupant can be changed, and a light shielding part that is provided on the camera and shields light other than the reflected light of the light emitted from the irradiation unit.
Need to check novelty before this filing date? Find Prior Art

Description

Imaging device

[0001] The present disclosure relates to an imaging device.

[0002] In recent years, driver monitoring systems (DMS) that use imaging devices to monitor the status of occupants such as drivers have become increasingly popular. In the future, such DMS systems are expected to become more widespread not only in general automobiles but also in vehicles such as construction machinery and agricultural machinery.

[0003] JP 2017-054170 A

[0004] Some construction machinery vehicles or agricultural machinery vehicles do not have any of the parts where a DMS imaging device is attached in a typical automobile, such as the steering column, dashboard, A-pillar, windshield, or roof. Therefore, to attach a DMS imaging device to a construction machinery vehicle or the like, the imaging device needs to be attached to a part that is actually attached to the construction machinery vehicle, such as the steering column.

[0005] However, if the imaging device is attached to a different location, the imaging area captured by the imaging device and the imaging area where the DMS monitors the occupant may differ, and the occupant may not fit within the imaging area. In such cases, there is a problem that the DMS cannot be used or the imaging device or the DMS algorithm must be redesigned.

[0006] Therefore, the present disclosure has been made in consideration of the above-mentioned problems, and has an object to provide a technology that allows the imaging area of ​​an imaging device in a vehicle to be changed as appropriate.

[0007] The imaging device according to the present disclosure comprises a camera including an imaging unit that images a vehicle occupant, an illumination unit that illuminates the occupant with light, a rod-shaped variable holding member that has a first end fixed to the vehicle and a second end connected to the camera and the illumination unit and that holds the camera so that the position and attitude of the camera relative to the occupant can be changed, and a light shielding unit that is provided on the camera and blocks light other than reflected light of light irradiated from the illumination unit.

[0008] According to the present disclosure, the variable holding member holds the camera so that the position and attitude of the camera relative to the occupant can be changed. With this configuration, the imaging area of ​​the imaging device in the vehicle can be appropriately changed.

[0009] The objects, features, aspects and advantages of the present disclosure will become more apparent from the following detailed description and the accompanying drawings.

[0010] FIG. 1 is a diagram showing a configuration of an imaging device according to embodiment 1. FIG. 2 is a plan view showing the internal configuration of a camera according to embodiment 1. FIG. 3 is a diagram showing a partial configuration of an imaging device according to embodiment 1. FIG. 4 is a diagram showing a configuration of an imaging device according to embodiment 1. FIG. 5 is a perspective view showing a partial configuration of an imaging device according to embodiment 1. FIG. 6 is a diagram showing an installation example of an imaging device according to embodiment 1.

[0011] <First Embodiment> Fig. 1 is an overall view showing the configuration of an imaging device according to the first embodiment. The imaging device of Fig. 1 includes a camera 1, a rod-shaped variable holding member 2, and a light shielding portion 3, and is used, for example, in a driver monitoring system (DMS) that monitors the state of a vehicle occupant, such as a driver. In the following description, the vehicle is assumed to be a specific vehicle that does not have any of a steering column, a dashboard, an A-pillar, a windshield, or a roof.

[0012] The specific vehicle may be, for example, a construction machine or an agricultural machine, but may also be a vehicle similar to these. Construction machine vehicles include, for example, hydraulic excavators, forklifts, and wheel loaders, and agricultural machine vehicles include, for example, tractors and combine harvesters.

[0013] FIG. 2 is a plan view showing the internal configuration of camera 1. Camera 1 includes a substrate 1a, an imaging unit 1b, and an illuminating unit 1c. Substrate 1a may be, for example, a printed circuit board or a flexible printed circuit (FPC). Imaging unit 1b is provided on substrate 1a and captures an image of an occupant of a specific vehicle. Illuminating unit 1c is provided on substrate 1a and, for example, when the brightness of an image captured by imaging unit 1b is equal to or lower than a threshold, irradiates light onto the occupant of the specific vehicle. Note that, although illuminating unit 1c is built into camera 1 in the first embodiment, it may also be provided separately from camera 1.

[0014] The variable holding member 2 in FIG. 1 has a first end 2a fixed to a specific vehicle and a second end 2b connected to the camera 1 and the irradiation unit 1c.

[0015] The first end 2 a of the variable holding member 2 is fixed to one of a plurality of predetermined portions 11 of a specific vehicle. The first end 2 a may be detachable from each of the predetermined portions 11, for example, by a suction cup or a screw, or may be non-detachable, for example, by an adhesive.

[0016] Each of the predetermined plurality of portions 11 of the specific vehicle has an area large enough to fix the first end 2a. If a conductor is provided inside the variable holding member 2, a connector may be provided at the first end 2a and each of the plurality of portions 11. With this configuration, the camera 1 can transmit the image captured by the imaging unit 1b via a wire to a control device of a DMS provided in the specific vehicle.

[0017] The second end 2b of the variable holding member 2 in Fig. 1 is connected to the camera 1 including the irradiation unit 1c, thereby connecting the camera 1 and the irradiation unit 1c. As shown in Fig. 3, a ball joint may be provided at the second end 2b, or, although not shown, a ball joint may also be provided at the first end 2a. In other words, a ball joint may be provided at at least one of the first end 2a and the second end 2b of the variable holding member 2. Note that in this specification, for example, "at least one of A, B, C, ..., and Z" means any one of all combinations of one or more types extracted from the group A, B, C, ..., and Z.

[0018] 1 holds the camera 1 so as to change the position and attitude of the camera 1 relative to the occupant. The variable holding member 2 is deformed so as to change the position and attitude of the camera 1 when subjected to an external force, for example, from a person, and maintains the position and attitude of the camera 1 when not subjected to an external force.

[0019] The variable holding member 2 may include, for example, a flexible arm, a wire made of a resin or alloy that can be variably held, or a bellows tube. When the variable holding member 2 includes these, the variable holding member 2 holds the camera 1 so that the three-dimensional position and attitude of the camera 1 relative to the occupant can be changed, as shown in Figures 1, 4, and 5. However, the variable holding member 2 is not limited to this, and may include, for example, a linear member that expands and contracts in a linear direction.

[0020] Fig. 6 is a perspective view showing a partial configuration of the imaging device according to Embodiment 1. As shown in Fig. 6, the light shielding unit 3 is, for example, a visor, and shields light other than the reflected light of the light irradiated from the irradiating unit 1c, for example, sunlight that may cause problems in the image captured by the imaging unit 1b.

[0021] 7(a) to 7(c) are diagrams illustrating examples of installation of an imaging device. In FIG. 7(a), the imaging device is installed in the area where the steering wheel is provided of a specific vehicle that does not have an A-pillar, windshield, or roof. In FIG. 7(b), the imaging device is installed on the roof of the specific vehicle, and in FIG. 7(c), the imaging device is installed on the A-pillar of the specific vehicle. In all of FIGS. 7(a) to 7(c), the position and orientation of the camera 1 are adjusted so that the occupant is within the imaging area in which the DMS monitors the occupant. To facilitate this adjustment, for example, the camera 1 may be provided with a notification unit that determines whether the DMS determines whether the occupant is within the imaging area and notifies the DMS of the determination result.

[0022] Summary of First Embodiment According to the imaging device of the first embodiment described above, the variable holding member 2 holds the camera 1 so that the position and orientation of the camera 1 relative to the occupant can be changed. This configuration allows the imaging area of ​​the imaging device in a specific vehicle to be changed as needed, enabling the DMS to be used without redesigning the imaging device or redeveloping the DMS algorithm. Furthermore, because the position and orientation of the camera 1 can be changed, a camera 1 with a narrow angle of view that is suited to the environment around the occupant can be used. Furthermore, because the camera 1 can be placed closer to the occupant, the number and brightness of the irradiating units 1c can be reduced, potentially reducing the cost of the device. Furthermore, the light shielding unit 3 blocks light other than reflected light emitted from the irradiating units 1c. Therefore, in a specific vehicle without a roof, for example, sunlight that can cause problems with the image captured by the imaging unit 1b can be blocked.

[0023] Furthermore, in the first embodiment, a ball joint is provided at at least one of the first end 2 a and the second end 2 b of the variable holding member 2. With this configuration, the range in which the attitude of the camera 1 can be changed can be widened.

[0024] In the first embodiment, the first end 2 a of the variable holding member 2 is fixed to one of a plurality of predetermined parts of the specific vehicle. This configuration can increase the possibility that the DMS can be used.

[0025] <Modifications> The light shielding portion 3 may be formed, for example, by a bellows that is expandable and contractible in the imaging direction of the camera 1. In this case, the shape of the light shielding portion 3 can be changed not only to the shape shown in FIG. 6 , but also to a shape in which the length of the lower portion of the light shielding portion 3 in the imaging direction is longer than the upper portion of the light shielding portion 3, or a shape in which one of the right and left portions of the light shielding portion 3 is longer than the other in the imaging direction. Such a configuration can improve the shielding ability of the light shielding portion 3. Note that the shape of the light shielding portion 3 may be changed manually, or may be automatically changed by a machine and a control device for the light shielding portion 3 according to the position and orientation of the second end 2b.

[0026] Furthermore, the irradiation unit 1c may be provided with a reflector that controls the light emitted from the irradiation unit 1c. Alternatively, if the irradiation unit 1c is provided separately from the camera 1, the orientation of the irradiation unit 1c itself may be changed so that the direction of light emitted from the irradiation unit 1c is variable. In these cases, at least one of the direction of light emitted from the irradiation unit 1c and the width of the irradiation beam is variable. This configuration can improve the quality of images captured using light emitted from the irradiation unit 1c. Note that at least one of the direction of light emitted from the irradiation unit 1c and the width of the irradiation beam may be manually changed or automatically changed by a machine or control device for the irradiation unit 1c according to the position and orientation of the second end 2b.

[0027] The contents of the embodiments can be modified or omitted as appropriate.

[0028] The above description is illustrative in all respects and is not restrictive. It is understood that countless variations not illustrated can be envisioned.

[0029] Reference Signs List 1 camera, 1b imaging section, 1c irradiation section, 2 variable holding member, 2a first end, 2b second end, 3 light shielding section, 11 section.

Claims

1. An imaging device comprising: a camera including an imaging unit that images an occupant of a vehicle; an illumination unit that illuminates the occupant with light; a rod-shaped variable holding member having a first end fixed to the vehicle and a second end connected to the camera and the illumination unit, and that holds the camera so that the position and attitude of the camera relative to the occupant can be changed; and a light shielding unit provided on the camera that blocks light other than reflected light of the light irradiated from the illumination unit.

2. An imaging device according to claim 1, wherein the variable holding member holds the camera so that the three-dimensional position and attitude of the camera relative to the occupant can be changed.

3. An imaging device according to claim 1, wherein a ball joint is provided at least at either the first end or the second end of the variable holding member.

4. An imaging device according to claim 1, wherein the first end of the variable holding member is fixed to any one of a plurality of predetermined portions of the vehicle.

5. An imaging device according to claim 1, wherein the shape of the light shielding portion is variable.

6. An imaging device according to claim 1, wherein at least one of the irradiation direction and irradiation beam width of the light from the irradiation section is variable.

7. An imaging device according to claim 1, wherein the vehicle comprises a construction machine vehicle or an agricultural machine vehicle.

Citation Information

Patent Citations

  • Closed-circuit monitoring device capable of automatically cleaning

    CN216827469U

  • Camera fixture

    JP2006119554A

  • In-cabin camera device

    JP2012096688A

  • Gesture detection device and program

    JP2021194982A

  • Video seating system for a vehicle

    US20030057749A1