Imaging device, collation system, analysis system and mobile unit

Abstract

To provide an imaging device, a collation system, an analysis system, and a mobile unit capable of acquiring an image close to the front of the face of a person viewing an image or video displayed on the side of a mobile body. [Solution] An imaging device (10) attached to a moving body (40) having a display unit (42) on the side on which an image or video is displayed comprises a first imaging unit (12) provided on the moving body (40) and installed in such a way that the imaging range faces diagonally forward relative to the direction of travel of the moving body (40) when moving straight ahead, and a facial image is obtained by the first imaging unit (12) capturing an image of the face of a person viewing an image or video displayed on the display unit (42).

Description

[Technical Field]

[0001] The present disclosure relates to an imaging device, a matching system, an analysis system, and a mobile unit. [Background technology]

[0002] A conventional mobile advertising device that displays advertising images and videos on an electronic signage device mounted on the side of a moving object such as a truck, thereby showing the advertisement to unspecified people, is disclosed, for example, in Patent Document 1. The mobile advertising device disclosed in Patent Document 1 is provided with an imaging device for capturing images of the periphery of the electronic signage device, thereby detecting viewers who are viewing the advertisements displayed on the electronic signage device and estimating the level of interest in the advertising content. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-112166 Summary of the Invention [Problem to be solved by the invention]

[0004] Conventional mobile unit units disclosed in Patent Document 1 and the like have the problem that when a person walking parallel to the longitudinal direction of a moving mobile unit or a person facing parallel to the longitudinal direction is looking at an image or video displayed on the side of the mobile unit, it is difficult to obtain an image that is close to a front view of the person's face.

[0005] The present disclosure has been made in consideration of these points, and aims to provide an imaging device, a matching system, an analysis system, and a mobile unit that can acquire an image that is close to a front view of the face of a person viewing an image or video displayed on the side of a mobile body. [Means for solving the problem]

[0006] The imaging device of the present disclosure includes: An imaging device attached to a moving object having a display unit on the side on which an image or video is displayed, a first imaging unit provided on the moving body and installed in a direction such that an imaging range faces diagonally forward with respect to a traveling direction of the moving body when the moving body is traveling straight; The first imaging unit captures an image of a face of a person viewing an image or video displayed on the display unit, thereby acquiring a facial image.

[0007] In the imaging device of the present disclosure, The first imaging unit may be installed near a rear end of the moving object in a traveling direction.

[0008] The first imaging unit may be provided behind the center of the display unit in the traveling direction of the moving object.

[0009] The imaging device of the present disclosure includes: The vehicle may further include a second imaging unit that is provided on the moving body and is installed so that an imaging range faces diagonally rearward with respect to the traveling direction of the moving body when the moving body is traveling straight ahead.

[0010] The second imaging unit may be provided further forward than the first imaging unit in the traveling direction of the moving object.

[0011] The second imaging unit may be provided in front of the center of the display unit in the traveling direction of the moving object.

[0012] Furthermore, a part of the imaging range of the first imaging unit and a part of the imaging range of the second imaging unit may overlap.

[0013] The imaging device of the present disclosure includes: The vehicle may further include a third imaging unit that is provided on the moving body and is installed so that the imaging range faces in a direction perpendicular to the traveling direction of the moving body when the moving body moves straight ahead.

[0014] The third imaging unit may be provided at a position between the first imaging unit and the second imaging unit in the traveling direction of the moving object.

[0015] Furthermore, an angle of a center line from the first imaging unit in the horizontal direction of an imaging range of the first imaging unit with respect to a traveling direction when the moving body is traveling straight may be within a range of 10° to 80°.

[0016] The horizontal angle of view of the imaging range of the first imaging unit may be within a range of 30° to 80°.

[0017] The first imaging unit may be installed at a height within a range of 3 m to 5 m from the ground on the moving body.

[0018] Furthermore, an angle of a center line from the first imaging unit in the vertical direction of an imaging range of the first imaging unit with respect to the horizontal direction may be within a range of 20° to 60°.

[0019] The imaging device of the present disclosure includes: An imaging device attached to a moving object having a display unit on the side on which an image or video is displayed, a second imaging unit provided in the moving body and installed in a direction such that an imaging range faces diagonally rearward with respect to a traveling direction of the moving body when the moving body is traveling straight, The second imaging unit captures an image of a face of a person viewing an image or video displayed on the display unit, thereby acquiring a facial image.

[0020] The collation system of the present disclosure comprises: The imaging device described above; a face image capture device for capturing an image of a person's face; The method is characterized in that by comparing information about the face image acquired by the imaging device with information about the face image acquired by the face image acquisition device, it is possible to verify the person whose face image was acquired by the face image acquisition device.

[0021] The analysis system of the present disclosure comprises: The imaging device described above; an analysis device that performs analysis using information about the face image acquired by the imaging device; The present invention is characterized by the following.

[0022] The mobile unit of the present disclosure comprises: a mobile object having a display unit on a side surface thereof for displaying an image or video; an imaging device attached to the moving body; Equipped with The imaging device is a first imaging unit provided on the moving body and installed in a direction such that an imaging range faces diagonally forward with respect to a traveling direction of the moving body when the moving body is traveling straight, The first imaging unit captures an image of a face of a person viewing an image or video displayed on the display unit, thereby acquiring a facial image.

[0023] The mobile unit of the present disclosure comprises: a mobile object having a display unit on a side surface thereof for displaying an image or video; an imaging device attached to the moving body; Equipped with The imaging device is a second imaging unit provided on the moving body and installed in a direction such that an imaging range faces diagonally rearward with respect to a traveling direction of the moving body when the moving body is traveling straight, The second imaging unit captures an image of a face of a person viewing an image or video displayed on the display unit, thereby acquiring a facial image. [Effects of the Invention]

[0024] The imaging device, collation system, analysis system, and mobile unit of the present disclosure can acquire an image that is close to a front view of the face of a person viewing an image or video displayed on the side of a mobile body. [Brief explanation of the drawings]

[0025] [Figure 1]1 is a functional block diagram illustrating a schematic configuration of a verification system according to an embodiment of the present invention. [Figure 2] 2 is a top view schematically showing the installation positions of a first imaging unit, a second imaging unit, and a third imaging unit attached to a vehicle as a moving body. FIG. [Figure 3] 3 is a top view showing the imaging ranges of a first imaging unit and a second imaging unit attached to a vehicle. FIG. [Figure 4] 4 is a side view showing an imaging range of a first imaging unit attached to a vehicle. FIG. [Figure 5] 2 is a flowchart showing the operation of the verification system shown in FIG. [Figure 6] 1 is a functional block diagram schematically illustrating the configuration of an analysis system according to an embodiment of the present invention. DETAILED DESCRIPTION OF THE INVENTION

[0026] 1 to 5 are diagrams showing a verification system 1, an imaging device 10, and the like according to an embodiment of the present disclosure.

[0027] First, an overview of a verification system 1 according to this embodiment will be described with reference to FIG.

[0028] As shown in Fig. 1, a verification system 1 according to this embodiment includes an imaging device 10 installed in a vehicle 40 (described later) as a moving object, a face image acquisition device 20 installed in a store or the like, and a verification device 30. In addition, as shown in Fig. 2, in this embodiment, a vehicle unit 50 is configured by combining the vehicle 40 and the imaging device 10. The components of the imaging device 10, face image acquisition device 20, and verification device 30 will be described in detail below.

[0029] The imaging device 10 is installed in a vehicle 40 serving as a moving body as shown in FIG. 2 and other figures. In this embodiment, a truck is used as the moving body vehicle 40. Display units 42 for displaying images or videos are provided on both sides of the vehicle 40. Various advertisements are displayed as images or videos on the display units 42, and by displaying images or videos as advertisements on the display units 42 while the vehicle 40 moves through town, people walking through the town can see the images or videos as advertisements displayed on the display units 42 of the vehicle 40. The configuration of such imaging device 10 will be described in detail below.

[0030] The face image acquisition device 20 is installed in a store, etc. The face image acquisition device 20 has a fourth imaging unit 22, an installation information acquisition unit 24, and a communication unit .

[0031] The fourth imaging unit 22 is configured by, for example, a camera and is installed near the store entrance or the cash register. The fourth imaging unit 22 is capable of capturing facial images of customers entering the store or customers about to pay at the cash register.

[0032] The installation information acquiring unit 24 is configured to acquire various installation information such as identification information such as the name of the store where the face image capturing device 20 is installed, the address of the store, store owner information, the installation location in the store of the fourth imaging unit 22, etc. Such installation information may be acquired by the installation information acquiring unit 24 by being input as initial setting information when the face image capturing device 20 is installed in the store.

[0033] The communication unit 26 is composed of a communication interface and the like that transmits and receives various information to and from the verification device 30 via an Internet line, and is configured to transmit to the verification device 30 a facial image of a person captured by the fourth imaging unit 22 or information related to the facial image of the person, and installation information of the fourth imaging unit 22 acquired by the installation information acquisition unit 24. Specifically, the facial image of a person captured by the fourth imaging unit 22 may itself be transmitted to the verification device 30 by the communication unit 26. Furthermore, when the fourth imaging unit 22 is configured to acquire a hash value from the captured facial image of a person using a predetermined hash function, the hash value acquired by the fourth imaging unit 22 is transmitted to the verification device 30 by the communication unit 26. Such a hash value becomes information that does not identify the individual of the person captured.

[0034] The verification device 30 is installed in a management room or the like that manages the verification system 1. The verification device 30 has a storage unit 32, a verification unit , and a communication unit .

[0035] The storage unit 32 stores a human face image or information (specifically, hash values) related to the human face image captured by each of the first imaging units 12, second imaging units 14, and third imaging units 16, which is transmitted from the imaging device 10. The storage unit 32 may also store a human face image or information (specifically, hash values) related to the human face image captured by the fourth imaging unit 22, which is transmitted from the matching device 30.

[0036] The matching unit 34 compares the information about the facial image acquired by the imaging device 10, which is stored in the memory unit 32, with the information about the facial image acquired by the facial image acquisition device 20, thereby matching the person whose facial image was acquired by the facial image acquisition device 20. This makes it possible to obtain information such as whether or not a person who viewed an image or video as an advertisement displayed on the display unit 42 of the vehicle 40 actually purchased a product or the like related to the advertisement at a store, thereby making it possible to measure the effectiveness of the advertisement displayed on the display unit 42 of the vehicle 40.

[0037] The communication unit 36 ​​is configured with a communication interface and the like for transmitting and receiving various information between the imaging device 10 and the face image acquisition device 20 via an internet line.

[0038] Next, a detailed description will be given of the configuration of the imaging device 10 installed in the vehicle 40. As shown in Figures 1 to 3, the imaging device 10 has a first imaging unit 12, a second imaging unit 14, a third imaging unit 16, and a communication unit 18.

[0039] As shown in Fig. 2, the first imaging units 12 are composed of, for example, cameras, and are installed on the sides of the vehicle 40 as a pair on the left and right near the rear end of the vehicle 40 in the traveling direction (left direction in Fig. 2). Each of the pair of left and right first imaging units 12 is provided behind the center of the display unit 42 in the traveling direction of the vehicle 40. Each of the pair of left and right first imaging units 12 is installed so that its imaging range faces diagonally forward with respect to the traveling direction of the vehicle 40 when traveling straight, as shown in Fig. 3. As shown in Fig. 4, each of the pair of left and right first imaging units 12 is installed at a height within a range of 3 m to 5 m from the ground on the vehicle 40, and is installed so that its imaging range faces diagonally downward from near the top of the vehicle 40.

[0040] The second imaging units 14 are, for example, composed of cameras, and are installed on the sides of the vehicle 40 as a pair on the left and right near the front end of the vehicle 40 in the traveling direction (leftward in FIG. 2). Each of the pair of left and right second imaging units 14 is installed forward of the center of the display unit 42 in the traveling direction of the vehicle 40. In other words, each of the pair of left and right second imaging units 14 is installed forward of each of the first imaging units 12 in the traveling direction of the vehicle 40. Each of the pair of left and right second imaging units 14 is installed so that its imaging range faces diagonally backward with respect to the traveling direction of the vehicle 40 when traveling straight, as shown in FIG. 3. Each of the pair of left and right second imaging units 14 is installed at a height of 3 m to 5 m from the ground on the vehicle 40, and is installed so that its imaging range faces diagonally downward from near the top of the vehicle 40.

[0041] The third imaging units 16 are, for example, composed of cameras, and are installed on the sides of the vehicle 40 as a pair on the left and right near the front end of the vehicle 40 in the traveling direction (leftward in FIG. 2). Each of the pair of left and right third imaging units 16 is installed near the center of the display unit 42 in the traveling direction of the vehicle 40. In other words, each of the pair of left and right third imaging units 16 is installed between the first imaging units 12 and the second imaging units 14 in the traveling direction of the vehicle 40. Each of the pair of left and right third imaging units 16 is installed in an orientation such that the imaging range faces in a direction perpendicular to the traveling direction when the vehicle 40 is traveling straight (i.e., facing upward or downward in FIG. 2). As shown in FIG. 4, each of the pair of left and right third imaging units 16 is installed at a height within a range of 3 m to 5 m from the ground on the vehicle 40, and is installed in an orientation such that the imaging range faces diagonally downward from near the top of the vehicle 40.

[0042] The communication unit 18 is composed of a communication interface and the like that transmits and receives various information to and from the verification device 30 via an Internet line, and is configured to transmit facial images of people or information related to facial images of people captured by each of the first imaging units 12, second imaging units 14, and third imaging units 16 to the verification device 30. Specifically, the facial images of people captured by each of the first imaging units 12, second imaging units 14, and third imaging units 16 may be transmitted to the verification device 30 by the communication unit 18. Furthermore, if each of the first imaging units 12, second imaging units 14, and third imaging units 16 uses a predetermined hash function to obtain a hash value from the captured facial image of a person, the hash value obtained by each of the first imaging units 12, second imaging units 14, and third imaging units 16 is transmitted to the verification device 30 by the communication unit 18. Such hash values ​​are information that does not identify the individual of the person captured. The facial images of people or information related to the facial images of people transmitted to the verification device 30 are stored in the storage unit 32. Furthermore, the hash value may be further subjected to vector conversion, and information relating to the face image may be stored in the storage unit 32 in a manner that takes privacy into consideration.

[0043] Furthermore, each of the first imaging units 12, second imaging units 14, and third imaging units 16 may analyze a person's attributes, such as gender and age, from a captured facial image of the person, or analyze the person's clothing, accessories, belongings, etc. from a captured full-body image of the person. The analyzed information on the person's attributes, clothing, accessories, belongings, etc. is transmitted to the verification device 30 by the communication unit 18 and stored in the memory unit 32. Furthermore, if the location information of the vehicle 40 is acquired by a GPS or the like (not shown) when the first imaging units 12, second imaging units 14, and third imaging units 16 of the imaging device 10 capture images, information on the person's facial images captured by the first imaging units 12, second imaging units 14, and third imaging units 16, and information on the person's attributes, clothing, accessories, belongings, etc. are linked to the location information of the vehicle 40 and transmitted from the imaging device 10 to the verification device 30 and stored in the memory unit 32 of the verification device 30.

[0044] Next, the imaging ranges of the first imaging units 12 and the second imaging units 14 installed on the vehicle 40 will be described with reference to FIGS. 3 and 4. In FIGS. 3 and 4, a person near the vehicle 40 is indicated by reference symbol P. In FIG. 3, the imaging range of the first imaging unit 12 installed on the right side of the vehicle 40, out of the pair of left and right first imaging units 12, is indicated by reference symbol 12a, and the imaging range of the first imaging unit 12 installed on the left side of the vehicle 40 is indicated by reference symbol 12c. In addition, the imaging range of the second imaging unit 14 installed on the right side of the vehicle 40, out of the pair of left and right second imaging units 14, is indicated by reference symbol 14a, and the imaging range of the second imaging unit 14 installed on the left side of the vehicle 40 is indicated by reference symbol 14c. In FIG. 3, the imaging ranges of the third imaging units 16 are omitted because including the imaging ranges of the first imaging units 12 and the second imaging units 14 would make it difficult to see the imaging ranges of the first imaging units 12 and the second imaging units 14. 4, the imaging ranges of the first imaging units 12, the second imaging units 14, and the third imaging units 16 installed on the vehicle 40 when viewed from the side are indicated by reference numeral 17. As shown in FIG. 4, the first imaging units 12, the second imaging units 14, and the third imaging units 16 are installed near the top of the vehicle 40 with their imaging ranges facing diagonally downward.

[0045] As shown in Fig. 3, each of the pair of left and right first imaging units 12 is installed so that the imaging range faces diagonally forward with respect to the traveling direction of the vehicle 40 when traveling straight. In this case, it is possible to acquire an image that is close to the front of the face of a person walking in the opposite direction to the traveling direction of the vehicle 40 when traveling straight, or facing the opposite direction to the traveling direction of the vehicle 40 when traveling straight. Here, the angle of the center line (indicated by reference signs 12p and 12q in Fig. 3) from each first imaging unit 12 in the horizontal direction of the imaging ranges 12a and 12c of each first imaging unit 12 with respect to the traveling direction of the vehicle 40 when traveling straight (left direction in Fig. 3) is within a range of 10° to 80°, preferably 20° to 70°, and more preferably 30° to 60°. Specifically, the angle of center line 12p from each first imaging unit 12 in the horizontal direction of imaging range 12a of first imaging unit 12 installed on the right side of vehicle 40 relative to the traveling direction (left direction in FIG. 3) when vehicle 40 is traveling straight is approximately 45°. Also, the angle of center line 12q from each first imaging unit 12 in the horizontal direction of imaging range 12c of first imaging unit 12 installed on the left side of vehicle 40 relative to the traveling direction (left direction in FIG. 3) when vehicle 40 is traveling straight is also approximately 45°.

[0046] Furthermore, the horizontal angle of view of imaging ranges 12a and 12c of first imaging unit 12 installed on the right side of vehicle 40 is within a range of 30° to 80°, and preferably 35° to 70°. Specifically, the horizontal angle of view of imaging range 12a of first imaging unit 12 installed on the right side of vehicle 40 (indicated by reference character a in FIG. 3) is approximately 39°, while the horizontal angle of view of imaging range 12c of first imaging unit 12 installed on the left side of vehicle 40 (indicated by reference character c in FIG. 3) is approximately 68°. The reason why the horizontal angles of view of imaging ranges 12a and 12c are different will be described later.

[0047] 3, each of the pair of left and right second imaging units 14 is installed so that the imaging range faces diagonally backward with respect to the traveling direction of the vehicle 40 when traveling straight. In this case, it is possible to acquire an image that is close to the front of the face of a person walking in the traveling direction of the vehicle 40 when traveling straight or facing the traveling direction of the vehicle 40 when traveling straight. Here, the angle of the center line (indicated by reference signs 14p and 14q in FIG. 3) from each second imaging unit 14 in the horizontal direction of the imaging ranges 14a and 14c of each second imaging unit 14 with respect to the traveling direction of the vehicle 40 when traveling straight (left direction in FIG. 3) is within a range of 10° to 80°, preferably 20° to 70°, and more preferably 30° to 60°. Specifically, the angle of center line 14p from each second imaging unit 14 in the horizontal direction of imaging range 14a of second imaging unit 14 installed on the right side of vehicle 40 relative to the traveling direction (left direction in FIG. 4) when vehicle 40 is traveling straight is approximately 45°. Also, the angle of center line 14q from each second imaging unit 14 in the horizontal direction of imaging range 14c of second imaging unit 14 installed on the left side of vehicle 40 relative to the traveling direction (left direction in FIG. 3) when vehicle 40 is traveling straight is also approximately 45°.

[0048] The horizontal angle of view of imaging ranges 14a, 14c of second imaging unit 14 installed on the right side of vehicle 40 is within a range of 30° to 80°, and preferably 35° to 70°. Specifically, the horizontal angle of view of imaging range 12a of second imaging unit 14 installed on the right side of vehicle 40 (indicated by reference character b in FIG. 3) is approximately 39°, while the horizontal angle of view of imaging range 12c of second imaging unit 14 installed on the left side of vehicle 40 (indicated by reference character d in FIG. 3) is approximately 68°. The reason why the horizontal angles of view of imaging ranges 14a, 14c are different will be described later.

[0049] As shown in Fig. 4, each of the first imaging units 12, second imaging units 14, and third imaging units 16 is installed near the top of the vehicle 40 (specifically, at a height of 3 to 5 meters above the ground on the vehicle 40) with its imaging range looking diagonally downward. Here, for imaging range 17 of each of the first imaging units 12, second imaging units 14, and third imaging units 16, the angle of center line 17a from each of the first imaging units 12, second imaging units 14, and third imaging units 16 in the vertical direction relative to the horizontal direction (indicated by reference character e in Fig. 4) is within a range of 20 to 60 degrees. This reduces the downward angle when each of the first imaging units 12, second imaging units 14, and third imaging units 16 images a person's face, thereby enabling more accurate matching in the matching device 30. 4, the imaging line along which each of the first imaging units 12, second imaging units 14, and third imaging units 16 captures an image of a person's face is indicated by reference symbol 17b, and the look-down angle is indicated by reference symbol f. If the look-down angle is 30° or less, the small look-down angle allows each of the first imaging units 12, second imaging units 14, and third imaging units 16 to capture an image of the person's face that is close to the front. On the other hand, if the look-down angle is greater than 30°, each of the first imaging units 12, second imaging units 14, and third imaging units 16 captures the person's face from above at an angle downward, and therefore cannot capture an image of the person's face that is close to the front, which may result in a deterioration in the matching accuracy of the matching device 30. In this way, in order to keep the look-down angle of each of the first imaging units 12, second imaging units 14, and third imaging units 16 when imaging a person's face at 30° or less, it is desirable to set the angle of the center line 17a from each of the first imaging units 12, second imaging units 14, and third imaging units 16 in the vertical direction relative to the horizontal direction (shown by reference symbol e in Figure 4) within the range of 20° to 60°.

[0050] From this perspective, the imaging ranges of the first imaging units 12 and the second imaging units 14, which enable more accurate matching in the matching device 30, are indicated by reference symbols 12b, 12d, 14b, and 14d in Fig. 3. That is, if a person gets too close to the vehicle 40, the look-down angle at which the first imaging units 12, the second imaging units 14, and the third imaging units 16 capture images of the person's face will be greater than 30°, which could result in a deterioration in the matching accuracy of the matching device 30. Also, if a person is too far from the vehicle 40, the facial images of the person captured by the first imaging units 12, the second imaging units 14, and the third imaging units 16 will be small, which could result in a deterioration in the matching accuracy of the matching device 30.

[0051] Furthermore, by installing each of the first imaging units 12, second imaging units 14, and third imaging units 16 at a height of 3 m or more from the ground on the vehicle 40, it is possible to prevent people from getting in the way of capturing a facial image of one person, even when many people are gathered on the side of the vehicle 40, and therefore to prevent individual facial images from being lost due to being obscured by other people. On the other hand, by installing each of the first imaging units 12, second imaging units 14, and third imaging units 16 at a height of 5 m or less from the ground on the vehicle 40, it is possible to prevent the downward angle from becoming large when capturing an image of a person's face with each of the first imaging units 12, second imaging units 14, and third imaging units 16.

[0052] In this embodiment, as shown in Fig. 3, a portion of the imaging range of each of the pair of left and right first imaging units 12 overlaps with a portion of the imaging range of each of the pair of left and right second imaging units 14. The overlapping portions are indicated by reference numerals 15a and 15b in Fig. 3. In this case, a portion of the imaging range of each of the first imaging units 12 overlaps with a portion of the imaging range of each of the second imaging units 14, so that a person imaged by each of the first imaging units 12 can be continuously tracked by each of the second imaging units 14. In other words, it is possible to prevent the same person from being imaged by each of the first imaging units 12 and each of the second imaging units 14 and then being transmitted to the matching device 30 as a facial image of a different person.

[0053] In the present embodiment, as described above, the horizontal angles of view of the imaging range 12a of the first imaging unit 12 installed on the right side of the vehicle 40 are different from those of the imaging range 12c of the first imaging unit 12 installed on the left side of the vehicle 40. The horizontal angles of view of the imaging range 14a of the second imaging unit 14 installed on the right side of the vehicle 40 are also different from those of the imaging range 14c of the second imaging unit 14 installed on the left side of the vehicle 40. This is because, in Japan, the vehicle 40 travels on the left side of the road lanes, and therefore, the sidewalk to the left of the traveling vehicle 40 is on which there may be a person. Therefore, by increasing the horizontal angles of view of the imaging ranges 12c, 14c, a deterioration in the matching accuracy of the matching device 30 is prevented even if a person is near the vehicle 40. On the other hand, the right side of the vehicle 40 is an oncoming lane, and therefore, the distance between the right side of the vehicle 40 and a person on the other side of the oncoming lane is large. Therefore, even if the horizontal angles of view of the imaging ranges 12a, 14a are reduced, the matching accuracy of the matching device 30 is not deteriorated. In this case, as shown in FIG. 3, the overlapping point (reference symbol 15b) of the imaging range of the first imaging unit 12 installed on the left side of the vehicle 40 and the imaging range of the second imaging unit 14 is closer to the vehicle 40 than the overlapping point (reference symbol 15a) of the imaging range of the first imaging unit 12 installed on the right side of the vehicle 40 and the imaging range of the second imaging unit 14.

[0054] Next, the operation of the verification system 1 of this embodiment configured as described above will be described with reference to the flowchart shown in FIG.

[0055] First, a vehicle 40 equipped with an imaging device 10 according to this embodiment is driven around town, and information about facial images of people viewing advertisement images or videos displayed on a display unit 42 of the vehicle 40 is acquired by each of the first imaging units 12, second imaging units 14, and third imaging units 16. The information about facial images of people acquired by each of the first imaging units 12, second imaging units 14, and third imaging units 16 is transmitted to the verification device 30 by the communication unit 18 (step S1 in FIG. 5). The information about facial images of people transmitted to the verification device 30 is stored in the storage unit 32. Furthermore, when attributes of people, such as gender and age, are analyzed from the captured facial images of people, each of the first imaging units 12, second imaging units 14, and third imaging units 16 transmits information about the analyzed attributes of people to the verification device 30 by the communication unit 18 and is stored in the storage unit 32.

[0056] Furthermore, when a person who has seen an image or video as an advertisement displayed on display unit 42 of vehicle 40 visits a store or the like to purchase a product or receive a service related to the advertisement, information about the person's facial image is acquired by fourth imaging unit 22 of facial image acquisition device 20 installed in the store or the like. The information about the person's facial image acquired by fourth imaging unit 22 is transmitted to matching device 30 by communication unit 26 (step S2 in FIG. 5). The information about the person's facial image transmitted to matching device 30 may be stored in memory unit 32.

[0057] The matching unit 34 of the matching device 30 compares the information about the facial image acquired by the imaging device 10 and the information about the facial image acquired by the facial image acquisition device 20, which is stored in the memory unit 32, to match the person whose facial image was acquired by the facial image acquisition device 20 (step S3 in FIG. 5). This makes it possible to obtain information such as whether or not a person who viewed an image or video as an advertisement displayed on the display unit 42 of the vehicle 40 actually purchased a product or the like related to this advertisement at a store, thereby making it possible to measure the effectiveness of the advertisement displayed on the display unit 42 of the vehicle 40.

[0058] According to the imaging device 10 of the present embodiment configured as described above, the verification system 1 including such imaging device 10, and the vehicle unit 50 including the imaging device 10 and the vehicle 40, the imaging device 10 is attached to the vehicle 40 (moving object) on whose side a display unit 42 for displaying images or videos is provided, and includes a first imaging unit 12 that is provided on the vehicle 40 and is installed so that its imaging range faces diagonally forward with respect to the traveling direction of the vehicle 40 when traveling straight, and a facial image is acquired by the first imaging unit 12 capturing an image of a person viewing an image or video displayed on the display unit 42. According to the imaging device 10, verification system 1, and vehicle unit 50 configured as described above, since the person's face is captured by the first imaging unit 12 that is installed so that its imaging range faces diagonally forward with respect to the traveling direction of the vehicle 40 when traveling straight, it is possible to acquire an image that is close to the front of the face of a person walking in the opposite direction to the traveling direction of the vehicle 40 when traveling straight, or facing in the opposite direction to the traveling direction of the vehicle 40 when traveling straight. This makes it possible to obtain a facial image that is closer to the front of the person compared to when only an imaging unit (e.g., the third imaging unit 16) is installed with the imaging range facing in a direction perpendicular to the direction of travel when the vehicle 40 is traveling straight ahead, thereby improving the accuracy of analysis of person attributes and matching by the matching device 30.

[0059] Furthermore, in the imaging device 10, verification system 1, and vehicle unit 50 of the present embodiment, as described above, the first imaging unit 12 is installed near the rear end in the traveling direction of the vehicle 40. In this case, when a person viewing an image or video displayed on the display unit 42 is walking in the opposite direction to the traveling direction of the vehicle 40 when the vehicle 40 is traveling straight ahead, or is facing the opposite direction to the traveling direction of the vehicle 40 when the vehicle 40 is traveling straight ahead, a facial image of this person that is closer to being viewed from the front can be obtained.

[0060] Furthermore, in the imaging device 10, verification system 1, and vehicle unit 50 of the present embodiment, as described above, the first imaging unit 12 is provided behind the center of the display unit 42 in the direction of travel of the vehicle 40. In this case, when a person viewing an image or video displayed on the display unit 42 is walking in the opposite direction to the direction of travel of the vehicle 40 when the vehicle 40 is traveling straight, or is facing the opposite direction to the direction of travel of the vehicle 40 when the vehicle 40 is traveling straight, a facial image of this person that is closer to being viewed from the front can be obtained.

[0061] Furthermore, in the imaging device 10, the verification system 1, and the vehicle unit 50 of the present embodiment, as described above, the second imaging unit 14 is additionally provided on the vehicle 40, and is installed so that the imaging range faces diagonally rearward with respect to the traveling direction of the vehicle 40 when traveling straight. In this case, since the person's face is imaged by the second imaging unit 14, which is installed so that the imaging range faces diagonally rearward with respect to the traveling direction of the vehicle 40 when traveling straight, it is possible to obtain an image that is close to the front of the face of a person who is walking in the traveling direction of the vehicle 40 when traveling straight or who is facing the traveling direction of the vehicle 40 when traveling straight.

[0062] Furthermore, in the imaging device 10, verification system 1, and vehicle unit 50 of the present embodiment, as described above, the second imaging unit 14 is provided further forward than the first imaging unit 12 in the direction of travel of the vehicle 40. In this case, when a person viewing an image or video displayed on the display unit 42 is walking next to the traveling vehicle 40 in the direction of travel of the vehicle 40 when traveling straight, or is facing the direction of travel of the vehicle 40 when traveling straight, a facial image of this person that is closer to being viewed from the front can be obtained.

[0063] Furthermore, in the imaging device 10, verification system 1, and vehicle unit 50 of the present embodiment, as described above, the second imaging unit 14 is provided forward of the center of the display unit 42 in the direction of travel of the vehicle 40. In this case, when a person viewing an image or video displayed on the display unit 42 is walking next to the traveling vehicle 40 in the direction of travel of the vehicle 40 when traveling straight, or is facing the direction of travel of the vehicle 40 when traveling straight, a facial image of this person that is closer to being viewed from the front can be obtained.

[0064] Furthermore, in the imaging device 10, verification system 1, and vehicle unit 50 of this embodiment, as described above, part of the imaging ranges 12a and 12c of the first imaging unit 12 overlaps part of the imaging ranges 14a and 14c of the second imaging unit 14. In this case, part of the imaging range of the first imaging unit 12 overlaps part of the imaging range of the second imaging unit 14, making it possible for the second imaging unit 14 to continue tracking the person imaged by the first imaging unit 12.

[0065] Furthermore, in the imaging device 10, verification system 1, and vehicle unit 50 of the present embodiment, as described above, the third imaging unit 16 is provided on the vehicle 40, and is installed so that the imaging range faces in a direction perpendicular to the traveling direction of the vehicle 40 when the vehicle 40 is traveling straight ahead. In this case, it is possible to obtain a facial image that is close to the front of a person who is looking at an image or video displayed on the display unit 42 from a position next to the traveling vehicle 40, facing the vehicle 40.

[0066] Furthermore, in the imaging device 10, verification system 1, and vehicle unit 50 of the present embodiment, as described above, the third imaging unit 16 is provided at a position between the first imaging unit 12 and the second imaging unit 14 in the traveling direction of the vehicle 40. In this case, when a person is looking at an image or video displayed on the display unit 42 from the side of the vehicle 40 in a sideways orientation, a facial image that is closer to a frontal view of the person can be obtained.

[0067] Furthermore, in imaging device 10, verification system 1, and vehicle unit 50 of the present embodiment, as described above, the angle of the center line from first imaging unit 12 in the horizontal direction of the imaging range of first imaging unit 12 with respect to the traveling direction when vehicle 40 is traveling straight is within a range of 10° to 80°. In this case, when a person viewing an image or video displayed on display unit 42 is walking in the opposite direction to the traveling direction when vehicle 40 is traveling straight, or facing in the opposite direction to the traveling direction when vehicle 40 is traveling straight, a facial image that is closer to a frontal view of this person can be obtained.

[0068] Furthermore, in imaging device 10, verification system 1, and vehicle unit 50 of the present embodiment, as described above, the horizontal angle of view of the imaging range of first imaging unit 12 is within the range of 30° to 80°. In this case, when a person viewing an image or video displayed on display unit 42 is walking in the opposite direction to the traveling direction of vehicle 40 when traveling straight, or is facing the opposite direction to the traveling direction of vehicle 40 when traveling straight, a facial image of this person that is closer to being viewed from the front can be obtained.

[0069] Furthermore, in the imaging device 10, the verification system 1, and the vehicle unit 50 of this embodiment, as described above, the first imaging unit 12 is installed at a height within a range of 3 m to 5 m from the ground on the vehicle 40. In this case, the angle of view from above when the first imaging unit 12 captures an image of a person's face can be reduced. This prevents people from getting in the way of capturing a facial image of a person even when many people are gathered on the side of the vehicle 40, thereby preventing individual facial images from being obscured by other people. Furthermore, the angle of view from above when each of the first imaging unit 12, each of the second imaging unit 14, and each of the third imaging unit 16 captures a person's face can be prevented from becoming too large.

[0070] Furthermore, in the imaging device 10, verification system 1, and vehicle unit 50 of the present embodiment, as described above, the angle of the center line from first imaging unit 12 in the vertical direction of the imaging range of first imaging unit 12 with respect to the horizontal direction is within a range of 20° to 60°. In this case as well, the downward angle when first imaging unit 12 images a person's face can be reduced.

[0071] The imaging device 10, the verification system 1, and the vehicle unit 50 according to this embodiment are not limited to the above-described aspects, and various modifications can be made.

[0072] For example, in the above description, the first imaging unit 12, the second imaging unit 14, and the third imaging unit 16 are installed on both sides of the vehicle 40, but the present embodiment is not limited to this. As another example, the first imaging unit 12, the second imaging unit 14, and the third imaging unit 16 may be installed on only one side of the vehicle 40.

[0073] Furthermore, the imaging device 10 according to this embodiment may be one that does not include the third imaging unit 16. That is, the imaging device 10 may be one that is configured only with the first imaging unit 12 and the second imaging unit 14. Here, if the imaging device 10 according to this embodiment is provided with the third imaging unit 16, the third imaging unit 16 can capture a front image of a person viewing an advertisement image or video displayed on the display unit 42 from a position directly to the side of the vehicle 40 when the vehicle 40 is stopped. On the other hand, if the imaging ranges of the first imaging unit 12 and the second imaging unit 14 overlap, even if the third imaging unit 16 is not provided, images of people on the side of the vehicle 40, particularly when the vehicle 40 is moving, can be captured by at least one of the first imaging unit 12 and the second imaging unit 14. Therefore, omitting the third imaging unit 16 can reduce costs. As described above, when cost reduction is intended for the imaging device 10 according to the present embodiment, it is desirable to exclude the imaging section (specifically, the third imaging section 16) that is installed so that the imaging range faces in a direction perpendicular to the traveling direction of the vehicle 40 when traveling straight ahead. Furthermore, as an imaging device 10 of yet another aspect, one that is composed only of the first imaging section 12 may be used. Furthermore, as an imaging device 10 of yet another aspect, one that is composed only of the second imaging section 14 without the first imaging section 12 may be used.

[0074] Furthermore, the vehicle 40 on which the imaging device 10 is installed is not limited to a truck. The vehicle 40 on which the display unit 42 is provided on the side may be configured to be any other than a truck.

[0075] Furthermore, the moving body according to the present disclosure is not limited to the vehicle 40. The moving body according to the present disclosure may be configured as a motorbike, a bicycle, a robot such as a food delivery robot or a cleaning robot, or any other object other than the vehicle 40. In this case, a moving body unit is configured by combining such a moving body with the imaging device 10 installed on the moving body.

[0076] Moreover, instead of the collation system 1 shown in Fig. 1, an analysis system 2 shown in Fig. 6 may be used. The analysis system 2 shown in Fig. 6 includes the above-described imaging device 10 and an analysis device 60.

[0077] The analysis device 60 is installed in a control room or the like that manages the analysis system 2. The analysis device 60 has a storage unit 62, an analysis unit 64, and a communication unit 66.

[0078] The memory unit 62 stores facial images of people or information about the facial images of people (specifically, hash values) captured by each of the first imaging units 12, each of the second imaging units 14, and each of the third imaging units 16, which are transmitted from the imaging device 10.

[0079] The analysis unit 64 performs various analyses using the human face images or information about the human face images captured by each of the first imaging units 12, second imaging units 14, and third imaging units 16, transmitted from the imaging device 10. For example, various analyses are performed on the number and attributes of people viewing the images or videos as advertisements displayed on the display unit 42 of the vehicle 40, the effectiveness of the advertisement taking into consideration the location information of the vehicle 40, and the optimal travel route for the vehicle 40 to enhance the effectiveness of the advertisement.

[0080] The communication unit 66 is configured with a communication interface and the like for transmitting and receiving various information to and from the imaging device 10 via an internet line.

[0081] Such analysis system 60 can acquire an image that is closer to the front of the face of a person walking in the direction of travel or in the opposite direction to the direction of travel when vehicle 40 is traveling straight, or facing the direction of travel or the opposite direction to the direction of travel when vehicle 40 is traveling straight. This makes it possible to acquire a facial image that is closer to the front of the person than when only an imaging unit (e.g., third imaging unit 16) is provided that is installed with an imaging range oriented in a direction perpendicular to the direction of travel when vehicle 40 is traveling straight, thereby improving the accuracy of analysis by analysis device 60. [Explanation of symbols]

[0082] 1. Matching System 2. Analysis System 10. Imaging device 12 First imaging unit 14 Second imaging unit 16 Third imaging unit 17. Image capture area 18 Communications Department 20 Facial image acquisition device 22 Fourth Imaging Unit 24 Installation information acquisition section 26 Communications Department 30 Collation device 32 Storage section 34 Matching unit 36 Communications Department 40 vehicles 42 Display section 50 vehicle units 60 Analyzer 62 Memory section 64 Analysis Department 66 Communications Department

Claims

1. An imaging device attached to a moving object having a display unit on the side on which an image or video is displayed, a first imaging unit that is provided on the moving body and is installed so that an imaging range faces diagonally forward with respect to a traveling direction of the moving body when the moving body is traveling straight, and whose orientation with respect to the moving body is determined; the first imaging unit is provided on a side surface of the moving body on which the display unit is provided, and is provided rearward of a center of the display unit in a traveling direction of the moving body; An imaging device in which a face image is acquired by the first imaging unit capturing an image of a face of a person viewing an image or video displayed on the display unit.

2. The imaging device according to claim 1 , wherein the first imaging unit is installed near a rear end of the moving body in the traveling direction.

3. The imaging device according to claim 1 , wherein the first imaging unit is provided behind the center of the display unit in the direction of travel of the moving object.

4. a second imaging unit that is provided on the moving body and is installed so that an imaging range faces diagonally rearward with respect to a traveling direction of the moving body when the moving body is traveling straight, and whose orientation with respect to the moving body is determined; The imaging device according to claim 1 , wherein the second imaging unit is provided on a side of the moving body on which the display unit is provided, and is located forward of a center of the display unit in a direction of travel of the moving body.

5. The imaging device according to claim 4 , wherein the second imaging unit is provided ahead of the first imaging unit in the traveling direction of the moving object.

6. The imaging device according to claim 4 , wherein the second imaging unit is provided forward of the center of the display unit in the direction of travel of the moving object.

7. The imaging device according to claim 4 , wherein a part of the imaging range of the first imaging unit and a part of the imaging range of the second imaging unit overlap each other.

8. 5. The imaging device according to claim 4, further comprising a third imaging unit provided on the moving body and oriented such that an imaging range faces a direction perpendicular to a traveling direction of the moving body when the moving body moves straight ahead.

9. The imaging device according to claim 8 , wherein the third imaging unit is provided at a position between the first imaging unit and the second imaging unit in the traveling direction of the moving object.

10. 2. The imaging device according to claim 1, wherein an angle of a center line from the first imaging unit in the horizontal direction of the imaging range of the first imaging unit relative to the direction of travel of the moving body when moving straight is within a range of 10° to 80°.

11. 2. The imaging device according to claim 1, wherein the horizontal angle of view of the imaging range of said first imaging unit is within a range of 30° to 80°.

12. 2. The imaging device according to claim 1, wherein the first imaging unit is installed at a height within a range of 3 m to 5 m from the ground on the moving body.

13. 2. The imaging device according to claim 1, wherein an angle of a center line from said first imaging unit in a vertical direction of an imaging range of said first imaging unit with respect to a horizontal direction is within a range of 20° to 60°.

14. An imaging device attached to a moving object having a display unit on the side on which an image or video is displayed, a second imaging unit that is provided on the moving body and is installed so that an imaging range faces diagonally rearward with respect to a traveling direction of the moving body when the moving body is traveling straight, and whose orientation with respect to the moving body is determined; the second imaging unit is provided on a side surface of the moving body on which the display unit is provided, and is provided forward of a center of the display unit in a traveling direction of the moving body; An imaging device in which a face image is acquired by the second imaging unit capturing an image of a face of a person viewing an image or video displayed on the display unit.

15. An imaging device according to any one of claims 1 to 14; a face image capture device for capturing an image of a person's face; Equipped with A matching system that matches the person whose face image is acquired by the face image acquisition device by comparing information about the face image acquired by the imaging device with information about the face image acquired by the face image acquisition device.

16. An imaging device according to any one of claims 1 to 14; an analysis device that performs analysis using information about the face image acquired by the imaging device; An analysis system comprising:

17. a mobile object having a display unit on its side on which an image or video is displayed; an imaging device attached to the moving body; Equipped with The imaging device is a first imaging unit that is provided on the moving body and is installed so that an imaging range faces diagonally forward with respect to a traveling direction of the moving body when the moving body is traveling straight, and that has a fixed orientation with respect to the moving body; the first imaging unit is provided on a side surface of the moving body on which the display unit is provided, and is provided rearward of a center of the display unit in a traveling direction of the moving body; The mobile unit is configured such that the first imaging unit captures an image of a face of a person viewing an image or video displayed on the display unit, thereby acquiring a facial image.

18. a mobile object having a display unit on its side on which an image or video is displayed; an imaging device attached to the moving body; Equipped with The imaging device is a second imaging unit that is provided on the moving body and is installed so that an imaging range faces diagonally rearward with respect to a traveling direction of the moving body when the moving body is traveling straight, and whose orientation with respect to the moving body is determined; the second imaging unit is provided on a side surface of the moving body on which the display unit is provided, and is provided forward of a center of the display unit in a traveling direction of the moving body; The mobile unit, wherein the second imaging unit captures an image of a face of a person viewing an image or video displayed on the display unit, thereby acquiring a facial image.

Images