Information processing device, information processing system, information processing method, and recording medium

The information processing device improves facial recognition by determining backlight countermeasures based on vehicle information, effectively capturing images in outdoor environments.

JP2025146033APending Publication Date: 2025-10-03NEC CORP
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
JP2024046601
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2024-03-22
Publication Date
2025-10-03

AI Technical Summary

Technical Problem

Existing imaging systems struggle with capturing images suitable for facial recognition due to backlight issues, particularly in outdoor environments where the brightness of the subject's face is significantly darker than the surroundings, leading to improper image capture.

Method used

An information processing device that acquires vehicle information related to the appearance of a subject's vehicle and determines the necessity of backlight countermeasures based on this information, adjusting imaging conditions or notifying administrators to capture images effectively.

Benefits of technology

The solution assists in capturing images suitable for facial recognition by addressing backlight issues, ensuring proper image capture for biometric authentication.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2025146033000001_ABST
    Figure 2025146033000001_ABST
Patent Text Reader

Abstract

To provide an information processing device, an information processing system, an information processing method, and a recording medium that assist in capturing an image of a target suitable for face recognition by determining whether backlight countermeasures are necessary when capturing an image of the target.SOLUTION: An information processing device includes acquisition means for acquiring vehicle information regarding the appearance of the vehicle in which the subject is riding, and determination means for determining, on the basis of the vehicle information, whether backlight countermeasures are necessary when the subject is being photographed, and includes notification means for notifying the subject of backlight countermeasures when it is determined that backlight countermeasures are necessary, or control means for controlling the imaging means for photographing the subject.SELECTED DRAWING: Figure 1
Need to check novelty before this filing date? Find Prior Art

Description

[Technical Field]

[0001] The present disclosure relates to the technical fields of an information processing device, an information processing system, an information processing method, and a recording medium. [Background technology]

[0002] As an example of this type of device, a device has been proposed that, when a subject set as an imaging target is present in a specified area, causes an unmanned aerial vehicle having an imaging means to image the subject by transmitting subject information and a control signal to the unmanned aerial vehicle (see Patent Document 1). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] International Publication No. 2021 / 060113 Summary of the Invention [Problem to be solved by the invention]

[0004] An object of this disclosure is to provide an information processing device, an information processing system, an information processing method, and a recording medium that aim to improve the technology related to the above-mentioned prior art documents. [Means for solving the problem]

[0005] One aspect of the information processing device includes an acquisition means for acquiring vehicle information regarding the appearance of a vehicle in which a subject is riding, and a determination means for determining, based on the vehicle information, whether or not backlight countermeasures are necessary when the subject is photographed.

[0006] One aspect of the information processing system includes an acquisition means for acquiring vehicle information regarding the appearance of a vehicle in which a subject is riding, and a determination means for determining, based on the vehicle information, whether or not backlight countermeasures are necessary when the subject is photographed.

[0007] One aspect of the information processing method acquires vehicle information relating to the appearance of a vehicle in which a subject is riding, and determines, based on the vehicle information, whether or not countermeasures against backlight are necessary when the subject is imaged.

[0008] One aspect of the recording medium has a computer program recorded on it that causes a computer to execute an information processing method that acquires vehicle information regarding the appearance of a vehicle in which a subject is riding, and determines, based on the vehicle information, whether backlight countermeasures are necessary when the subject is photographed. [Brief explanation of the drawings]

[0009] [Figure 1] FIG. 10 is a conceptual diagram illustrating an example of entry management. [Figure 2] FIG. 1 is a block diagram illustrating an example of a configuration of an information processing apparatus according to an embodiment. [Figure 3] 10 is a flowchart illustrating an example of an operation of the information processing device according to the embodiment. [Figure 4] FIG. 10 is a block diagram showing another example of the configuration of the information processing device according to the embodiment. [Figure 5] FIG. 1 is a block diagram illustrating an example of a configuration of a calculation device according to an embodiment. [Figure 6] FIG. 10 is a block diagram showing another example of the configuration of the arithmetic device according to the embodiment. [Figure 7] FIG. 10 is a block diagram showing another example of the configuration of the arithmetic device according to the embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0010] First Embodiment An information processing device, an information processing system, an information processing method, and a recording medium according to a first embodiment will be described with reference to Figures 1 to 3. In the following, the information processing device, the information processing system, the information processing method, and the recording medium according to the first embodiment will be described using an information processing device 10.

[0011] (Entrance / exit management) The information processing device 10 according to the first embodiment may be applied to entrance / exit gate management in a large facility such as a factory or warehouse, for example. An example of entrance / exit gate management will be described with reference to FIG. 1. In FIG. 1, vehicle V1 is an example of a vehicle entering a large facility, and vehicle V2 is an example of a vehicle leaving the large facility. Managers GM1 and GM2 are persons in charge of entrance / exit gate operations. Note that managers GM1 and GM2 may be, for example, at least one of a security guard and a security guard. Note that manager GM1 may be located in building GR1. Manager GM2 may be located in building GR2. Note that the gate configuration shown in FIG. 1 is an example and is not limited to this.

[0012] For example, the identity of the occupant of vehicle V1 may be verified before gate GT1. If the occupant of vehicle V1 is permitted to enter after the identity verification, information related to the occupant of vehicle V1 (e.g., name, company name, etc.) may be recorded as an entrant. For example, the identity of the occupant of vehicle V2 may be verified before gate GT2. If the occupant of vehicle V2 is permitted to exit after the identity verification, information related to the occupant of vehicle V2 (e.g., name, company name, etc.) may be recorded as an entrant. At least one of managers GM1 and GM2 may perform entry / exit management, for example, based on records of entry and exit persons and records of exit persons. Note that an example of entry / exit management is at least one of identifying persons who are entering and identifying persons who have already exited.

[0013] For example, biometric authentication may be used for identity verification in order to improve security and user convenience. Examples of biometric authentication include at least one of face authentication, iris authentication, fingerprint authentication, palm print authentication, vein authentication, voice print authentication, and ear acoustic authentication.

[0014] Here, the description will be continued assuming that facial recognition is performed as the biometric authentication. For example, when facial recognition is performed on the occupants of vehicle V1, the faces of the occupants of vehicle V1 may be captured. The camera capturing the faces of the occupants of vehicle V1 may be installed near gate GT1, may be carried by manager GM1, or may be mounted on an unmanned mobile object such as a robot or drone.

[0015] Incidentally, gates (e.g., gates GT1 and GT2) are often installed outdoors. Therefore, depending on the light around the gate (e.g., sunlight, lighting, etc.), the brightness of the face included in the facial image may be relatively dark. In other words, there is a problem that an image suitable for facial recognition may not be acquired due to the light around the gate.

[0016] (Configuration of information processing device) The information processing device 10 according to the first embodiment has been made in consideration of the above-mentioned problems. The configuration of the information processing device 10 will be described with reference to FIG. 2. In FIG. 2, the information processing device 10 includes an acquisition unit 11 and a determination unit 12. Note that the information processing device 10 may include only one of the acquisition unit 11 and the determination unit 12. In this case, another device different from the information processing device 10 may include the other of the acquisition unit 11 and the determination unit 12. The information processing device 10 and the other device may constitute an information processing system. In this case, the information processing system may include the information processing device 10 and the other device. In this case, it can be said that the information processing system includes the acquisition unit 11 and the determination unit 12. Note that the information processing device 10 including the acquisition unit 11 and the determination unit 12 may constitute a part of the information processing system. In this case, it can be said that the information processing system includes the acquisition unit 11 and the determination unit 12.

[0017] The acquisition unit 11 acquires vehicle information related to the appearance of a vehicle in which a subject (i.e., a subject of biometric authentication) rides. The vehicle information may include, for example, at least one of an exterior image showing the vehicle's appearance, information indicating at least one of the vehicle length, width, and height, information indicating at least one of the window position, shape, type, and color, the steering wheel position, the vehicle model, the vehicle manufacturer, whether or not a roof is present, and a feature value indicating at least one of these. For example, in the case of a vehicle whose length, width, and height are 490 cm, 194 cm, and 185 cm, respectively, the feature values ​​indicating the vehicle length, width, and height may be (490, 194, 185).

[0018] Here, cameras often have an automatic exposure function. The automatic exposure function is a function that automatically adjusts the exposure of the camera so that, for example, the average value of multiple brightness values ​​corresponding to multiple pixels included in a predetermined range approaches a predetermined value. For example, if the angle of view of the camera includes an extremely bright area or an extremely dark area, the brightness of the captured object may deviate from the appropriate brightness due to the automatic exposure function. In particular, when the brightness of the surroundings of the object (i.e., the object of biometric authentication) is significantly brighter than the brightness of the object itself (in other words, when the object is backlit), face authentication is often not performed properly.

[0019] Therefore, the determination unit 12 of the information processing device 10 determines whether backlight countermeasures are necessary when an object is captured, based on vehicle information. For example, the determination unit 12 may determine whether backlight countermeasures are necessary when an object aboard a vehicle is captured from outside the vehicle. For example, if the positional relationship between a camera capturing an image of the object and a gate (e.g., gate GT1 in FIG. 1) is fixed and the camera's angle of view is constant, the area of ​​the vehicle occupying the camera's image changes depending on the size of the vehicle. For example, the larger the area of ​​the vehicle occupying the camera's image, the less the influence of the brightness around the vehicle (in other words, the surroundings of the object) on the camera's automatic exposure function. For example, a vehicle with a relatively large number of windows is more likely to have a brighter surroundings for the object than a vehicle with a relatively small number of windows. For example, the more windows a vehicle has, the more the influence of the brightness around the object on the camera's automatic exposure function. Therefore, it is possible to determine whether backlight countermeasures are necessary from vehicle information (i.e., vehicle information related to the vehicle's appearance).

[0020] When the determination unit 12 determines that a countermeasure against backlight is necessary, for example, the information processing device 10 may notify an administrator (for example, at least one of the administrators GM1 and GM2) that a countermeasure against backlight is necessary. When the determination unit 12 determines that a countermeasure against backlight is necessary, for example, the information processing device 10 may change the imaging conditions (for example, exposure compensation value) of a camera that captures an image of the target. In other words, the information processing device 10 may control the camera.

[0021] The operation of the information processing device 10 will be further described with reference to the flowchart of Fig. 3. In Fig. 2, the acquisition unit 11 of the information processing device 10 acquires vehicle information (step S101). The vehicle information determination unit 12 determines whether or not backlight countermeasures are necessary based on the vehicle information acquired in the processing of step S101 (step S102).

[0022] In this way, the information processing device 10 may perform an information processing method in which vehicle information regarding the appearance of the vehicle in which the subject is riding is acquired, and based on the vehicle information, it is determined whether or not backlight countermeasures are necessary when the subject is photographed.

[0023] The information processing device 10 may be realized by a computer reading a computer program recorded on a recording medium. In this case, the recording medium may store a computer program for causing the computer to execute an information processing method for acquiring vehicle information related to the appearance of a vehicle in which a subject is riding and determining, based on the vehicle information, whether backlight countermeasures are necessary when the subject is being imaged.

[0024] (Technical Effects) According to the information processing device 10 of the first embodiment, when an object is imaged, it is determined whether or not countermeasures against backlight are necessary. Therefore, according to the information processing device 10 of the first embodiment, it is possible to assist in capturing an image of the object suitable for face recognition. Note that the information processing device 10 is not limited to face recognition, and can also be applied to, for example, iris recognition. However, when a near-infrared image is used for iris recognition, the object is irradiated with near-infrared light, so the influence of the brightness around the object on iris recognition is limited.

[0025] Second Embodiment A second embodiment of the information processing device, information processing system, information processing method, and recording medium will be described with reference to Figures 4 and 5. Hereinafter, the second embodiment of the information processing device, information processing system, information processing method, and recording medium will be described using information processing device 100. Note that, for the second embodiment, descriptions that overlap with the description of the first embodiment will be omitted as appropriate.

[0026] 4, the information processing device 100 includes an arithmetic unit 110, a storage device 120, a communication device 130, an input device 140, and an output device 150. The arithmetic unit 110, the storage device 120, the communication device 130, the input device 140, and the output device 150 may be connected via a data bus 160. Note that the information processing device 100 does not necessarily include at least one of the input device 140 and the output device 150.

[0027] The arithmetic device 110 may include a processor 1101. The arithmetic device 110 may include other processors in addition to the processor 1101. That is, the arithmetic device 110 may include one or more processors. The processor 1101 may be a multi-core processor. When the arithmetic device 110 includes a single processor 1101 that is a multi-core processor, it can be said that the arithmetic device 110 logically includes multiple processors.

[0028] The processor 1101 may be, for example, at least one of a central processing unit (CPU), a graphics processing unit (GPU), a field programmable gate array (FPGA), a tensor processing unit (TPU), and a quantum processor.

[0029] The storage device 120 may include a memory 1201. The storage device 120 may include other memories in addition to the memory 1201. That is, the storage device 120 may include one or more memories. The memory 1201 may be, for example, at least one of a random access memory (RAM), a read-only memory (ROM), a hard disk drive, a magneto-optical disk drive, a solid-state drive (SSD), and an optical disk array. Therefore, the storage device 120 may include the memory 1201 as a non-transitory recording medium. The storage device 120 is capable of storing desired data. The memory 1201 of the storage device 120 may store a computer program 1201a executed by the calculation device 110. The storage device 120 may temporarily store data that the calculation device 110 temporarily uses when the calculation device 110 is executing the computer program 1201a.

[0030] The computer program 1201a may be recorded on a computer-readable, non-transitory recording medium. In this case, the computer program 1201a may be stored in the memory 1201 by reading the recording medium using a recording medium reading device (not shown) included in the information processing device 100. The recording medium may be at least one of an optical disk, a magnetic medium, a magneto-optical disk, a semiconductor memory, and any other medium capable of storing a program. The computer program 1201a may be acquired (in other words, downloaded) from a device (not shown) external to the information processing device 100 via the communication device 130. The acquired computer program 1201a may be stored in the memory 1201.

[0031] The communication device 130 may be capable of communicating with devices external to the information processing device 100. The communication device 130 may perform wired communication or wireless communication.

[0032] The input device 140 is a device capable of accepting information input to the information processing device 100 from outside. The input device 140 may include an operation device (e.g., a keyboard, a mouse, a touch panel, etc.) that can be operated by a user of the information processing device 100. The input device 140 may include a recording medium reading device that can read information recorded on a recording medium that is detachable from the information processing device 100, such as a USB (Universal Serial Bus) memory. Note that when information is input to the information processing device 100 via the communication device 130 (in other words, when the information processing device 100 acquires information via the communication device 130), the communication device 130 may function as an input device.

[0033] The output device 150 is a device capable of outputting information to the outside of the information processing device 100. The output device 150 may output, as the information, visual information such as characters or images, auditory information such as sound, or tactile information such as vibration. The output device 150 may include, for example, at least one of a display, a speaker, a printer, and a vibration motor. The output device 150 may be capable of outputting information to a recording medium detachable from the information processing device 100, such as a USB memory. Note that when the information processing device 100 outputs information via the communication device 130, the communication device 130 may function as the output device.

[0034] The processor 1101 of the arithmetic device 110, together with the memory 1201 of the storage device 120 in which a computer program 1201a is stored (in other words, together with the memory 1201 and the computer program 1201a stored in the memory 1201), may execute the processing to be performed by the information processing device 100. For example, the processor 1101 may execute the computer program 1201a, thereby realizing logical functional blocks in the arithmetic device 110 (for example, in the processor 1101) for executing the processing to be performed by the information processing device 100.

[0035] 6, the arithmetic device 110 may have an acquisition unit 111 and a determination unit 112 as logically realized functional blocks or as physically realized processing circuits. At least one of the acquisition unit 111 and the determination unit 112 may be realized in a form in which a logical functional block and a physical processing circuit (i.e., hardware) are mixed.

[0036] When the acquisition unit 111 and the determination unit 112 are realized as functional blocks, the acquisition unit 111 and the determination unit 112 may be realized by a single processor (for example, the processor 1101). Alternatively, the acquisition unit 111 and the determination unit 112 may be realized by different processors. The "acquisition unit 111" and the "determination unit 112" are components corresponding to the "acquisition unit 11" and the "determination unit 12" in the first embodiment, respectively. The information processing device 100 may constitute a part of an information processing system. In this case, it can be said that the information processing system includes the acquisition unit 111 and the determination unit 112.

[0037] The acquisition unit 111 may acquire vehicle information related to the appearance of the vehicle in which the target is riding. The determination unit 112 may determine, based on the vehicle information, whether backlight countermeasures are necessary when the target is imaged. The determination unit 112 may determine, based on, in addition to the vehicle information, for example, light source information related to the light source, whether backlight countermeasures are necessary. Examples of light sources include at least one of the sun and a lighting device. The lighting device may include, for example, a device that emits relatively strong light, such as a floodlight or a vehicle headlight. The light source information is not limited to information indicating the position of the light source, but may also include information for estimating the position of the light source. The information indicating the position of the light source may include, for example, information indicating the position of a light source whose position is fixed, such as a fixed floodlight. For example, if the light source is the sun, the information for estimating the position of the light source may include date and time and geographical information such as the orientation of the gate. For example, the determination unit 112 may estimate the position of the sun based on the date and time indicated by the light source information. The light source information may include, for example, at least one of the weather, the brightness around the gate, and the intensity of light emitted from the lighting device (in other words, information about the intensity of the light source). For example, if the light source is the sun, the determination unit 112 may estimate the intensity of sunlight based on the date, time, and weather. The determination unit 112 may determine whether backlight countermeasures are necessary depending on the position of the light source relative to the target (in other words, the vehicle) based on the light source information. For example, the determination unit 112 may estimate the brightness of the target and the brightness of the surroundings of the target (in other words, the background) based on the positional relationship between the light source and the target (in other words, the vehicle), the shape of the vehicle, and the intensity of the light source based on the vehicle information and the light source information. For example, the determination unit 112 may determine whether backlight countermeasures are necessary based on the brightness of the target and the brightness of the surroundings of the target. Note that the determination unit 112 may estimate the brightness of the target and the brightness of the surroundings of the target using, for example, at least one piece of information indicated by the vehicle information, at least one piece of information indicated by the light source information, and a table showing the relationship between the brightness of the target and the brightness of the surroundings of the target.In addition, the determination unit 112 may determine whether or not backlight countermeasures are necessary by using, for example, a table showing the relationship between at least one piece of information indicated by the vehicle information, at least one piece of information indicated by the light source information, and whether or not backlight countermeasures are necessary.

[0038] The determination unit 112 may have a trained model that, when vehicle information is input, outputs information indicating whether or not backlight countermeasures are necessary. Such a trained model may be constructed, for example, by machine learning using teacher data (i.e., by supervised learning), or by machine learning without using teacher data (i.e., by unsupervised learning). Such a trained model may be constructed, for example, by deep learning, which is a form of machine learning. A trained model constructed by deep learning may have a multi-layered neural network with multiple intermediate layers (which may also be referred to as hidden layers).

[0039] (Technical Effects) The information processing device 100 according to the second embodiment can assist in capturing an image of a target suitable for face recognition, similar to the information processing device 10 according to the first embodiment.

[0040] Third Embodiment A third embodiment of an information processing device, an information processing system, an information processing method, and a recording medium will be described with reference to Fig. 6. Hereinafter, the third embodiment of an information processing device, an information processing system, an information processing method, and a recording medium will be described using an information processing device 100. Note that, for the third embodiment, descriptions that overlap with the descriptions for the first and second embodiments will be omitted as appropriate.

[0041] The information processing device 100 according to the third embodiment may include a calculation device 110a instead of the calculation device 110. The calculation device 110a may have one or more processors, similar to the calculation device 110. As shown in Fig. 6, the calculation device 110a may have an acquisition unit 111, a determination unit 112, and a notification unit 113 as logically realized functional blocks or as physically realized processing circuits. Note that at least one of the acquisition unit 111, the determination unit 112, and the notification unit 113 may be realized in a form in which a logical functional block and a physical processing circuit (i.e., hardware) are mixed.

[0042] Note that, when the acquisition unit 111, the determination unit 112, and the notification unit 113 are realized as functional blocks, the acquisition unit 111, the determination unit 112, and the notification unit 113 may be realized by a single processor (for example, the processor 1101). Alternatively, the acquisition unit 111, the determination unit 112, and the notification unit 113 may be realized by different processors. Alternatively, parts of the acquisition unit 111, the determination unit 112, and the notification unit 113 may be realized by one processor, and the remaining parts of the acquisition unit 111, the determination unit 112, and the notification unit 113 may be realized by one or more other processors different from the one processor.

[0043] For example, an administrator of entrance / exit management (for example, at least one of administrators GM1 and GM2) may take an image of a subject riding in a vehicle using a camera carried by the administrator. Any camera can be used as the camera carried by the administrator. Examples of cameras carried by the administrator include at least one of a camera that can be held in one hand, a head-mounted camera, a gun camera, and a camera attached to a head-mounted display that takes images of the area around the head-mounted display.

[0044] If the determination unit 112 determines that a countermeasure against backlight is necessary, the notification unit 113 may notify at least one of the administrator carrying the camera (i.e., the person taking the image of the target) and the target (particularly, the target driving the vehicle) of the need to take countermeasures against backlight. For example, the notification unit 113 may notify the administrator of a position where the target can be imaged while avoiding backlight. Note that the positional relationship between the position of the sun according to the date and time and the gate (in other words, the vehicle's stopping position) is known. For example, the notification unit 113 may notify the administrator of a position where the target can be imaged while avoiding backlight using a table showing the relationship between the date and time and the position where the target can be imaged while avoiding backlight. Note that the vehicle's stopping position at the gate is known, so the notification unit 113 can also specify the camera orientation by notifying the administrator of a position where the target can be imaged while avoiding backlight.

[0045] Note that if the positional relationship between the sun and the vehicle does not change (in other words, if the vehicle does not move to another position), backlighting may not be avoided. In this case, the notification unit 113 may notify the administrator to narrow the camera's angle of view (in other words, zoom in so that the area occupied by the object in the image increases) and capture the object. Alternatively, in this case, the notification unit 113 may notify at least one of the administrator and the object of at least one of the vehicle's orientation and the vehicle's stopping position, which will allow backlighting to be avoided. Note that when the notification unit 113 notifies the object, the notification unit 113 may notify the object by audio, for example, via a speaker installed outside the vehicle. Alternatively, the notification unit 113 may notify the object by displaying at least one of text and an image on a display installed outside the vehicle. Note that the notification unit 113 may notify the object by transmitting information indicating at least one of the vehicle's orientation and the vehicle's stopping position to at least one of a device installed in the vehicle and a mobile terminal carried by the object. In this case, the manager may guide the vehicle, for example, to a location with a roof.

[0046] For example, the gates of large facilities such as factories and warehouses have a relatively high volume of traffic. Therefore, for example, from a safety perspective, the range within which an administrator (e.g., at least one of administrators GM1 and GM2) can approach an entering vehicle (e.g., vehicle V1) and an exiting vehicle (e.g., vehicle V2) may be limited. For example, the notification unit 113 may notify the administrator of a range within which the administrator can safely capture an image of a target, based on vehicle information and the volume of traffic at the gate. That is, the notification unit 113 may notify the administrator of a range within which the administrator carrying a camera (in other words, the photographer) can move to capture an image of the target. For example, if the vehicle in which the target is riding does not have a roof, the notification unit 113 may set the range so that the administrator can capture an image of the target from a position relatively far from the vehicle. The notification unit 113 may then notify the administrator of the set range. Note that an example of a vehicle without a roof is at least one of an open car and a motorcycle. For example, if the vehicle in which the target is riding is a boxcar and the current traffic volume at the gate is relatively low, the notification unit 113 may set the above range so that the administrator can capture an image of the target from a position relatively close to the vehicle. The notification unit 113 may then notify the administrator of the set range. This configuration can ensure the safety of the administrator. Note that the range in which the administrator can safely capture an image of the target may be notified not only when the determination unit 112 determines that backlight countermeasures are necessary, but also when the determination unit 112 determines that backlight countermeasures are not necessary.

[0047] (Technical Effects) According to the information processing device 100 of the third embodiment, it is possible to have an administrator (for example, at least one of a security guard and a security guard) capture an image of a target suitable for face recognition.

[0048] <Fourth embodiment> A fourth embodiment of an information processing device, an information processing system, an information processing method, and a recording medium will be described with reference to Fig. 7. Hereinafter, the fourth embodiment of an information processing device, an information processing system, an information processing method, and a recording medium will be described using an information processing device 100. Note that, for the fourth embodiment, descriptions that overlap with the descriptions of the first to third embodiments will be omitted as appropriate.

[0049] The information processing device 100 according to the fourth embodiment may include a calculation device 110b instead of the calculation device 110. The calculation device 110b may have one or more processors, similar to the calculation device 110. As shown in Fig. 7, the calculation device 110b may have an acquisition unit 111, a determination unit 112, and a control unit 114 as logically realized functional blocks or as physically realized processing circuits. Note that at least one of the acquisition unit 111, the determination unit 112, and the control unit 114 may be realized in a form in which a logical functional block and a physical processing circuit (i.e., hardware) are mixed.

[0050] Note that, when the acquisition unit 111, the determination unit 112, and the control unit 114 are realized as functional blocks, the acquisition unit 111, the determination unit 112, and the control unit 114 may be realized by a single processor (for example, the processor 1101). Alternatively, the acquisition unit 111, the determination unit 112, and the control unit 114 may be realized by different processors. Alternatively, the acquisition unit 111, the determination unit 112, and a part of the control unit 114 may be realized by one processor, and the remaining parts of the acquisition unit 111, the determination unit 112, and the control unit 114 may be realized by one or more other processors different from the one processor. Note that the arithmetic device 110b may include a notification unit 113.

[0051] For example, a camera mounted on an unmanned mobile object such as a robot or a drone, and a camera installed near a gate (for example, at least one of gates GT1 and GT2) may capture images of a subject riding in a vehicle. The camera installed near the gate may be, for example, a PTZ (Pan-Tilt-Zoom) camera.

[0052] If the determination unit 112 determines that a backlight countermeasure is necessary, the control unit 114 may control at least one of a camera and an unmanned mobile object, which are examples of imaging means for capturing an image of the target. The control unit 114 may, for example, set imaging conditions that allow the target to be captured while avoiding backlight. The control unit 114 may control at least one of the camera and the unmanned mobile object based on the set imaging conditions. The imaging conditions may include, for example, at least one of aperture value, shutter speed, ISO sensitivity, angle of view (in other words, the degree of zoom), imaging position, and imaging attitude. For example, the control unit 114 may control at least one of the camera and the unmanned mobile object based on the imaging conditions to capture an image of the target by narrowing the angle of view. For example, the control unit 114 may control at least one of the camera and the unmanned mobile object based on at least one of a position and attitude that allow the target to be captured while avoiding backlight, as indicated by the imaging conditions.

[0053] (Technical Effects) According to the information processing device 100 according to the fourth embodiment, it is possible to capture an image of a target suitable for face recognition.

[0054] <Additional Notes> Some or all of the above embodiments can be described as, but are not limited to, the following supplementary notes.

[0055] (Appendix 1) An acquisition means for acquiring vehicle information relating to the appearance of a vehicle in which a subject rides; a determination means for determining whether or not a countermeasure against backlight is necessary when the object is imaged based on the vehicle information; An information processing device comprising:

[0056] (Appendix 2) The determining means determines whether or not a countermeasure against backlight is necessary based on the vehicle information and light source information relating to a light source. 10. The information processing device according to claim 1.

[0057] (Appendix 3) and a notification unit that notifies at least one of a photographer taking an image of the object and the object itself of the need for a countermeasure against backlight when it is determined that the countermeasure against backlight is necessary. 3. The information processing device according to claim 1 or 2.

[0058] (Appendix 4) and a control unit that controls the imaging unit that images the object when it is determined that a countermeasure against backlight is necessary. 4. The information processing device according to claim 1.

[0059] (Appendix 5) The determining means determines whether or not a countermeasure against backlighting is necessary depending on the position of the light source relative to the object based on the light source information. 3. The information processing device according to claim 2.

[0060] (Appendix 6) The notification means notifies at least one of the direction of the vehicle and the stopping position of the vehicle as a countermeasure against backlight. 4. The information processing device according to claim 3.

[0061] (Appendix 7) and a notification unit that notifies a photographer who takes an image of the target of a range in which the photographer can move to take an image of the target based on the vehicle information. 7. An information processing device according to any one of claims 1 to 6.

[0062] (Appendix 8) The control means controls the imaging means to narrow the angle of view of the imaging means to capture an image of the target as a countermeasure against backlight. 5. The information processing device according to claim 4.

[0063] (Appendix 9) An acquisition means for acquiring vehicle information relating to the appearance of a vehicle in which a subject rides; a determination means for determining whether or not a countermeasure against backlight is necessary when the object is imaged based on the vehicle information; An information processing system comprising:

[0064] (Appendix 10) Obtain vehicle information regarding the appearance of the vehicle in which the subject is riding; Based on the vehicle information, it is determined whether or not a countermeasure against backlight is necessary when the object is imaged. Information processing methods.

[0065] (Appendix 11) On the computer, Obtain vehicle information regarding the appearance of the vehicle in which the subject is riding; Based on the vehicle information, it is determined whether or not a countermeasure against backlight is necessary when the object is imaged. A recording medium on which a computer program for executing an information processing method is recorded.

[0066] Furthermore, some or all of the configurations described in Supplementary Notes 2 to 8, which are dependent on Supplementary Note 1, may also be dependent on Supplementary Notes 9 and 10 in the same dependent relationship as Supplementary Notes 2 to 8. Furthermore, not limited to Supplementary Notes 1, 9, and 10, but also to various hardware, software, various recording means for recording software, or systems, some or all of the configurations described as Supplements may be dependent on each other within the scope of the above-mentioned embodiments.

[0067] This disclosure may be modified as appropriate within the scope that does not contradict the gist or idea of ​​the invention that can be read from the claims and the entire specification, and information processing devices, information processing methods, and recording media that involve such modifications are also included in the technical idea of ​​this disclosure. [Explanation of symbols]

[0068] 10, 100... information processing device, 11, 111... acquisition unit, 12, 112... determination unit, 113... notification unit, 114... control unit

Claims

1. An acquisition means for acquiring vehicle information relating to the appearance of a vehicle in which a subject rides; a determination means for determining whether or not a countermeasure against backlight is necessary when the object is imaged based on the vehicle information; An information processing device comprising:

2. The determining means determines whether or not a countermeasure against backlight is necessary based on the vehicle information and light source information relating to a light source. The information processing device according to claim 1 .

3. and a notification unit that notifies at least one of a photographer taking an image of the object and the object itself of the need for a countermeasure against backlight when it is determined that the countermeasure against backlight is necessary. The information processing device according to claim 1 .

4. and a control unit that controls the imaging unit that images the object when it is determined that a countermeasure against backlight is necessary. The information processing device according to claim 1 .

5. The determining means determines whether or not a countermeasure against backlighting is necessary depending on the position of the light source relative to the object based on the light source information. The information processing device according to claim 2 .

6. The notification means notifies at least one of the direction of the vehicle and the stopping position of the vehicle as a countermeasure against backlight. The information processing device according to claim 3 .

7. and a notification unit that notifies a photographer who takes an image of the target of a range in which the photographer can move to take an image of the target based on the vehicle information. The information processing device according to claim 1 .

8. An acquisition means for acquiring vehicle information relating to the appearance of a vehicle in which a subject rides; a determination means for determining whether or not a countermeasure against backlight is necessary when the object is imaged based on the vehicle information; An information processing system comprising:

9. Obtain vehicle information regarding the appearance of the vehicle in which the subject is riding; Based on the vehicle information, it is determined whether or not a countermeasure against backlight is necessary when the object is imaged. Information processing methods.

10. On the computer, Obtain vehicle information regarding the appearance of the vehicle in which the subject is riding; Based on the vehicle information, it is determined whether or not a countermeasure against backlight is necessary when the object is imaged. A recording medium on which a computer program for executing an information processing method is recorded.

Citation Information

Patent Citations

  • Photography system, control device, control method, program, and storage medium

    WO2021060113A1