Face recognition program, terminal device, and management system

Abstract

This technology allows for clearer facial photography when using a terminal device to take pictures of one's own face. [Solution] The face-capture program is implemented by the control unit in a terminal device comprising a main unit, a camera having a lens provided on the front of the main unit, a display having a display panel provided on the front of the main unit with adjustable brightness, and a control unit connected to the camera and the display. The control unit implements a brightness change function that changes the brightness of the display panel from a first brightness to a second brightness that is brighter than the first brightness, and a shooting function that causes the camera to capture the face of the terminal device user while the brightness of the display panel has been changed to the second brightness by the brightness change function.

Description

Technical Field

[0001] The present invention relates to a face photographing program, a terminal device, and a management system.

Background Art

[0002] Patent Document 1 discloses a system for checking the presence or absence of alcohol on a driver before driving a vehicle. This system wiredly connects a malodor measuring device provided with an alcohol sensor to a driver's mobile terminal, and uses the connected malodor measuring device to detect an alcohol component in the driver's breath. The detection result of the alcohol component is displayed on the display of the mobile terminal by an application installed in the mobile terminal.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] As a countermeasure against drunk driving, it is effective not only to check the measurement result by an alcohol detector but also to check the driver's complexion. For this reason, it is conceivable to take and record a face photo of the driver. However, it is difficult to take a clear face photo that allows the driver's complexion to be discriminated in a dark place. The present disclosure provides a technique that can capture a face more clearly when taking a self-portrait using a terminal device.

Means for Solving the Problems

[0005] A face-capture program relating to one aspect of this disclosure is a face-capture program executed by the control unit in a terminal device comprising a main unit, a camera having a lens provided on the front of the main unit, a display having a display panel provided on the front of the main unit and capable of adjusting the brightness of the display panel, and a control unit connected to the camera and the display, wherein the control unit implements a brightness change function that changes the brightness of the display panel from a first brightness to a second brightness that is brighter than the first brightness, and a capture function that causes the camera to capture the face of the terminal device user while the brightness of the display panel has been changed to the second brightness by the brightness change function.

[0006] A terminal device relating to another aspect of this disclosure comprises a main unit, a camera having a lens provided on the front of the main unit, a display having a display panel provided on the front of the main unit and having an adjustable brightness for the display panel, and a control unit connected to the camera and the display, wherein the control unit changes the brightness of the display panel from a first brightness to a second brightness which is brighter than the first brightness, and captures the face of the terminal device user with the camera while the brightness of the display panel is at the second brightness.

[0007] A management system relating to yet another aspect of this disclosure is a management system comprising a plurality of terminal devices and a server capable of communicating with the terminal devices, wherein each of the plurality of terminal devices comprises a main unit, a camera having a lens provided on the front of the main unit, a display having a display panel provided on the front of the main unit and having a display panel with adjustable brightness, and a control unit connected to the camera and the display, wherein the control unit changes the brightness of the display panel from a first brightness to a second brightness which is brighter than the first brightness, and with the display panel brightness at the second brightness, the camera captures the face of the user of the terminal device, and the server acquires and stores images of the user's face corresponding to each of the plurality of terminal devices from the plurality of terminal devices. [Effects of the Invention]

[0008] According to this disclosure, when taking photos of one's own face using a terminal device, it is possible to capture a clearer image of the face. [Brief explanation of the drawing]

[0009] [Figure 1] This block diagram shows an example of the configuration of a terminal device according to this embodiment. [Figure 2] Figure 1 is a schematic diagram showing an example of the front view of the terminal device. [Figure 3] Figure 1 is a flowchart illustrating an example of the operation of the terminal device shown. [Figure 4] Figure 4(A) shows the user's behavior when the display panel is set to the first brightness level, and Figure 4(B) shows the user's behavior when the display panel is set to the second brightness level. [Figure 5] This is a schematic diagram showing an example of a management system according to this embodiment. [Figure 6] Figure 5 is a block diagram showing an example of the configuration of a server, administrator terminal, terminal device, and alcohol detector. [Figure 7] This figure shows an example of a screen displayed on the administrator's terminal. [Figure 8] This is an example of the settings screen for driver verification items on the administrator terminal. [Figure 9] Figure 9(A) shows an example of the settings window for additional items. Figure 9(B) shows an example of the display for terminal device 1. [Modes for carrying out the invention]

[0010] Embodiments of the present disclosure will be described in detail below with reference to the drawings. In the description of the drawings, the same elements are denoted by the same reference numerals, and redundant descriptions are omitted.

[0011] (Overview of terminal equipment and programs) Figure 1 is a block diagram showing an example of the configuration of the terminal device according to this embodiment. Figure 2 is a schematic diagram showing an example of the front view of the terminal device shown in Figure 1. The terminal device 1 shown in Figures 1 and 2 is a terminal operated by the person being measured (an example of a user). The person being measured is the person whose alcohol level is to be measured. The terminal device 1 is a portable terminal such as a smartphone or tablet. The terminal device 1 may also be a stationary terminal.

[0012] As shown in Figure 1, the terminal device 1 includes a camera 11, a display 12, a processor 13 (an example of a control unit), a storage device 14, and an input device 16.

[0013] Camera 11 is a device that photographs the face of the person being measured. Camera 11 is capable of capturing still images or videos. As shown in Figure 2, camera 11 is a so-called front camera and has a lens 11a provided on the front surface 10a of the main body 10 of the terminal device 1.

[0014] The display 12 is a device that displays still images or moving images. As shown in Figure 2, the display 12 has a display panel 12a provided on the front 10a of the main body 10 of the terminal device 1. The display 12 allows adjustment of the brightness of the display panel 12a. For example, the display 12 adjusts the brightness of the display panel 12a by adjusting the brightness of the backlight of the display panel 12a.

[0015] The processor 13 is an electronic device that controls the operation of the terminal device 1. The processor 13 is, for example, a CPU (Central Processing Unit). The processor 13 is connected to the camera 11 and the display 12 and operates the camera 11 and the display 12 according to instructions contained in the program. The processor 13 operates the camera 11 and the display 12 according to instructions contained in a system program, including the OS (Operating System), and instructions contained in a program 15 (an example of a face capture program) stored in the storage device 14.

[0016] The memory device 14 is a device that stores information. The memory device 14 is, for example, a semiconductor RAM (Random Access Memory), an HDD (Hard Disk Drive), or the like.

[0017] The program 15 is stored in the memory device 14 and includes instructions executed by the processor 13. The program 15 causes the processor 13 to implement a brightness change function that changes the brightness of the display panel 12a from a first brightness to a second brightness that is brighter than the first brightness. The first brightness is a preset brightness. The first brightness may be the brightness before shooting, or may be a brightness automatically set according to the surrounding environment. The second brightness is not particularly limited as long as it is brighter than the first brightness. The second brightness may be the maximum brightness of the terminal device 1.

[0018] The program 15 causes the processor 13 to implement a shooting function that causes the camera 11 to shoot the face of the measured person in a state where the brightness of the display panel 12a is changed to the second brightness by the brightness change function. Thereby, since the light of the display panel 12a illuminates the face of the measured person, a clearer self-shot face image is shot than when shooting at the first brightness.

[0019] The program 15 may further cause the processor 13 to implement a notification function that displays, on the display panel 12a, an image for notifying the measured person that the face of the measured person is to be shot. The image to be notified includes, for example, information indicating that shooting is to be performed or that shooting has been instructed. Such information may be a message such as characters, or may be an icon such as a camera mark. As an example, the image to be notified includes a message prompting the measured person to take a self-shot of the face of the measured person in order to record the face of the measured person before driving. The image to be notified may include an area for displaying the video being shot by the camera 11. In this case, the measured person can take a self-shot while confirming the reflection of their own face. The notification function is not limited to display, and for example, the measured person may be notified using voice from the speaker of the terminal device 1.

[0020] The brightness change function implemented by program 15 may change the brightness of the display panel 12a in response to the notification function displaying an image on the display panel 12a. For example, the brightness change function changes the brightness of the display panel 12a after displaying an image on the display panel 12a, or simultaneously with displaying an image on the display panel 12a. This ensures that the face is automatically illuminated at the time when shooting is required.

[0021] Program 15 may further implement a reception function in the processor 13 to receive shooting instructions from the person being measured. In this case, the terminal device 1 receives shooting instructions from the person being measured via the input device 16. The input device 16 is a device for the person being measured to give instructions to the terminal device 1. The input device 16 is, for example, a touch panel. If the input device 16 is a touch panel, the input device 16 and the display 12 become one unit. The input device 16 may also be an operation button, mouse, or keyboard provided on the main unit 10. A shooting instruction is given, for example, by pressing the shutter button provided on the main unit 10 or the shutter button icon displayed as a screen icon.

[0022] The brightness adjustment function may change the brightness of the display panel 12a in response to a shooting instruction being received by the reception function. This allows, for example, the face to be automatically illuminated when the shutter button is pressed.

[0023] The brightness adjustment function may change the brightness of the display panel 12a from the second brightness level to the first brightness level in response to the camera 11 taking a picture using the shooting function. This, for example, returns the brightness of the display panel 12a after shooting back to the brightness it was at before shooting.

[0024] The shooting function may also allow the camera 11 to record the subject's face as a video. Since some subjects do not like being photographed in still images, recording a video instead satisfies the user's needs.

[0025] (Operation of the terminal device) Figure 3 is a flowchart illustrating an example of the operation of the terminal device shown in Figure 1. The flowchart shown in Figure 3 is executed by terminal device 1, for example, when the person being measured launches the alcohol detection app.

[0026] As shown in Figure 3, the processor 13 of the terminal device 1, in step S10, notifies the subject of imaging. For example, to record the subject's face before driving, the processor 13 displays an image on the display panel 12a of the display 12 that includes a message prompting the subject to take a selfie of their face.

[0027] Next, in step S12, the processor 13 changes the brightness of the display panel 12a from the first brightness to a second brightness that is brighter than the first brightness. The brightness of the display panel 12a is changed to, for example, the maximum brightness. Figure 4(A) shows the user's appearance when the display panel is displayed at the first brightness, and Figure 4(B) shows the user's appearance when the display panel is displayed at the second brightness. The light L2 at the second brightness shown in Figure 4(B) can illuminate the face of the person being measured better than the light L1 at the first brightness shown in Figure 4(A).

[0028] Returning to Figure 3, in step S14, the processor 13 changes the brightness of the display panel 12a to the second brightness level and causes the camera 11 to capture an image of the subject's face. This results in a clearer image of the subject's face.

[0029] Finally, in step S16, the processor 13 changes the brightness of the display panel 12a from the second brightness to the first brightness. The brightness of the display panel 12a is returned to the state before shooting. When step S16 is completed, the flowchart shown in Figure 3 is completed.

[0030] (Summary of terminal devices and programs) When program 15 is executed, the brightness of the display panel 12a of terminal device 1 is changed from the first brightness to the second brightness, which is brighter than the first brightness. As a result, the light from the display panel 12a illuminates the face of the person being measured more brightly on terminal device 1. The person's face is then photographed in this state. Therefore, program 15 can be used to operate terminal device 1 to take clearer photos of faces when the user takes a photo using terminal device 1.

[0031] (Overview of the management system) The terminal device 1 shown in Figure 1 can be used in a management system that stores driver facial images for the purpose of strengthening measures to prevent drunk driving. Figure 5 is a schematic configuration diagram showing an example of the management system according to this embodiment. As shown in Figure 5, the management system 100 includes a plurality of terminal devices 1, 1A, 1B, an alcohol detector group 70, an OTG cable 40 which is a cable compliant with the OTG (On-The-Go) standard, a server 50, and a network 60. The management system 100 manages, for example, the usage period and / or number of uses of the alcohol detectors included in the alcohol detector group. The management system 100 manages, for example, the alcohol status of employees (an example of a user) in an organization to which employees who drive vehicles belong. The management system 100 manages, for example, the employee's driving status, such as destination and distance traveled. Employees measure their breath alcohol concentration before driving a vehicle or after driving a vehicle. Hereinafter, employees will be referred to as subjects of measurement.

[0032] Since the multiple terminal devices 1, 1A, and 1B all have the same basic configuration, the following description will refer to terminal device 1 as a representative example. Terminal device 1 (hereinafter sometimes referred to as "this device") is operated by the person being measured. Terminal device 1 included in the management system 100 is configured to be connectable to the network 60. Terminal device 1 operates as an alcohol concentration determination device for determining the alcohol concentration in the breath of the person being measured.

[0033] The alcohol detector group 70 is a collection of alcohol detectors and includes at least one alcohol detector. Each alcohol detector included in the alcohol detector group 70 is a device for measuring the alcohol concentration in the breath of a person being tested. The alcohol detector group 70 includes multiple alcohol detectors 20, 20A, 30, 30A. The alcohol detector group 70 may also consist of only one alcohol detector.

[0034] In the management system 100, the person being measured selects any alcohol detector from the group of alcohol detectors 70 to measure the alcohol concentration in their breath. The person being measured may also measure the alcohol concentration in their breath using the alcohol detector assigned to them in the management system 100.

[0035] The alcohol detector 20 is a device that can be connected to the terminal device 1 via an OTG cable 40 for information communication. When the alcohol detector 20 and the terminal device 1 are connected via the OTG cable 40, power is supplied to the alcohol detector 20 from the battery (not shown) of the terminal device 1. The alcohol detector 20 does not have its own power supply and operates using the battery of the terminal device 1 as its power source.

[0036] OTG (On-The-Go) is a USB standard established for connecting and using USB devices together, for example. OTG gives USB peripherals such as mice, printers, and digital cameras the function of a "host" (parent), and a personal computer the "client" (child), allowing the USB peripheral to control the personal computer. Instead of an OTG cable compliant with the USB standard, an OTG cable compliant with a standard compatible with the USB standard, such as the Lightning® standard, may be used as the OTG cable 40.

[0037] The alcohol detector 20 includes a display unit 23 and a breath inlet 24. The display unit 23 is composed of a light-emitting diode (LED). The display unit 23 includes display units 23a to 23c. Display unit 23a lights up when power is supplied from the battery of the terminal device 1, indicating that the alcohol detector 20 is powered on. Display unit 23b lights up to display the word "OK" when, for example, the measured alcohol concentration is less than 0.05 mg / L. Display unit 23c lights up to display the word "NG" when the measured alcohol concentration is 0.05 mg / L or more. The alcohol concentration threshold used for the display of display units 23b and 23c is not limited to 0.05 mg / L and can be set to any value. The display unit 23 is optional.

[0038] The exhalation inlet 24 is, for example, made of a tubular member. In the exhalation inlet 24, the end of the portion that protrudes outside the alcohol detector 20 is held in the mouth of the person being tested and is an inlet into which the person being tested breathes (see Figure 5). The person being tested breathes into the exhalation inlet 24. The breath blown in from the person being tested passes through the inside of the exhalation inlet 24 and is guided to the sensor 26 (see Figure 6). The exhalation inlet 24 is not limited to being made of a tubular member. The exhalation inlet 24 may also be an opening formed in the alcohol detector 20 to guide the breath blown in by the person being tested to the sensor 26. For example, such an opening is formed in the body of the alcohol detector 20 on which the display unit 23 is provided. The alcohol detector 20A has the same configuration as the alcohol detector 20.

[0039] The alcohol detector 30 is a device that cannot communicate with the terminal device 1. The alcohol detector 30 is equipped with a battery (not shown) as a power source. When the alcohol detector 30 is started up, power is supplied to each part of the alcohol detector 30 from its battery. The alcohol detector 30 includes a display 31, a breath inlet 32, and a sensor (not shown). The breath inlet 32 ​​has the same configuration as the breath inlet 24 of the alcohol detector 20. The display 31 shows the measurement result of the alcohol concentration measured by the sensor of the alcohol detector 30. The alcohol detector 30A has the same configuration as the alcohol detector 30.

[0040] Server 50 is a server for storing and managing information such as the usage period and number of uses of alcohol detectors 20 and 30, the measurement results of alcohol concentration, and facial images of the person being tested. The location of server 50 is not particularly limited, but it may be installed in a business center that manages persons being tested who drive vehicles.

[0041] The management system 100 may have an administrator terminal 80 used by a safe driving manager to manage information about the driving of the person being measured. The administrator terminal 80 is connected to the server 50 via the network 60. The administrator terminal 80 retrieves and displays information about the driving of the person being measured that is stored in the server 50. The safe driving manager approves or disapproves each of the driving of the person being measured via the administrator terminal 80. The administrator terminal 80 transmits the approval result to the server 50, and the server 50 stores the received approval result. Here, the safe driving manager includes the safe driving manager themselves and persons assisting the safe driving manager.

[0042] (Internal structure of the management system) Figure 6 is a block diagram showing an example of the configuration of the server, administrator terminal, terminal device, and alcohol detector shown in Figure 5.

[0043] As shown in Figure 6, terminal device 1 comprises a processor 13, primary memory 141, secondary memory 142, communication IF 17, input / output IF 18, display 12, camera 11, and input device 16. Each component is interconnected via a bus. The camera 11, display 12, processor 13, and input device 16 are the same as those in Figure 1.

[0044] The primary memory 141 and secondary memory 142 are storage media, similar to the storage device 14. For example, the secondary memory 142 stores program 15. Program 15 is the same as in Figure 1. Program 15 may also be an application program. The processor 13 loads program 15 stored in secondary memory 142 onto primary memory 141 according to a system program including the OS. The processor 13 executes each process according to the instructions contained in program 15 loaded onto primary memory 141. Primary memory 141 is, for example, semiconductor RAM. Secondary memory 142 is, for example, an HDD.

[0045] Communication IF17 is an interface for communicating with the server 50 via network 60. Communication IF17 is, for example, an Ethernet® interface. Available networks 60 include PAN (Personal Area Network), LAN (Local Area Network), CAN (Campus Area Network), MAN (Metropolitan Area Network), WAN (Wide Area Network), GAN (Global Area Network), or internetworks including these networks. The internetworks may be an intranet, an extranet, or the Internet.

[0046] The input / output IF18 is an interface for communicating with the alcohol detector 20. The input / output IF18 is a USB interface or Lightning interface compatible with the OTG cable 40. Alternatively, the input / output IF18 may use, for example, ATA (Advanced Technology Attachment), SCSI (Small Computer System Interface), or serial communication.

[0047] The alcohol detector 20 further comprises an input / output IF 25, a sensor 26, and a heater 27. The input / output IF 25 is an interface for communicating with the terminal device 1. The input / output IF 25 is a USB interface or a Lightning interface that corresponds to the OTG cable 40. The USB connector included in the USB interface is not particularly limited, but is for example a Type-C.

[0048] Sensor 26 measures the alcohol concentration in the breath of the person being measured. Sensor 26 is, for example, a semiconductor sensor containing a metal oxide semiconductor. Metal oxide semiconductors have the property of oxidizing when exposed to oxygen, and the alcohol concentration is measured from the electrical resistance value which changes depending on the concentration. Heater 27 is a heater for heating sensor 26. Heating sensor 26 cleans off any residue from the previous measurement.

[0049] Server 50 comprises a processor 51, primary memory 52, secondary memory 53, and a communication interface 54. The processor 51, primary memory 52, secondary memory 53, and communication interface 54 are interconnected via a bus. Server 50 is, for example, a workstation that constitutes a cloud server.

[0050] The processor 51, primary memory 52, and secondary memory 53 have the same configuration as the processor 13, primary memory 141, and secondary memory 142 described above. The program 55 is stored in the secondary memory 53. The processor 51 executes each process according to the instructions contained in the program 55. The communication IF 54 is an interface for communicating with terminal device 1 and administrator terminal 80 via the network 60. The communication IF 54 has the same configuration as the communication IF 17 described above.

[0051] The administrator terminal 80 comprises a processor 81, primary memory 82, secondary memory 83, communication interface 84, display 85, and input device 86 (an example of an administrator reception unit). The processor 51, primary memory 52, secondary memory 53, communication interface 54, display 85, and input device 86 are interconnected via a bus.

[0052] The processor 81, primary memory 82, secondary memory 83, communication IF 54, display 85, and input device 86 have the same configuration as the processor 13, primary memory 141, secondary memory 142, communication IF 17, display 12, and input device 16 described above.

[0053] (Operation of the terminal device) First, the processor 13 of terminal device 1 determines whether or not an alcohol detector 20 is connected to terminal device 1. If the alcohol detector 20 is connected, the processor 13 executes the application startup process according to the instructions of the system program and program 15. Next, the processor 13 provides the server 50 with the information necessary for logging into the application of program 15. The processor 13 provides the server 50 with information such as the name of the person being tested, the login ID identifying the person being tested, and the password required for login, via the communication IF 17.

[0054] The character type and number of characters required for passwords by the management system may be configurable for each company using the services provided by the management system. Server 50 stores the character type and number of characters parameters for passwords for each company. Changes to password settings are made by the provider of the management system upon request. System administrators of each company may be prohibited from making changes.

[0055] Password settings may include, for example, password levels. The first level requires the use of at least one of the following: uppercase English letters, lowercase English letters, numbers, and symbols. The second level requires the use of at least two of the above character types. The third level requires the use of at least three of the above character types. The fourth level requires the use of all four of the above character types. A minimum number of characters may be set according to the level. When raising the security level, passwords already set by users in operation may be excluded. In this case, the latest security level will be applied at the next password update.

[0056] If an alcohol detector 20 is connected to the device, the processor 13 of the terminal device 1 provides the server 50 via the communication IF 17 with the name of the person being tested, the login ID, and the password, along with the identification ID of the alcohol detector 20 connected to the device. The identification ID of the alcohol detector 20 is an example of an identifier used to identify the alcohol detector 20.

[0057] The processor 13 of terminal device 1 receives a notification from server 50 via communication IF 17 indicating that the person being measured has successfully logged in. The processor 13 may also receive from server 50 via communication IF 17 at least one of the usage period, remaining usage period, number of uses, and remaining number of uses of the alcohol detector 20 indicated by the identification ID.

[0058] The processor 13 of terminal device 1 displays a message prompting the user to take a selfie with camera 11 and an icon for a shooting button on display 12, and changes the brightness of the display panel from the first brightness to a second brightness, which is brighter than the first brightness. In response to the user operating input device 16 and pressing an operation button, the processor 13 causes camera 11 to capture a selfie of the user's face. The processor 13 provides the acquired face image to server 50 via communication IF 17.

[0059] The processor 13 of terminal device 1 may switch the shooting mode of camera 11 to video if the person being measured operates the input device 16 to indicate that they do not wish to save still images. The video may be saved, or if a video call is connected to a safe driving manager while the video mode is maintained and the safe driving manager approves, the video may not be saved instead of the call record.

[0060] If a wired connection to the alcohol detector 20 is established, the processor 13 of terminal device 1 prepares the alcohol detector 20 connected to itself for measurement and measures the alcohol concentration using the connected alcohol detector 20. The processor 13 provides a control signal to the connected alcohol detector 20 via the input / output IF 18 to heat the heater 27. Based on this control signal, the heater 27 and the sensor 26 are heated. While the heater 27 is heating, the processor 13 may display a screen on the display 12 indicating that the heater 27 is heating. After heating the heater 27 for a predetermined time, the processor 13 acquires a signal related to the alcohol concentration measurement result provided from the connected alcohol detector 20 via the input / output IF 18. The processor 13 provides the acquired alcohol concentration measurement result to the server 50 via the communication IF 17.

[0061] If a wired connection to the alcohol detector 20 is not established, the processor 13 of terminal device 1 activates the camera 11 and acquires an image of the alcohol detector 30 captured by the person being measured. The processor 13 may also perform character recognition of the alcohol concentration measurement result from the display 31 of the alcohol detector 30. The processor 13 provides the server 50 with the acquired image showing the alcohol concentration measurement result via the communication IF 17.

[0062] The processor 13 of terminal device 1 may provide driving-related information to the server 50. Driving-related information includes the date and time of driving, vehicle number, odometer reading of mileage at departure, departure and destination, mileage traveled, rest stops, rest times, and load weight. This information may also be input into terminal device 1 by the person being measured via input device 16.

[0063] (Server operation) The processor 51 of the server 50 obtains the information necessary to log in to the application of program 15 from the terminal device 1. The processor 51 obtains the name of the person being measured, the login ID, and the password, along with the identification ID of the alcohol detector 20 connected to the terminal device 1, via the communication IF 54.

[0064] The processor 51 of the server 50 provides the terminal device 1 with a notification via the communication IF 54 indicating that the person being measured has successfully logged in. The processor 51 also provides the terminal device 1 with at least one of the usage period, remaining usage period, number of uses, and remaining number of uses of the alcohol detector 20 indicated by the identification ID via the communication IF 54.

[0065] The processor 51 of the server 50 acquires the facial image of the person being measured, the signal related to the measurement result of the alcohol concentration from the alcohol detector 20, and the image obtained by capturing the alcohol detector 30 via the communication IF 54.

[0066] The processor 51 of the server 50 registers the measurement results in a database where information about the alcohol detectors 20 and 30 is recorded, based on the signals related to the measurement results of the alcohol detector 20. The processor 51 registers the images obtained by capturing images of the alcohol detector 30 in the database. The processor 51 registers the obtained facial images of the person being measured in the database. The processor 51 registers the obtained driving-related information in the database.

[0067] The processor 51 of server 50 sends a message to the administrator terminal 80 used by the safe driving manager prompting approval or denial of the subject's driving of the vehicle, based on the alcohol concentration measurement result provided by the subject. If requested by the administrator terminal 80, the processor 51 provides a screen for approving or denying the subject's driving. The processor 51 of server 50 registers the approval or denial of the subject's driving of the vehicle, made by the safe driving manager, in the database. The name of the safe driving manager who approved or denied the driving is also registered in the database. The above processing may also be performed for deputy safe driving managers, not just safe driving managers. Here, deputy safe driving managers include the deputy safe driving manager themselves and those who assist the deputy safe driving manager.

[0068] Thus, the server 50's database stores information such as the alcohol measurement result, the name of the person being measured, the date and time, a facial image, information about driving, and approval or denial, all associated with each other.

[0069] (Administrator terminal operation) The processor 81 of the administrator terminal 80 requests a screen from the server 50 to approve or deny the driver's operation. The processor 81 is provided with a web page in HTML (Hyper Text Markup Language) format, which can be viewed, for example, in an internet browser, from the server 50. The processor 81 displays the web page on the display 85 and sends the approval result, entered via the input device 86, to the server 50 via the communication interface 54.

[0070] Figure 7 shows an example of a screen displayed on the administrator terminal. As shown in Figure 7, the administrator screen G1 includes the first area TB1, the second area TB2, the third area TB3, and the fourth area TB4. The fourth area TB4 is the area that displays information stored in the database.

[0071] The first area TB1 is where tabs are displayed to change the database display format to a pre-specified list. For example, the first area TB1 includes "Record List" for viewing all records, "Safe Driving Manager List" for viewing records for each safe driving manager, "Assistant Safe Driving Manager List" for viewing records for each assistant safe driving manager, "Driver List" for viewing drivers, "Detector List" for viewing records for each detector, "Vehicle List" for viewing records for each vehicle, and "Group List" for viewing records for each pre-set group. These tabs can be operated by the safe driving manager, assistant safe driving manager, or system administrator, and the records related to the list of the selected tab are displayed in the fourth area TB4.

[0072] The second area, TB2, is where the organization ID, organization name, and other information being displayed are shown.

[0073] The third area, TB3, is where the conditions for displaying information from the list are specified. Display conditions include, for example, start date and time, end date and time, group name, administrator, driver, whether or not it has been approved, and vehicle. Display conditions may also include information about the display order, such as descending or ascending order. Display conditions may be selected, for example, in a dropdown format. The third area, TB3, may also include visual objects related to batch approval. Batch approval means approving all items to be approved in a single operation. Visual objects are user interface elements that are visible and selectable by the user on the screen, such as icons, links, and images (e.g., buttons). If the driver's name and vehicle can be identified, the third area, TB3, may display mileage values ​​for each vehicle and driver within a certain period, which are automatically calculated from the difference in meter readings before and after driving.

[0074] The fourth area, TB4, is an area where images are displayed for each driver corresponding to multiple terminal devices, including information about driving, an icon to display a facial image, and an icon to approve or deny driving. For example, the fourth area, TB4, displays "Safety Driving Manager," "Deputy Safety Driving Manager," "Date and Time," "Name," "Vehicle Number," "Driving," "Alcohol Level," "Measurement Result," "Facial Photo," "Meter Value," "Location," "Distance Traveled," "Detector ID," and "Other Contact Information" for each application (or each drive). "Other Contact Information" includes information such as vehicle malfunctions (whether a warning light is on, whether there is an oil leak, etc.) and whether the user has taken a break.

[0075] In the "Safe Driving Manager" column, icon OB1 (an example of a second visual object) is displayed to indicate that approval has not been granted. When the Safe Driving Manager clicks icon OB1, a smaller approval screen is overlaid on top of the manager screen G1. The Safe Driving Manager selects to approve or deny on the approval screen. Thus, icon OB1 is selected to approve or deny the driver's driving.

[0076] In the "Face Photo" field, icon OB2 (an example of a primary visual object) is displayed. When the safety driving manager clicks icon OB2, a smaller face display screen is overlaid on top of the administrator screen G1. In this way, icon OB1 is selected to display the face image. The safety driving manager can confirm the face image by operating on the administrator screen G1.

[0077] Thus, the administrator screen G1 can display information related to driving, an icon OB2 that displays a facial image, and an icon OB1 for approving or denying driving, all on a single screen. The administrator screen G1 does not have to include any or all of the first area TB1, the second area TB2, and the third area TB3.

[0078] (modified version) Although various exemplary embodiments have been described above, the examples are not limited to those described above, and various omissions, substitutions, combinations, and modifications may be made.

[0079] For example, the management system 100 may have a configuration that allows for flexible setting of the information to be managed. For instance, the management system 100 has a customization function that allows the business operator (user company) to set the confirmation items themselves according to their needs, which are entered by the person being measured (driver) at the terminal device 1 and confirmed by a safe driving manager, etc., at the administrator terminal 80. This customization function makes it possible for the business operator to operate their own confirmation items in addition to, or by modifying, the basic confirmation items stipulated by laws and regulations.

[0080] The customization function is provided through the cooperation of the server 50 and the terminal device 1. The processor 51 of the server 50 stores the confirmation items set by the administrator terminal 80 in secondary memory 53 or the like, associating them with business identification information. The processor 13 of the terminal device 1 queries the server 50 for the set confirmation items and displays a screen including the acquired confirmation items on the display 12. The processor 13 of the terminal device 1 accepts input operations from the person being measured via the input device 16 and acquires information about the confirmation items. The processor 13 of the terminal device 1 provides the information about the confirmation items to the server 50. The server 50 stores the collected information in a database. In this way, the set confirmation items are displayed on the terminal device 1, and the information about the confirmation items entered on the terminal device 1 is transmitted to the server 50 and stored there.

[0081] Figure 8 shows an example of the driver verification item settings screen on the administrator terminal 80. The administrator terminal 80 displays the settings screen shown in Figure 8 when the tab "Driver Verification Item Settings" displayed in the first area TB1 of the administrator screen G1 shown in Figure 7 is selected, for example, by the system administrator of the business operator.

[0082] As shown in Figure 8, the driver confirmation item settings screen has three areas: the first area TB1, the second area TB2, the fifth area TB5, and the sixth area TB6. The first area TB1 and the second area TB2 are identical to those shown in Figure 7. The first area TB1 is where tabs are displayed to change the database display format to a pre-specified list. The second area TB2 is where the organization ID, organization name, etc., of the currently displayed information are shown.

[0083] The fifth area, TB5, displays the "Driver Confirmation Item Settings" tab, which is currently set in the first area, TB1, and also displays the "Add" button OB3 for adding new confirmation items. The "Add" button OB3 will be explained later.

[0084] The sixth area, TB6, is an area where the "item name" of the currently set confirmation item, the "move" for changing the display order of each item, the "confirmation method" indicating the input method for the confirmation item, and the "operation" for editing the content of the confirmation item are displayed in a table format. This information is stored in the server 50's secondary memory 53, for example, in association with the business operator identification information.

[0085] In the sixth area TB6, the "Item Name" field displays the confirmation items. These confirmation items are, for example, information related to driving. Examples of driving information include rest periods [hours], load capacity [tons], daily inspection completed, driver's license validity period confirmed, and ETC usage. Driving information may also include driving date and time, vehicle license plate number, odometer reading at departure, departure and destination, distance traveled, and rest stops.

[0086] The order of the verification items in the sixth area TB6 is the same as the order of the verification items displayed on terminal device 1. In other words, in the example shown in Figure 8, the verification items will be displayed on terminal device 1 in the following order: "Rest [time]", "Load capacity [t]", "Daily inspection completed", "Driver's license validity period confirmed", and "ETC will be used" (see Figure 9(B) below).

[0087] The "Move" column in the sixth area TB6 is used to change the order of the confirmation items. For example, as shown in Figure 8, an up arrow icon and a down arrow icon corresponding to each confirmation item are displayed. When either up arrow icon is pressed, the display order of the confirmation item corresponding to the pressed up arrow icon and the confirmation item displayed one position above it in the table are swapped. Similarly, when any down arrow icon is pressed, the display order of the confirmation item corresponding to the pressed down arrow icon and the confirmation item displayed one position below it in the table are swapped. For example, in the example shown in Figure 8, suppose the up arrow icon for the confirmation item "Daily Inspection Completed" is pressed. In this case, the display order of the confirmation item "Daily Inspection Completed" is swapped with the confirmation item "Load Capacity [t]" which was displayed one position above it, and the display order in the table from top to bottom becomes "Rest [Time]", "Daily Inspection Completed", "Load Capacity [t]", "License Validity Period Confirmed", and "ETC Used". This changed display order is stored in the server 50 in association with the business operator identification information.

[0088] In the sixth area TB6, the "Confirmation Method" field displays the method selected from, for example, "Direct Input" or "Checkbox." Direct input is a method in which the driver inputs characters or numbers via terminal device 1, while checkboxes are a method in which the driver checks a box if the content of the confirmation item applies. For example, the "Confirmation Method" for the confirmation item "Load Capacity [t]" is "Direct Input," so the person being measured will input a numerical value such as "5" via input device 16 on terminal device 1, corresponding to the actual result. For example, the "Confirmation Method" for the confirmation item "Daily Inspection Completed" is "Checkbox," so the person being measured will check a box via input device 16 on terminal device 1 if the inspection has been completed. The confirmation method is not limited to the above methods and may also include radio buttons, photos, videos, audio, etc.

[0089] The "Operations" column in the sixth area TB6 is for modifying the content of the confirmation items. The "Operations" column displays options such as "Edit" and "Delete". When "Edit" is selected, a sub-window appears for editing, for example, the item name and confirmation method. The system administrator of the business operator can edit the item name and confirmation method in the sub-window. When "Delete" is selected, the row for the corresponding item name is deleted. The edited content is stored in server 50 in association with the business operator identification information.

[0090] When the "Add" button OB3 mentioned above is pressed, a sub-window for adding a new item name to the table in the sixth area TB6 is displayed. Figure 9(A) is an example of the setting window for adding an item. When the system administrator presses the "Add" button OB3, for example, the setting window W1 shown in Figure 9(A) is displayed on the display 85 of the administrator terminal 80. The setting window W1 has an input field FE1 for accepting the item name and an input field FE2 for accepting the confirmation method. In this setting window W1, the system administrator enters the name of the item to be added in input field FE1 and selects or enters the confirmation method in input field FE2. After setting, pressing the "OK" button OB4 adds the new item to the table in the sixth area TB6. The setting information is stored in the server 50's secondary memory 53 or the like, associated with the business identification information.

[0091] In this way, server 50 can maintain different custom item settings for each business operator. Definable items may include, for example, text input items (e.g., special notes, name of medication), numerical input items (e.g., sleep time, work time), items selected from pre-set options (e.g., medication status via checkbox, type of work via radio button), date input items, and even information format items such as photos, videos, and audio data acquired using the camera 11 and microphone (not shown) of terminal device 1. The system administrator can add new items, delete existing custom items by selecting them from the sixth area TB6, and change the display order using the aforementioned "move" button. The custom item settings stored in server 50 are used when inputting information on terminal device 1 and when displaying information on administrator terminal 80.

[0092] Figure 9(B) shows an example of the display of terminal device 1. In terminal device 1, when program 15 is executed, for example after login processing or before the start of alcohol detection processing, the processor 13 accesses the server 50 via the communication IF 17 to obtain the latest customized item information set for the business operator to which it belongs. Based on the obtained customized item information, the processor 13 dynamically generates and displays input areas TB7 corresponding to the customized items set by the business operator on the display panel 12a of the display 12, for example, as shown in Figure 9(B). The input area TB7 displays the item name and the corresponding input field (e.g., text box, checkbox, etc.) according to the display order set on the administrator screen G1. The person being measured (driver) also inputs information to these customized input fields via the input device 16. The entered information is displayed in the confirmation area TB8, for example, and after confirmation, by pressing the "Start Measurement" button OB5, it is associated with other information (alcohol concentration measurement result, face image, etc.), and after measurement, it is sent to the server 50 via the communication IF 17 and stored in the database.

[0093] In the administrator terminal 80, when the processor 81 acquires information about the subject's driving from the server 50 and displays it on the administrator screen G1 (see Figure 7), it also acquires information about the customized items set by the business operator. Then, in the record list for each subject displayed in the fourth area TB4, the customized items set by the business operator and the corresponding information entered by the subject (e.g., "Medication taken: Yes", "Medication name: XX tablets") are displayed alongside or associated with basic management items (e.g., "Name", "Vehicle number", "Alcohol level", etc.). At this time, the display order of the customized items can also reflect the order set on the administrator screen G1. As a result, the safe driving manager can centrally check not only basic information for legal compliance but also detailed information based on the business operator's unique management policy on the administrator screen G1, enabling more realistic safe driving management.

[0094] For example, there may be some differences in the items that must be recorded by law between businesses that operate commercial vehicles (so-called green license plates) and businesses that operate only private vehicles (so-called white license plates). Using this customization function, a standard set of items for green license plate businesses (e.g., rest locations, rest times, load weight, etc.) can be used as the initial settings, while white license plate businesses can use the administrator screen G1 (see Figure 8) to hide or delete unnecessary items from these. Conversely, it is also possible to add new management items specific to white license plate businesses (e.g., whether the vehicle is used for private purposes, specific items for daily inspections, etc.). Furthermore, businesses that want to require drivers engaged in specific tasks to confirm special health conditions (e.g., sleep duration the previous night, declaration of specific chronic illnesses) can add these items as customizable items and prompt drivers to input them. In addition, the server 50 can also make all the item names shown in the fourth area TB4 of Figure 7 subject to the customization function.

[0095] As described above, by providing a customization function to the management system 100 of this embodiment, businesses can flexibly and meticulously set and operate management items according to their business type, safety management policy, or priority management items for a specific period, without being bound by uniform management items. This contributes to improving the efficiency of driver input work, reducing unnecessary information, and improving the quality of verification and guidance by managers, thereby enhancing the overall convenience and effectiveness of the management system 100. Furthermore, by centrally managing the setting information on the server 50 side and dynamically reflecting it on the terminal device 1 and the administrator terminal 80, it is possible to change management items quickly and easily without modifying the application.

[0096] [Summary of the embodiments of this disclosure] This disclosure includes the following aspects:

[0097] (Clause 1) A face-capture program relating to one aspect of this disclosure is a face-capture program executed by the control unit in a terminal device comprising a main unit, a camera having a lens provided on the front of the main unit, a display having a display panel provided on the front of the main unit and capable of adjusting the brightness of the display panel, and a control unit connected to the camera and the display, wherein the control unit implements a brightness change function that changes the brightness of the display panel from a first brightness to a second brightness that is brighter than the first brightness, and a capture function that causes the camera to capture the face of the terminal device user while the brightness of the display panel has been changed to the second brightness by the brightness change function.

[0098] When this face-capture program is executed, the brightness of the terminal device's display panel is changed from the first brightness level to a second brightness level, which is brighter than the first brightness level. As a result, the user's face is illuminated more by the light from the display panel. The user's face is then captured in this state. Therefore, this face-capture program can make the terminal device operate in a way that captures a clearer image of the face when the user takes a picture using the device.

[0099] (Article 2) The face-capture program described in Clause 1 may further implement a notification function in the control unit that displays an image on the display panel to inform the user that their face is being photographed, and the brightness change function may change the brightness of the display panel in response to the display of an image on the display panel by the notification function. In this case, for example, when it is time to take a photograph, such as when alcohol is detected, an image that informs the user that their face is being photographed will be displayed on the display panel. Then, the brightness of the display panel will be changed in response to the display of the image. In this way, the face-capture program can operate the terminal device to automatically illuminate the face when it is time to take a photograph. In addition, when the face-capture program displays an image of the face on the display panel, it can operate the terminal device to take a photograph while allowing the user to confirm the illuminated face.

[0100] (Article 3) The face-capture program described in Clause 1 may further implement a reception function in the control unit that receives shooting instructions from the user, and the brightness change function may change the brightness of the display panel in response to the reception function receiving a shooting instruction. In this case, the face-capture program can operate the terminal device to automatically illuminate the face when, for example, the shutter button is operated.

[0101] (Article 4) In the face-capture program described in any one of clauses 1 to 3, the brightness change function may change the brightness of the display panel from the second brightness to the first brightness in response to the camera taking a picture using the shooting function. In this case, the face-capture program may operate the terminal device to return to the brightness before shooting.

[0102] (Article 5) In any of the face-capture programs described in clauses 1 to 4, the capture function may cause the camera to capture the user's face as a video. In this case, the face-capture program may operate the terminal device to accommodate the user's preference for not being captured as a still image.

[0103] (Article 6) A terminal device relating to another aspect of this disclosure comprises a main unit, a camera having a lens provided on the front of the main unit, a display having a display panel provided on the front of the main unit with adjustable brightness, and a control unit connected to the camera and the display. The control unit changes the brightness of the display panel from a first brightness to a second brightness which is brighter than the first brightness, and captures the face of the terminal device user with the camera while the brightness of the display panel is at the second brightness. This terminal device has the same effect as the face capture program described above.

[0104] (Article 7) A management system relating to yet another aspect of this disclosure is a management system comprising a plurality of terminal devices and a server capable of communicating with the plurality of terminal devices, wherein each of the plurality of terminal devices comprises a main unit, a camera having a lens provided on the front of the main unit, a display having a display panel provided on the front of the main unit and a display panel whose brightness can be adjusted, and a control unit connected to the camera and the display, wherein the control unit changes the brightness of the display panel from a first brightness to a second brightness which is brighter than the first brightness, and with the display panel brightness at the second brightness, the camera captures the face of the user of the terminal device, and the server acquires and stores the face images of the users corresponding to each of the plurality of terminal devices from the plurality of terminal devices. This management system can manage clearly captured face images for each user of the terminal device.

[0105] (Clause 8) The management system described in Clause 7 further comprises an administrator terminal connected to a server, having a display and an administrator reception unit for receiving operations from a safe driving manager, each of the multiple terminal devices being configured to input information about the corresponding user's driving, the server acquiring information about the user's driving corresponding to each of the multiple terminal devices from the multiple terminal devices, and further storing the information about the user's driving corresponding to each of the multiple terminal devices in association with the user's facial image, and the administrator terminal may display on a single screen the information about the user's driving, a first visual object displaying the user's facial image, and a second visual object for approving or denying the user's driving, corresponding to each of the multiple terminal devices. In this case, the safe driving manager can perform a series of actions on a single screen to review the driving information and facial image and approve or deny for multiple users. Thus, the management system can reduce the workload of the safe driving manager's approval work.

[0106] (Article 9) The management system described in Clause 7 further comprises an administrator terminal connected to the server and having a display and an administrator reception unit for receiving operations from a safe driving manager, wherein the administrator terminal displays a setting screen on the display for setting input items on input screens to be displayed on each of the plurality of terminal devices, receives operations on the setting screen and transmits information related to the input items to the server, and the server displays the configured input screen on each of the plurality of terminal devices and obtains driving-related information entered on the input screen from the plurality of terminal devices. In this case, the management system can allow the operator to set their own verification items and operate accordingly. [Explanation of Symbols]

[0107] 1, 1A, 1B... Terminal device, 10... Main unit, 11... Camera, 12... Display, 12a... Display panel, 50... Server, 80... Administrator terminal, 100... Management system.

Claims

1. A terminal device comprising a main unit, a camera having a lens provided on the front of the main unit, a display having a display panel provided on the front of the main unit and capable of adjusting the brightness of the display panel, and a control unit connected to the camera and the display, wherein a face capture program is executed by the control unit, and the control unit is configured to: A brightness adjustment function that changes the brightness of the display panel from a first brightness to a second brightness that is brighter than the first brightness, A shooting function that causes the camera to capture the face of the user of the terminal device while the brightness of the display panel is changed to the second brightness using the brightness adjustment function, A facial recognition program that makes this possible.

2. The control unit further implements a notification function that displays information on the display panel to inform the user that their face is being photographed. The face shooting program according to claim 1, wherein the brightness change function changes the brightness of the display panel in response to the notification function causing the information to be displayed on the display panel.

3. The control unit is further equipped with a reception function for receiving shooting instructions from the user. The face shooting program according to claim 1, wherein the brightness change function changes the brightness of the display panel in response to the reception function receiving the shooting instruction.

4. The face shooting program according to any one of claims 1 to 3, wherein the brightness change function changes the brightness of the display panel from the second brightness to the first brightness in response to the camera taking a picture using the shooting function.

5. The shooting function is a face shooting program according to any one of claims 1 to 3, which causes the camera to shoot the user's face as a video.

6. The main unit and A camera having a lens provided on the front of the main body, The main unit has a display panel on its front surface, and the brightness of the display panel can be adjusted. The camera and the control unit connected to the display, Equipped with, The control unit, The brightness of the display panel is changed from a first brightness level to a second brightness level that is brighter than the first brightness level. With the brightness of the display panel set to the second brightness level, the camera captures the user's face. Terminal device.

7. A management system comprising a plurality of terminal devices and a server capable of communicating with the plurality of terminal devices, Each of the aforementioned multiple terminal devices is: The main unit and A camera having a lens provided on the front of the main body, The main unit has a display panel on its front surface, and the brightness of the display panel can be adjusted. The camera and the control unit connected to the display, Equipped with, The control unit, The brightness of the display panel is changed from a first brightness level to a second brightness level that is brighter than the first brightness level. With the brightness of the display panel set to the second brightness level, the camera captures the face of the user of the terminal device. The server acquires and stores images of the user's face corresponding to each of the multiple terminal devices from the multiple terminal devices. Management system.

8. The system further includes an administrator terminal connected to the aforementioned server, which has a display and an administrator reception unit that accepts operations from a safe driving manager, Each of the aforementioned multiple terminal devices is configured to be able to input information related to the operation of the corresponding user, The server acquires information relating to the user's driving, corresponding to each of the multiple terminal devices, from the multiple terminal devices, and further stores the information relating to the user's driving, corresponding to each of the multiple terminal devices, in association with an image of the user's face. The aforementioned administrator terminal is The management system according to claim 7, which displays on a single screen information relating to the user's driving, a first visual object displaying an image of the user's face, and a second visual object for approving or denying the user's driving, each corresponding to one of the plurality of terminal devices.

9. The system further includes an administrator terminal connected to the aforementioned server, which has a display and an administrator reception unit that accepts operations from a safe driving manager, The administrator terminal displays a settings screen on its display for setting input items on input screens to be displayed on each of the multiple terminal devices, accepts operations on the settings screen, and transmits information related to the input items to the server. The management system according to claim 7, wherein the server displays the configured input screen on each of the plurality of terminal devices and obtains information related to operation entered on the input screen from the plurality of terminal devices.

Images