Information processing system, mobile terminal, and server

Abstract

To provide a system for providing information to a manager managing a driver.SOLUTION: An information processing system 100 includes a mobile terminal 10 including photographing means, and a server 20. In order to provide information to a manager who manages a driver using the mobile terminal 10, the mobile terminal 10 specifies identification information of the driver by facial authentication means using an image photographed by the photographing means, determines whether a driver's environment satisfies appropriate conditions based on the image photographed by the photographing means and environment information registered in advance, obtains an alcohol detection result for the driver, and transmits detection information including the identification information, a determination result by a determination unit, and the alcohol detection result to the server 20. The server 20 stores the detection information transmitted from the mobile terminal 10 in a predetermined storage area, and causes the stored detection information to be output to a predetermined management terminal 30.SELECTED DRAWING: Figure 6

Description

Technical Field

[0001] The present invention relates to an information processing system, a terminal, and a server for realizing information provision to an administrator who manages a driver using a terminal equipped with a photographing unit.

Background Art

[0002] Conventionally, various systems for a motor vehicle carrier to manage drivers have been proposed. For example, there is a system that displays health guidance information for a driver at the time of driver roll call (see Patent Document 1).

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] However, many of the conventional systems use only information obtained from the driver himself / herself, such as the alcohol in the driver's breath and the driver's body temperature, as information that the system can obtain from the driver during an alcohol test, and there are cases where sufficient information for driver management cannot be obtained. That is, for example, when a driver tries to falsify his / her own information, there are cases where useful information for safe driving management cannot be provided to the administrator.

[0005] The present invention has been made in view of the above points, and an object thereof is to provide an information processing system, a terminal, and a server for realizing information provision to an administrator who manages a driver.

Means for Solving the Problems

[0006] The information processing system according to the present invention comprises a mobile terminal equipped with a shooting means and a server, and is an information processing system for providing information to an administrator who manages drivers using the mobile terminal, wherein the mobile terminal comprises an identification unit that identifies the driver's identification information by facial recognition means using an image captured by the shooting means, a determination unit that determines whether the driver's environment meets appropriate conditions based on the image captured by the shooting means and pre-registered environmental information, an acquisition unit that acquires the alcohol detection result for the driver, and a transmission unit that transmits detection information including the identification information, the determination result by the determination unit and the alcohol detection result to the server, and the server comprises a storage unit that stores the detection information transmitted from the mobile terminal in a predetermined storage area and an output unit that outputs the detection information stored by the storage unit to a predetermined management terminal.

[0007] The present invention provides a portable terminal equipped with a shooting means, comprising: an identification unit that identifies the identification information of a driver using the portable terminal by facial recognition means using an image captured by the shooting unit; a determination unit that determines whether the driver's environment meets appropriate conditions based on the image captured by the shooting means and pre-registered environmental information; an acquisition unit that acquires the alcohol detection result for the driver; and a transmission unit that transmits detection information, including the identification information, the determination result by the determination unit, and the alcohol detection result, to a server used by an administrator who manages the driver.

[0008] The server according to the present invention is a server in an information processing system for providing information to an administrator who manages drivers using the mobile terminal, comprising a mobile terminal equipped with a shooting means and a server, and is characterized by comprising: an identification unit that identifies the driver's identification information using a facial recognition means that uses an image captured by the shooting means; a determination unit that determines whether the driver's environment meets appropriate conditions based on the image captured by the shooting means and pre-registered environmental information; an acquisition unit that acquires the alcohol detection result for the driver; a storage unit that stores detection information including the identification information, the determination result by the determination unit and the alcohol detection result in a predetermined storage area; and an output unit that outputs the detection information stored by the storage unit to a predetermined management terminal. [Effects of the Invention]

[0009] According to the present invention, it is possible to provide an information processing system, a mobile terminal, and a server for providing information to managers who manage drivers. [Brief explanation of the drawing]

[0010] [Figure 1] This is a block diagram showing an example of the configuration of the information processing system 100 according to the present invention. [Figure 2] This is a block diagram showing an example of the configuration of a mobile terminal 10 corresponding to at least one embodiment of the present invention. [Figure 3] This is an explanatory diagram illustrating an example of environmental information. [Figure 4] This is a block diagram showing an example of the configuration of a server 20 corresponding to at least one embodiment of the present invention. [Figure 5] This is a block diagram showing an example of the configuration of a management terminal 30 corresponding to at least one embodiment of the present invention. [Figure 6] This flowchart shows an example of a detection process performed by the mobile terminal 10 according to the present invention. [Figure 7] This flowchart shows an example of a management process performed by the server 20 according to the present invention. [Figure 8] This is an explanatory diagram illustrating an example of an administration screen. [Modes for carrying out the invention]

[0011] The following describes an example of an information processing system according to one embodiment of the present invention, with reference to the drawings. The examples described below can be combined as appropriate, provided that no inconsistencies arise. Furthermore, the order of the various processes constituting the various flows described below is not limited to any particular order, provided that no inconsistencies arise in the processing content.

[0012] Figure 1 is a block diagram showing an example of the configuration of the information processing system 100 according to the present invention. The information processing system 100 is a system for providing information to administrators who manage drivers using mobile terminals.

[0013] Here, "driver" refers to a person under the management of the administrator and who operates the vehicle. The type of vehicle operated by the driver is not particularly limited; any vehicle that can be used for transporting people, such as a car or motorcycle, is acceptable.

[0014] Furthermore, the term "manager" refers to someone who oversees the driver's condition. An example of a manager is a safe driving manager selected by the business that uses the vehicle.

[0015] The information processing system 100 includes at least a mobile terminal 10, a server 20, and a management terminal 30. The mobile terminal 10, server 20, and management terminal 30 are connected to each other via a communication network 40 such as the Internet.

[0016] The mobile terminal 10 is a terminal used by a driver, and is equipped with photographing means and communication means for communicating with the server 20. Although the configuration of the photographing means is not particularly limited, it preferably has not only an image (still image or moving image) but also a recording function. Further, although the configuration of the communication means is not particularly limited, it is preferably configured to enable wireless communication. An example of the mobile terminal 10 is a smartphone. Details of the functional configuration of the mobile terminal 10 will be described later.

[0017] The server 20 is a device that performs necessary processing to realize communication between the mobile terminal 10 and the management terminal 30. The server 20 only needs to have a function for performing necessary information management between the mobile terminal 10 and the management terminal 30, so a part or all of the functions may be provided in the mobile terminal 10 or the management terminal 30. Details of the functional configuration of the server 20 will be described later.

[0018] The management terminal 30 is a terminal used by an administrator. Details of the functional configuration of the function management terminal 30 will be described later.

[0019] Note that the mobile terminal 10, the server 20, and the management terminal 30 may be devices designed as dedicated machines, but it is assumed that they can be realized by general computers or server devices. In this case, the mobile terminal 10, the server 20, and the management terminal 30 are assumed to have a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a memory, and a storage such as a hard disk drive that general computers or server devices usually have (not shown). Needless to say, various processes are executed by programs in order to make these general computers or server devices function as the mobile terminal 10, the server 20, and the management terminal 30 in this example.

[0020] The mobile terminal 10, server 20, and management terminal 30 use data read into memory as appropriate to perform information processing necessary for various operations using their CPUs, and store the obtained processing results in the storage device as needed. The storage device functions as a storage medium for storing various types of information. The configuration of the storage device is not particularly limited, but examples include HDDs and SSDs.

[0021] In the example shown in Figure 1, the information processing system 100 included one mobile terminal 10, one server 20, and one management terminal 30. However, the information processing system 100 may include multiple mobile terminals 10, servers 20, and management terminals 30. In this case, for example, each driver may be provided with a mobile terminal 10, or management terminals 30 may be installed at multiple business locations.

[0022] Figure 2 is a block diagram showing an example of the configuration of a mobile terminal 10 corresponding to at least one embodiment of the present invention. As shown in Figure 2, the mobile terminal 10 comprises at least a identification unit 11, a determination unit 12, an acquisition unit 13, and a transmission unit 14.

[0023] The identification unit 11 has the function of identifying the driver's identification information using a facial recognition means that uses an image captured by the shooting means.

[0024] Here, "face recognition means" refers to a means for recognizing a face from an image. The configuration of the face recognition technology to be adopted is not particularly limited, but it is preferable that the recognition accuracy is improved by utilizing AI. An example of such a configuration is one in which a face recognition program stored in a memory device of the mobile terminal 10 or the server 20 is used, and face recognition is achieved using a learning model trained by deep learning technology such as a neural network.

[0025] Furthermore, driver identification information refers to information used to uniquely identify a driver in the information processing system 100. The configuration for identifying driver identification information is not particularly limited as long as it utilizes facial recognition means. An example of such a configuration is one in which information relating to a face and identification information (driver information) is referenced, and the identification information corresponding to the face authenticated by the facial recognition means is identified as the driver's identification information. The identification information is not particularly limited as long as it can identify a driver, but it is preferable that the information does not overlap in content among multiple drivers. An example of such information is an identification ID assigned to each driver to identify them. Another example of identification information is the driver's personal information. Examples of the driver's personal information include the driver's name, age, gender, and address.

[0026] The determination unit 12 has the function of determining whether the driver's environment meets the appropriate conditions (environmental determination) based on the image captured by the photographic means and the environmental information registered in advance.

[0027] Here, the image used by the determination unit 12 is not particularly limited, but it is preferably the image used for the facial recognition means or an image corresponding to that image (corresponding image). By reusing the image used for facial recognition, the driver is not required to take a separate image for determination. Examples of corresponding images include images other than the face portion included in the facial recognition image (for example, the background), or images taken by the rear camera when the front camera takes a picture of the image taken for facial recognition.

[0028] Furthermore, environmental information refers to information used to determine the suitability of the environment in which the driver is placed. Environmental information is not particularly limited as long as it is information registered before the determination is made; it may be information used in common for all drivers, or it may be information whose content differs depending on the driver.

[0029] Furthermore, the configuration for performing environmental determination is not particularly limited. The configuration may determine that an environment is "appropriate" if at least a portion of a predetermined object (appropriate object) is included in the image to be determined (image to be determined), or it may determine that an environment is "appropriate" if at least a portion of a specific object (inappropriate object) is not included in the image to be determined. An example of such a configuration is one in which, if the image to be determined includes an object registered as an appropriate object that is expected to be visible in an environment where a driver is undergoing alcohol testing (for example, a steering wheel or meter), it is determined that "the driver's environment meets the appropriate conditions." Alternatively, there is a configuration in which, if the image to be determined includes an object registered as an inappropriate object that is expected not to be visible in an environment where a driver is undergoing alcohol testing (for example, a container of alcoholic beverages), it is determined that "the driver's environment does not meet the appropriate conditions."

[0030] Figure 3 is an explanatory diagram illustrating an example of environmental information. In this example, the environmental information includes the driver number, vehicle type, object, and comparison image. The driver number refers to a number used to identify the driver. The vehicle type refers to the type of vehicle used by the driver. The object refers to the object used for environmental determination. The comparison image refers to an image registered as a comparison target when performing environmental determination using image recognition.

[0031] The acquisition unit 13 has the function of acquiring the alcohol detection results for the driver.

[0032] Here, "alcohol detection result" refers to the detection result obtained using an alcohol detector used to confirm whether or not the driver is intoxicated. The configuration for obtaining the alcohol detection result for the driver is not particularly limited; for example, the acquisition unit 13 may receive information representing the alcohol detection result wirelessly or via a wired connection from an alcohol detector carried by the driver, or the system may recognize the detection result from an image representing the detection result of the alcohol detector. An example of such a configuration is one in which the alcohol detection result is obtained from an alcohol detector paired with a mobile terminal 10.

[0033] The transmission unit 14 has the function of transmitting detection information to the server 20, which includes identification information, the judgment result from the determination unit 12 (i.e., information indicating whether or not the appropriate conditions are met), and the alcohol detection result.

[0034] Here, the configuration for sending detection information to the server 20 is not particularly limited. The configuration may be such that detection information is sent to the server 20 only when the judgment result "meets the appropriate conditions," or the configuration may be such that detection information is sent to the server 20 regardless of whether the appropriate conditions are met or not.

[0035] The above describes an example of the configuration of a mobile terminal 10 corresponding to at least one embodiment of the present invention. Note that some of the functions of the mobile terminal 10 may be provided by the server 20 or the management terminal 30 instead.

[0036] Figure 4 is a block diagram showing an example of the configuration of a server 20 corresponding to at least one embodiment of the present invention. As shown in Figure 4, the server 20 includes a storage unit 21 and an output unit 22.

[0037] The storage unit 21 has the function of storing detection information transmitted from the mobile terminal in a predetermined storage area.

[0038] Here, the detection information may be stored in a memory device provided by the server terminal 20, or it may be stored in an external device other than the server 20. Preferably, the detection information is configured to record at least whether or not the person is under the influence of alcohol for a predetermined period (for example, one year from the date of storage).

[0039] The output unit 22 has the function of outputting the detection information stored by the storage unit 21 to the management terminal 30. The configuration for outputting the detection information to the management terminal is not particularly limited; it may be configured to send the detection information to the management terminal 30 at a fixed interval, or it may be configured to send the detection information to the management terminal 30 in response to a request from the management terminal 30.

[0040] The above describes an example of the configuration of a server 20 corresponding to at least one embodiment of the present invention. Note that some of the functions of the server 20 may be provided by a mobile terminal 10 or a management terminal 30 instead of the server 20.

[0041] Figure 5 is a block diagram showing an example of the configuration of a management terminal 30 corresponding to at least one embodiment of the present invention. As shown in Figure 5, the management terminal 30 includes a display unit 31 and a reception unit 32.

[0042] The display unit 31 has the function of displaying various information using predetermined display means. For example, the display unit 31 displays received detection information using predetermined display means.

[0043] Here, the predetermined display means is not particularly limited and may be a display device built into the management terminal 30 itself, or an external display device other than the management terminal 30. In this example, the predetermined display means is the display built into the management terminal 30 itself.

[0044] The reception unit 32 has the function of receiving requests from the administrator.

[0045] The configuration for receiving requests from the administrator is not particularly limited, but it is preferable that the configuration allows for receiving various requests through a predetermined management screen.

[0046] The above describes an example of the configuration of a management terminal 30 corresponding to at least one embodiment of the present invention. Note that some of the functions of the management terminal 30 may be provided by the server 20 instead.

[0047] Figure 6 is a flowchart showing an example of a detection process performed by the mobile terminal 10 according to the present invention. In this example, the detection process involves processing related to sending detection information to the server 20. The following explanation will use the case where the mobile terminal 10 performs the detection process independently as an example.

[0048] The detection process is initiated, for example, when the mobile terminal 10 receives a request from a driver operating the mobile terminal 10.

[0049] In the detection process, the mobile terminal 10 first identifies the driver using facial recognition means (step S101). In this example, the mobile terminal 10 identifies the driver's identification information using facial recognition means that use the driver's facial image captured by the camera installed in the mobile terminal 10.

[0050] When the mobile terminal 10 identifies a driver, it determines whether the driver's environment meets the appropriate conditions (step S102). In this example, the mobile terminal 10 determines whether the driver's environment meets the appropriate conditions based on the background image of the driver's face image captured by the camera installed in the mobile terminal 10 and the environmental information registered in advance. If part of the detection process is performed by the server 20 or the management terminal 30, the mobile terminal 10 may transmit the image to the server 20 or the management terminal 30 and receive the determination result from the server 20 or the management terminal 30.

[0051] When the mobile terminal 10 determines that the appropriate conditions have been met, it obtains the alcohol detection result (step S103). In this example, the mobile terminal 10 obtains the alcohol detection result by communicating with an alcohol detector available to the driver.

[0052] When the mobile terminal 10 obtains the alcohol detection result, it sends the detection information to the server (step S104) and terminates the detection process. In this example, the mobile terminal 10 sends detection information to the server 10, which includes the identification information of the identified driver, the result of the determination of appropriate conditions, and the alcohol detection result.

[0053] Figure 7 is a flowchart showing an example of management processing performed by the server 20 according to the present invention. In this example, the management processing involves processes related to managing detection information. The following explanation will describe the case where the server 20 performs the management processing on its own.

[0054] The management process is initiated, for example, when the server 20 receives detection information from the mobile terminal 10.

[0055] In the management process, the server 20 first saves the detection information (step S201). In this example, the server 20 saves the detection information transmitted from the mobile terminal 10 to a predetermined storage area.

[0056] When the server 20 saves the detection information, the mobile terminal 10 outputs the detection information to the management terminal (step S202) and terminates the management process. In this example, the server 20 sends the saved detection information to the management terminal 30 without waiting for a request from the management terminal 30, causing the management terminal 30 to output a management screen that includes at least one part of the detection information.

[0057] Figure 8 is an explanatory diagram illustrating an example of a management screen. As shown in Figure 8, the management screen is provided with a display area 801 for displaying various information used for driver management, a new registration button 802, a search area 803, and a download button 804.

[0058] Display area 801 shows the driver's facial image, name, date of birth, membership information, and status. Here, the membership information clearly distinguishes between registered users with registered facial recognition information, employees without registered facial recognition information, and administrators. The status also clearly indicates whether or not the user can log in to the system via facial recognition (enabled or disabled).

[0059] Furthermore, the new registration button 802 is a button for registering a new user in the system. The search area 803 is an area for accepting search terms entered by the administrator. In addition, the download button 804 is a button for accepting the operation to download the information displayed on the management screen to the management terminal in a predetermined format.

[0060] The above describes examples of how to use the information processing system 100 according to the present invention.

[0061] As described above, the information processing system 100 in this example comprises a mobile terminal 10 equipped with a camera and a server 20. In order to provide information to an administrator who manages drivers using the mobile terminal 10, the mobile terminal 10 identifies the driver's identification information using a facial recognition means that uses the image captured by the camera, determines whether the driver's environment meets the appropriate conditions based on the image captured by the camera and pre-registered environmental information, obtains the alcohol detection result for the driver, transmits detection information including the identification information, the determination result by the determination unit, and the alcohol detection result to the server 20, and the server 20 stores the detection information transmitted from the mobile terminal 10 in a predetermined storage area and outputs the stored detection information to a predetermined management terminal 30, thereby enabling the provision of information to an administrator who manages drivers.

[0062] In other words, since the images taken by the driver can be used for purposes other than facial recognition, useful information can be provided to administrators without increasing the burden on the driver. In particular, by adopting facial recognition, it becomes unnecessary for drivers to enter their ID or password, and it is also possible to determine whether the environment in which the driver performs the alcohol check is appropriate. This allows administrators to receive information that can contribute to an effective system while reducing the costs required for safe driving management.

[0063] Furthermore, in the information processing system 100 in this example, the driver can provide the administrator with the information required for safety management by turning on an alcohol detector available to them at the time requested by the administrator, launching an app installed for this system on the driver's smartphone, and performing facial recognition using the smartphone's front camera. In addition, by having the driver take a picture of the car's steering wheel and instrument panel with the smartphone's rear camera, the administrator can verify whether or not it is a vehicle other than the intended one, and make judgments about the driving environment. Moreover, when the driver performs an alcohol check with the alcohol detector, the detection information is sent to the server as information indicating when, where, and by whom the alcohol check was performed before starting work, which reduces the burden on the administrator compared to a system where the administrator needs to interview the driver. It is also possible to configure the system so that if the detection information meets the conditions defined as conditions under which an abnormality can be inferred to have occurred in the driver, the administrator is immediately notified via the administrator screen and email. Examples of detection information in this case include starting location information, start time, photo taken during facial recognition, and photo confirming the check at the time of the accident. Furthermore, the system may be configured to require drivers to perform at least a portion of the above tasks using the mobile device 10 at the end of their shift, allowing the manager to confirm that the driver did not consume alcohol during their shift. Additionally, all or part of the processes required of drivers and managers may be notified to the manager or another person in charge via the cloud in near real-time and centrally managed.

[0064] Furthermore, although not specifically mentioned in the above-described examples of embodiments, the mobile terminal 10 may be configured to send detection information to the server 20 if the driver's environment meets the appropriate conditions, and to send notification information to the server 20 to notify the administrator if the driver's environment does not meet the appropriate conditions. With such a configuration, the administrator can determine whether or not drivers who do not meet the appropriate conditions are necessary. In this case, it is preferable that the determination of appropriate conditions and notification to the administrator are carried out quickly. By enabling the administrator to know in real time which drivers do not meet the appropriate conditions, the quality of safety management can be further improved.

[0065] Furthermore, in the above-described embodiment, the mobile terminal 10 may be configured to determine that the appropriate conditions are met if it determines that at least a portion of the objects included in the environmental information (for example, the steering wheel or instrument panel of a car, or other objects that serve as criteria for determining whether it is appropriate to be in the driving environment) are included in the image used for facial recognition by the facial recognition means. By adopting such a configuration, it becomes possible to provide useful information to the administrator without forcing the driver to perform an operation different from the image capture operation used for facial recognition. That is, for example, if facial recognition and alcohol detection are required of the driver in the driver's seat, the credibility of the fact that the driver performed facial recognition in the driver's seat can be improved if the car seat is visible in the background of the driver's face image. Note that the configuration for identifying objects from a portion of the image is not particularly limited and is intended to use known technology, so a detailed explanation is omitted here.

[0066] Furthermore, in the above-described embodiment, the mobile terminal 10 is configured to determine that the driver's environment does not meet the appropriate conditions if it determines that at least some of the inappropriate objects included in the environmental information (for example, liquor bottles or cartons of liquor, or other objects that serve as criteria for determining that it is inappropriate for them to be in the driving environment) are included in the image used for facial recognition by the facial recognition means. Therefore, by registering inappropriate objects, the quality of safety management can be further improved. In addition, the configuration may be such that the target objects (for example, appropriate objects and inappropriate objects) are managed in association with items for individually identifying the driver's seat (for example, driver's name, vehicle type, and vehicle identification information), thereby increasing the effectiveness of the images used for determining appropriateness. That is, by using images that match conditions specific to the driver's seat as a comparison target, it may be possible to expect an improvement in the accuracy of determining whether or not a driver is in the driver's seat.

[0067] Furthermore, the mobile terminal 10 is a housing that includes a front side with a display screen for displaying images and a back side located behind the front side. The shooting means consists of an in-camera on the front and an out-camera on the back. The driver is identified by facial recognition using the image captured by the in-camera, and the appropriate conditions are determined using the image captured by the out-camera. This configuration allows images that can be obtained from the out-camera at the same time as the in-camera to be used for safety management. Moreover, with the widespread use of smartphones equipped with both in-cameras and out-cameras, safety management can be implemented simply by installing an app that functions as the mobile terminal 10 on the smartphone carried by the driver. This reduces the cost of implementing safety management compared to, for example, providing each driver with a dedicated terminal.

[0068] Furthermore, the mobile terminal 10 may be equipped with a recording unit that records ambient sounds when video is recorded by the recording unit, and a facial recognition unit that uses the video recorded by the recording unit to identify the driver. Based on the video information recorded by the recording unit, the sound recorded by the recording unit, and environmental information, it may be configured to determine whether the driver's environment meets appropriate conditions. With such a configuration, the mobile terminal 10 can be used to record the driver's health management beyond just alcohol consumption by recording the situation when the driver is unable to answer questions from the smartphone, such as slurred speech, stroke, or dementia. In this case, for example, the mobile terminal 10 or server 20 may be configured to identify the driver's facial color obtained from the video, determine the driver's health condition from the identified facial color, and transmit the result of the determination to the server 20 or management terminal 30. With such a configuration, it becomes possible to have the information processing system 100 perform the judgment that would be made by the supervisor, compared to, for example, the supervisor looking at the image and making a judgment. Furthermore, by accumulating information regarding drivers' alcohol detection (particularly information regarding appropriate conditions and information regarding alcohol detection results), it may be possible to use AI to support or replace the judgments made by managers.

[0069] Alternatively, the mobile terminal 10 may be configured to acquire detection results by receiving detection information acquired by the alcohol detector, or by capturing a screen displaying the alcohol detection result using a camera. This configuration makes it possible to enable cooperation between various alcohol detectors and the mobile terminal 10 without depending on the driver's operating ability.

[0070] Furthermore, the mobile terminal 10 may be configured to acquire acquisition-related information, including the time and location where the alcohol detection result was obtained, and to transmit the detection information, including the acquisition-related information, to the server 20. With such a configuration, it becomes possible to manage the alcohol detection result in association with the driver's movements, thereby providing useful information to the administrator. That is, for example, if an alcohol test is conducted at the start and end of a driver's work-related driving, recording the time and location where the alcohol detection result was acquired by the mobile terminal 10 improves the usefulness of the information for the administrator to grasp. The timing of the alcohol test is not particularly limited as long as it is considered effective for safety management. An example of such timing is when a driver starts driving again after eating or taking a break. In this case, the mobile terminal 10 may be configured to determine that the driver has eaten or taken a break based on predetermined re-detection conditions and notify the driver that another alcohol test is required. Examples of re-detection conditions include the driver reaching their set break time, the vehicle not moving for a predetermined period of time, or stopping at a predetermined location, and other conditions that can be determined from various information that can be managed by the mobile terminal 10 or the server 20. In this case as well, since the driver using the mobile device 10 can perform alcohol detection using facial recognition, the burden on the driver is reduced compared to when they have to enter login information or other data.

[0071] Furthermore, the mobile terminal 10 may be configured to notify a designated recipient (for example, a management terminal or a mobile terminal owned by the driver's supervisor) of the judgment result when the notification conditions are met (for example, when the driver's environment does not meet the appropriate conditions), and to notify the driver that driving is permitted once approval is obtained from the recipient. In particular, by having the driver's information delivered to the administrator (or the driver's supervisor) by email or other means in near real time, the administrator can decide whether or not to approve the driver's driving. In this case, the system may be configured so that the driver can check whether or not they have received approval. With such a configuration, even in situations where the driver's judgment ability is lower than usual, it is possible to prevent situations where safety management cannot be achieved because the driver makes decisions on their own.

[0072] It should be noted that the present invention is not limited to the embodiments described above, and various configurations or embodiments can be taken without departing from the spirit of the present invention.

[0073] [Note] The above-described embodiments are written in such a way that at least the following invention can be put into practice by a person with ordinary skill in the art to which the invention pertains.

[0074] [1] An information processing system comprising a mobile terminal equipped with a means for taking pictures and a server, for providing information to an administrator who manages drivers using the mobile terminal, The aforementioned mobile terminal is An identification unit that identifies the driver's identification information using a facial recognition means that uses an image captured by the aforementioned photographic means, A determination unit that determines whether the driver's environment meets the appropriate conditions based on the image captured by the aforementioned photographic means and the environmental information registered in advance, An acquisition unit that acquires the alcohol detection result for the aforementioned driver, The system includes a transmission unit that transmits detection information, including the identification information, the determination result by the determination unit, and the alcohol detection result, to the server. The aforementioned server, A storage unit that stores the detection information transmitted from the mobile terminal in a predetermined storage area, The system includes an output unit that outputs the detection information stored by the storage unit to a predetermined management terminal. An information processing system characterized by the following: [2] The transmitting unit transmits the detection information to the server if the driver's environment meets the appropriate conditions, and transmits notification information to the server to perform notification to the administrator if the driver's environment does not meet the appropriate conditions. [1] The information processing system described above. [3] The determination unit determines that the appropriate conditions are met if it determines that the image used for facial recognition by the facial recognition means includes at least a part of the object included in the environmental information. The information processing system described in [1] or [2]. [4] If the determination unit determines that the image used for facial recognition by the facial recognition means contains at least some of the inappropriate objects included in the environmental information, it determines that the driver's environment does not meet the appropriate conditions. An information processing system as described in any of [1] to [3]. [5] The aforementioned mobile terminal is a housing comprising a front panel including a display screen for displaying images, and a back panel located behind the front panel. The aforementioned imaging means includes an in-camera provided on the front and an out-camera provided on the rear, The aforementioned identification unit identifies the driver using facial recognition means that utilizes the image captured by the in-camera, The determination unit determines whether the conditions for compliance are met using the image captured by the rear camera. An information processing system as described in any of [1] through [4]. [6] The aforementioned mobile terminal is equipped with a recording unit that records ambient sounds when video is being recorded by the aforementioned shooting means. The identification unit identifies the driver using a facial recognition means that uses a video captured by the shooting means. The determination unit determines whether the driver's environment meets the appropriate conditions based on the video information captured by the recording means, the sound recorded by the recording unit, and the environmental information. An information processing system as described in any of [1] through [5]. [7] The acquisition unit acquires the detection result by receiving the detection information acquired by the alcohol detector, or by capturing a screen displaying the alcohol detection result using the shooting means. An information processing system as described in any of [1] through [6]. [8] The acquisition unit acquires acquisition-related information, including the time and place where the alcohol detection result was acquired. The transmission unit transmits the detection information, including the acquisition-related information, to the server. An information processing system as described in any of [1] through [7]. [9] A portable device equipped with a means of taking pictures, An identification unit identifies the driver's identification information using the image captured by the aforementioned imaging unit, through facial recognition means. A determination unit that determines whether the driver's environment meets the appropriate conditions based on the image captured by the aforementioned photographic means and the environmental information registered in advance, An acquisition unit that acquires the alcohol detection result for the aforementioned driver, The system includes a transmission unit that transmits detection information, including the identification information, the determination result from the determination unit, and the alcohol detection result, to a server used by the administrator who manages the driver. A mobile device characterized by the following features.

[10] A server in an information processing system comprising a mobile terminal equipped with a means for taking pictures and a server, for providing information to an administrator who manages drivers using the mobile terminal, An identification unit that identifies the driver's identification information using a facial recognition means that uses an image captured by the aforementioned photographic means, A determination unit that determines whether the driver's environment meets the appropriate conditions based on the image captured by the aforementioned photographic means and the environmental information registered in advance, An acquisition unit that acquires the alcohol detection result for the aforementioned driver, A storage unit that stores the identification information, the determination result by the determination unit, and the detection information including the alcohol detection result in a predetermined storage area. The system includes an output unit that outputs the detection information stored by the storage unit to a predetermined management terminal. A server characterized by the following features.

[11] An information processing program comprising a mobile terminal equipped with a means for taking pictures and a server, for providing information to an administrator who manages drivers using the mobile terminal, The aforementioned mobile device, A function that identifies the driver's identification information using a facial recognition means that uses an image captured by the aforementioned shooting means, A determination function that determines whether the driver's environment meets the appropriate conditions based on the image captured by the aforementioned photographic means and the environmental information registered in advance, An acquisition function for acquiring the alcohol detection results for the aforementioned driver, A transmission function that transmits detection information, including the identification information, the determination result by the determination unit, and the alcohol detection result, to the server. An information processing program to make it happen. [Explanation of Symbols]

[0075] 100 Information Processing Systems 10 Mobile devices 11 Specific section 12 Judgment section 13 Acquisition Department 14. Transmitter 20 servers 21 Preservation Department 22 Output section 30 Management terminals 31 Display section 32 Reception Department

Claims

1. An information processing system including a mobile terminal equipped with a photographing means and a server, for realizing information provision to an administrator who manages a driver using the mobile terminal, wherein the mobile terminal includes a specifying unit that specifies the driver's identification information by a face authentication means using an image photographed by the photographing means, a determination unit that determines whether the driver's environment satisfies appropriate conditions based on at least an image including an in-vehicle meter photographed by the photographing means and environment information which is pre-registered information and includes at least an image of an in-vehicle meter as a determination target image, an acquisition unit that acquires an alcohol detection result for the driver, and a transmission unit that transmits detection information including the identification information, the determination result by the determination unit, and the alcohol detection result to the server, wherein the server includes a storage unit that stores the detection information transmitted from the mobile terminal in a predetermined storage area, and an output unit that causes the detection information stored by the storage unit to be output to a predetermined management terminal characterized by the above information processing system.

2. The mobile terminal includes a recording unit that records ambient sound when a video is photographed by the photographing means, and the determination unit determines whether the driver's environment satisfies the appropriate conditions based on the video information photographed by the photographing means, the sound recorded by the recording unit, and the environment information. The information processing system according to claim 1, characterized by the above.

3. The specifying unit specifies the driver by a face authentication means using the video information. The information processing system according to claim 2, characterized by the above.

4. The mobile terminal includes a recording unit that records the driver's voice, the determination unit determines the driver's health state based on the voice recorded by the recording unit, and the transmission unit transmits the determination result of the health state to the server. The information processing system according to any one of claims 1 to 3, characterized by the above.

5. The mobile terminal is a housing including a front surface including a display screen for displaying an image and a back surface located on the back side of the front surface, the photographing means includes an in-camera provided on the front surface and an out-camera provided on the back surface, the specifying unit specifies the driver by a face authentication means using an image photographed by the in-camera, and the determination unit determines whether the appropriate conditions are satisfied using an image photographed by the out-camera. The information processing system according to any one of claims 1 to 4, characterized in that...

6. A terminal equipped with photographing means, a specifying unit that specifies identification information of a driver who uses the mobile terminal by face authentication means using an image photographed by the photographing means; a determination unit that determines whether the driver's environment satisfies appropriate conditions based on an image including at least an in-vehicle meter photographed by the photographing means and environment information that is pre-registered information and includes at least an image of an in-vehicle meter as a determination target image; an acquisition unit that acquires an alcohol detection result for the driver; and a transmission unit that transmits detection information including the identification information, the determination result by the determination unit, and the alcohol detection result to a predetermined transmission destination. The terminal is characterized by the above.

7. In a terminal equipped with photographing means, a specifying function that specifies the driver's identification information by face authentication means using an image photographed by the photographing means; a determination function that determines whether the driver's environment satisfies appropriate conditions based on an image including at least an in-vehicle meter photographed by the photographing means and environment information that is pre-registered information and includes at least an image of an in-vehicle meter as a determination target image; an acquisition function that acquires an alcohol detection result for the driver; and a transmission function that transmits detection information including the identification information, the determination result by the determination unit, and the alcohol detection result to a predetermined transmission destination. An information processing program for realizing the above.

Images