System, information processing method, information processing device, and program

Abstract

This provides information processing technology that enables efficient checking of vehicle operations. [Solution] An information processing method relating to an alcohol check, comprising: acquiring identification information of the person performing the alcohol check and the person being checked in relation to the alcohol check; receiving input of detector check result information, which is information relating to the alcohol detection result in the alcohol check, in a first information processing device; receiving input of response check result information, which is information relating to the result of a response check regarding the presence or absence of alcohol in the alcohol check, in a second information processing device; and storing the detector check result information, the response check result information, the identification information of the person performing the alcohol check, and the identification information of the person being checked in association with each other.

Description

Technical Field

[0004] , ,

[0001] The present invention relates to an information processing technology for improving the efficiency of inspection work related to vehicle operation.

Background Art

[0002] In businesses that use vehicles, it is an important responsibility to conduct inspection work related to vehicle operation. For example, it is important to check whether a driver is driving while under the influence of alcohol. Furthermore, due to recent legal amendments, the scope in which it is necessary to check drivers using an alcohol detector at times such as before and after driving (hereinafter referred to as "alcohol check") has expanded, and the importance of alcohol checks has further increased.

[0003] For example, according to the Road Traffic Act Enforcement Regulations (revised in 2022), in an alcohol check, a safety operation manager must satisfy at least the following requirements, and corresponding measures are necessary. · Visually check the driver's condition before and after driving to confirm whether the driver has the smell of alcohol. · Record the content of the above confirmation and store the record for one year. · Conduct the above confirmation using an alcohol detector specified by the National Public Safety Commission. · Always keep the alcohol detector in an effective state.

[0004] As a conventional technology related to alcohol checks, for example, in Patent Document 1, when a digital tachograph that records the operation status of a vehicle is communicable with a manager's terminal operated by an operation manager who manages the operation of the vehicle, driver information is acquired to conduct a点名 call to the driver boarding the vehicle and transmitted to the manager's terminal, and at the same time, the inspection result of alcohol in the driver's breath is acquired and transmitted to the manager's terminal. In the manager's terminal, the received driver information and inspection result are notified to the operation manager, and a technology is disclosed in which it is not necessary for all drivers to carry a driver device in an alcohol check. Furthermore, for example, Patent Document 2 discloses a technology that can reduce discomfort and resistance from the person being checked in by conducting the driver check-in via a service robot. Furthermore, for example, Patent Document 3 discloses an alcohol detection means for detecting the amount of alcohol a driver has, an alcohol check means for comparing the amount of alcohol detected by the alcohol detection means with a standard value and determining that the driver is intoxicated if the detected amount of alcohol exceeds the standard value, and a technology for notifying the driver of the results of the alcohol check performed by the alcohol check means. Furthermore, for example, Patent Document 4 discloses a technology that can deter impersonation when a vehicle leaves a parking lot and authenticate the correct driver, regardless of which vehicle the driver is in. [Prior art documents] [Patent Documents]

[0005] [Patent Document 1] Japanese Patent Publication No. 2015-130109 [Patent Document 2] Japanese Patent Publication No. 2019-91394 [Patent Document 3] Japanese Patent Publication No. 2020-97364 [Patent Document 4] Japanese Patent Publication No. 2015-130109 [Overview of the Initiative] [Problems that the invention aims to solve]

[0006] In alcohol checks, it is preferable that the checks be conducted by a designated person, such as a designated safe driving manager. However, in situations where it is difficult for such a person to perform the checks, another person may perform the checks, but there was a possibility that this other person would also have difficulty performing the checks.

[0007] Furthermore, it was necessary to store information regarding alcohol checks based on legal requirements. Moreover, if the check was performed by someone other than the designated safe driving manager, it was preferable to remember the information regarding the alcohol check so that the safe driving manager could later reconfirm the details. When implementing these measures, problems arose, such as the accumulation of information overwhelming the storage capacity, and the complexity of managing information such as which users were subject to alcohol checks and who performed the checks.

[0008] The objective of this invention is to enable efficient checking of vehicle operations. [Means for solving the problem]

[0009] According to one aspect of the present invention, a system including an information processing device and a checker device comprises: a user identification information identification unit that identifies the identification information of a user who is the subject of an alcohol check through the information processing device; a communication establishment unit that establishes communication between the information processing device and the checker device associated with the checker who performs the alcohol check; a user image and voice information output unit that outputs user image and voice information, including image and voice information relating to the user's alcohol check status, acquired by the information processing device, to the checker device via the communication; an acquisition unit that acquires check result information, which is information relating to the results of the alcohol check, input by the checker; and a storage unit that stores the user identification information in association with the check result information. [Effects of the Invention]

[0010] The system according to the present invention makes it possible to efficiently perform checks related to vehicle operation. [Brief explanation of the drawing]

[0011] [Figure 1] This is a system configuration diagram of an alcohol check system according to one aspect of this embodiment. [Figure 2] It is a block diagram showing the functional configuration of the information processing apparatus 10 in FIG. 1. [Figure 3] It is a block diagram showing the functional configuration of the server 20 in FIG. 1. [Figure 4] It is a block diagram showing the functional configuration of the checker device 50 in FIG. 1. [Figure 5] It is a flowchart showing an example of processing when performing an alcohol check before the user gets on the vehicle 1 in the present embodiment. [Figure 6] It is an example of a user interface used to identify the vehicle 1 and displayed on the information processing apparatus 10. [Figure 7] It is an example of a user interface used to perform face authentication of the user and displayed on the information processing apparatus 10. [Figure 8] It is an example of a user interface used to capture the state of the alcohol check by the user and displayed on the information processing apparatus 10. [Figure 9] It is an example of a user interface used to grasp the alcohol check result by the user and displayed on the information processing apparatus 10. [Figure 10] It is an example of a user interface used for the checker to input the alcohol check result and displayed on the information processing apparatus 10. [Figure 11] It is another example of a user interface used for the checker to input the alcohol check result and displayed on the information processing apparatus 10. [Figure 12] It is a flowchart of the first alcohol check related process 1 which is an example of processing when performing the checker selection process in the first embodiment. [Figure 13] It is an example of the checker candidate list 221. [Figure 14] It is a flowchart showing an example of processing when performing an alcohol check after the user gets off the vehicle 1 in the first embodiment. [Figure 15] It is a flowchart showing an example of the final confirmation process of the check result in the first embodiment. [Figure 16] It is an example of a user interface for displaying check result information by a checker other than the administrator and performing a final confirmation by the administrator. [Figure 17] It is another example of a user interface for displaying check result information by a checker other than the administrator and performing a final confirmation by the administrator. [Figure 18] It is yet another example of a user interface for displaying check result information by a checker other than the administrator and performing a final confirmation by the administrator. [Figure 19] It is yet another example of a user interface for displaying check result information by a checker other than the administrator and performing a final confirmation by the administrator. [Figure 20] It is yet another example of a user interface for displaying check result information by a checker other than the administrator and performing a final confirmation by the administrator. [Figure 21] In the second embodiment, it is a flowchart of the second processing example related to alcohol check, the second processing related to alcohol check. [Figure 22] In the second embodiment, it is an example of a user interface displayed to prompt the input of detector check result information. [Figure 23] In the second embodiment, it is an example of a user interface displayed to prompt the input of response check result information. [Figure 24] In the second embodiment, it is an example of the data structure of each information stored in the second processing related to alcohol check. [Figure 25] In the second embodiment, it is an example of a user interface displayed to prompt the input of information for identifying a checker.

Modes for Carrying Out the Invention

[0012] Examples of embodiments for carrying out the present invention will be described below with reference to the drawings. In addition, in the descriptions of the drawings, the same reference numeral is used for identical elements, and redundant explanations may be omitted. Furthermore, the components described in these embodiments are merely illustrative and are not intended to limit the scope of the present invention to them.

[0013] [First Embodiment] The following describes a first embodiment, which is an example of realizing the information processing technology of the present invention. Furthermore, the contents described in this embodiment are applicable to any of the other embodiments, examples, or modifications.

[0014] Figure 1 is a system configuration diagram of an alcohol check system according to one aspect of this embodiment. In this system, an alcohol check is performed when a user boards or alights from vehicle 1, and the details are transmitted to the checker device 50 via an information processing device 10 located in the office. Information regarding the content of the alcohol check using the alcohol detector 30 is also acquired, and the results of the checker's verification are transmitted to the server 20 for recording.

[0015] In this embodiment, Vehicle 1 is a vehicle used for business purposes, but is not limited to such a vehicle. When boarding a vehicle, it is the vehicle the user is about to use, and when alighting from a vehicle, it is the vehicle the user was using. In Server 20, information about Vehicle 1 and information about the corresponding vehicle key 40 are registered in association with each other.

[0016] Figure 2 is a block diagram showing the functional configuration of the information processing device 10 in Figure 1. The information processing device 10 in this embodiment is not limited to any particular device, but may be an electronic device such as a tablet or a laptop PC. The information processing device 10 is configured to include, for example, a control unit 110, a storage unit 120, a communication unit 130, a display unit 140, an input unit 150, an audio output unit 160, and an imaging unit 170. The information processing device 10 is installed, for example, in office A, and is available for use by multiple users using either vehicle 1 or other vehicles. The information processing device 10 is connected to a network such as the Internet via the communication unit 130, and for example, when a user operates an application running on the device, it transmits various information acquired by the input unit 150, imaging unit 170, etc., and information stored in the storage unit 120 to the server 20.

[0017] The control unit 110 is composed of a processing arithmetic unit including, for example, a CPU (Central Processing Unit) and an MPU (Micro-Processing Unit). The control unit 110 performs various processing on each data and also controls the functional units of the communication unit 130, display unit 140, input unit 150, audio output unit 160, imaging unit 170, and audio input unit 180 by reading and executing programs stored in the storage unit 120.

[0018] The storage unit 120 includes, for example, an HDD (Hard Disk Drive), SSD (Solid State Drive), EEPROM (Electrically Erasable Programmable Read-Only Memory), ROM (Read-Only Memory), RAM (Random Access Memory), etc., and stores control programs processed by the control unit 110, as well as various data, such as image information acquired by the imaging unit 170 and audio information acquired by the audio input unit 180. Note that the storage unit 120 is not limited to one built into the information processing device 10, but may also be an external storage device connected via a digital input / output port such as USB (Universal Serial Bus).

[0019] Furthermore, the memory unit 120 stores an alcohol check-related processing program for executing the first alcohol check-related processing, which will be described later, in cooperation with the server 20 and the checker device 50.

[0020] The communication unit 130 is a module that connects to a public network such as the Internet using, for example, mobile communication such as LTE (Long Term Evolution), 3G, 4G, and 5G, or narrowband communication such as DSRC (Dedicated Short Range Communication), and is capable of data communication with various devices such as the server 20 connected to the same network. For example, the information processing device 10 exchanges data with the server 20 through the communication unit 130.

[0021] The display unit 140 is a display means for displaying various information, such as a liquid crystal display or an organic EL (Electro-Luminescence) display. The display unit 140 displays various information acquired through the communication unit 130 and processing results from the control unit 110. For example, it displays image information captured by the imaging unit 170 and video signals acquired from the checker device 50, etc., via the network NW, which have been decoded by the control unit 110.

[0022] The input unit 150 is an input means for the user to input various information to the information processing device 10. For example, it is composed of buttons, a touch panel, a switch, etc. Alternatively, the input unit 150 may be configured as a touchscreen integrated with the display unit 140. When a user performs an input operation on the input unit 150, a control signal corresponding to that input is generated and output to the control unit 110. The control unit 110 then performs calculation processing and control corresponding to that control signal.

[0023] The input unit 150 is not limited to the above, and may, for example, have a function to upload images captured by the imaging unit 170. As will be described in more detail later, the results displayed by the detector may be captured through the imaging unit 170 and uploaded to the server 20 through the input unit 150.

[0024] The audio output unit 160 consists of, for example, an audio output terminal and transmits an audio signal to output sound from connected earphones or speakers. Alternatively, it may be a speaker that outputs sound corresponding to the audio signal. The audio output unit 160 outputs audio, such as a beep, to notify the corresponding user, for example, when an abnormality is detected in the alcohol check results acquired through the imaging unit 170. It also outputs audio decoded by the control unit 110 from video signals including audio signals acquired from the checker device 50, etc., via the network NW.

[0025] The imaging unit 170 is a functional unit for capturing and acquiring still images or videos, such as a camera. During an alcohol check, it captures the user's appearance during the alcohol check and the results of the alcohol detector check, and outputs them as image information. The output image information is stored in the storage unit 120. The imaging unit 170 may be a camera attached to the information processing device 10, such as a tablet, or an external camera connected via USB, and its form is not particularly limited. Preferably, the image information acquired by the imaging unit 170 is transmitted by the control unit 110 or to the server 20 and analyzed as appropriate by the control unit 210. For example, it is possible to recognize the person in the image to determine which user is performing the alcohol check, or to recognize the code attached to the car key 40 in the image to determine which vehicle the alcohol check pertains to.

[0026] In this embodiment, the image information may refer to information about a single image, or it may refer to information as a video composed of multiple images, and it shall include at least both of these concepts.

[0027] The audio input unit 180 is, for example, a microphone that collects the voice spoken by the user, and acquires and outputs the surrounding sound of the information processing device 10 as audio information. When outputting the audio information, it may be output as image-audio information that includes both image and sound, together with the image information output by the imaging unit 170.

[0028] Figure 3 is a block diagram showing the functional configuration of the server 20 in Figure 1. In this embodiment, the server 20 is configured to include a control unit 210, a storage unit 220, and a communication unit 230. The server 20 is connected to the information processing device 10, etc., via a network such as the Internet, and receives various information such as location information from the information processing device 10, etc., and stores it in the storage unit 220. The server 20 also processes the stored information as appropriate, for example, the user's alcohol check results obtained by the information processing device 10.

[0029] The control unit 210, like the control unit 110 of the information processing device 10, is composed of a processing arithmetic unit including, for example, a CPU (Central Processing Unit) and an MPU (Micro-Processing Unit). The control unit 210 performs various processing on each data and also reads and executes programs stored in the storage unit 220. Furthermore,

[0030] The storage unit 220, like the storage unit 120 of the information processing device 10, includes, for example, an HDD (Hard Disk Drive), SSD (Solid State Drive), EEPROM (Electrically Erasable Programmable Read-Only Memory), ROM (Read-Only Memory), RAM (Random Access Memory), etc., and stores control programs processed by the control unit 210, various data, such as an installed device table in which device identification information is registered. Note that the storage unit 220 is not limited to one built into the server 20, but may also be an external storage device connected via a digital input / output port such as USB (Universal Serial Bus).

[0031] Furthermore, the memory unit 220 stores an alcohol check-related processing program for executing the first alcohol check-related processing, which will be described later, in cooperation with the information processing device 10 and the checker device 50.

[0032] The communication unit 230 is a module that connects to a network NW such as the Internet using a wired communication interface, or, similar to the communication unit 130 of the information processing device 10, using mobile communication such as LTE (Long Term Evolution) or 3G, or narrowband communication such as DSRC (Dedicated Short Range Communication), and is capable of data communication with various devices such as the information processing device 10 and the checker device 50 that are connected to the network NW.

[0033] The alcohol detector 30 is a measuring device that measures the alcohol concentration in the breath, for example, by blowing into the sensor. The alcohol detector 30 has a display unit that displays the alcohol concentration measurement result on the display unit. Preferably, the alcohol detector 30 has a communication unit that connects to a network NW (Internet) or to the information processing device 10 by any communication method and transmits the alcohol concentration measurement result information to the information processing device 10 or the server 20. When the measurement result information is transmitted to the information processing device 10, the information processing device 10 associates the measurement result information with other alcohol check result information (time information, user information, acquired image and sound information, etc.) and transmits and stores it in the server 20. When the measurement result information is transmitted to the server 20, the server 20 associates the measurement result information with other information related to the alcohol check result (check result information by the checker, time information, checker information, user information, information indicating that the alcohol check was performed while riding in a vehicle or while riding in a vehicle, image and sound information capturing the alcohol check situation, etc.) and stores it in the storage unit 220.

[0034] The alcohol detector 30 does not necessarily have a communication function. In this case, as will be described in detail later, the check result displayed by the detector may be captured by the imaging unit 170 and the acquired image information may be uploaded via the input unit 150, or the user may input the check result displayed by the detector via the input unit 150 to store the check result in the storage unit 220.

[0035] Furthermore, while it is preferable to keep the alcohol detector 30 constantly active in accordance with laws and regulations, communication-type detectors are more expensive than non-communication-type detectors, making it costly for each driver to own one. Therefore, one possible approach is to install a common communication-type alcohol detector 30 in an office where users gather, and conduct alcohol checks centrally. On the other hand, considering cases where users go directly to or from work without stopping by the office, it is also conceivable to distribute non-communication type alcohol detectors 30 to users and collect the detection results from the alcohol detectors 30 using a different means of communication. The present invention provides an alcohol check method that can handle both of the above cases, as well as the case in which an alcohol detector 30 with communication capabilities is used.

[0036] The car key 40 is the car key used to start vehicle 1. It is usually kept in the office, and in order to use vehicle 1, the car key 40 must be retrieved from its location. The car key 40 is associated with the identification information of the corresponding vehicle, and in this embodiment, the identification information is encoded (for example, a one-dimensional code, a two-dimensional code, etc., but the encoding method is not particularly limited) and a sticker is affixed to the car key 40. In this embodiment, a user who takes out the car key 40 in the office will determine that it is an alcohol check related to vehicle 1 by pointing the imaging unit 170 of the information processing device 10 at the code attached to the car key 40 and capturing it.

[0037] Figure 4 is a block diagram showing the functional configuration of the checker device 50 in Figure 1. In this embodiment, the checker device 50, like the information processing device 10, may be an electronic device such as a tablet or laptop PC, not limited to it, and may be configured to include, for example, a control unit 510, a storage unit 520, a communication unit 530, a display unit 540, an input unit 550, an audio output unit 560, an imaging unit 570, and an audio input unit 580. Furthermore, the details of each of these functional units may be the same as those of the information processing device 10, so their explanation will be omitted. In addition, in this embodiment, it is assumed that there is at least one of the checker device 50a installed in office A where the information processing device 10 is installed, and the checker device 50b installed in office B, which is different from office A.

[0038] The checker device 50 is installed, for example, in an office, and is associated with a checker who verifies the results of an alcohol check performed by a user. In this case, being associated means that it is possible to assume that the checker is using the checker device 50, for example, by logging in with a checker account on the checker device 50, or simply by it being a checker device 50 assigned to each checker (for example, the checker is loaned the checker device 50 by the company), but the form is not particularly limited.

[0039] Furthermore, as described above, there may be multiple checker devices 50, such as checker device 50a installed in office A and checker device 50b installed in office B. Also, the installation location of the checker device 50 is not limited to offices; it can be placed in any location that a checker can use, such as a home, a shared office, or an office of a different company. In addition, a checker device 50 may be prepared and associated with each of the multiple checkers, or multiple checkers may be associated with a single checker device 50. Furthermore, one checker may be able to use multiple checker devices 50. However, in this case, it is preferable that one of the multiple available checker devices 50 is associated with the checker in order to specify which checker device 50 to use at that time.

[0040] [First step related to alcohol checks upon boarding a vehicle] Figure 5 is a flowchart showing an example of the process when an alcohol check is performed before the user boards vehicle 1 in this embodiment. The processing shown in the flowcharts of Figure 5 and other figures is realized, for example, when the control unit 210 of the server 20 reads the code of the information processing program stored in the memory unit 220 into a RAM (not shown) and executes it. The execution entity is not limited to the control unit 210; for example, it may be the control unit 110 of the information processing device 10 or the control unit 510 of the checker device 50, or the control units 110, 210, and 510 may cooperate to perform the processing.

[0041] In the flowcharts of Figure 5 and other figures, each symbol S represents a step. Furthermore, the flowchart described below is merely an example of the information processing procedure in this embodiment, and other steps may be added or some steps may be deleted.

[0042] As a prerequisite, the first alcohol check-related processing when boarding a vehicle is performed before boarding the vehicle. Here, in this embodiment, "boarding a vehicle" may refer not only to simply boarding a vehicle, but also to the first time a user boards a vehicle at a predetermined time interval (for example, one day). The timing of the alcohol check is not limited to before boarding the vehicle and after disembarking from the vehicle as described in this embodiment, but may be at any time. Furthermore, the alcohol check-related processing programs stored in the respective storage units of the information processing device 10, server 20, and checker device 50 are read and executed, thereby performing at least a part of the first alcohol check-related processing.

[0043] First, the user picks up the car key 40 corresponding to the intended vehicle, vehicle 1, and approaches the tablet, which is an information processing device 10, located in the office. To identify the vehicle the user is about to use, the user points the code attached to the car key 40 at the information processing device 10, and the imaging unit 170 of the information processing device 10 acquires and analyzes the code. The code contains the identification information of the corresponding vehicle, vehicle 1, and by analyzing the code, the identification information of vehicle 1 is obtained, and vehicle 1 corresponding to the car key 40 is identified (S1001). This is done using a user interface as shown in Figure 6. In this user interface, the imaging unit 170 captures the QR code (registered trademark) attached to the car key 40, which is placed in front of the information processing device 10, and obtains the vehicle identification information, which is the information corresponding to the captured QR code.

[0044] Subsequently, for user authentication, for example, a facial image is used for authentication. The user points their face towards the tablet, and the imaging unit 170 captures a facial image, which is then recognized and authenticated (S1003). User information is obtained after user authentication. This is done using a user interface as shown in Figure 7. Similar to the example shown in Figure 6, this user interface uses the imaging unit 170 to capture the face of a person in front of the information processing device 10, determines whether user information corresponding to the captured face image exists in, for example, the storage unit 220 of the server 20, and retrieves the user information if it exists. If, as a result of analyzing the face image, user information cannot be obtained for reasons such as not being able to identify the corresponding user information or the corresponding user information not existing, the process may be terminated or the user may be prompted to acquire the face image again.

[0045] Once user authentication is complete, a process is performed to select the person who will perform the alcohol check, i.e., the checker (S1005). Details of this process will be described later. Then, a call is made to the checker device 50 associated with that person, and when the checker device 50 responds to the call, for example, when the called checker device 50 inputs an indication that it agrees to perform the alcohol check, a video call is established between the information processing device 10 and the checker device 50 (S1007).

[0046] During a video call, information acquired by the imaging unit 170 and audio input unit 180 of the user's information processing device 10 is transmitted to the checker's device 50 and output by the display unit 540 and audio output unit 560 of the checker's device. Information acquired by the imaging unit 570 and audio input unit 580 of the checker's checker's device 50 is transmitted to the information processing device 10 and output by the display unit 140 and audio output unit 160 of the information processing device 10. This enables communication between the user and the checker via video and audio. Furthermore, this video call allows the checker to interact with the user, confirming the user's facial expression, the tone of their voice in response, and verifying the measurement results from the alcohol detector.

[0047] In this case, it is preferable to use the establishment of a video call as a trigger to start recording (e.g., encoding) all or part of the information acquired by at least one of the imaging unit 170, audio input unit 180, imaging unit 570, and audio input unit 580, which constitutes the communication content of the video call, and to acquire this as image and audio information of the alcohol check and record it in the storage unit 220 of the server 20. As will be described later, when storing the information, the acquired image and audio information is stored in association with the alcohol check result information. The acquired and stored image and audio information may take the form of, for example, image and audio information of the user's alcohol check situation acquired by the imaging unit 170 and the audio input unit 180, or image and audio information of the user's alcohol check situation acquired by the imaging unit 170, the audio input unit 180 and the audio input unit 580, as well as audio information of the checker during the check, or image and audio information of the user's alcohol check situation acquired by the imaging unit 170, the audio input unit 180, the imaging unit 570 and the audio input unit 580, as well as image and audio information of the checker during the check. This configuration makes it possible to reconfirm the circumstances of the alcohol check later. In particular, in a configuration in which the image information and voice information of the user, as well as the voice information of the checker, are stored while excluding the image information of the checker, it is possible to reconfirm at least the user's actions and voice, as well as the checker's voice, during the alcohol check while reducing the amount of storage required. Furthermore, in a configuration in which the voice information of the checker is also excluded, and only the image information and voice information of the user are stored, it is possible to reconfirm at least the user's actions and voice during the alcohol check while further reducing the amount of storage required.

[0048] Furthermore, when storing the acquired image and audio information, the system may store the image and audio information itself acquired by at least one of the imaging unit 170, the audio input unit 180, the imaging unit 570, and the audio input unit 580, or it may store information obtained by processing the acquired image and audio information. Here, "processing" is not limited to any specific type, but examples include shortening the length, reducing the resolution or frame rate, deleting either image or audio information, extracting only the image and audio information that shows the main parts (e.g., the user's face or an alcohol detector), or combinations thereof, in order to reduce the capacity occupied by the memory unit 220. In other words, any method of reducing the amount of data that allows the necessary information to be confirmed when referenced later is sufficient, and the specific form of "processing" is not particularly limited.

[0049] Subsequently, the user performs an alcohol check so that the information processing device 10 can capture the process. The imaging unit 170 captures images of the alcohol check and acquires image information, while the audio input unit 180 captures audio from the alcohol check and acquires audio information. This image and audio information is also displayed to the checker device 50 via video call (S1009). The alcohol check process refers to the user's actions during the alcohol check, and preferably includes actions such as blowing breath into the sensor of the alcohol detector 30, displaying measurement results on the alcohol detector's display, and responding to calls from the checker. In this case, a user interface such as the one shown in Figure 8 is used. As shown in Figure 8, the left side of the display unit 140 shows the user performing the alcohol check in front of the information processing device 10, as captured by the imaging unit 170, and the left side of the display unit 140 shows the checker standing in front of the checker device 50, as captured by the imaging unit 570. The user's appearance, as captured by the checker device 50, is also displayed on the display unit 540, and at the same time, the surrounding sounds of the information processing device 10, captured by the voice input unit 180, are output by the voice output unit 560. This allows the checker to understand the user's appearance while performing the alcohol check, and, if necessary, to call out to the user via the voice input unit 580, etc., and confirm their response.

[0050] Furthermore, the results of the alcohol check are accessed using a user interface as shown in Figure 9. Similar to Figure 8, the left side of the display unit 140 shows the content of the measurement result displayed by the alcohol detector captured by the imaging unit 170, and the string "0.00 mg / L" which is the result of image analysis of that content. The right side of the display unit 140 shows the appearance of the checker in front of the checker device 50, as captured by the checker device 50. In other words, the character information or numerical information of the measurement result (hereinafter referred to as "measurement result information") is obtained and displayed by analyzing the image of the captured measurement result to read the displayed characters. It is also preferable that this measurement result information is stored in association with the check result information described later. Furthermore, the method for acquiring measurement result information displayed by the alcohol detector is not limited to image analysis. For example, the measurement result from the alcohol detector may be acquired by a checker who confirms the content displayed on the display unit 540 and inputs the measurement result information into the checker device 50. Alternatively, the confirmation of the content and input of the measurement result information may be performed by a person other than the checker, using a separate device connected to the network NW, rather than the checker device 50.

[0051] Here, the alcohol detector 30 may be equipped with a communication unit (not shown) and connect directly or indirectly (for example, via a smartphone owned by the user) to the information processing unit 10, the checker device 50, or the server 20, thereby transmitting the measurement results to the information processing unit 10, the checker device 50, or the server 20. In this way, it is possible to omit capturing the measurement results with the imaging unit 170 and analyzing the image, or for the checker to input the measurement results. The method of communication with the alcohol detector 30 in this case is not particularly limited and may be either wired or wireless. If wireless, it may be, for example, Bluetooth® or Wi-Fi®, or mobile communication such as LTE (Long Term Evolution) or 3G.

[0052] The checker observes the user's alcohol check status displayed on the display unit 540 of the checker device 50, evaluates the measurement results of the alcohol detector (for example, showing a numerical value indicating that there is enough alcohol in the breath to be considered intoxicated), checks for any problems with the user's complexion or any abnormalities in their response, and inputs the evaluation information of the check results into the checker device 50 (S1011). This evaluation information of the check results includes, for example, "OK," which indicates that no intoxication was detected in the alcohol detector results and there were no problems with the response, or "NG," which indicates that intoxication was detected in the measurement results or there were problems with the response.

[0053] When the checker inputs the check result information, which is the content of the checker's judgment, they do so using a user interface like the one shown in Figure 10. As shown in Figure 10, the display unit 540 of the checker device 50 displays the user's alcohol check, captured by the information processing device 10, in the center. Below it, there is a checkbox to select whether the alcohol check result was good or bad (select OK or NG), and a comment field to input any points of concern during the alcohol check as text. Figure 11 shows an example of a user interface when the user is presented with the results of an alcohol check performed by an alcohol detector. In Figure 11, in addition to the elements shown in Figure 10, the measured value obtained from image analysis of the measurement result by the alcohol detector is also presented, and the person performing the check has selected "OK" in the check result information and entered the comment "No abnormalities". This information is then stored in the storage unit 220 as check result information and may also be transmitted to the information processing device 10 and displayed.

[0054] If the check result information is "NG" (S1013; NG), that is, if the measurement result indicates intoxication or there is a problem with the response, an alert is sent to the information processing device 10 (S1014). The method of notifying the user of an alert is not particularly limited as long as it notifies the user that there is a problem, but examples of methods include displaying a problem on the display unit 140 of the information processing device 10 or outputting a sound such as a beep from the audio output unit 160. Alternatively, the display unit 140 or audio output unit 160 of the information processing device 10 may output a message indicating that there was a problem during the alcohol check. In other words, the output content is not particularly limited as long as it allows the user to recognize the check results made by the checker.

[0055] If the evaluation information of the check result is "OK" (S1013; OK), that is, if the alcohol detector results show no signs of intoxication and the response is evaluated as having no problems, then, for example, an output indicating that there were no problems in the alcohol check will be made by the display unit 140 or the voice output unit 160 of the information processing device 10. As with the above, the content of the output is not particularly limited as long as it is an output that allows the user to recognize the check result made by the checker. This allows users to see the results of their alcohol test.

[0056] Then, the video call between the user and the checker established in step S1007 is disconnected (S1015). Preferably, the acquisition of image and audio information is terminated when the video call is disconnected, or when input is received by the user or checker upon completion of the alcohol check. Subsequently, the check result information obtained by the checker in step S1011 is associated with the time information obtained by a time information acquisition unit (not shown) and the user information obtained in step S1003, and stored in the storage unit 220 of the server 20 (S1017). At this time, it is preferable to also obtain checker information (for example, the checker's name or an ID that can uniquely identify the checker) which is the identification information of the checker who performed the check, and store it associated with the check result information. It is also preferable to store the fact that it is an alcohol check while boarding a vehicle. Furthermore, the vehicle identification information obtained in step S1001 and the acquired image and sound information may also be stored associated with the information.

[0057] Following the above flow, the first process related to alcohol checks upon boarding the vehicle is completed. After that, the user boards vehicle 1 while holding the car key 40 and begins using vehicle 1. Of course, if a user has problems during the alcohol check, it may be decided that they will not be allowed to board the vehicle based on the checker's findings.

[0058] By doing this, the results of the alcohol test can be stored in a convenient memory.

[0059] [Selection process for checkers] The following describes the process of selecting a checker, which takes place in step S1005. Figure 12 is a flowchart showing an example of the process when performing the checker selection process in this embodiment. The checker selection process involves selecting a checker, who is a person who will check the user's alcohol check via video call and observe their facial expression and tone of voice. Preferably, the checker is a manager, such as a designated safety driving manager or operations manager. However, if it is difficult for such a manager to perform the check, another person, such as a deputy manager, manager's assistant, or performance assistant, will act as the checker. Therefore, the objective is to select a checker who is appropriate and capable of performing the check when a user performs an alcohol check.

[0060] First, the administrator determines whether they are able to perform the check (S10051). For convenience, the administrator here refers to a person who should take priority in performing alcohol checks, such as a person who is responsible for managing alcohol checks. Whether or not the administrator is able to perform the check means that the administrator is able to perform the check, for example, when the checker device 40 associated with the administrator makes a call to the administrator via an app or the like, and the administrator responds that they are able to perform the check. Conversely, if there is an input indicating that the administrator is not able to perform the check, or if there is no response to the call within a specified time (for example, 15 seconds), it is determined that the administrator is not able to perform the check. If checking is possible (S10051; Y), the administrator is designated as the checker (S10052), and the checker selection process is terminated.

[0061] If it is not possible to perform the check (S10051;N), the list of candidate checkers 221 stored in the storage unit 220 of the server 20 is referred to, and a person to be the checker is tentatively determined (S10053). Figure 13 shows an example of a checker candidate list 221. As shown in Figure 13, the checker candidate list 221 consists of elements such as a number, name, terminal information, and schedule availability. The number is a number assigned to each checker candidate, and may simply indicate some order (e.g., registration order, alphabetical order) or a priority order. The name is the name of the checker candidate (mmm, nnn, ooo). Alternatively, any information that can identify the checker candidate may be used instead of a name, such as a checker candidate ID or nickname. The terminal information is information that can identify the checker device 50 associated with each checker candidate, and may include, for example, a terminal name (a, b, c), MAC address, IP address, etc. Furthermore, this terminal information is not fixed to the name, and it is preferable that it be changed as appropriate in response to changes in the checker device 50 used (i.e., associated with) by the checker candidate. For example, when a candidate checker logs into a checker device 50, the terminal information is updated to include information that identifies the logged-in checker device 50. Schedule availability indicates whether the candidate checker's schedule is free at that time. For example, the system checks whether there are any other appointments for a predetermined period (e.g., 15 minutes) from the current time by referring to the candidate checker's schedule information (e.g., information from the scheduling application installed on the checker device 50 corresponding to the terminal information). If the candidate is free, they are tentatively selected as a checker; otherwise, they are excluded from the tentative selection of checkers. Furthermore, in the list of potential checkers 221, instead of using information on available schedules as an element, the schedule information of each checker may be used as an element. In other words, there are no particular limitations as long as the element allows for determining whether alcohol testing is possible at that time.

[0062] As a method for tentatively determining the person to be the checker, for example, the checker candidate list 221 is referred to, and a checker candidate with an available schedule is extracted from the list of checker candidates. According to the example of the checker candidate list 221 shown in Figure 13, it can be seen that person mmm and person ooo are available in terms of schedule. In this case, either person mmm or person ooo may be tentatively determined as the checker at random, or person mmm, who has the lower number, may be tentatively determined. Alternatively, information about person mmm and person ooo may be displayed on the display unit 140, and the user may be asked to select one of them as the checker, and the tentative determination may be made based on that input.

[0063] Once a checker is tentatively determined, it is determined whether the tentatively determined checker is capable of performing the check (S10055). The determination of whether or not the checker is capable is the same as in step S10051. If the checker is capable (S10055; Y), the tentatively determined checker is confirmed as the checker (S10056), and the checker selection process ends. If the checker is not capable (S10055; N), the tentatively determined checker is excluded based on the checker candidate list 221, a new checker is tentatively determined (S10057), and the process returns to step S10055.

[0064] By doing so, the process can be designed to prioritize the selection of managers as checkers, and if it is difficult for managers to perform the checks, alcohol checks can be carried out by appropriate non-managerial checkers.

[0065] [First step related to alcohol checks upon exiting a vehicle] Next, we will explain the procedure for alcohol checks when exiting a vehicle. In this embodiment, "disembarking from the vehicle" is not limited to simply getting out of the vehicle, as in "boarding the vehicle," but may also refer to the last time the user disembarks from the vehicle on a daily basis. Figure 14 is a flowchart showing an example of the process when an alcohol check is performed after the user has exited vehicle 1 in this embodiment.

[0066] First, the user authenticates with the tablet (S2001). The user authentication method is the same as in step S1003. Next, based on the authenticated user information, the system refers to the information stored in the storage unit 220 of the server 20 to determine that the user had undergone an alcohol check upon entering a vehicle on the same day, and to identify the vehicle they were in (S2003). In other words, while alcohol checks upon entering a vehicle required identifying the vehicle, such as reading the code attached to the car key 40, upon exiting the vehicle, it was sufficient to read the information registered during the corresponding vehicle entry. Of course, a step to identify the vehicle by reading the code attached to the car key 40 may be performed after or before step S2001, or the user may be asked to input whether it is vehicle entry or vehicle exit.

[0067] Furthermore, "having undergone an alcohol check immediately before boarding the vehicle" means that, by referring to the user's alcohol check history, it was recorded that the most recent alcohol check was performed upon boarding the vehicle. In addition, if there is no record of an alcohol check being performed upon boarding or alighting the vehicle, it may also be considered that an alcohol check was performed immediately before boarding the vehicle if the vehicle has been identified once and then not identified again, i.e., if it can be inferred that the vehicle is in use. Furthermore, if user authentication is performed before vehicle identification when boarding a vehicle, the system may refer to the information stored in the storage unit 220 and, if it confirms that the user had not undergone an alcohol check immediately before boarding the vehicle, proceed with the vehicle identification procedure.

[0068] The subsequent steps S2005 to S2017, including the subroutine in step S1005, are the same as steps S1005 to S1017 in the first alcohol check-related processing when boarding a vehicle, so their explanation will be omitted. In step S2017, the check result information is stored in the storage unit 220 in association with time information and user information. It is preferable to also store in association that the alcohol check was performed upon exiting the vehicle.

[0069] After following the above steps, the first process related to alcohol checks upon exiting the vehicle is completed. It is preferable to return the car key 40 to its designated location within the office.

[0070] [Final confirmation process of check results] Alcohol checks should ideally be conducted by a manager; however, if the manager is unable to perform the check, a non-manager will be assigned to do so. Here, the non-manager is not limited to being from the same company as the manager; they may belong to a different company. In other words, outsourcing the check to an external company is also a possibility. Therefore, in cases where an alcohol check is performed by a non-manager, the manager will re-examine the check results and make a final judgment on whether or not there were any problems.

[0071] This section explains the final verification process for the check results. Figure 15 is a flowchart showing an example of the final confirmation process of the check results in this embodiment. First, the administrator logs into the checker device 50 and launches an application for performing the final confirmation of the check results. The method of launching this application is not particularly limited; for example, it may be implemented by software installed on the checker device 50, or it may be implemented by accessing a predetermined address on the server 20 via a web browser. In conjunction with the launch of the application, the control unit 210 extracts from the check result information stored in the storage unit 220 that shows alcohol checks performed by non-administrators (S3001). Then, the extracted check result information is displayed on the display unit 540 (S3003). At this time, information associated with the check result information may also be displayed.

[0072] Here, before step S3001, a notification may be sent to the administrator or the checker device 50 associated with the administrator prompting them to perform a final check of the check result information that is the subject of the final confirmation process. The form of the notification is not particularly limited, but for example, a notification may be sent to the administrator's email address stating that there is still check result information that requires final confirmation processing, or a link to launch the application, or a notification may be sent on the application installed on the checker device 50 associated with the administrator stating that there is still check result information that requires final confirmation processing. Furthermore, this notification may be given at any time, at a predetermined time (for example, every day at 10:00 a.m.), or when the check result information that should undergo final verification processing meets predetermined conditions. These predetermined conditions include, for example, when a predetermined amount of time (for example, one week) has elapsed since the time information associated with the oldest check result information that should undergo final verification processing, or when a predetermined number or quantity of such check result information has been accumulated.

[0073] An example of the interface displayed on the display unit 540 in step S3003 is shown in Figure 16. As shown in Figure 16, for example, this interface includes, for each alcohol check opportunity, an identification ID (No.), the date and time the alcohol check was performed, the name of the person who performed the check at the alcohol check opportunity, an address (or link) to access a video file of the alcohol check situation (i.e., image and audio information of the alcohol check situation), the measured value from the alcohol detector (i.e., measurement information), check result information (OK or NG), and final confirmation information, which displays a checkbox indicating that the administrator has made the final confirmation. Note that some parts of the check result that say OK or NG are underlined, which indicates that in addition to the check result, there is a comment from the person who performed the check, and this comment can be viewed by clicking on it (Figures 17 and 18).

[0074] In this case, when displaying check result information that has not undergone final confirmation, it is preferable to display check result information that has been elapsed for a predetermined time (for example, 3 days) from the time in the associated time information in a different display manner than check result information that has not yet been elapsed. This approach facilitates the final confirmation of check results information that has been checked by non-administrators some time ago.

[0075] Furthermore, as described above, in this embodiment, it is possible to access image and audio information regarding the alcohol check situation, and by selecting a link or performing other operations, it is possible to view the corresponding image and audio information. Figure 19 shows an example of what is displayed when image and audio information for an alcohol check opportunity with identification ID "3" is played. In this way, the checker can make a final confirmation of the check results by referring to the comments attached to the check results information, viewing related information such as videos of the alcohol check situation, and referring to the measurement device readings.

[0076] Once the administrator has finished reviewing the check result information, they check the check box in the final confirmation section (S3005). Checking the check box indicates that the final confirmation of the check result information is complete, and the section displaying the check result information and related information is displayed in gray. Consequently, the image and audio information of the alcohol check situation is deleted from the storage unit 220 (S3007). For example, in the example shown in Figure 19, for alcohol check opportunity No. 2, the final confirmation check box has already been checked, so the section displaying the check result information and related information is displayed in gray, and the link to access the alcohol check situation video has been deleted. Similarly, in the example shown in Figure 20, for alcohol check opportunity No. 3, the final confirmation check box has been checked, so the section displaying the check result information and related information is displayed in gray, and the link to access the alcohol check situation video has been deleted.

[0077] In step S3007, the image and audio information of the alcohol check status may be deleted immediately, or it may be deleted after a predetermined period of time (for example, 24 hours). That is, the information may remain available for confirmation for a predetermined period of time, anticipating that further confirmation may be necessary. Alternatively, instead of deleting the image and audio information of the alcohol check status, it may be made available for deletion. Making it available for deletion means, for example, making it available in a state similar to "putting it in the trash," allowing it to be deleted by an additional operation. In this case, it is preferable that the image and audio information of the alcohol check status associated with judgment information for which confirmation has not been completed is protected so that it cannot be deleted. Furthermore, in step S3007, the image and audio information of the alcohol check situation may be replaced with processed information. The method of processing the image and audio information here is not particularly limited, as long as it reduces the amount of data in a manner that allows the necessary information to be confirmed when it is referenced later, as described above.

[0078] After following the above steps, the final confirmation process of the check results is completed. Furthermore, since it is preferable to perform the final confirmation process of the check results as soon as possible after an alcohol check is performed by a non-administrator, if a predetermined time has elapsed since the oldest alcohol check performed by a non-administrator among the check result information for which the final confirmation process has not yet been performed, a push notification may be sent to the checker device 50 associated with the administrator prompting it to perform the final confirmation process of the check result information. Alternatively, for check result information for which a predetermined time has elapsed since the time an alcohol check was performed by a non-administrator and for which the final confirmation process has not yet been performed, the user interface displayed on the checker device 50 may be displayed in a different manner than the check result information for which the predetermined time has not yet elapsed, thereby prompting the user to perform the final confirmation of such check result information.

[0079] [Differentiation] In the above-described embodiment, a code corresponding to the vehicle is pre-attached to the car key 40, and the vehicle being used is identified by acquiring and analyzing the code in the information processing device 10. However, the identification method is not limited to this, and any method can be applied. For example, a code with character information that can identify the vehicle, such as the vehicle number, may be attached, and the vehicle being used may be identified by the user inputting that character information to the information processing device 10 via the input unit 150. Alternatively, an identification number may be attached to the place where the car key 40 is kept in the office (for example, a place to hang it on the wall with a hook, or a storage box), so that it is possible to identify which car key has been taken, and the user may input that identification number to the information processing device 10.

[0080] Furthermore, while the above-described embodiment uses facial image analysis for user authentication, the method of user authentication is not limited to this, and any method can be applied. For example, biometric authentication using fingerprints or voiceprints may be used, or authentication may be performed by having the user input an ID and password into the information processing device 10.

[0081] Furthermore, in the above-described embodiment, the measurement results from the alcohol detector are captured and analyzed via the imaging unit 170 to recognize the textual information of the displayed measurement results, and the alcohol check results are evaluated based on that content. However, the method of acquiring the measurement results from the alcohol detector is not limited to this, and any method can be applied. For example, the measurement results from the alcohol detector may be displayed on the display unit 540, the checker may input the measurement results through the input unit 550, and the input measurement result information may be stored in association with the check result information. Alternatively, the user may show the measurement results to the checker via video call, input the measurement results through the input unit 150 of the information processing device 10, and the input measurement result information may be stored in association with the check result information. In this case, it is preferable that the checker confirms the consistency between the input measurement result information and the content displayed on the display unit 540 via video call, for example, by uttering a voice message indicating consistency or by inputting an input indicating consistency to the checker device 50.

[0082] Furthermore, in the above-described embodiment, image and audio information is acquired using steps S1007 (S2007) and S1015 (S2015) as triggers, but the start and end timings for acquiring image and audio information are not limited to these, nor are the triggers for starting and ending the acquisition limited to these. For example, the acquisition of image and audio information may be started or ended by an input operation by the checker to the checker device 50, or by an input operation by the user to the information processing device 10. Moreover, the acquisition of image and audio information may be started after a predetermined time (for example, 10 seconds) has elapsed since the establishment of the video call in step S1007 (S2007). In addition, it is not limited to acquiring one image and audio piece, but it is also possible to acquire multiple image and audio pieces. For example, image and audio information recording the user's alcohol check may be acquired separately from image and audio information recording the alcohol check results.

[0083] Furthermore, for a predetermined period (e.g., 1 minute) from the establishment of a video call between the user and the checker in steps S1007 and S2007, input of the measurement result from the alcohol detector may not be accepted. Not accepting input of the measurement result from the alcohol detector means, for example, if the user inputs the measurement result from the alcohol detector, not displaying the user interface for input or displaying it as an input unavailable state; if the user inputs the measurement result from the alcohol detector by image analysis, not displaying the results of the image analysis or not performing the image analysis itself; and if the results are received by the information processing device 10 via communication from the alcohol detector, not displaying the received results or not receiving them at all. This prevents, for example, the misuse of alcohol measurement results from a third party conducted immediately before a video call and presenting them as the user's alcohol measurement result.

[0084] Similarly, the system may choose not to accept input of the alcohol check measurement result unless it is within a predetermined time (for example, within 1 minute) from the start of the measurement operation by the alcohol detector. Not accepting the measurement result means, for example, not displaying the user interface for input or displaying it as an input-disabled state, as described above, not performing image analysis of the measurement result captured by the imaging unit 170, invalidating the measurement result and displaying that fact on the display unit 140 or display unit 540, etc. In this way, the alcohol check can be carried out quickly and the measurement result corresponding to the observed measurement operation can be reflected. In this case, the information processing device 10 includes a measurement operation detection unit (not shown), which detects the measurement operation of the alcohol detector. For example, the measurement operation detection unit may detect the operation by analyzing an image of the alcohol check captured by the imaging unit 170, or by recognizing the user's voice during the alcohol check captured by the voice input unit 180 (for example, a voice saying "I will start measuring"), or by detecting that the measurement operation is started by an input from the user to the input unit 150. In addition, the person checking the measurement operation may determine whether a predetermined time has elapsed by inputting a trigger to start counting time based on the start of the measurement operation, or the person checking the time may start counting time when the start of the measurement operation is detected, and the method of detecting the trigger to start the time count is not particularly limited.

[0085] Furthermore, in the above-described embodiment, it is possible for a checker to perform an alcohol check using the checker device 50 located in Office B, which is different from Office A. However, Office B does not have to belong to the same company as Office A. In other words, the checker in an alcohol check may be a person belonging to a different company than the user or manager. Alternatively, given that people are working remotely, they may be working from home or a shared office instead of an office, and the location of the checker device 50 is not particularly limited.

[0086] Furthermore, the priority given to selecting checkers may be adjusted based on location information, such as which office they are in. For example, a checker candidate in office A may be given a higher or lower priority than a checker candidate in office B. This allows, for instance, when requesting checks from a company other than your own, you may choose to lower their priority to avoid them due to cost considerations, or conversely, give them a higher priority to encourage them to perform the checks objectively. Additionally, you may prioritize checkers who are your own employees during their working hours, or prioritize external individuals or companies requested to perform the checks outside of working hours, thus setting priorities that reflect a variety of intentions. For similar reasons, prioritization may be adjusted based on the attributes of each candidate checker (for example, whether they are an employee of the company, whether they have been appointed to actively perform the checking work, whether they have been designated to perform only a predetermined number of checks, etc.).

[0087] In this case, it is preferable that the list of candidate checkers 221 shown in Figure 13 further includes "Location Information" and "Attributes" fields, where information identifying the office to which each checker belongs or is located at that time, and the attributes of each checker are entered. For example, if a candidate checker belongs to or is located at Office A and has the attribute of being an employee of the company, "Office A" would be written in the "Location Information" field and "Company Employee" in the "Attributes" field. If a candidate checker belongs to or is located at Office B and has the attribute of being a member of a company contracting agency, "Office B" would be written in the "Location Information" field and "Member of Company Contracting Agency" in the "Attributes" field. By referring to such a list of candidate checkers 221, the location information and attributes of each candidate checker can be identified, and based on the identified location information and attributes, the priority of each candidate checker can be set.

[0088] Furthermore, while the above-described embodiment involves conducting a video call in a manner that allows the checker and the user to recognize each other, the method is not limited to this. For example, in a video call, the checker's image may not be displayed to the user, or the checker's image may be blurred, converted to an avatar, or another image may be displayed, so that the user cannot recognize who the checker is. Similarly, the content may be conveyed in a way that prevents the user from knowing whose voice the checker is, such as by modulating the checker's voice before outputting it, or converting it to text information and displaying it. In this way, by having the user conduct a video call in a manner that prevents the user from recognizing who the checker is, the user can perform the check without being influenced by any preconceptions or images they have of the checker or the checker's characteristics (title, affiliation, etc.).

[0089] Similarly, in a video call, the user's video may not be displayed to the checker, or the user's video may be blurred, converted to an avatar, or displayed as a different image, so that the checker cannot recognize who the user is. Likewise, the user's voice may be modulated or converted to text information so that the content is conveyed in a way that the checker cannot identify whose voice it is. In this way, by having the video call conducted in a manner that the checker cannot recognize who the user is, the checker can perform an objective check without being influenced by any preconceptions or images they have of the user or the user's characteristics.

[0090] Furthermore, while the above-described embodiment establishes a video call consisting of both video and audio between the user and the checker, the communication method is not limited to video calls. For example, a call may be made using only audio, or only video. In this case, in addition to the call, the checker's instructions and the user's responses may be displayed on the display unit 140 or display unit 540, or the checker's instructions and the user's responses may be output on the audio output unit 160 or audio output unit 560.

[0091] Furthermore, in the above embodiment, one checker performs the alcohol check on the user, but the number of checkers is not limited to one, and multiple checkers may perform the alcohol check in one go. For example, multiple checkers may check the user's facial expression and tone of voice and input the results, and if there are no problems in all of the check results from all checkers, it may be determined that there are no problems (i.e., N) in steps S1011 and S2011. Alternatively, the checks may be divided, with some check the facial expression and others check the tone of voice.

[0092] Furthermore, in the above-described embodiment, the process proceeds to the checker selection process after user authentication is performed in step S1003 or step S2001. However, before or after user authentication, it may be confirmed whether the user is getting into the vehicle for the first time that day, or whether the user has just finished their last driving opportunity of the day and disembarked from the vehicle. If either of these situations applies, the process may then proceed to the checker selection process. The method of this verification is not particularly limited. For example, the display unit 140 could display a message asking whether the user is about to board the vehicle for the first time that day, or has just disembarked from the vehicle after their last driving opportunity of the day, and the user could respond via the input unit 150. Alternatively, verification may be performed through voice communication between the user and the voice output unit 160 and the voice input unit 140. Furthermore, the determination may be made based on the time of user authentication. For example, if it is before 9:00 AM, it may be determined that the user is about to board the vehicle for the first time that day, and if it is after 5:00 PM, it may be determined that the user has just disembarked from the vehicle after their last driving opportunity of the day.

[0093] Alternatively, the process may begin by confirming whether the user is getting into the vehicle for the first time that day, or whether the user has just finished driving for the last time that day and has disembarked from the vehicle. If this is confirmed, the checker selection process may be performed. In other words, the process from steps S1005 to S1009, or from steps S2005 to S2009, may be performed without user authentication or vehicle identification. In this case, authentication may be performed when performing step S1009 or step S2009. For example, the user may be asked to enter a user ID and password, or the user's face image may be extracted from an image of the user during the alcohol check and authentication may be performed using the extracted face image, or some kind of biometric authentication method may be used. The authentication method is not particularly limited.

[0094] Furthermore, in the above-described embodiment, the checker selection process in step S1005 or S2005 is performed by selecting a checker based on whether the determined checker candidates are available to perform the check, but this method is not particularly limited. For example, the checker candidate list 221 may be referenced to display a list of checker candidates who are available on the schedule from among the checker candidates, and the user may select one from among them via the input unit 150. The checker may then be selected based on whether the selected checker candidate is available to perform the check. In this case, the information of the at least one checker candidate displayed may include not only their name but also information regarding their schedule and priority. Alternatively, instead of displaying information that identifies the checker, such as their name, the system could simply display a number corresponding to each checker. This would ensure that the selection of checkers is not biased and allow for objective alcohol testing.

[0095] Furthermore, in the above-described embodiment, the checker selection process in step S1005 or S2005 first determines whether the administrator is able to perform the check, and if not, a checker is selected from non-administrator checker candidates, but the embodiment is not limited to this. For example, if there are multiple administrators, an administrator checker list (not shown) may be used to tentatively determine which administrator will perform the check based on their availability, and then it may be determined whether they are able to perform the check. If possible, they may be selected as a checker; if not, a checker may be selected from among the other administrators. Also, for example, if there are no administrators, or if the administrators themselves do not perform alcohol checks but only perform the final confirmation process, step S10051 may be omitted and the process may start from step S10053.

[0096] Furthermore, in the above-described embodiment, it was preferred to store the acquired image and audio information in association with each other in steps S1017 and S2017. However, when a check is performed by a checker who is an administrator, the image and audio information may not be acquired, or the image and audio information may be processed as described above before acquiring it. By doing so, the capacity stored in the storage unit 220 and the like can be reduced.

[0097] Furthermore, although the above-described embodiment explained that the information processing device 10 is a device located in an office, the information processing device 10 is not limited to being a device located in an office. For example, the information processing device 10 may be a device such as a smartphone held by a user, and as long as it has an imaging unit 170 and an audio input unit 180 and is capable of acquiring at least one of the user's image information and audio information, and is capable of communicating with the server 20 and the checker device 50 to send and receive various types of data, its form is not particularly limited. For example, if an alcohol check cannot be performed at the office due to the user going directly to and from work or traveling for business, it is possible to perform the alcohol check using a familiar device such as the user's smartphone.

[0098] Furthermore, in the above-described embodiment, time information, user information, measurement result information, image and sound information, etc., are stored in association with the generated check result information, but the storage method is not limited to these. For example, time information may be used as the axis to store each piece of information in association, or user information may be used as the axis to store each piece of information in association, and the information used as the axis is not particularly limited as long as it can be identified later as to which check result information that the information corresponds to. Furthermore, instead of using a single piece of information as the central axis, multiple pieces of information may be used as the central axis to associate and store each piece of information. For example, check result information and time information may be associated and stored, while other information may be associated with either the check result information or the time information. In other words, as long as each piece of information is stored directly or indirectly in association with the check result information, the method of storing each piece of information is not particularly limited.

[0099] Furthermore, in the above-described embodiment, each process is performed through the cooperation of the information processing device 10, the server 20, and the checker device 50, but this is not limited to this. The role of the server 20 (for example, information storage, etc.) may be incorporated into the information processing device 10 or the checker device 50, and each process may be performed without the server 20.

[0100] [Second Embodiment] The following describes a second embodiment, which is another example of how to realize the information processing technology of the present invention. Furthermore, the contents described in this embodiment are applicable to any of the other embodiments, examples, and modifications, just as they are to the first embodiment.

[0101] In the second embodiment, unlike the first embodiment, the user and the checker each input the results from the alcohol detector and the results of the check regarding whether or not the user is intoxicated, respectively, into the alcohol check system. The configuration of the information processing device 10, server 20, alcohol checker 30, car key 40, and checker device 50 that constitute the system is the same as in the first embodiment, so the same reference numerals will be used for these, and detailed explanations will be omitted.

[0102] [Alcohol check related second processing] Figure 21 is a flowchart of the second alcohol check-related process, which is a second example of a process related to alcohol checking in this embodiment.

[0103] As a premise of the flowchart in Figure 21, communication has been established between the user using the information processing device 10 (the person being checked in the alcohol check) and the checker in the checker device 50 via video call or voice call, and they are able to communicate with each other. In this case, communication may be made on the alcohol check-related processing program described later, or it may be made by a program other than the alcohol check-related processing program (for example, a video call application or telephone). Furthermore, the alcohol check detector 30 does not have a communication function, or if it does, it is not used in this embodiment.

[0104] First, the user starts the first alcohol check-related processing program on the information processing device 10 (S3001). The first alcohol check-related processing program is a program that works in cooperation with the server 20 and the second alcohol check-related processing program started on the checker device 50 (described later) to perform the second alcohol check-related processing, which manages information related to alcohol checks, including the input of detector check information (described later). Furthermore, "starting" here refers, not exclusively, to the state in which the user is logged into the alcohol check-related processing program using their unique user ID. Similarly, the checker starts the second alcohol check-related processing program in the checker device 50 (S3201). The second alcohol check-related processing program is a program that works in cooperation with the first alcohol check-related program started in the server 20 and the information processing device 10 to perform a second alcohol check-related processing that manages information related to alcohol checks, including the input of response check information, which will be described later.

[0105] Then, the server 20 issues a token to the checker device 50 that has started the second alcohol check-related processing program (S3101). The token here is information such as a string that is generated in accordance with each expected alcohol check session, and is unique to each session. Furthermore, as will be described later, it is preferable that the token has an expiration date (for example, 3 minutes).

[0106] The issued token is then displayed on the display unit 540 of the checker device 50 (S3202). The checker, upon viewing the displayed token, notifies the user being checked of the token, for example, by verbal communication, through the established communication (S3203).

[0107] When the user receives a token notification from the checker (S3002), they input the notified token into the alcohol check-related processing program via the input unit 150 (S3003). In this case, as mentioned above, since the token has an expiration date, it is preferable that the input be made between the token issuance and the set expiration date.

[0108] The information processing device 10 transmits the input token to the server 20. Upon receiving the token transmitted from the information processing device 10, the server 20 determines whether the issued token matches the received token (S3102). If the tokens do not match (S3201; N), a new token is issued, and the user is prompted to repeat the same process. Alternatively, the display unit 140 of the information processing device 10 may display a message prompting the user to enter the correct token until the token's expiration date has passed, or the alcohol check-related second process may be terminated. In this case, if the correct token is not entered and the token's expiration date has passed, it is preferable to handle it in the same way as if the token did not match.

[0109] If the tokens match (S3201; Y), a session ID specific to each alcohol check session is issued, associated with the user ID (e.g., the user's login ID in the first alcohol check-related processing program) and the checker ID (e.g., the checker's login ID in the second alcohol check-related processing program) (S3103). Here, the session ID is preferably given an expiration date, and subsequent processing is managed by the session ID, based on the information generated through the exchange between the information processing device 10 and the checker device 50 whose tokens match, until the session ID expires. After the expiration date has expired, the information processing device 10 and the checker device 50 associated with the session ID will either not accept input, or, even if they accept input, will not store it and will treat it as invalid.

[0110] The display unit 140 of the information processing device 10 displays a user interface for inputting detector check result information, which is information about the user's alcohol detector check results, and prompts the user to input the detector check result information. Figure 22 is an example of a user interface displayed to prompt the user to input the detector check result information. Note that the input method is not limited to that shown in Figure 22. For example, as shown in Figure 22, when inputting detector check result information, a user interface is displayed for uploading an image of the detector in which the result was displayed.

[0111] The information processing device 10 then receives detector check result information from the user through the input unit 150 (S3004). The detector check result information to be input can be in any form as long as it allows the detector check result to be identified. For example, it may be an image of the detector with the result displayed, as described above, or the user may be asked to input a numerical value related to the detector check result (for example, an alcohol concentration value) through the input unit 150.

[0112] Upon receiving the detector check result information, the information processing device 10 transmits the input detector check result information to the server 20 (S3005). The server 20, having received the detector check result information, stores the detector check result information in the storage unit 220, associating it with the session ID (S3101).

[0113] Furthermore, when inputting an image displaying the results of a detector check, the input image may be analyzed using AI or other means, and the read information (e.g., characters, numerical values) may be stored in the storage unit 220 as detector check result information, associated with the user ID. If the image is unclear or otherwise deemed insufficient as detector check result information, the system may prompt the user to take another picture of the detector results and upload it. Alternatively, if a predetermined amount of time has elapsed, such as the session period ending, the system may prompt the user to perform another detector check, take a picture of the results, and upload them.

[0114] On the other hand, the checker device 50 receives input of response check result information, which is information relating to the results of the response check performed by the checker, through the input unit 550 (S3204). When inputting the response check result information, for example, a user interface for inputting the response check result information, as shown in Figure 23, is displayed on the display unit 540, prompting the user to input the response check result information.

[0115] Upon receiving the response check result information, the checker device 50 transmits the input response check result information to the server 20, and the server 20 stores the received response check result information in the storage unit 220 in association with the session ID (S3105).

[0116] In response to storing the response check result information, the server 20 notifies the information processing device 10 that the checker has completed their input, and the information processing device 10 displays this fact on the display unit 140 (S3005). In this way, the user can recognize that the checker's response has been completed.

[0117] Server 20 determines whether the session ID has expired, and if it has expired, it terminates the management of information using the session ID (S3106). If the expiration date has passed without the input of necessary information, such as detector check result information or response check result information, being completed, it is preferable for Server 20 to display a message on at least the display unit 140 of the information processing device 10 prompting the user to repeat the alcohol check.

[0118] Figure 24 shows an example of a data structure in a database that stores information for each session stored in the storage unit 220 of the server 20 by the first alcohol check-related processing program and the second alcohol check-related processing program.

[0119] As shown in Figure 24, for example, session ID 0001 was started at 09:01 on 2023 / 2 / 5, the corresponding checked person ID is U003, the checker ID is C001, the URL of the input image data is stored as the detector check result information, and "OK" is stored as the response check result information.

[0120] Furthermore, the fourth session, session ID 0004, started at 12:54 on 2023 / 2 / 5, with the corresponding subject ID being U017 and the checker ID being C002. However, the detector check result information and response check result information fields are blank, indicating that no information has yet been stored. This indicates that either an alcohol check was in progress at that time, or the session ended without the necessary information being entered. In the latter case, as mentioned above, it is preferable to have the display unit 140 display a message prompting the information processing device 10 to repeat the alcohol check.

[0121] This concludes the second step related to alcohol testing.

[0122] In this way, even when using an alcohol detector without communication capabilities, alcohol checks can be performed efficiently, and necessary information can be recorded. In particular, when using an alcohol detector with communication capabilities, it is not possible to track whether or not a checker actually existed. However, according to this embodiment, it is possible to manage and record information, including who the checker was.

[0123] [Differentiation] In this embodiment, tokens are issued and handled in the alcohol check-related processing program, but the embodiment is not limited to this. For example, token issuance and verification may be performed by a program separate from the first and second alcohol check-related processing programs. In this case, if a match is confirmed, it is preferable to automatically or manually input the result into the first or second alcohol check-related processing program to issue a corresponding session ID. For example, in a token-related program, when it is confirmed that the issued token matches the token transmitted from the information processing device 10, the program passes the result to the first alcohol check-related processing program or the second alcohol check-related processing program, or at least one of the information processing device 10 and the checker device 50 (preferably the checker device 50) makes an input to the alcohol check-related processing program confirming the match, thereby issuing a session ID.

[0124] Alternatively, identification information for both the user and the checker may be obtained without using tokens. For example, using a diagram like the one shown in Figure 25, based on the user inputting information to identify the checker from the information processing device 10, the corresponding checker device 50 may activate a second alcohol check-related processing program, and the checker may input response check result information.

[0125] In other words, the user remembers the person who will perform or has performed the check and inputs who that person was. When inputting the checker, a user interface for inputting the checker, as shown in Figure 25, is displayed on the display unit 140, and the user is prompted to input (or select) the checker. In response to this input, checker identification information, which is information that can identify the checker, is generated and sent to the server 20. The checker identification information may be, for example, a checker ID.

[0126] In Figure 25, it is also possible to select a legal entity such as a company instead of an individual as the checker. This is because, as explained in the first embodiment, it is possible to outsource the checking work to an external company, and this is intended to account for the case where the checking work is performed by an external company.

[0127] When the server 20 receives the checker identification information, it sends a program startup notification to the checker device 50 corresponding to that checker to start the second alcohol check-related processing program. Upon receiving the program startup notification, the checker device 50 starts the second alcohol check-related processing program if it is not already running. Alternatively, the display unit 540 of the checker device 50 may display a message prompting the user of the checker device 50 (checker) to start the second alcohol check-related processing program.

[0128] Similarly, the checker may remember the person being checked, or the person being checked, and input who that person was. In response to such input, person identification information, which is information that can identify the person being checked, is generated and sent to the server 20. The person identification information may be, for example, a person ID. Furthermore, upon receiving information identifying the person being checked, a program startup notification may be sent to the information processing device 10 corresponding to that person being checked to start the first alcohol check-related processing program.

[0129] Furthermore, in this embodiment, when a token match is confirmed based on the login information of the person being checked and the person checking for the alcohol check in the first alcohol check-related processing program and the second alcohol check-related processing program, the login information of both parties is associated with the session ID as identification information, but this is not limited to this embodiment.

[0130] For example, the checker does not need to be logged into the second alcohol check-related processing program. In this case, when requesting a token from the server 20, the checker's identification information is entered into the server 20, and the server 20's storage unit 220 stores the issued token in association with the checker's identification information. When a token match is confirmed, the server 20 reads the checker's identification information stored in association with the token and associates it with the session ID.

[0131] In the above case, the person being checked does not need to be logged into the first alcohol check-related processing program. In this case, when the checker inputs the notified token into the information processing device 10, the checker may also input their own identification information (not limited to, but for example, name or employee number) and send it to the server 20 along with the token. In this way, when the token match is confirmed, the identification information sent along with the input token may be associated with the session ID.

[0132] Similarly, for example, if the token issued by server 20 is issued to the person being checked, and the person being checked notifies the checker of the token, and the checker enters the token, the person being checked does not need to be logged into the alcohol check-related processing program. The following processes are the same as above.

[0133] Furthermore, in this embodiment, for the sake of explanation, the detector check result information is input first to the information processing device 10, and then the response check result information is input to the checker device 50. However, the order is not limited to this, and the response check result information may be input first, or the inputs may be accepted simultaneously. Furthermore, similar to how the checker device 50 displays a message indicating that the input of the response check result has been completed in step S3005, it is preferable that, in response to the input of the detector check result information being performed by the information processing device 10, the checker device 50 is notified, for example, via the server 20, that the user's input has been completed, and that this fact is displayed. In this way, the checker can recognize that the user's check response has been completed.

[0134] Furthermore, in response to the completion of inputting the detector check result information in the information processing device 10, the display unit 540 may display a prompt to input the response check result information in the checker device 50. The reverse is also true; in response to the completion of inputting the response check result information in the checker device, the display unit 140 may display a prompt to input the detector check result information in the information processing device 50.

[0135] Furthermore, the first alcohol check-related processing program for inputting and recording detector check result information and the first alcohol check-related processing program for inputting and recording response check result information may be separate or the same.

[0136] If they are separate, preferably the first alcohol check-related processing program and the second alcohol check-related processing program cooperate directly or indirectly. For example, once the input and recording of the detector check result information by the first alcohol check-related processing program is complete, a message indicating that the input of the detector check result information is complete and prompting the input of the response check result information may be displayed to the corresponding checker's account (e.g., email account, SMS account, messaging service account, etc.). The second alcohol check-related processing program may be started (or activated if it was in sleep mode) on the checker device 50 by the corresponding operation, enabling the input of the response check result information. Alternatively, the input may be made on the account (for example, by being presented with the question "Were there any problems with the response?" and selecting either "yes" or "no"), which may start or activate the second alcohol check-related processing program on the checker device 50, and information corresponding to the input (e.g., "yes" or "no", other remarks, etc.) may be passed to the second alcohol check-related processing program, thereby completing the input of the response check result information in the second alcohol check-related processing program. In the above description, it is certainly acceptable to swap the first alcohol check-related processing program and the second alcohol check-related processing program.

[0137] If they are identical, the alcohol check-related processing program (this designation applies when the first and second alcohol check-related processing programs are identical) operates in cooperation with the information processing device 10, the server 20, and the checker device 50, without the need to pass information between programs. For example, once the input and recording of the detector check result information is complete, a message may be displayed to the corresponding checker's account (e.g., email account, SMS account, messaging service account, etc.) indicating that the input of the detector check result information is complete and prompting the input of the response check result information. The corresponding operation may start (or activate if it was in sleep mode) the alcohol check-related processing program on the checker device 50, enabling the input of the response check result information. Alternatively, the input may be made on the account (for example, by being presented with the question "Were there any problems with the response?" and selecting either "yes" or "no"), which may start or activate the alcohol check-related processing program on the checker device 50, and the input of the response check result information may be completed when the information corresponding to the input (e.g., "yes" or "no", other remarks, etc.) is passed to the alcohol check-related processing program.

[0138] Furthermore, while it is preferable that an expiration date be set for the session ID, after the expiration date has passed, it is preferable that the corresponding information processing device 10 and checker device 50 will not accept input of information to the alcohol check-related processing program, or that any input information will be invalidated, until a new token is issued and a match is confirmed. If a match for a new token is confirmed after the expiration of the validity period, information management will be performed using a new session ID corresponding to that new token.

[0139] Furthermore, in this embodiment or its modified form, the alcohol check session is initiated by the input of detector check result information, the input of response check result information, or confirmation of token matching. However, the trigger for initiating the session is not limited to these, and any trigger can be set. For example, a session may be started as a trigger when both the user inputs a session start request in the information processing device 10 and the same session start request is received by the checker device 50. In this case as well, it is preferable to set an effective period based on the session start date.

[0140] Specifically, the two parties may share certain information (e.g., a password) in advance or at the start of the video call, and then, for example, both parties input this specific information into the first alcohol check-related processing program and the second alcohol check-related processing program, and the session may start when it is confirmed that the input information matches. In other words, in the case of a token, the server 20 issues the token, but in this modified example, the parties only need to agree on specific information beforehand.

[0141] Furthermore, in this embodiment, the checker device 50 inputs the response check result through a UI such as the one shown in Figure 23, but it is not limited to this. For example, the system may send a notification prompting the user to input response check result information via email, SNS applications, messaging applications, web applications, etc., and accept the input of response check result information (for example, by presenting a question such as "Were there any problems with the response?" and allowing the user to select either "yes" or "no" to input and send the information), thereby allowing the user to complete input through the checker device 50 to such an external application. Alternatively, the system may display a message on the display unit 540 via SMS or some other means prompting the user to use such a program, causing the user of the checker device 50 (presumably a checker) to launch the external application and input the information. In other words, the checking device 50 does not necessarily need to use the second alcohol check-related processing program; the input can be in any form as long as it can transmit response check result information to the server 20.

[0142] Furthermore, although this embodiment assumes that user identification information has been acquired by the first alcohol check-related processing program, processing may be started even if the identification information has not been acquired. In this case, for example, when inputting the detector check result information in step S3004, the user may take and upload an image that includes their own face when capturing the image of the result taken by the detector. Then, facial recognition processing may be applied to the uploaded image to identify the user who performed the alcohol check and associate the corresponding user ID with the session ID. The facial recognition method is not particularly limited and can be arbitrary.

[0143] If face recognition processing fails for reasons such as the uploaded face image being unclear, the face not being clearly visible, or the corresponding person not being identifiable, the system may prompt the user to take another picture and upload it, similar to the case where detector check results are uploaded. Alternatively, if a predetermined amount of time has elapsed, such as the session period ending, the system may perform another detector check and prompt the user to take a picture that includes both the results and their own face and upload it.

[0144] Furthermore, while the above-described embodiment assumes that alcohol checks are conducted, it may also be possible to extract information on when alcohol checks should have been conducted but were not, and notify administrators or other relevant parties of such information.

[0145] For example, vehicle 1 is equipped with a location information acquisition device (not shown) that periodically acquires location information of vehicle 1 via GPS information, etc., and periodically transmits the acquired location information to server 20 for storage. By comparing this location information with location information similarly acquired periodically in the location information acquisition unit (not shown) of the information processing device 10, it is possible to determine whether a user is riding in vehicle 1.

[0146] In this case, the system may determine whether an alcohol check was performed when the user boarded and when the user alighted, based on the user's boarding status at the time of the alcohol check. If an alcohol check was not performed, the system may immediately or at a predetermined time (for example, 9 a.m. the following day) notify the administrator of this fact via email or an alcohol check-related processing program to an administrator device (not shown) used by the administrator.

[0147] The timing of when users undergo alcohol checks is not limited to the above and may be at the user's discretion. For example, each user's schedule for using vehicle 1 could be registered on server 20, for example, via information processing device 10, and the timing of the first use of vehicle 1 and the end of use of vehicle 1 on a daily basis could be considered as the timing for an alcohol check. Alternatively, the timing of the alcohol check itself could be registered in the schedule.

[0148] Furthermore, it is preferable to verify whether the alcohol check was performed appropriately based on the information registered in the schedule, and if it was not performed (for example, if it is determined that neither the response check result information nor the detector check result information was stored within a predetermined time range (for example, within 1 hour) from the set alcohol check timing), to notify the user or administrator corresponding to that schedule that the alcohol check was not performed appropriately.

[0149] Furthermore, in this embodiment, information within the same alcohol check session (e.g., checker ID, person being checked ID, detector check result information, and response check result information) is managed by associating and storing it with the session ID as the axis, but this is not limited to this. For example, it is sufficient that at least the checker ID, person being checked ID, detector check result information, and response check result information within the same session are stored in association, and it is not necessarily required to involve the session ID. For example, the information could be managed by associating it with the date and time information at the start of the session as the axis, or the information could be managed by associating it with the pair of checker ID and person being checked as the axis.

[0150] Furthermore, in this embodiment, the system is configured to accept or record each piece of information (for example, detector check result information, response check result information) for a predetermined period after the session ID is issued. However, the system is not limited to this, and the predetermined period may be set at any time. For example, the predetermined period may be based on the time when the token is issued by the server 20, or it may be based on the time when any information (for example, either detector check result information or response check result information) is first received after the session ID is issued, or furthermore, the server 20 may store pre-configured schedule information for alcohol checks in its storage unit 220, and only accept or record each piece of information during the period corresponding to such schedule information.

[0151] Furthermore, the predetermined period for accepting or recording each piece of information is not limited to a fixed period based on a specific point in time. For example, if the predetermined period is set based on the time the token is issued, the predetermined period may be extended when a session ID is issued (for example, from 3 minutes to 5 minutes). Furthermore, the predetermined period may be extended again when any information is received for the first time after the session ID has been issued. In other words, a predetermined period may be set for the entire alcohol check session, or a detailed predetermined period may be set for each step, such as issuing a session ID or entering information, and if these are completed within the predetermined period, another predetermined period may be set for the next task that is expected to occur.

[0152] Furthermore, in this embodiment, the condition for starting a session is that the token issued by the server 20 matches the token input to the information processing device 10, but this is not the only condition. For example, the condition for starting a session may be that the token issued by the server 20 corresponds to the token input to the information processing device 10. Specifically, the content of the former may be a keyword that evokes the content of the latter (for example, "the highest mountain in Japan"), and if the content of the latter corresponds to that keyword (for example, "Mount Fuji"), the session may be started. In other words, the issued token and the input token do not necessarily have to match.

[0153] Furthermore, while the above-described embodiments are based on the premise of conducting alcohol checks, the concept of the present invention is not limited to alcohol checks. For example, it can be applied to any situation where visual confirmation is necessary when passengers get on or off a moving object (not limited to vehicles), such as vehicle inspections or driver roll calls.

[0154] Furthermore, in the above embodiments, various programs and data related to various processes are stored in the storage unit, and the processing unit reads and executes these programs to realize the processes in each of the above embodiments. In this case, the storage unit of each device may have recording media (recording media, external storage devices, storage media) such as memory cards (SD cards), CompactFlash® cards, Memory Sticks, USB memory, CD-RWs (optical discs), and MOs (magneto-optical discs), in addition to internal storage devices such as ROM, EEPROM, flash memory, hard disks, and RAM, and the above programs and data may be stored on these recording media.

[0155] Although embodiments and modifications of the present invention have been described in detail above, the scope of the present invention is not limited to the embodiments and modifications described above. Furthermore, the embodiments and modifications described above can be improved or modified in various ways without departing from the spirit of the present invention. In addition, the embodiments and modifications described above can be combined. [Explanation of symbols]

[0156] 1 vehicle 10 Information Processing Devices 20 servers 30 Alcohol Detectors 40 Car Keys 50 Checker device

Claims

1. A method for processing information related to alcohol checks, To obtain the identification information of the person performing the alcohol check and the person being checked, The first information processing device receives input of detector check result information, which is information regarding the alcohol detection result in the alcohol check. The second information processing device receives input of response check result information, which is information regarding the result of the response check regarding the presence or absence of alcohol in the alcohol check. The detector check result information, the response check result information, the identification information of the checker, and the identification information of the person being checked are stored in association with each other. Information processing methods, including those mentioned above.

2. The information processing method according to claim 1, A first program, which includes processing for inputting the detector check result information, is running on the first information processing device. The identification information of the person being checked corresponds to the login information of the person being checked in the first program. Information processing methods.

3. The information processing method according to claim 2, A second program, which includes processing for inputting the response check result information and works in cooperation with the first program, is running on the second information processing device. The identification information of the checker corresponds to the login information of the checker in the second program. Information processing methods.

4. The information processing method according to claim 1, In response to receiving the input of the detector check result information, the checker device outputs an output prompting the input of the response check result information. An information processing method that further includes the above.

5. The information processing method according to claim 1, In response to receiving the input of the response check result information, the first information processing device outputs a prompt to input the detector check result information. An information processing method that further includes the above.

6. The information processing method according to claim 1, The first information processing device accepts input of checker identification information, which is information that identifies the checker, It further includes, The identification information of the checker is obtained based on the checker identification information. Information processing methods.

7. The information processing method according to claim 1, The second information processing device accepts input of information identifying the person to be checked, which is information identifying the person to be checked. It further includes, The identification information of the person being checked is obtained based on the identification information of the person being checked. Information processing methods.

8. The information processing method according to claim 2, In response to receiving the input of the detector check result information, the second information processing device makes available a second program for processing including the input of the response check result information, or outputs a message prompting its use. An information processing method that further includes the above.

9. The information processing method according to claim 1, The first information processing device accepts input of first password information, The second information processing device accepts input of second password information, To determine whether the first password information and the second password information correspond, It further includes, Acceptance of the input of the detector check result information or the response check result information is permitted when it is determined that the first password information and the second password information correspond. Information processing methods.

10. The information processing method according to claim 1, To issue a first token corresponding to the alcohol check to the second information processing device, The first information processing device accepts input of a second token, To determine whether the first token and the second token correspond, It further includes, Acceptance of the input of the detector check result information or the response check result information is permitted when it is determined that the first token and the second token correspond. Information processing methods.

11. The information processing method according to claim 10, The first token is stored in association with the identification information of the checker, An information processing method that further includes the above.

12. The information processing method according to claim 10, An information processing method that includes receiving the input of the second token, which includes receiving the identification information of the person being checked.

13. The information processing method according to claim 1, To issue a first token corresponding to the alcohol check to the first information processing device, The second information processing device accepts input of a second token, To determine whether the first token and the second token correspond, It further includes, Acceptance of the input of the detector check result information or the response check result information is permitted when it is determined that the first token and the second token correspond. Information processing methods.

14. The information processing method according to claim 13, The first token is stored in association with the identification information of the person being checked, An information processing method that further includes the above.

15. The information processing method according to claim 13, An information processing method that includes receiving the input of the second token, which includes receiving the identification information of the checker.

16. The information processing method according to claim 10 or 13, The aforementioned permission is, At the point when it is determined that the first token and the second token correspond, At the time the first token is issued, At the time the aforementioned detector check result information is entered At the time when the aforementioned response check result information is entered, and The schedule information set for the person being checked, It is valid for a period set based on at least one of the following: Information processing methods.

17. The information processing method according to claim 10 or 13, A third program, which includes processing for issuing the first token and inputting the second token, operates in cooperation with the first information processing device and the second information processing device. The acquisition of the identification information of the checker and the identification information of the person being checked corresponds to the login information of the checker and the login information of the person being checked in the third program, respectively. Information processing methods.

18. The information processing method according to claim 1, The person being checked remembers information regarding when the alcohol check should be performed, To determine whether the detector check result information and the response check result information corresponding to the aforementioned timing are stored, If it is determined that neither the response check result information nor the detector check result information is stored, the person being checked shall be notified accordingly. An information processing method that further includes the above.

19. The information processing method according to claim 1, The aforementioned detector check result information is an image including a face and the display result from the detector, It further includes, The acquisition of the identification information of the person being checked is performed based on the results of facial recognition of the face. Information processing methods.

20. A system related to alcohol checks, An identification information acquisition unit that acquires the identification information of the person performing the alcohol check and the identification information of the person being checked, The first information processing device includes a first receiving unit that receives input of detector check result information, which is information relating to the alcohol detection result in the alcohol check, The second information processing device includes a second receiving unit that receives input of response check result information, which is information regarding the result of the response check regarding the presence or absence of alcohol in the alcohol check, A storage unit that stores the detector check result information, the response check result information, the checker's identification information, and the checked person's identification information in association with each other, Information processing device, including

21. A system including a first information processing device and a second information processing device related to alcohol checks, To obtain the identification information of the person performing the alcohol check and the person being checked, The first information processing device receives input of detector check result information, which is information relating to the alcohol detection result in the alcohol check, The second information processing device receives input of response check result information, which is information regarding the result of the response check regarding the presence or absence of alcohol in the alcohol check, The detector check result information, the response check result information, the identification information of the checker, and the identification information of the person being checked are stored in association with each other. A program that executes something.

22. A system including a first information processing device and a second information processing device, A user identification information identification unit identifies the user's identification information, which is the subject of the alcohol check, through the first information processing device. A communication establishment unit establishes communication between the first information processing device and the checker device associated with the checker performing the alcohol check, A user image and audio information output unit outputs user image and audio information, including image and audio information related to the user's alcohol check status, acquired by the first information processing device, to the second information processing device via the communication; An acquisition unit that acquires check result information, which is information regarding the results of the alcohol check, entered by the aforementioned checker, A storage unit that stores the aforementioned check result information in association with the user's identification information, A system equipped with these features.

23. The system according to claim 22, A checker image and voice information output unit outputs checker image and voice information, including the checker's image information and voice information acquired by the second information processing device, to the first information processing device via the communication; A system that further incorporates these features.

24. The system according to claim 23, The system outputs the image and audio information of the checker in a manner that does not allow the checker to be identified.

25. The system according to claim 22, A vehicle identification information acquisition unit that acquires identification information of a vehicle used or used by the user, Furthermore, The storage unit stores the acquired vehicle identification information in association with the check result information. system.

26. The system according to claim 22, A driving opportunity determination unit that determines whether the alcohol check is performed before the first vehicle boarding or after the last vehicle disembarking has been completed, Furthermore, The system includes a memory unit that stores the judgment result made by the driving opportunity judgment unit in association with the check result information.

27. The system according to claim 22, The system outputs the user image and voice information in a manner that does not allow the user to be identified.

28. The system according to claim 22, The system includes a storage unit that stores storage image and audio information, which includes at least a portion of the outputted user image and audio information, in association with the check result information.

29. The system according to claim 23, The system includes a storage unit that stores storage image and audio information, which includes at least a portion of the outputted user image and audio information, in association with the check result information.

30. The system according to claim 29, The system further includes at least a portion of the outputted voice information of the checker, in addition to the image-audio information for storage.

31. The system according to claim 29, The system further includes at least a portion of the outputted image information of the checker as the image information for storage.

32. The system according to claim 22, A data reduction unit acquires processed information that reduces the amount of data from the output user image and audio information, Furthermore, The system includes a storage unit that stores image and audio information for storage, including the processed information, in association with the check result information.

33. The system according to claim 23, A data volume reduction unit acquires processed information obtained by processing the output user image and voice information and the output checker's voice information to reduce the amount of data, Furthermore, The system includes a storage unit that stores image and audio information for storage, including the processed information, in association with the check result information.

34. The system according to claim 23, A data volume reduction unit acquires processed information obtained by processing the output user image and voice information and the output checker image and voice information to reduce the amount of data. Furthermore, The system includes a storage unit that stores image and audio information for storage, including the processing information, in association with the check result information.

35. The system according to claim 22, The checker selection department selects checkers from a group of checker candidates that includes multiple checker candidates, A system that further incorporates these features.

36. The system according to claim 35, The system includes a checker selection unit that determines whether a checker candidate identified from the checker candidate group based on predetermined conditions is capable of performing the check, and if it is determined that the checker candidate is not capable of performing the check, it selects a checker from the group of checker candidates excluding the checker candidate determined to be uncapable.

37. The system according to claim 22, A checker selection unit that selects the checker from a group of checker candidates that includes the manager and at least one non-manager in the alcohol check, A system that further incorporates these features.

38. The system according to claim 37, The aforementioned checker selection unit, The administrator will determine whether they are able to perform the check, If it is determined that the check can be performed, the aforementioned administrator will be selected as the checker. If it is determined that the check cannot be performed, the system will select a checker from among the aforementioned at least one non-administrator.

39. The system according to claim 37, When the checker selection unit selects a checker from among the at least one non-administrator, the notification unit notifies the administrator or the checker device associated with the administrator to prompt the selected checker to confirm the check result information. A system that further incorporates these features.

40. The system according to claim 37, When the checker selection unit selects a checker from among the at least one non-administrator, the deletion unit deletes the storage image and audio information associated with the check result information, in accordance with the confirmation of the check result information by the selected checker by the administrator. A system that further incorporates these features.

41. The system according to claim 37, When the checker selection unit selects a checker from among the at least one non-administrator, the setting unit sets the storage image and audio information associated with the check result information to be deletable, in accordance with the confirmation of the check result information by the selected checker by the administrator. A system that further incorporates these features.

42. The system according to claim 37, When the checker selection unit selects a checker from among the at least one non-administrator, the replacement unit replaces the storage image and audio information associated with the check result information with information that has been processed to reduce the amount of data, in accordance with the confirmation of the check result information by the administrator by the selected checker. A system that further incorporates these features.

43. The system according to claim 39, The notification unit is a system that notifies when check result information that has not been confirmed by the administrator meets predetermined conditions.

44. The system according to claim 37, When the checker selection unit selects a checker from among the at least one non-administrator, the check result information display unit displays, in a different display manner from the check result information for which the first predetermined time has elapsed from the time indicated by the associated time information, among the check result information by the selected checker that has not been confirmed by the administrator, on the checker device associated with the administrator. A system that further incorporates these features.

45. The system according to claim 22, A receiving unit that receives measurement result information, which is information regarding the measurement results obtained by the alcohol detector used in the aforementioned alcohol check, Furthermore, The system includes a storage unit that stores the measurement result information in association with the check result information.

46. The system according to claim 45, The reception unit does not accept input of the measurement result information during the period from when the communication is established until a second predetermined time has elapsed.

47. The system according to claim 45, A detection unit that detects when the user initiates an alcohol check, Furthermore, The reception unit is a system that does not accept input of the measurement result information after a third predetermined time has elapsed since the start of the alcohol check operation was detected.

48. The system according to claim 34, The aforementioned checker selection unit is a system that selects checkers based on the attribute information of each checker candidate in the checker candidate group.

49. The system according to claim 34, The aforementioned checker selection unit is a system that selects checkers based on the location information of each checker candidate in the checker candidate group.

50. The system according to claim 22, A checker information acquisition unit acquires checker information, which is the identification information of the checker, Furthermore, The system includes a memory unit that stores the checker information in association with the check result information.

51. An information processing device, A user identification information identification unit identifies the user's identification information based on input from the user who is subject to the alcohol check, A communication establishment unit that establishes communication with the checker device associated with the checker who performs the alcohol check, A user image and audio information acquisition unit acquires user image and audio information, including image and audio information related to the user's alcohol check status. A user image and audio information output unit outputs the acquired user image and audio information to the checker device via the communication, An acquisition unit that acquires check result information, which is information regarding the results of the alcohol check, entered by the aforementioned checker, A result output unit that outputs the result corresponding to the acquired check result information, An information processing device equipped with the following features.

52. A system including a first information processing device and a second information processing device, Through the first information processing device, the identification information of the user who is subject to the alcohol check is identified, To establish communication between the first information processing device and the second information processing device associated with the person performing the alcohol check, The first information processing device outputs user image and audio information, including image and audio information related to the user's alcohol check status, to the second information processing device via the communication. To obtain check result information, which is information regarding the results of the alcohol check entered by the aforementioned checker, The user's identification information is associated with and stored in relation to the aforementioned check result information. A program that executes something.

53. An information processing method in a system including a first information processing device and a second information processing device, Through the first information processing device, the identification information of the user who is subject to the alcohol check is identified, To establish communication between the first information processing device and the second information processing device associated with the person performing the alcohol check, The first information processing device outputs user image and audio information, including image and audio information related to the user's alcohol check status, to the second information processing device via the communication. To obtain check result information, which is information regarding the results of the alcohol check entered by the aforementioned checker, The user's identification information is associated with and stored in relation to the aforementioned check result information. Information processing methods, including those mentioned above.

Images