Illegal detection system, illegal detection device, illegal detection method, and recording medium

Abstract

In the illegal detection system (S), in a case where a detection object is detected by the detection device (40), a prescribed process is executed. The action determination unit (201) determines whether a prescribed action is performed by a user having the user terminal (20) before the detection object is detected. The illegal detection unit (103) executes illegal detection related to the user in accordance with the identification information stored in the user terminal (20) in a case where it is determined that the prescribed action is performed. The execution unit (303) executes a prescribed process in accordance with the execution result of the illegal detection in a case where the detection object is detected.

Description

Technical Field

[0001] This disclosure relates to illegal detection systems, illegal detection devices, illegal detection methods, and recording media. Background Technology

[0002] Previously, techniques for performing illegality detection related to users were known. For example, Patent Document 1 describes a technique in which a machine learning model learns from training data that takes user features as input and the user's legality determination result as output, and then uses the learned machine learning model to perform illegality detection.

[0003] Existing technical documents

[0004] Patent documents

[0005] Patent Document 1: International Publication No. 2019 / 049210 Summary of the Invention

[0006] The problem that the invention aims to solve

[0007] The inventors have researched systems that perform illegal detection in accordance with prescribed procedures when a detection object is detected using a detection device. One example of such a system is one that issues a code (an example of a detection object) to a user for access to a facility, and upon detecting the code displayed on the user's terminal using a code reader (an example of a detection device), performs a procedure to verify the legitimacy of the identification information contained in the code (an example of prescribed procedures).

[0008] In the system described above, it is necessary to shorten the time from detecting the target to completing the prescribed process. However, cases like those in Patent Document 1, where illegal detection is time-consuming, are common. Therefore, if illegal detection is performed after the target is detected, and the prescribed process is performed only after confirming that the user is not an illegal user, it will be very time-consuming.

[0009] One of the purposes of this disclosure is to shorten the time from detection of the target to completion of the prescribed processing, even if illegal detection is carried out.

[0010] Methods for solving problems

[0011] This disclosure discloses an illegal detection system that, upon detecting a target using a detection device, performs prescribed processing. The illegal detection system includes: an action determination unit that determines whether a user with a user terminal performed a prescribed action before detecting the target; an illegal detection unit that, upon determining that the prescribed action was performed, performs illegal detection related to the user based on identification information stored in the user terminal; and an execution unit that, upon detecting the target, performs the prescribed processing based on the execution result of the illegal detection.

[0012] Invention Effects

[0013] According to this disclosure, even if illegal testing is performed, the time from detection of the target to completion of the prescribed processing can be shortened. Attached Figure Description

[0014] Figure 1 This is a diagram illustrating an example of the overall structure of an illegal detection system.

[0015] Figure 2 This is a diagram illustrating an example of a user entering the facility in the first embodiment.

[0016] Figure 3 This is a functional block diagram illustrating an example of the functionality implemented in an illegal detection system.

[0017] Figure 4 This is a diagram illustrating an example of data storage in a user database.

[0018] Figure 5 This is a diagram illustrating an example of data storage in a facility database.

[0019] Figure 6 This is a diagram illustrating an example of data storage in the illegal detection queue.

[0020] Figure 7 This is a diagram illustrating an example of data storage for execution results.

[0021] Figure 8 This is a flowchart illustrating an example of the process performed in the first embodiment.

[0022] Figure 9 This is a diagram illustrating an example of a user entering the facility in the second embodiment.

[0023] Figure 10 This is a flowchart illustrating an example of the process performed in the second embodiment.

[0024] Figure 11 This is the function block diagram in the variant example.

[0025] Figure 12 This is an example of a user terminal screen showing the locational relationship between the user and the facility.

[0026] Figure 13 It is a diagram showing the orientation or posture of the user terminal in variant example (4). Detailed Implementation

[0027] [1. First Embodiment]

[0028] The following describes an example of a first embodiment of the illegal entry detection system of this disclosure. In the first embodiment, the illegal entry detection system is described using a scenario of a user entering a facility as an example. The illegal entry detection system can be applied to any other scenario. Other application examples are described in the variations described later.

[0029] [1-1. Overall Structure of the Illegal Detection System]

[0030] Figure 1 This is a diagram illustrating an example of the overall structure of an illegal detection system. (As shown...) Figure 1 As shown, the illegal detection system S includes a server 10, a user terminal 20, and a facility terminal 30. The server 10, user terminal 20, and facility terminal 30 are each capable of connecting to a network N, such as the Internet. Furthermore, in... Figure 1 The diagram shows one server 10, one user terminal 20, and one facility terminal 30, but there can be multiple of them.

[0031] Server 10 is a server computer. Server 10 is an example of an illegal detection device. Server 10 includes a control unit 11, a storage unit 12, and a communication unit 13. The control unit 11 includes at least one processor. The storage unit 12 includes volatile memory such as RAM and non-volatile memory such as a hard disk. The communication unit 13 includes at least one of a communication interface for wired communication and a communication interface for wireless communication.

[0032] User terminal 20 is a computer operated by a user. For example, user terminal 20 is a smartphone, tablet, wearable device, or personal computer. User terminal 20 includes a control unit 21, a storage unit 22, a communication unit 23, an operation unit 24, a display unit 25, a camera unit 26, and a GPS receiver unit 27. The physical structures of control unit 21, storage unit 22, and communication unit 23 may be the same as those of control unit 11, storage unit 12, and communication unit 13, respectively.

[0033] The operation unit 24 is an input device such as a touch panel. The display unit 25 is a liquid crystal display or an organic EL display. The photography unit 26 includes at least one camera. The GPS receiver 27 is a receiver that receives signals from satellites.

[0034] Facility terminal 30 is a computer configured in the facility. For example, facility terminal 30 is a tablet terminal, personal computer, or smartphone. Facility terminal 30 includes a control unit 31, a storage unit 32, a communication unit 33, an operation unit 34, a display unit 35, and a camera unit 36. The physical structure of control unit 31, storage unit 32, communication unit 33, operation unit 34, display unit 35, and camera unit 36 ​​may also be the same as that of control unit 11, storage unit 12, communication unit 13, operation unit 24, display unit 25, and camera unit 26, respectively.

[0035] The detection device 40 is connected to the facility terminal 30 via wired or wireless means. The detection device 40 is a device for detecting an object. The object being detected is the physical object being detected. The object can be tangible or intangible. The object can be of any type, such as an electronically displayed image, an image formed on a medium such as paper, a user's body part, an RFID tag, an IC chip (non-contact or contact type), or electronic data. The object can be detected by any detection method, such as optical detection methods, detection methods utilizing wireless communication, or detection methods utilizing sensor signals.

[0036] In the first embodiment, the detection object is described as the code displayed on the user terminal 20. Therefore, the location referred to as the code in the first embodiment can be replaced with the detection object. The code itself can be various standards, such as barcodes or QR codes. Code detection can also be called code reading. The code can be detected using a detection method corresponding to the standard.

[0037] The detection device 40 can be any device corresponding to the object being detected. For example, the detection device 40 can be a barcode reader, camera, scanner, biometric information reading device, sensor, RFID reader, IC chip reader, antenna, or computer capable of receiving electronic data. In the first embodiment, the detection device 40 is used for code detection and is located outside the user terminal 20. "Located outside" means not included in the housing. In the first embodiment, the detection device 40 is located outside the facility terminal 30, but it may also be included within the facility terminal 30. Furthermore, the code may be detected by the camera unit 36 ​​without the detection device 40. In this case, the detection device 40 can be omitted, and the camera unit 36 ​​is equivalent to the detection device of this disclosure.

[0038] Furthermore, the programs and data stored in storage units 12, 22, and 32 can also be provided via network N. Moreover, the hardware structures of server 10, user terminal 20, and facility terminal 30 are not limited to the examples described above, and various hardware can be applied. For example, it may include at least one of a reading unit (e.g., an optical disc drive, memory card slot) for reading computer-readable information storage media, and an input / output unit (e.g., a USB port) for inputting / outputting data with external devices. For example, at least one of the programs and data stored in the information storage media can also be supplied via at least one of the reading unit and the input / output unit.

[0039] [1-2. Overview of the First Embodiment]

[0040] In the first embodiment, the user causes the user terminal 20 to display the code required to enter the facility. When the user visits the facility and the detection device 40 reads the code, entry is permitted. The facility can be of any type, such as an event venue, stadium, station, airport, office building, test venue, polling station, cinema, art gallery, or public facility. For example, an application for displaying the code is installed on the user terminal 20. The user launches the application to display the code.

[0041] Figure 2 This diagram illustrates an example of a user entering the facility in the first embodiment. (See diagram below.) Figure 2 As shown, a user accesses a facility while holding a portable user terminal 20. For example, a staff member waits in the facility. The staff member prompts the user to display a code on the user terminal 20. The user launches an application on the user terminal 20, causing it to display the code and prompting the staff member.

[0042] like Figure 2 As shown in the enlarged version of the user terminal 20, in the first embodiment, the case of displaying both a barcode and a QR code will be described, but it is also possible to display only either the barcode or the QR code. In the following description, barcodes and QR codes will be referred to simply as codes without distinction.

[0043] The code contains an application ID stored in user terminal 20. The application ID is an example of identification information disclosed herein. Therefore, the location designated as the application ID in the first embodiment can be replaced with identification information. Identification information is information capable of identifying a user. In the first embodiment, the case where identification information is issued in a manner that does not repeat between users is described, but if the amount of identification information is small, it may also be repeated between users. Identification information is not limited to an application ID and can be any information. For example, identification information can be a user account (described later) or information referred to by other names. Identification information can be in any form, for example, expressed using numbers, characters, or combinations thereof.

[0044] exist Figure 2 In the example, the value "9000 0152 6619 8395" is the application ID. The application ID can be in any form, and may even contain characters. The code displayed on the user terminal 20 is an image obtained by encoding the application ID. Additionally, the code may contain information other than the application ID.

[0045] For example, before accessing the facility, the user installs the application on the user terminal 20 and completes the required usage registration. When the usage registration is completed, the server 10 issues a user account and password. The server 10 generates an application ID and sends it to the user terminal 20. The user terminal 20 receives the application ID and records it in the storage unit 22.

[0046] In the first embodiment, the application ID is updated each time the user displays the code. For example, the application ID is updated when the application is launched, when the application is switched back to background mode, when the application is switched to sleep mode after launch and then released from sleep mode, or when a specified update operation is performed while the application is launched. When the application ID is updated, the code displayed on the user terminal 20 is also updated.

[0047] When a user presents a code to staff, the staff uses detection device 40 to read the code. Facility terminal 30 extracts the application ID from the code and sends it to server 10. Server 10 verifies the validity of the application ID and sends a confirmation result to facility terminal 30. Facility terminal 30 displays the confirmation result received from server 10. After staff review the confirmation result and confirm its validity, they allow the user to enter.

[0048] As described above, in the first embodiment, a service is provided that allows access to a facility using a code. In such a service, malicious users sometimes illegally obtain other users' user accounts and impersonate them to enter the facility. Therefore, it is preferable to perform user illegitimate detection before entry into the facility, but as explained in the prior art, illegitimate detection is mostly time-consuming. Ensuring the accuracy of illegitimate detection takes even longer. Therefore, if the server 10 performs illegitimate detection after the detection device 40 reads the code, time will be spent until the user is allowed entry.

[0049] Therefore, in the illegal access detection system S, when the action of displaying a code to the user terminal 20 is performed, the server 10 performs illegal access detection. That is, in principle, the server 10 performs illegal access detection from the time the code is displayed on the user terminal 20 until the detection device 40 reads the code prompted by the user to the staff. Therefore, in principle, illegal access detection is completed when the detection device 40 reads the code, thus shortening the time until the user is allowed to enter. The details of this technology will be explained below.

[0050] [1-3. Functions implemented in the first embodiment]

[0051] Figure 3 This is a functional block diagram illustrating an example of the functions implemented in the illegality detection system S. The functions implemented in the server 10, user terminal 20, and facility terminal 30 are explained.

[0052] [1-3-1. Functionality Implemented in the Server]

[0053] like Figure 3 As shown, server 10 implements data storage unit 100, update unit 101, calculation unit 102 and illegal detection unit 103.

[0054] [Data Storage Department]

[0055] The data storage unit 100 is implemented based on the storage unit 12. The data storage unit 100 stores the data required for the processing described in the first embodiment. Among them, as examples of the data stored in the data storage unit 100, the user database DB1, the facility database DB2, the illegal detection queue Q, and the execution result data D will be described.

[0056] Figure 4 This is a diagram illustrating an example of data storage in user database DB1. (For example...) Figure 4 As shown, the user database DB1 is a database that stores information related to users. For example, the user database DB1 stores user accounts, passwords, user names, application IDs, and service usage history. When a user registers for service, a new record is generated in the user database DB1, storing information related to that user.

[0057] User account and password are the information required to log in to the service. Server 10 issues an application ID to the logged-in user. Each time the application ID stored in user terminal 20 is updated, the application ID stored in user database DB1 is also updated. Usage history is the past usage of the service. For example, it stores the date and time a user entered the facility, information that identifies the facility, and the location of user terminal 20 when the code was displayed, as usage history.

[0058] Figure 5 This is a diagram illustrating an example of data storage in the facility database DB2. (For example...) Figure 5 As shown, the facility database DB2 is a database that stores information related to facilities. For example, the facility database DB2 stores facility IDs, facility names, and location information. The facility ID is information that uniquely identifies the facility. The location information is information that identifies the location of the facility. For example, the location information includes at least one of the facility's address and dimensional precision (coordinates).

[0059] Figure 6 This is a diagram illustrating an example of data storage for the illegal detection queue Q. For example... Figure 6 As shown, the illegal detection queue Q contains data related to users waiting for illegal detection to be executed. For example, the illegal detection queue Q stores the execution order of illegal detections, the application IDs of the users waiting for illegal detection, and the probabilities calculated by the calculation unit 102. Alternatively, users waiting for illegal detection can be identified using other information such as user accounts, rather than application IDs. When an illegal detection is performed on the user whose execution order is first, that user's record is deleted from the illegal detection queue Q, and the execution order is incremented by one.

[0060] Figure 7 This is a diagram illustrating an example of data storage for the execution result data D. For example... Figure 7 As shown, execution result data D contains data related to the execution result of the illegal detection. For example, execution result data D stores the application ID of the user who performed the illegal detection, the execution result of the illegal detection, and the execution date and time. Alternatively, the user who performed the illegal detection can also be identified using other information such as their user account, rather than their application ID. Records of users who have successfully entered the facility can also be deleted from execution result data D.

[0061] Furthermore, the data stored in the data storage unit 100 is not limited to the examples described above. For instance, the data storage unit 100 stores the learning model used for probability calculation in the calculation unit 102 and the learning model used for illegal detection in the illegal detection unit 103. The learning model is a model that utilizes machine learning. Machine learning itself can utilize various methods, such as any of taught machine learning, semi-taught machine learning, or untaught machine learning. For example, the learning model can also be generated using a neural network.

[0062] [Update Department]

[0063] The update unit 101 is implemented based on the control unit 11. When the prescribed update conditions are met, the update unit 101 updates the application ID stored in the user terminal 20. When the update conditions are not met, the update unit 101 does not update the application ID.

[0064] The update condition can be any condition. In the first embodiment, it is a display action that causes the user terminal 20 to display code. That is, performing the display action is equivalent to satisfying the update condition. The display action can be performed by any operation, such as an application startup operation, a rewind operation of an application that has been switched to background mode, a deactivation operation to release an application from sleep mode, or a specified update operation performed while the application is running.

[0065] Furthermore, the update conditions are not limited to the examples above and can be any conditions. For example, update conditions could be a specified time elapsed since the application ID was updated, the user terminal 20's movement distance exceeding a threshold, or the distance between the user terminal 20 and the facility being less than a threshold. Additionally, for example, update conditions could also be a specified time elapsed while the same code is displayed and the user terminal 20's movement distance exceeding a threshold.

[0066] Furthermore, in the first embodiment, since the code ID is updated and illegality detection is performed when a display action is determined to have been performed, the code update cycle is consistent with the illegality detection execution cycle. Alternatively, the code update cycle and the illegality detection execution cycle may not be consistent. That is, the code update conditions and the illegality detection execution conditions (performing the actions specified later) may also be inconsistent.

[0067] [Computer Department]

[0068] The calculation unit 102 is implemented based on the control unit 11. The calculation unit 102 calculates the probability that the code displayed on the user terminal 20 will be used by the user according to a predetermined calculation method. For example, the calculation unit 102 calculates the probability based on a learning model for probability calculation. This learning model learns from training data, which includes pairs of input data (features related to the user who caused the code to be displayed) and output data (indicating whether the code is actually used). When input data in the same format as the input data included in the training data is input, the learning model outputs the probability that the code is used (classified as a label indicating the likelihood of the code being used).

[0069] For example, when a user displays a code, the user terminal 20 sends an application ID to the server 10. The calculation unit 102 determines the user corresponding to the application ID received from the user terminal 20 based on the user database DB1. The calculation unit 102 generates a feature value for that user as input data and calculates the probability using a learning model for probability calculation. Alternatively, the feature value can also be calculated internally within the learning model.

[0070] The input data only needs to include items related to the probability of the code being used by the user. The input data can contain any items, such as the location information of the user terminal 20, the date and time the code was displayed, the date and time the display action was performed, the distance to the nearest facility to the user terminal 20, and at least one of the user's usage history. The input data is in the same format as the input data included in the training data of the learning model used for probability calculation.

[0071] Input data can be represented in any format, such as vectors, permutations, or single numerical values. The learning model used for probability calculation can treat the input data itself as a feature, or it can calculate features based on the input data. The learning model outputs the probability corresponding to the input data.

[0072] Furthermore, the method of probability calculation is not limited to the examples described above. For instance, the calculation unit 102 may calculate the probability according to a prescribed procedure without using a learning model for probability calculation. Additionally, the calculation unit 102 may calculate the probability according to a prescribed mathematical formula or table. In these cases, the relationship between the feature quantity related to the user who caused the code to be displayed and the probability that the code is used can be defined in the program, mathematical formula, or table. Besides this, the probability may also be calculated according to a prescribed rule.

[0073] [Illegal Testing Department]

[0074] The illegal detection unit 103 is implemented based on the control unit 11. When it is determined that a prescribed action has been performed, the illegal detection unit 103 performs illegal detection related to the user based on the application ID stored in the user terminal 20. The details of the prescribed action will be described below. If it is not determined that a user has performed the prescribed action, the illegal detection unit 103 does not perform illegal detection related to that user. That is, a user performing the prescribed action is a condition for performing illegal detection related to that user.

[0075] User-related illegitimacy detection refers to determining whether a user is illegitimate or calculating the probability that a user is illegitimate. Illegitimate behavior refers to a violation of the service's terms of service. Examples include unauthorized login (impersonation), misuse of illegally obtained information, attacks on server 10, or disruptive behavior towards other users.

[0076] In the first embodiment, the case of performing illegal detection using a learning model for illegal detection will be described. This learning model learns from training data, which includes input data containing features related to the user as the object of illegal detection, and output data indicating whether the user is actually illegal. When the learning model is given input data in the same format as the training data, it outputs a label indicating whether the user is illegal or the probability that the user is classified as illegal.

[0077] For example, when it is determined that a user has performed a specified action, the user's terminal 20 sends its stored application ID to the server 10. The illegal detection unit 103 determines the user who performed the specified action (i.e., the user targeted for illegal detection) based on the application ID received from the user terminal 20, using the user database DB1. The illegal detection unit 103 generates a feature value for the user as input data and calculates the probability using a learning model for illegal detection. Alternatively, the feature value can be calculated internally within the learning model. The illegal detection unit 103 associates the application ID of the user who performed the illegal detection, the execution result of the illegal detection, and the current date and time (i.e., the execution date and time) in the execution result data D.

[0078] The input data should include items related to illegality. The input data can contain any items, such as the location information of user terminal 20, the date and time the code was displayed, the date and time the display action was performed, the distance to the nearest facility to user terminal 20, and at least one of the user's usage history. The input data is in the same format as the input data included in the training data of the learning model used for illegality detection.

[0079] Input data can be represented in any format, such as vectors, permutations, or single numerical values. The learning model for illegal detection can treat the input data itself as a feature, or it can compute features based on the input data. The learning model for illegal detection outputs the result of the illegal detection corresponding to the input data.

[0080] In the first embodiment, since displaying a code on the user terminal 20 is equivalent to a predetermined action, the user can be identified using the application ID stored in the user terminal 20. Therefore, when it is determined that a display action has been performed, the illegality detection unit 103 performs illegality detection based on the application ID stored in the user terminal 20. If it is not determined that a display action has been performed by a particular user, the illegality detection unit 103 does not perform illegality detection related to that user. That is, displaying a code by a particular user becomes a condition for performing illegality detection related to that user.

[0081] Furthermore, the method for performing illegal detection can employ a variety of approaches. For example, it may not utilize a learning model for illegal detection, but instead perform illegal detection based on predetermined rules. For instance, these rules might be based on the characteristic parameters of the user being targeted for illegal detection. The illegal detection unit 103 would then classify users who meet the rules as illegal. Alternatively, the illegal detection unit 103 may perform illegal detection based on predetermined procedures, mathematical formulas, or tables. In this case, the relationship between the characteristic parameters of the user being targeted for illegal detection and whether the user is illegal can be defined in the procedure, mathematical formula, or table.

[0082] In the first embodiment, when a display action is determined to have occurred, the illegal detection unit 103 performs illegal detection based on the probability calculated by the calculation unit 102. For example, if there are multiple users (users who displayed the code on the user terminal 20) for whom illegal detection should be performed, the illegal detection unit 103 determines the execution order of illegal detection based on the probability corresponding to each user. The higher the probability, the earlier the illegal detection is executed. That is, the higher the probability of a user, the higher the priority for illegal detection of that user.

[0083] For example, the illegal detection unit 103 updates the illegal detection queue Q in a manner that ensures the execution order of illegal detection aligns with the order of probability from high to low. When illegal detection for a user is completed, the illegal detection unit 103 refers to the illegal detection queue Q and executes the illegal detection for the first user in the execution order. That is, the illegal detection unit 103 executes the illegal detection for users with relatively high probabilities before executing the illegal detection for users with relatively low probabilities. In other words, the illegal detection unit 103 executes the illegal detection for each user in descending order of their respective probabilities. The illegal detection unit 103 can also execute illegal detection for multiple users simultaneously.

[0084] Furthermore, the execution method of probability-based illegal detection is not limited to the examples described above. The illegal detection unit 103 may also decide whether to perform illegal detection for a user based on the probability corresponding to that user. For example, if the probability of a user is less than a threshold, the illegal detection unit 103 may not perform illegal detection for that user, while if the probability of a user is above the threshold, the illegal detection unit 103 may perform illegal detection for that user. The threshold may be a fixed value or a variable value corresponding to a user. Moreover, in particular, illegal detection may be performed without calculating the probability. In this case, illegal detection is performed in the order in which display actions were accepted.

[0085] In the first embodiment, the illegality detection unit 103 performs illegality detection when it is determined that the application ID has been updated and a display action has been performed. If the application ID has not been updated and / or a display action has not been determined, the illegality detection unit 103 does not perform illegality detection. The application ID being updated and a display action being performed are the two conditions for performing illegality detection. Therefore, even if code is displayed, if the application ID has not been updated, illegality detection is not performed. However, in the first embodiment, since the application ID is also updated during the series of processes of displaying code, both conditions are satisfied simultaneously. As described above, these two conditions may not be satisfied simultaneously.

[0086] Furthermore, the illegal detection unit 103 can also perform illegal detection regardless of probability. In this case, the calculation unit 102 can be omitted. Additionally, the illegal detection unit 103 can perform illegal detection even if the application ID has not been updated. In this case, the update unit 101 can be omitted.

[0087] [1-3-2. Functions implemented in the user terminal]

[0088] like Figure 3 As shown, the user terminal 20 implements a data storage unit 200, an action determination unit 201, a display control unit 202, a transmission unit 203, and a receiving unit 204.

[0089] [Data Storage Department]

[0090] The data storage unit 200 is implemented based on the storage unit 22. The data storage unit 200 stores the data required for the processing described in the first embodiment. For example, the data storage unit 200 stores the application and application ID used for displaying codes. As described above, the application ID stored in the data storage unit 200 is updated (rewritten) each time a display action is performed. The data storage unit 200 may also store the facility database DB2. The user terminal 20 may also obtain the execution result of the illegal detection by the illegal detection unit 103 and store the execution result of the illegal detection in the data storage unit 200. In this case, the facility terminal 30 may also obtain the execution result of the illegal detection stored in the data storage unit 200 using wireless communication or codes.

[0091] [Motion Judgment Department]

[0092] The action determination unit 201 is implemented based on the control unit 21. The action determination unit 201 determines whether a predetermined action was performed by a user having the user terminal 20 before the code was detected. The predetermined action is an action performed before the code is detected. The predetermined action can also be referred to as a preparation or preparatory action performed before the operation for detecting the code (e.g., the operation of reading the code by the detection device 40).

[0093] In the first embodiment, the described action refers to a display action used to cause the user terminal 20 to display code. Therefore, the position where the display action for causing the user terminal 20 to display code was described in the first embodiment can be replaced with the described action. For example, the application startup operation, recall operation, cancellation operation, and update operation described above are equivalent to display actions. The display action is not limited to these examples and can be any action.

[0094] The action determination unit 201 determines whether a display action was performed before the code was detected. For example, the action determination unit 201 determines whether any one of the following operations was performed: application startup, recall, deactivation, or update, based on the operation performed on the operation unit 24. Furthermore, the defined actions are not limited to the examples of the first embodiment. Examples of other actions will be described in the variations described later.

[0095] [Display Control Department]

[0096] The display control unit 202 is implemented based on the control unit 21. When a user performs a prescribed action, the display control unit 202 causes the display unit 25 to display code based on the application ID stored in the data storage unit 200. As described above, application startup, recall, cancellation, or update operations are examples of prescribed actions. The display control unit 202 encodes the application ID according to a standard code sequence, causing the display unit 25 to display the code.

[0097] [Sending Department]

[0098] The sending unit 203 is implemented based on the control unit 21. The sending unit 203 sends arbitrary data to the server 10. For example, the sending unit 203 sends the application ID stored in the data storage unit 200 to the server 10. In addition, the sending unit 203 can also send the application ID to the facility terminal 30. Furthermore, the sending unit 203 can also send other data to the server 10 or the facility terminal 30.

[0099] [Receiving Department]

[0100] The receiving unit 204 is implemented based on the control unit 21. The receiving unit 204 receives arbitrary data from the server 10. For example, the receiving unit 204 receives the application ID issued to the user from the server 10. Additionally, the receiving unit 204 can also receive other data from the server 10. Furthermore, the receiving unit 204 can also receive certain data from the facility terminal 30.

[0101] [1-3-3. Functions implemented in facility terminals]

[0102] like Figure 3 As shown, the facility terminal 30 implements a data storage unit 300, a transmission unit 301, a receiving unit 302, and an execution unit 303.

[0103] [Data Storage Department]

[0104] The data storage unit 300 is implemented based on the storage unit 32. The data storage unit 300 stores the data required for the processing described in the first embodiment. For example, the data storage unit 300 stores the facility ID of the facility on which the facility terminal 30 is configured.

[0105] [Sending Department]

[0106] The transmitting unit 301 is implemented based on the control unit 31. The transmitting unit 301 transmits arbitrary data to the server 10. For example, the transmitting unit 301 transmits to the server 10 the facility ID stored in the data storage unit 300 and the application ID contained in the code read by the detection device 40. Additionally, the transmitting unit 301 can also transmit other data to the server 10. Furthermore, the transmitting unit 301 can also transmit certain data to the user terminal 20.

[0107] [Receiving Department]

[0108] The receiving unit 302 is implemented based on the control unit 31. The receiving unit 302 receives arbitrary data from the server 10. For example, the receiving unit 302 receives the execution result of illegal detection from the server 10. In addition, the receiving unit 302 can also receive other data from the server 10. Furthermore, the receiving unit 302 can also receive certain data from the user terminal 20.

[0109] [Execution Department]

[0110] The execution unit 303 is implemented based on the control unit 31. In the illegal detection system S, when a code is detected by the detection device 40, the prescribed processing is executed. When a code is detected, the execution unit 303 executes the prescribed processing based on the result of the illegal detection. When an illegal user is detected, the execution unit 303 does not execute the prescribed processing; however, when no illegal user is detected, the execution unit 303 executes the prescribed processing. In other words, detecting a code and not detecting an illegal user are conditions for executing the prescribed processing.

[0111] The prescribed processing is the processing allowed (executed) when the execution result of the illegal detection is a prescribed result. In the first embodiment, the description of displaying a message indicating that the facility terminal 30 is allowed to enter is equivalent to the prescribed processing, but the prescribed processing can be any kind of processing. For example, if an entrance door is installed in the facility, the processing of opening the entrance door can also be equivalent to the prescribed processing. Furthermore, for example, if a printer is connected to the facility terminal 30, printing a receipt or ticket indicating that the user is allowed to enter can also be equivalent to the prescribed processing. The prescribed processing can be any processing corresponding to the scenario in which the illegal detection system S is applied. An example of the prescribed processing in other application examples will be described in the modified examples described later.

[0112] [1-4. Processes performed in the first embodiment]

[0113] Figure 8 This is a flowchart illustrating an example of the processing performed in the first embodiment. Control units 11, 21, and 31 operate according to the programs stored in storage units 12, 22, and 32, respectively, thereby executing... Figure 8 The processing is shown below. The processing described below is by... Figure 3 This is an example of the processing performed by the function block shown. Additionally, in user terminal 20, the application is installed and its application ID is recorded.

[0114] like Figure 8 As shown, when the user terminal 20 receives a specified application launch operation from the operation unit 24, it launches the application stored in the storage unit 22 (S1) and sends an application ID update request to the server 10 (S2). The application launch operation is an operation for launching an application, such as selecting the icon of the application displayed on the user terminal 20. The update request is a notification for requesting an update of the application ID, which is done by sending data in a specified format. For example, the update request includes the application ID stored in the storage unit 22 and the location information of the user terminal 20 detected by the GPS receiver 27.

[0115] When server 10 receives an update request, it issues a new application ID according to the prescribed issuance rules (S3). In S3, server 10 issues the new application ID in a manner that does not overlap with the application IDs of other users stored in user database DB1. Server 10 stores the issued application ID in the record in user database DB1 that stores the application IDs included in the update request. Thus, the application ID on server 10 is updated.

[0116] Server 10 sends the new application ID issued in S3 to user terminal 20 (S4). Upon receiving the new application ID, user terminal 20 records the application ID in storage unit 22 (S5) and displays code on display unit 25 based on the updated application ID in S5 (S6). In S5, user terminal 20 rewrites the old application ID (the application ID included in the update request) with the new application ID. Thus, the application ID on the user terminal 20 side is updated.

[0117] Server 10 calculates the probability that the code displayed on user terminal 20 will be used based on the learning model used for probability calculation (S7). In S7, server 10 obtains input data for the learning model used for probability calculation based on the location information of user terminal 20 included in the update request and the information stored in user database DB1. Server 10 inputs the input data into the learning model used for probability calculation and obtains the probability output from the learning model used for probability calculation.

[0118] Server 10 adds a user to the illegal detection queue Q based on the probability calculated in S7 (S8). In S8, server 10 adds the user to the illegal detection queue Q in such a way that the higher the probability calculated in S7, the earlier the illegal detection is executed.

[0119] Server 10 performs illegal detection (S9) based on the illegal detection queue Q and the learning model used for illegal detection. Server 10 determines the user added to the illegal detection queue Q with the earliest execution order. Server 10 obtains input data for the illegal detection learning model based on the location information of the user terminal 20 included in the user's update request and the information stored in the user database DB1. Server 10 inputs the input data into the illegal detection learning model and obtains the execution result of the illegal detection output from the learning model. Server 10 stores the execution result of the illegal detection in execution result data D. Server 10 removes the user who performed the illegal detection from the illegal detection queue Q. The processing in S9 is executed at any time.

[0120] Facility terminal 30 determines whether the code displayed by user terminal 20 has been read by detection device 40 (S10). If it is determined that the code has been read (S10; Yes), facility terminal 30 sends the application ID contained in the code to server 10 (S11). Furthermore, in the first embodiment, the case where S10 and S11 are executed after S8 and S9 is described, but S8 and S9, and S10 and S11, can also be executed in parallel. For example, S10 can be executed before the completion of S9.

[0121] When server 10 receives an application ID, it refers to the execution result of the illegal detection of the user corresponding to the application ID based on the execution result data D (S12). In S12, if the received application ID is stored in the execution result data D, server 10 determines that the application ID is valid and refers to the execution result of the illegal detection associated with the application ID. If the application ID is not stored in the execution result data D, server 10 determines that the application ID is invalid and proceeds to the processing in S13. Furthermore, if the application ID is not stored in the execution result data D, it is possible that the execution result of the illegal detection will be added to the execution result data D immediately afterward; therefore, server 10 can also wait a fixed period of time and refer to the execution result data D again.

[0122] If an illegal user is detected in S12 or the application ID is determined to be illegal (S12; Illegal), the server 10 sends a confirmation result indicating illegality to the facility terminal 30 (S13). Upon receiving the confirmation result, the facility terminal 30 displays a message on the display unit 35 indicating that the user is not allowed to enter (S14), and the process ends.

[0123] If no illegal user access is detected (S12; legal), the server 10 sends a confirmation result indicating legality to the facility terminal 30 (S15). Upon receiving the confirmation result, the facility terminal 30 displays a message on the display unit 35 indicating that the user's access is permitted (S16), and the process ends.

[0124] User terminal 20 determines the user's operation based on the detection signal from operation unit 24 (S17). In S17, a recall operation, a cancellation operation, an update operation, or an application termination operation is performed.

[0125] If a recall, cancellation, or update operation is performed in S17 (S17; recall, etc.), the process returns to S2 and an update request is sent. Upon receiving the update request, server 10 transfers to the process in S3. In this case, a new application ID is issued, and an illegality check is performed. On the other hand, if a termination operation is performed in S17 (S17; termination), user terminal 20 terminates the application (S18), ending this process.

[0126] According to the illegal detection system S of the first embodiment, when it is determined that a user has performed a display action, illegal detection is performed based on the application ID stored in the user terminal 20. This shortens the time from detecting the code displayed on the user terminal 20 to granting access to the facility. Furthermore, by setting the performance of a display action as a condition for performing illegal detection, the number of illegal detection operations can be reduced, or illegal detection can be avoided from being performed all at once at a specific time (distributing the execution of illegal detection), thereby reducing the processing load on the server 10. Even if the object being detected is not a code, and the prescribed process is not for accessing the facility, the time from detecting the object to performing the prescribed process is similarly shortened, further reducing the processing load on the server 10. Moreover, by performing illegal detection just before the object is detected (just before performing the prescribed process), a more accurate illegal detection can be achieved. As a result, security is improved.

[0127] Furthermore, the illegal detection system S optimizes the execution order of illegal detection by performing it based on the probability of code exploitation. In addition, it can further reduce the number of illegal detection executions or effectively avoid concentrating illegal detections at a specific time, thereby effectively reducing the processing load on server 10.

[0128] Furthermore, when the application ID is updated and a display action is determined to have been performed, the illegal detection system S prevents unnecessary illegal checks from being executed, effectively reducing the processing load on server 10. In addition, the illegal detection system S improves security by performing illegal checks every time the application ID is updated.

[0129] [2. Second Implementation]

[0130] Next, a second embodiment of the illegal detection system S will be described. In this second embodiment, an example will be given of a scenario where the illegal detection system S is applied to a situation where the user terminal 20 reads code disclosed by the facility. That is, in this second embodiment, the operation of reading the code is performed by a user, not a facility worker. Furthermore, descriptions of structures identical to those in the first embodiment will be omitted.

[0131] In the second embodiment, the detection device 40 in the facility can be omitted. In the second embodiment, the camera unit 26 of the user terminal 20 is equivalent to the detection device of this disclosure. Therefore, the position referred to as camera unit 26 in the second embodiment can be replaced by a detection device.

[0132] Figure 9 This diagram illustrates an example of a user entering the facility in the second embodiment. (See diagram below.) Figure 9As shown, the facility contains a code that includes a facility ID. When a user accesses the facility, the user terminal 20 launches its application and camera unit 26 to capture the code. The user terminal 20 then sends the facility ID contained in the code and the application ID stored within it to the server 10.

[0133] Furthermore, in the second embodiment, the application ID is not encoded and displayed, but within the application, it is possible to switch between a code display mode as in the first embodiment and a code capture mode as in the second embodiment. That is, both the service described in the first embodiment and the service described in the second embodiment can be provided to the user.

[0134] When server 10 receives the facility ID and application ID, it verifies the validity of the application ID and sends a confirmation result to the facility terminal 30 corresponding to the facility ID. Facility terminal 30 displays the confirmation result received from server 10. Once staff review the confirmation result and confirm its validity, they allow the user to enter. In this scenario, if server 10 performs an illegality check after user 20 reads the code, time will still be spent before allowing the user to enter.

[0135] Therefore, in the illegal detection system S of the second embodiment, when a startup operation is performed to start the camera unit 26 of the user terminal 20, the server 10 performs illegal detection. That is, in principle, the server 10 performs illegal detection from the time the camera unit 26 of the user terminal 20 starts until the camera unit 26 reads the code. Therefore, in principle, illegal detection is completed by the time the camera unit 26 reads the code, thus shortening the time until the user is allowed to enter. The details of this technology will be explained below.

[0136] In the second embodiment, the object of detection is code located outside the user terminal 20. The code can be displayed on the facility terminal 30 or revealed in a state formed on a medium such as paper. In the second embodiment, the camera unit 26, used for code detection, is included in the user terminal 20.

[0137] The action specified in the second embodiment is a startup action for activating the camera unit 26 of the user terminal 20. For example, the camera unit 26 is activated when an application is launched, when a specified camera startup operation is performed while the application is running, when the application is switched to background mode and then recalled, or when the application is switched to sleep mode and then released from sleep mode. In the second embodiment, the case where the application ID is updated at a timer when the camera unit 26 is activated is described; however, similar to the first embodiment, the application ID update cycle and the illegal detection execution cycle may be different.

[0138] The action determination unit 201 determines whether a startup action was performed before the code was detected. For example, based on the operation performed on the operation unit 24, the action determination unit 201 determines whether any one of the following was performed: an application startup operation, a camera startup operation, a recall operation, or a deactivation operation. These operations are examples of startup actions. Startup actions are not limited to these examples and can be any action.

[0139] If the illegality detection unit 103 determines that a startup action has been performed, it performs an illegality detection based on the application ID stored in the user terminal 20. If the illegality detection unit 103 does not determine that a startup action was performed by a specific user, it does not perform illegality detection related to that user. In other words, a startup action by a specific user is a condition for performing illegality detection related to that user. The processing of the execution unit 303 is the same as in the first embodiment; if code is detected, the execution unit 303 performs the prescribed processing based on the execution result of the illegality detection.

[0140] Figure 10 This is a flowchart illustrating an example of the process performed in the second embodiment. For example... Figure 10 As shown, S21 to S25 are the same as S1 to S5, respectively. When the user terminal 20 records the application ID to the storage unit 22 in S25, it starts the camera unit 26 (S26). Alternatively, S26 can be executed before S22 or S25. The following S27 to S29 are the same as S7 to S9, respectively. The probability of the code being used in S27 represents the probability that the code captured by the user is used, that is, the probability that the code is captured by the user.

[0141] User terminal 20 determines whether the code posted by the facility has been read by camera unit 26 (S30). If it is determined that the code has been read (S30; Yes), user terminal 20 sends the facility ID contained in the code and the application ID recorded in storage unit 22 to server 10 (S31). In the second embodiment, the case where S28 and S29 are executed followed by S30 and S31 is described, but S28 and S29, and S30 and S31 can also be executed in parallel. For example, S30 can be executed before S29 is completed. The following S32 to S38 are the same as S12 to S18, respectively.

[0142] According to the second embodiment, when a startup action is determined to have occurred, an illegal detection is performed based on the application ID stored in the user terminal 20. This shortens the time from detecting the code posted by the facility to allowing access to the facility. Furthermore, setting the startup action as a condition for performing illegal detection prevents unnecessary illegal detection from being performed, thereby reducing the processing load on the server 10.

[0143] [3. Variations]

[0144] Furthermore, this disclosure is not limited to the embodiments described above. Appropriate modifications can be made without departing from the spirit of this disclosure.

[0145] Figure 11 This is a functional block diagram from a variant example. For example... Figure 11 As shown, in the following modified examples, the functions described in the alternative embodiments are implemented for the location determination unit 104, the first permission unit 105, the second permission unit 106, the terminal determination unit 107, and the validity determination unit 108.

[0146] (1) For example, if an illegal detection is performed every time a display action is performed, an illegal detection may still be performed even if the user attempts to display the code without intending to enter the facility. In this case, server 10 performs unnecessary illegal detection, which may increase the processing load. Therefore, the code may not be displayed if the user is not in or near the facility. If the code is not displayed, the application ID is not updated, and no illegal detection is performed. That is, even if a display action is performed, no illegal detection is performed if the display of the code is not permitted.

[0147] In this variation, similar to the first embodiment, the detection device 40 is disposed in a facility. A facility is an example of a designated location. Therefore, the location referred to as a facility can be replaced with a designated location. A designated location is a location where the detection device 40 is disposed or a location where a code is posted. A designated location can also be referred to as a location accessed by a user.

[0148] The illegal detection system S in this modified example includes a location determination unit 104 and a first permission unit 105. The location determination unit 104 and the first permission unit 105 are implemented based on the control unit 11.

[0149] Figure 12 This is an example diagram showing a screen of a user terminal 20 corresponding to the locational relationship between the user and the facility. For example... Figure 12 As shown, the location determination unit 104 determines whether a user is present in or near the facility. For example, the location determination unit 104 obtains location information from the user terminal 20 and determines whether the distance between the user terminal 20 and the facility is less than a threshold based on the location information of the user terminal 20 and the location information of the facility stored in the facility database DB2.

[0150] The facility that the location determination unit 104 determines can be only the facility closest to the user terminal 20, but the second or subsequent closest facilities can also be determined. If the distance between the user terminal 20 and the facility being determined is above a threshold, the location determination unit 104 does not determine that a user is present at or near the facility; however, if the distance is less than the threshold, the location determination unit 104 determines that a user is present at or near the facility.

[0151] Furthermore, the determination method of the location determination unit 104 is not limited to the examples described above. For example, it may also determine whether a user exists in or near the facility based on beacons configured in the facility, the communication status between the user terminal 20 and the wireless communication equipment of the facility, the information of the portable base station to which the user terminal 20 belongs, or by using images from cameras configured in the facility.

[0152] If it is determined that a user is present in or near the facility, the first enabling unit 105 allows the display of codes in the user terminal 20. If it is not determined that a user is present in or near the facility, the first enabling unit 105 does not allow the display of codes in the user terminal 20. The presence of a user in or near the facility is a condition for the user terminal 20 to display codes.

[0153] In this modified example, since the first enabling unit 105 is included in the server 10, the first enabling unit 105 controls whether the display of the code is allowed by sending a specified notification to the user terminal 20. In this modified example, the notification is described as indicating that the display of the code is not allowed; however, the notification could also be indicating that the display of the code is allowed.

[0154] For example, if no user is determined to be present in or near the facility, the first permission unit 105 sends a notification to the user terminal 20 indicating that the display of a code is not permitted. Upon receiving the notification, the display control unit 202 does not display the code. If no notification is received, the display control unit 202 displays the code based on the application ID stored in the data storage unit 200. Not receiving a notification means not receiving any notification from the first permission unit 105, or receiving a notification indicating that the display of a code is permitted.

[0155] If a display action is determined to have been performed and the display of code is permitted, the illegal detection unit 103 performs illegal detection. If a display action is not determined to have been performed and / or the display of code is not permitted, the illegal detection unit 103 does not perform illegal detection. Performing a display action and permitting the display of code are the two conditions for performing illegal detection. Therefore, even if a display action is performed, illegal detection will not be performed if the display of code is not permitted.

[0156] According to variation (1), when it is determined that a user is present in or near the facility, by allowing the display of the code in the user terminal 20, it is possible to prevent the execution of unnecessary illegal detection, thereby reducing the processing load of the server 10.

[0157] Furthermore, applying variation (1) to the second embodiment, if it is not determined that a user is present in or near the facility, the camera unit 26 can be restricted from starting when the application is running. That is, if it is determined that a user is present in or near the facility, the camera unit 26 can be allowed to start even when the application is running. If the camera unit 26 is not started, the application ID is not updated, and no illegal detection is performed. Even if a startup action is performed, no illegal detection is performed if the startup of the camera unit 26 is not allowed.

[0158] (2) Furthermore, for example, if the probability of an illegal user being detected is high, then the code may not need to be displayed. The illegal detection system S in this modified example includes a second enabling unit 106. The second enabling unit 106 is implemented based on the control unit 11.

[0159] If the user's illegality is not confirmed based on the execution result of the illegality detection, the second enabling unit 106 allows the display of code in the user terminal 20. If the user's illegality is confirmed based on the execution result of the illegality detection, the second enabling unit 106 prevents the display of code in the user terminal 20. The failure to confirm the user's illegality is a condition for the user terminal 20 to display code.

[0160] In this modified example, since the second enabling unit 106 is included in the server 10, the second enabling unit 106 controls whether the display of the code is allowed by sending a specified notification to the user terminal 20. In this modified example, the notification is described as a notification indicating that the display of the code is not allowed; however, the notification could also be a notification indicating that the display of the code is allowed.

[0161] For example, if an unauthorized user is detected, the second authorization unit 106 sends a notification to the user terminal 20 indicating that the display of a code is not allowed. Upon receiving the notification, the display control unit 202 does not display the code. If no notification is received, the display control unit 202 displays the code based on the application ID stored in the data storage unit 200. Not receiving a notification means not receiving any notification from the second authorization unit 106, or receiving a notification indicating that the display of a code is allowed.

[0162] Furthermore, regarding users detected as acting illegally, the display of their codes can be permitted through the administrator's intervention after review by the administrator of the illegal detection system S. Additionally, for example, code display can be restricted for a specified period from the time illegality is detected until the specified time has elapsed, after which code display can be permitted again.

[0163] If a display action is determined to have been performed and the display of the code is permitted, the illegal detection unit 103 performs an illegal detection. In variation (1), the determination result of the first permission unit 105 becomes the execution condition for illegal detection; in contrast, in variation (2), the determination result of the second permission unit 106 becomes the execution condition for illegal detection. All other points are the same: even if a display action is performed, illegal detection is not performed if the display of the code is not permitted. Furthermore, both the determination result of the first permission unit 105 and the determination result of the second permission unit 106 can become the execution condition for illegal detection.

[0164] According to variation (2), by allowing the display of codes in the user's terminal 20 without confirming the user's unauthorized access, unauthorized users can be prevented from entering the facility, thereby improving security. Furthermore, since the display of codes is not allowed for unauthorized users, unnecessary unauthorized checks can be prevented once unauthorized access is detected, thus reducing the processing load on the server 10.

[0165] Furthermore, applying variation (2) to the second embodiment, if an illegal user is detected, the camera unit 26 can be restricted from starting when the application is already running. That is, if an illegal user is not detected, the camera unit 26 can be allowed to start even when the application is running. Even if a startup operation is performed, if the startup of the camera unit 26 is not allowed, illegal detection will not be performed.

[0166] (3) Furthermore, for example, as in variation (1), the display of the code can be allowed even when the user is not in or near the facility, but illegal detection is not performed, rather than preventing the code from being displayed. The illegal detection system S in this variation is the same as that in variation (1), and includes a location determination unit 104.

[0167] If a display action is determined to have occurred and a user is determined to be present in or near the facility, the illegal detection unit 103 performs an illegal detection. If no display action is determined to have occurred and / or no user is determined to be present in or near the facility, the illegal detection unit 103 does not perform an illegal detection. The conditions for performing an illegal detection are the occurrence of a display action and the presence of a user in or near the facility. Therefore, even if a code is displayed, if the user is not in or near the facility, no illegal detection will be performed.

[0168] According to variation (3), if it is determined that a display action has been performed and it is determined that a user is present in or near the facility, by performing illegal detection, unnecessary illegal detection can be prevented, thereby reducing the processing load of server 10.

[0169] Alternatively, variation (3) can be applied to the second embodiment, where an illegal detection is performed if it is determined that a startup action has been performed and a user is present in or near the facility. That is, even if a startup action has been performed, an illegal detection may not be performed if the user is not in or near the facility.

[0170] (4) Furthermore, for example, illegal detection may sometimes occur after illegal detection has been performed. Therefore, illegal detection is best performed just before the code is about to be read. However, even if the user accesses the facility and displays the code, the detection device 40 may not immediately read the code. In this regard, when the user causes the detection device 40 to read the code, the user terminal 20 may sometimes be in a specified orientation or posture. Therefore, illegal detection can also be performed when the user terminal 20 is in a specified orientation or posture.

[0171] The method for detecting the orientation or posture of the user terminal 20 can employ a wide variety of approaches. For example, the user terminal 20 may include at least one sensor for detecting orientation or posture, utilizing the detection signal from at least one sensor to detect the orientation or posture of the user terminal 20. The sensor can be of any type, such as a gyroscope sensor, an accelerometer, a geomagnetic sensor, or an electronic compass.

[0172] The illegal detection system S in this modified example includes a terminal determination unit 107. The terminal determination unit 107 is implemented based on the control unit 11.

[0173] Figure 13 This is a diagram showing the orientation or posture of the user terminal 20 in variant example (4). Figure 13 As shown, the terminal determination unit 107 determines whether the orientation or posture of the user terminal 20 is a predetermined orientation or posture for the detection device 40 to detect the code. Posture can also be referred to as tilt.

[0174] The prescribed orientation is one that makes it easy for the detection device 40 to read the code. The same applies to the prescribed posture; it is a posture that makes it easy for the detection device 40 to read the code. In other words, the orientation or posture of the user terminal 20 so that the operator can see the display unit 25 (screen) corresponds to the prescribed orientation or posture.

[0175] For example, the orientation or posture of a user terminal 20 with the display unit 25 (screen) facing directly upwards (vertically) corresponds to a predetermined orientation or posture. The terminal determination unit 107 determines whether the offset (intersection angle) between the orientation of the display unit 25 (the vertical direction of the display unit 25) and the vertical direction on Earth is less than a threshold (e.g., 20 degrees). If the offset is less than the threshold, it is considered a predetermined orientation or posture.

[0176] Furthermore, for example, if the user terminal 20 is reversed so that the display unit 25 (screen) faces the detection device 40, or if the orientation or posture of the user terminal 20 of the operator corresponds to a predetermined orientation or posture, the terminal determination unit 107 measures the change in the orientation or posture of the user terminal 20 and determines whether the offset (rotation angle) from the orientation or posture when the code is displayed is above a threshold (e.g., 150 degrees). An offset above the threshold corresponds to a predetermined orientation or posture.

[0177] In this modified example, since the terminal determination unit 107 is included in the server 10, the user terminal 20, when displaying a code, acquires terminal information related to orientation or posture based on the detection signals from the aforementioned sensors and sends it to the server 10. The server 10 receives the terminal information, and the terminal determination unit 107 determines, based on the terminal information, whether the user terminal 20 is in a prescribed orientation or posture. The threshold described above can be a fixed value or a variable value corresponding to the user's habits.

[0178] If a display action is determined to have been performed and the user terminal 20 is in the prescribed orientation or posture, the illegal detection unit 103 performs illegal detection. If no display action is determined to have been performed and / or the user terminal 20 is not in the prescribed orientation or posture, the illegal detection unit 103 does not perform illegal detection. Performing a display action and the user terminal 20 being in the prescribed orientation or posture are the two conditions for performing illegal detection. Therefore, even if a code is displayed, if the user terminal 20 is not in the prescribed orientation or posture, illegal detection is not performed.

[0179] According to variation (4), when it is determined that a display action has been performed and the user terminal 20 is in the specified orientation or posture, an illegal detection is performed, thereby preventing unnecessary illegal detection and reducing the processing load of the server 10.

[0180] Alternatively, variation (4) can be applied to the second embodiment, whereby an illegal detection is performed if it is determined that an activation action has been performed and the user terminal 20 is in a predetermined orientation or posture. In this case, the predetermined orientation or posture is the orientation or posture of the camera unit 26 relative to the code displayed on the read facility. For example, if the camera direction of the camera unit 26 deviates from the horizontal direction on Earth (intersection angle) by less than a threshold (e.g., 20 degrees), it is considered to be in a predetermined orientation or posture.

[0181] (5) Furthermore, for example, since illegal actions may sometimes occur between the execution of illegal detection and the reading of code, the validity of the execution result of illegal detection can also be determined. The illegal detection system S of this modified example includes a validity determination unit 108. The validity determination unit 108 is implemented based on the control unit 11.

[0182] The validity determination unit 108 determines the validity of previously performed illegal tests based on prescribed determination conditions. The determination conditions can be arbitrary, such as the conditions in the following variations (5-1)-(5-3). Two or more conditions in the following variations (5-1)-(5-3) can also be combined. In addition, similar to variations (1)-(4), the following variations (5-1)-(5-3) can also be applied to both the first embodiment and the second embodiment.

[0183] (5-1) For example, the specified determination condition is a condition related to the elapsed time since the last illegal detection was performed. This elapsed time can also be called the validity period of the illegal detection. This elapsed time is the time from the execution date and time of the most recent illegal detection to the current date and time. The validity determination unit 108 determines the validity based on the elapsed time. In this modified example, if an illegal detection of a certain user is performed, the illegal detection unit 103 stores the date and time of the illegal detection in the result data D. Alternatively, the execution date and time may not be stored, but the validity period of the illegal detection may be stored in the execution result data D.

[0184] The validity determination unit 108 obtains the elapsed time based on the current date and time and the date and time of the illegal detection. If the elapsed time is above a threshold, the validity determination unit 108 determines that the execution result of the illegal detection is invalid; if the elapsed time is below the threshold, the validity determination unit 108 determines that the execution result of the illegal detection is valid. Alternatively, the validity determination unit 108 can also determine whether the valid period of the illegal detection has elapsed based on the current date and time. In this modified example, since the validity determination unit 108 is included in the server 10, the validity determination unit 108 sends the validity determination result to the facility terminal 30.

[0185] The execution unit 303 executes the prescribed processing based on the execution result of the illegal detection and the determination of the validity of the illegal detection. If the execution result of the illegal detection is determined to be invalid, the execution unit 303 does not execute the prescribed processing regardless of the execution result of the illegal detection. If the execution result of the illegal detection is valid and no illegality of the user is detected, the execution unit 303 executes the prescribed processing. That is, the absence of illegality and the validity of the execution result are conditions for executing the prescribed processing. Therefore, even if no illegality is detected, if validity cannot be confirmed, the prescribed processing is not executed.

[0186] According to variation (5-1), security can be improved by allowing entry into the facility based on the results of illegal detection and the determination of the validity of the illegal detection.

[0187] Furthermore, by determining the validity of illegal detections based on the elapsed time since their last execution, security can be improved by setting a time limit for the validity of illegal detections. For example, the older the execution result of an illegal detection, the lower its reliability; therefore, older illegal detections can be invalidated and executed again.

[0188] (5-2) Furthermore, for example, the specified determination criteria are related to the user's movement distance since the last illegal detection was performed. The validity determination unit 108 determines validity based on the movement distance. This movement distance is the total movement distance from the date and time of the most recent illegal detection to the current date and time.

[0189] The user's travel distance can be calculated either by the user terminal 20 or by the server 10. For example, the user terminal 20 tracks the location information detected by the GPS receiver 27 and measures the travel distance. Alternatively, the user's travel distance can be measured by any other method. For example, the user's travel distance can also be measured using changes in the portable base station information of the user terminal 20 or the communication equipment information that communicates wirelessly with the user terminal 20.

[0190] Server 10 receives location information from user terminal 20 at any time and measures the distance traveled. If the user's travel distance is above a threshold, the validity determination unit 108 determines that the execution result of the illegal detection is invalid; if the travel distance is less than the threshold, the validity determination unit 108 determines that the execution result of the illegal detection is valid. The processing of execution unit 303 is as described in the modified example (5-1).

[0191] According to variation (5-2), by determining the validity of illegal detection based on the user's movement distance since the previous illegal detection was performed, security can be improved by setting a limit on the movement distance for the validity of illegal detection. For example, if a user makes an overly unnatural movement, the user may commit an illegal act, thus invalidating the previously performed illegal detection and re-performing it.

[0192] (5-3) Furthermore, for example, the specified determination condition is a condition related to the distance between the facility and the location of the user terminal 20 when a display operation is performed. The validity determination unit 108 determines the validity based on this distance. The location of the user terminal 20 when a display operation is performed refers to the location of the user terminal 20 at the moment the code is displayed or at a time before or after it, such as the location of the user terminal 20 when an application startup operation, recall operation, cancellation operation, or update operation is received.

[0193] The method for obtaining the aforementioned distance is as described in Modification (1). If the distance is above the threshold, the validity determination unit 108 determines that the execution result of the illegal detection is invalid; if the distance is below the threshold, the validity determination unit 108 determines that the execution result of the illegal detection is valid. The processing of the execution unit 303 is as described in Modification (5-1).

[0194] According to variation (5-3), by determining the validity of illegal detection based on the distance between the facility and the location of the user terminal 20 when the display action has been performed, the aforementioned distance limitation can be set to improve security. For example, since there is a possibility that the user may commit illegal acts after leaving the facility, the previously performed illegal detection can be invalidated and the illegal detection can be performed again.

[0195] (6) Furthermore, for example, a scenario where a user enters a facility is given, but the illegal entry detection system S can also be applied to electronic payment services. In this variation, a scenario where a user visits a store to purchase goods is given as an example. In this variation, the store is equivalent to a facility, and the facility terminal 30 is configured in the store. For example, the facility terminal 30 is a POS terminal, a vending machine, or a ticketing machine. The store can be an unmanned store or a store such as a mobile sales vehicle.

[0196] First, as in the first embodiment, let's take the case where the detection device 40 reads the code displayed on the user terminal 20 as an example. The detection device 40 is connected to the store's facility terminal 30. The user takes the store's goods to the checkout counter. The store clerk reads the product's barcode using the detection device 40. Alternatively, in the case of a self-checkout machine, the user, rather than a clerk, may read the product's barcode using the detection device 40. The facility terminal 30 stores a product database and retrieves the product information corresponding to the barcode. The product information includes the product name, price, etc. The facility terminal 30 records the product information, such as the items the user took to the checkout counter and their total amount, in the storage unit 32.

[0197] The user launches the application on user terminal 20 and displays a code to inform the cashier to use the electronic payment service. With the application launched, the application ID is updated, and an illegal detection is performed as described in the first embodiment. The cashier reads the code displayed on user terminal 20 using detection device 40. Facility terminal 30 sends the application ID contained in the code to server 10.

[0198] When server 10 receives an application ID, it performs settlement processing based on the execution result of the illegality detection corresponding to the application ID. In this variation, illegality detection can also be performed by any method. For example, illegality detection unit 103 performs illegality detection based on information such as the user's location, settlement amount, or settlement frequency in past settlements.

[0199] If an illegal transaction is detected, server 10 will not execute the payment process; otherwise, it will execute the payment process. Server 10 sends the execution result of the payment process to facility terminal 30. Facility terminal 30 displays the execution result of the payment process. If the payment process is not executed, the clerk informs the user of the situation and encourages them to pay using another payment method. If the payment process is executed, the clerk performs the prescribed checkout procedure, and the user accepts the goods.

[0200] In this variation, the specified processing is settlement processing. The execution unit 303 is included in the server 10 and is implemented based on the control unit 11. Upon detecting code, the execution unit 303 performs settlement processing based on the execution result of the illegal detection and the user's settlement information. The settlement information is information required for settlement, such as credit card number, debit card information, bank account information, electronic currency information, points information, virtual currency information, or wallet information. The settlement information is stored in the user database DB1.

[0201] If an illegal user is detected, the execution unit 303 will not perform the settlement process; otherwise, it will perform the settlement process based on the settlement information. In other words, detecting a code and not detecting illegality are both conditions for performing the settlement process. When the settlement process is performed, the result is displayed on the facility terminal 30.

[0202] In addition, the user can select multiple settlement methods. The execution unit 303 performs settlement processing based on the settlement information corresponding to the settlement method selected by the user. The settlement method selected by the user can be pre-registered in the user database DB1 or recorded in the user terminal 20. Information identifying the settlement method selected by the user can also be included in the code displayed on the user terminal 20.

[0203] According to variation (6), the time until settlement processing is performed can be shortened. For example, even if the timeout period from code detection is set short, settlement processing can be performed after illegal detection is performed. For example, if the timeout period for points settlement is set very short compared to the timeout period for credit card settlement, it is difficult to perform illegal detection after the code for points settlement is detected, but illegal detection can still be performed even in such a case. Furthermore, for example, it is also possible to supplement the insufficient points in points settlement by using electronic money that is immediately credited to the credit card. In this case, the timeout period in points settlement sometimes becomes the benchmark, and although credit card settlement is being performed as the back-end processing, it becomes difficult to perform illegal detection, but illegal detection can still be performed even in such a case.

[0204] Additionally, as in the second embodiment, the illegal payment detection system S can also be applied to electronic checkout services where the user terminal 20 reads the codes posted in the store. The process up to reading the product's barcode is the same as described above. The user tells the cashier to use the electronic checkout service, activates the application and camera unit 26 on the user terminal 20, and uses the camera unit 26 to read the codes posted at the checkout counter. After the application and activation actions are performed, the application ID is updated and illegal payment detection is performed as described in the second embodiment. The user completes the checkout by entering the total amount and performing other prescribed operations on the application, and the cashier sees a checkout completion screen. After confirming the screen, the cashier delivers the goods to the user. In this case, the illegal payment detection system S can also be applied.

[0205] (7) In addition, for example, the variations described above can also be combined.

[0206] Furthermore, the prescribed action determined by the action determination unit 201 is not limited to the examples described above. The prescribed action can be any action performed before the detected object is detected. For example, a predetermined time elapsed while a code is displayed on the user terminal 20 can also be considered a prescribed action. For example, the user stopping while a code is displayed on the user terminal 20 can also be considered a prescribed action. For example, the user speaking a prescribed language while a code is displayed on the user terminal 20 can also be considered a prescribed action. In this case, the flag on the user terminal 20 or the facility terminal 30 corresponds to a detection device.

[0207] Furthermore, for example, the prescribed action may not necessarily involve displaying a code. For instance, the prescribed action could be the user approaching the facility or its vicinity without displaying a code. Furthermore, the prescribed action could be the user terminal 20 adopting a prescribed orientation or posture without displaying a code. Furthermore, the prescribed action could be the user speaking a prescribed language without displaying a code. When the object of detection is not a code but an RFID tag, IC chip, etc., the display of a code is not a condition, so the prescribed action only needs to be one or more of the actions described above. Furthermore, for instance, illegal detection can also be performed if the user performs the prescribed action within a specified time period.

[0208] Furthermore, for example, the illegal detection system S can also be applied to services other than those described in the above embodiments and variations, such as electronic ticketing services, automatic ticket checking services, electronic remittance services, or SNS services.

[0209] Furthermore, for example, the illegal detection system S can also be applied to situations where a specified process (e.g., money transfer between users or adding friends on an SNS) is performed by reading the code displayed on a user's terminal 20 from another user's terminal 20. In this case, the camera unit 26 of the other user's terminal 20 is equivalent to the detection device of this disclosure.

[0210] Furthermore, for example, the illegal detection system S can also be applied to situations where the detection device 40 detects a user's biometric information. The detection target is the user's biometric information, and the detection device 40 is used to detect biometric information. The prescribed action is that the user approaches or touches the detection device 40 (the user is present in or near the facility). The action determination unit 201 determines whether the user approached or touched the detection device 40 before detecting biometric information. If it is determined that the user approached or touched the detection device 40, the illegal detection unit 103 performs illegal detection based on the application ID. If biometric information is detected, the execution unit 303 performs the prescribed processing based on the execution result of the illegal detection.

[0211] Furthermore, while the main functions are described using server 10, these functions can also be distributed among multiple computers. For example, functions can be distributed among server 10, user terminal 20, and facility terminal 30 respectively. For example, illegal detection can be performed via user terminal 20 or facility terminal 30 instead of server 10. In this case, user terminal 20 or facility terminal 30 acts as an illegal detection device. Furthermore, for example, the execution of prescribed processes can be performed via server 10 or user terminal 20 without using facility terminal 30. Furthermore, for example, facility terminal 30 can be omitted. Furthermore, for example, in the case where the illegal detection system S includes multiple server computers, functions can be distributed among these multiple server computers.

Claims

1. An illegal detection system, which, upon detecting a target object using a detection device, performs prescribed processing, wherein, The illegal detection system includes: An action determination unit determines whether a user with a user terminal performed a prescribed action before the detected object was detected. An illegal detection unit, upon determining that the specified action has been performed, performs illegal detection related to the user based on the identification information stored in the user terminal; as well as The execution unit, upon detecting the detected object, performs the prescribed processing based on the result of the illegal detection. The object being detected is the code displayed on the user terminal. The detection device, used for detecting the code, is located outside the user terminal. The specified action is a display action used to cause the user terminal to display the code. The action determination unit determines whether the display action was performed before the code was detected. If the display action is determined to have been performed, the illegal detection unit performs the illegal detection based on the identification information. If the code is detected, the execution unit performs the prescribed processing based on the execution result of the illegal detection. The illegal detection system also includes a computing unit that calculates the probability that the code displayed on the user terminal can be exploited by the user, according to a prescribed calculation method. If the display action is determined to have been performed, the illegal detection unit performs the illegal detection based on the probability.

2. An illegal detection system, which, upon detecting a target object using a detection device, performs prescribed processing, wherein, The illegal detection system includes: An action determination unit determines whether a user with a user terminal performed a prescribed action before the detected object was detected. An illegal detection unit, upon determining that the specified action has been performed, performs illegal detection related to the user based on the identification information stored in the user terminal; An execution unit, upon detecting the detected object, performs the prescribed processing based on the execution result of the illegal detection; as well as The update unit updates the identification information stored in the user terminal when the specified update conditions are met. When the identification information is updated and it is determined that the prescribed action has been performed, the illegal detection unit performs the illegal detection.

3. An illegal detection system, which, upon detecting a target object using a detection device, performs prescribed processing, wherein, The illegal detection system includes: An action determination unit determines whether a user with a user terminal performed a prescribed action before the detected object was detected. An illegal detection unit, upon determining that the specified action has been performed, performs illegal detection related to the user based on the identification information stored in the user terminal; An execution unit, upon detecting the detected object, performs the prescribed processing based on the execution result of the illegal detection; as well as The validity determination unit determines the validity of the previously performed illegal tests based on prescribed criteria. The execution unit performs the prescribed processing based on the execution result of the illegal detection and the determination result of the validity of the illegal detection.

4. The illegal detection system according to claim 3, wherein, The specified judgment criteria are conditions related to the elapsed time since the previous execution of the illegal detection. The validity determination unit determines the validity based on the elapsed time.

5. The illegal detection system according to claim 3, wherein, The specified determination criteria are related to the user's movement distance since the previous execution of the illegal detection. The validity determination unit determines the validity based on the movement distance.

6. The illegal detection system according to claim 3, wherein, The detection device is installed in a designated location. The specified determination criteria are related to the following distance: the distance between the specified location and the location of the user terminal when the specified action was performed. The validity determination unit determines the validity based on the distance.

Images