Device and method

Abstract

Provided are a device and a method which are capable of correctly determining a behavior of a subject.　A behavior determination device 100 of the present disclosure comprises: an image analysis unit 102 that functions as an acquisition unit which acquires a subject state of a subject P; a threshold value update unit 104 that functions as a change unit which, when the subject state indicates one state, changes a determination criterion for a significant behavior among subsequent behaviors of the subject P; and a behavior determination unit 103 that determines the significant behavior of the subject according to the determination criterion. The threshold value update unit 104 changes the determination criterion to a criterion which makes it easy to determine an inappropriate act. For example, when an act is determined not to be an inappropriate act (significant behavior) if the distance between the subject P and a target object (a ticket gate 300 in the present disclosure) is within a prescribed distance (determination criterion), the threshold value update unit 104 reduces the prescribed distance (determination criterion).

Description

Apparatus and method

[0001] The present invention relates to an apparatus and method for determining a user state.

[0002] Patent Document 1 describes setting a threshold for detecting abnormalities, and transmitting only video data in which abnormal behavior is detected from the surveillance camera to an abnormality monitoring device, and in so doing, detecting behavior close to the threshold, such as behavior that is a precursor to abnormal behavior.

[0003] JP 2012-4720 A

[0004] However, the technique described in Patent Document 1 may result in an erroneous determination.

[0005] Therefore, an object of the present invention is to provide an apparatus and method that can accurately determine the behavior of a subject.

[0006] The device of the present invention comprises an acquisition unit that acquires the user status of a user, a modification unit that, if the user status indicates a certain state, modifies the criteria for determining important behavior for subsequent user behavior, and a behavior determination unit that determines the user's important behavior in accordance with the criteria, and the modification unit modifies the criteria to criteria that make it easier to determine that the user is performing the important behavior.

[0007] According to the present invention, the behavior of a subject can be accurately determined.

[0008] FIG. 1 is a diagram illustrating a system configuration including a behavior determination device 100 according to the present disclosure. FIG. 2 is a diagram illustrating a functional configuration of the behavior determination device 100 according to the present disclosure. FIG. 3 is a diagram illustrating an example of skeletal information and other suspicious behaviors. FIG. 4 is a diagram illustrating the positional relationship of a target person with respect to a ticket gate. FIG. 5 is a flowchart illustrating, among the operations of the behavior determination device 100 according to the present disclosure, an operation for changing a determination criterion based on a prior behavior. FIG. 6 is a flowchart illustrating a behavior determination operation of the behavior determination device 100. FIG. 7 is a diagram illustrating an example of a hardware configuration of the behavior determination device 100 according to an embodiment of the present disclosure.

[0009] The present disclosure will be described with reference to the accompanying drawings. Whenever possible, the same parts are designated by the same reference numerals and redundant description will be omitted.

[0010] <Embodiment of the Present Disclosure> FIG. 1 is a diagram illustrating a system configuration including a behavior determination device 100 according to the present disclosure. As illustrated in the figure, in this system, a camera 200 captures an image of a subject P passing through a ticket gate 300, and the behavior determination device 100 determines the subject P's behavior based on the image data of the subject P. In the present disclosure, the ticket gate 300 is assumed to be a railway entrance and serves as an entrance / exit where payment processing for entry or exit is performed by touching an IC card. The subject P can perform payment processing for entry or exit by touching a commuter pass or an IC card with ticket functionality to a contact portion provided on the ticket gate 300. The behavior determination device 100 also accesses a fare evasion database 150 to acquire and reference fare evasion history information. The fare evasion database 150 stores user identification information (appearance information) and history information indicating fare evasion in association with each other.

[0011] 2 is a diagram showing the functional configuration of the behavior determination device 100 of the present disclosure. The behavior determination device 100 includes an image data acquisition unit 101, an image analysis unit 102, a behavior determination unit 103, a threshold update unit 104, and a fraud processing unit 105.

[0012] The image data acquisition unit 101 is a part that acquires image data from the camera 200. This image data may include the subject P.

[0013] The image analysis unit 102 is a part that performs image analysis on the subject P when the subject P is included in the image data. This image analysis unit 102 performs a known skeletal estimation using video. As shown in FIG. 3 , the image analysis unit 102 can acquire skeletal information when a human is included in the image data through image analysis. This skeletal information includes the posture of the subject P and the position of their hand (i.e., the position of the IC card).

[0014] Furthermore, the image analysis unit 102 acquires the appearance, speed of movement, belongings, etc. of the subject P contained in the image data as a preliminary detection.

[0015] The behavior determination unit 103 is a part that determines whether or not the subject P is performing an important behavior based on the behavior of the image analysis unit 102. The behavior determination unit 103 determines whether or not the behavior is an important behavior according to predetermined determination criteria. For example, the behavior determination unit 103 determines whether or not the distance between the ticket gate 300 and the subject P is within a reference distance (e.g., 5 cm), and whether or not the distance between the ticket gate 300 (particularly the IC card touch portion or ticket insertion portion) and the subject P's hand is within the reference distance.

[0016] The threshold updating unit 104 is a part that changes the reference distance used by the behavior determining unit 103 based on the prior behavior of the subject P obtained by prior detection. For example, when the prior behavior of the subject P is a predetermined behavior, the threshold updating unit 104 sets the reference distance to be long so that the prior behavior of the subject P can be easily determined to be an important behavior.

[0017] The fraud processing unit 105 is a unit that notifies the entity that manages the ticket gate 300, such as a railway company, of the behavior determined by the behavior determination unit 103. In addition to this, the fraud processing unit 105 may also instruct the camera 200 to capture the facial information.

[0018] Here, the pre-action and important actions of the subject P will be described. FIG. 4 is a diagram showing the position of the subject P when he / she is about to pass through the ticket gate 300. FIG. 4(a) is a diagram showing the subject P in front of the entrance to the ticket gate 300. FIG. 4(b) is a diagram showing the subject P when he / she is about to pass through the ticket gate 300. The image analysis unit 102 analyzes and acquires the actions and appearance of the subject P at the position shown in FIG. 4(a). This position is within the pre-action detection range, and is a distance L from the ticket gate 300. For example, this distance L is about 5 m, but is not limited to this.

[0019] The behavior determination unit 103 detects and determines, as a prior behavior, the behavior of the subject P several meters before the entrance of the ticket gate 300. As described above, the threshold update unit 104 changes the determination criteria of the behavior determination unit 103 based on this prior behavior.

[0020] The image analysis unit 102 also estimates the skeleton of the subject P at the position shown in FIG. 4(b) and analyzes and acquires the positional relationship between the ticket gate 300 and the touch area. The touch area is a part that recognizes the IC card without contact. Alternatively, a ticket insertion area may be used instead of the touch area.

[0021] In addition to skeletal structure estimation, the image analysis unit 102 can also determine, by image analysis, whether or not the subject P is holding a ticket, smartphone, or IC card. The image analysis unit 102 can make this determination by registering images of the shapes of tickets, smartphones, and IC cards in advance and matching them.

[0022] The image analysis unit 102 may also determine the appearance of the subject P. For example, the image analysis unit 102 can determine whether the subject P is wearing a mask, sunglasses, or the like, from image analysis.

[0023] The behavior determination unit 103 determines whether or not a behavior is an important behavior based on the positional relationship between the subject P, the ticket gate 300, and the touch area when the subject P attempts to pass through the ticket gate 300, and based on what criteria.

[0024] FIG. 5 is a flowchart showing the operation of the behavior determination device 100 of the present disclosure, which changes the determination criteria based on prior behavior. The image data acquisition unit 101 acquires image data captured by the camera 200 (S101). When a subject P is within the prior behavior detection range, the image analysis unit 102 performs video analysis of the subject P to acquire appearance information, speed information, movement information, and information about the subject P's belongings (S102 to S105). Note that in process S102, the height of the subject P may be acquired as appearance information. The threshold update unit 104 may determine that the subject P is a child if the subject P meets several child-specific appearance criteria, such as being short in height, carrying a school bag, and wearing a uniform. In this case, even if other criteria indicate a possibility of fare evasion, the threshold may not be changed. For example, if the subject is only short in height, the threshold update unit 104 may determine that the subject is not a child. Furthermore, if the subject is not a child because of appearance information indicating that the subject is short in height but wearing a suit, the threshold update unit 104 may not determine that the subject is a child.

[0025] Furthermore, the communication connection unit 101a accesses the fare fraud DB 150 (S106) and acquires fare fraud history information (S107).

[0026] The threshold update unit 104 then changes the judgment criteria of the behavior determination unit 103 based on the subject P's appearance information, speed information, movement information, belongings information, and fare evasion history information (S108). For example, if the threshold update unit 104 obtains information that the subject P is wearing a mask and sunglasses as appearance information, information that the subject P is running as speed information, information that the subject P is behaving suspiciously as movement information, and information that the subject P does not have a ticket, a boarding IC card, or a smartphone as belongings information, the threshold update unit 104 determines that fare evasion is highly likely and changes the judgment criteria of the behavior determination unit 103 to make fare evasion more likely. For example, the threshold update unit 104 shortens the reference distance for determining whether the subject P's hand has touched the touch area of ​​the ticket gate 300. As a result, the behavior determination unit 103 will strictly judge the relationship between the subject P's hand and the touch area of ​​the ticket gate 300 and the touch state due to the short reference distance. Examples of the suspicious behavior include looking around, constantly looking down, not looking towards the camera at all, etc. These are determined by image analysis by the image analysis unit 102.

[0027] In addition to the information, the threshold updating unit 104 can change the judgment criteria based on the history information of fare evasion. As in the above, when the threshold updating unit 104 determines from the history information that the target person P (determined from appearance) has committed fare evasion, it sets the reference distance of the behavior judgment unit 103 to a short value.

[0028] The criteria for judgment include the reference distance between the subject P and the ticket gate 300 and the reference distance between the subject P's hand and the touch area, and one or both of these may be changed.

[0029] Next, the behavior determination operation of the behavior determination device 100 will be described. FIG. 6 is a flowchart showing the behavior determination operation of the behavior determination device 100. The image data acquisition unit 101 acquires image data captured by the camera 200 (S201). The behavior determination unit 103 determines whether the subject P is at the passing point of the ticket gate 300 (S202). The behavior determination unit 103 determines whether the subject P at the passing point has his / her head and feet positioned in front of his / her hands (S203). If it is determined that the head is positioned in front of his / her hands (process S203: YES), the behavior determination unit 103 determines that the subject P has committed fare evasion (S208). In the above, if fare evasion is determined in processes S207 and S208, the behavior determination unit 103 may update the history information in the fare evasion DB 150. That is, the fare rigging DB 150 stores identification information such as the appearance of the target person P and whether or not there has been fare rigging, and the behavior determination unit 103 updates the information on the appearance of the target person P and whether or not there has been fare rigging. The fare rigging DB 150 also stores date and time information, and this date and time information may also be stored. The target person P is identified by his or her appearance.

[0030] A schematic diagram of this is shown in Figure 3(b). As shown in the figure, the positions of the head, limbs, and feet of the subject P are recognized by skeletal estimation. When passing through the ticket gate 300, the behavior determination unit 103 recognizes that the subject P is running or moving quickly based on the positional relationship between the subject P's head, feet, and hands, and determines that the subject P is ridden illegally. If the subject P's head and feet are significantly in front of the hands (for example, 0.5 m or more), the behavior determination unit 103 determines that the subject P is ridden illegally. The same applies if the subject P's head is determined to be looking around at this timing. As shown in Figure 3(c), the image analysis unit 102 recognizes the amount of head movement based on the subject P's line of sight, and the behavior determination unit 103 can determine this.

[0031] The behavior determination unit 103 also determines whether the moving speed of the target person P is equal to or greater than a predetermined value (S204). If it is determined that the moving speed is equal to or greater than the predetermined value (step S204: YES), the behavior determination unit 103 determines that the target person P is ridden illegally (S208).

[0032] If the answer is NO in processes S204 and S205, the behavior determination unit 103 acquires the distance between the ticket gate 300 and the subject P, and the distance between the touch area of ​​the ticket gate 300 and the hand of the subject P (S205, S206).

[0033] The behavior determination unit 103 determines whether or not fare evasion has occurred based on the acquired distances and threshold values ​​(S207).

[0034] <Effects of the Behavior Determination Device 100 of the Present Disclosure> Next, the effects of the behavior determination device 100 of the present disclosure will be described. The behavior determination device 100 of the present disclosure includes an image analysis unit 102 that functions as an acquisition unit that acquires the subject state of the subject P, a threshold update unit 104 that functions as a change unit that, when the subject state indicates a certain state, changes the criteria for determining significant behavior among the subsequent behaviors of the subject P, and a behavior determination unit 103 that determines significant behavior of the subject P in accordance with the criteria. The threshold update unit 104 changes the criteria to criteria that make it easier to determine fraudulent behavior. For example, if the distance between the subject P and an object (the ticket gate 300 in the present disclosure) is within a predetermined distance (criteria), the threshold update unit 104 reduces the predetermined distance (criteria) when determining that fraudulent behavior (significant behavior) is not occurring.

[0035] For example, the threshold update unit 104 changes the judgment criteria based on the state of the subject P at a pre-action judgment position that is set several meters before the ticket gate 300. Then, the behavior judgment unit 103 judges whether or not the behavior of the subject P at an important action judgment position (a position where the subject P is about to pass through the ticket gate 300) that is chronologically later than the pre-action position is an important action.

[0036] In the present disclosure, the state of the subject P refers to the behavior or appearance of the subject P. The state of the subject P's behavior indicates that the subject P is behaving suspiciously or moving quickly. The state of the subject P's appearance indicates that the subject P is wearing a mask and sunglasses, making it difficult to identify the subject P.

[0037] In addition, with regard to the behavior of the subject P, the threshold update unit 104 is a threshold change unit that changes the judgment criteria in a direction that makes it easier to judge that the subject P is riding illicitly if the moving speed of the subject P before passing the judgment position of the important behavior is equal to or greater than the reference speed.

[0038] According to this configuration, if the target person P is moving quickly, it can be determined that the target person P intends to fare-free, and in that case, by setting stricter criteria, it can be appropriately determined that the target person P will engage in important behavior (fare-free).

[0039] Furthermore, when the appearance of the subject P is in an exceptional state (for example, a child), the threshold update unit 104 does not change the judgment criteria.

[0040] According to this configuration, if the person has a child-like appearance, for example, they may behave in an unexpected manner, so it is better not to change the criteria for judgment.

[0041] Furthermore, if the state of the subject P indicates whether or not the subject P is in possession of an object for legitimate conduct, the threshold update unit 104 does not change the judgment criteria. For example, if the subject P is holding a ticket or the like for a normal ride, the judgment criteria are not changed.

[0042] This allows for appropriate decisions to be made.

[0043] In the present disclosure, the behavior determination device 100 further includes a communication connection unit 101a that accesses a storage unit that stores historical information on fraudulent behavior. The threshold update unit 104 changes the criteria for determining significant behavior based on the historical information. For example, if the target person P has a history of fare evasion, the threshold update unit 104 changes the criteria to be stricter.

[0044] Furthermore, when the target person P is at a judgment position for an important behavior, if the target person P does not have an object for a legitimate behavior, the behavior judgment unit 103 judges that the target person P is performing an important behavior without referring to the judgment criteria. For example, if the target person P does not have a ticket, it is judged that there is an intention to fare fraud.

[0045] If the user's movement speed at the important behavior determination position is equal to or greater than a predetermined speed, the behavior determination unit 103 determines that the behavior is important regardless of the determination criteria. For example, if the target person P runs through the ticket gate 300, it is determined that the target person P has ridden a train without permission.

[0046] In the present disclosure, the judgment criteria include criteria for the subject P and criteria for specific parts of the subject P. For example, the criteria correspond to the positional relationship between the subject P's entire body and the ticket gate 300, and the positional relationship between the subject P's hand (holding a ticket, etc.) and the touch area of ​​the ticket gate 300. Naturally, the lengths used as the criteria for each are different. For example, the normal judgment criteria for the distance between the subject P's entire body and the ticket gate 300 may be, for example, 30 cm, but after the change, it may be, for example, 25 cm.

[0047] In the present disclosure, the description is based on the assumption that fare evasion is an important behavior, but of course, this is not limited to this. For example, if a person is in trouble in a store, on the street, or the like, the troubled state may be determined as important behavior depending on the degree of trouble. Furthermore, the criteria for determining the troubled state may be set variably. For example, if a person is loitering in front of a shelf, the criteria may be changed to make it easier to determine that subsequent behavior is important behavior. Conversely, the present invention may also be applied to someone attempting to commit a fraudulent act such as shoplifting.

[0048] <Configuration of the behavior determination device 100 according to the present disclosure> The behavior determination device 100 according to the present disclosure has the following configuration.

[0049] [1] A device comprising: an acquisition unit that acquires a user state of a user; a modification unit that, when the user state indicates a certain state, modifies a criterion for determining an important behavior for subsequent user behavior; and a behavior determination unit that determines an important behavior of the user in accordance with the criterion, wherein the modification unit modifies the criterion to a criterion that makes it easier to determine that the user is performing the important behavior.

[0050] [2] The device according to [1], wherein the user state is a behavior of the user or an appearance of the user.

[0051] [3] The device according to [2], wherein, when the user state is the user's behavior, the change unit changes the judgment criteria if the user's movement speed before passing through the judgment position of the important behavior is equal to or greater than a reference speed.

[0052] [4] The device according to [2], wherein when the user state is the appearance of the user, the change unit does not change the determination criterion if the appearance of the user is in an exceptional state.

[0053] [5] The device according to [1], wherein the user state indicates whether the user is in possession of an object for a legitimate action.

[0054] [6] The device according to [1], further comprising a communication unit that accesses a storage unit that stores historical information about fraudulent activities, wherein the change unit changes the criteria for determining the significant behavior based on the historical information.

[0055] [7] The device described in [5], wherein the behavior determination unit determines that the user is performing an important behavior without referring to the determination criteria if the user is in a judgment position for an important behavior and the user is not carrying an object for the legitimate action.

[0056] [8] The device according to [1], wherein the behavior determination unit determines that an important behavior is an important behavior without relying on the determination criterion when the user's moving speed at a determination position of the important behavior is equal to or greater than a predetermined speed.

[0057] [9] The device according to any one of [1] to [8], wherein the judgment criteria include criteria for the user and criteria for a specific part of the user.

[0058]

[10] A method comprising: an acquisition step of acquiring a user status of a user; a modification step of, if the user status indicates one state, modifying a criterion for determining significant behavior among subsequent user behaviors; and a behavior determination step of determining significant behavior of the user in accordance with the criterion, wherein the modification step modifies the criterion to a criterion that makes it easier to determine that the behavior is fraudulent.

[0059] <Hardware Configuration and Terminology of the Behavior Determination Device 100 of the Present Disclosure> Next, the hardware configuration and terminology of the present disclosure will be described. The block diagrams used to describe the above embodiments show functional blocks. These functional blocks (components) are realized by any combination of at least one of hardware and software. Furthermore, the method for realizing each functional block is not particularly limited. That is, each functional block may be realized using a single device that is physically or logically coupled, or may be realized using two or more physically or logically separated devices that are directly or indirectly connected (e.g., wired, wireless, etc.) and these multiple devices. The functional block may be realized by combining the single device or multiple devices with software.

[0060] Functions include, but are not limited to, judgment, determination, assessment, calculation, computation, processing, derivation, investigation, search, confirmation, reception, transmission, output, access, resolution, selection, selection, establishment, comparison, assumption, expectation, consideration, broadcasting, notifying, communicating, forwarding, configuring, reconfiguring, allocating, mapping, and assignment. For example, a functional block (component) that performs transmission is called a transmitting unit or transmitter. As mentioned above, there are no particular limitations on how these functions are implemented.

[0061] For example, the behavior determination device 100 according to an embodiment of the present disclosure may function as a computer that performs processing of the behavior determination method of the present disclosure. Fig. 7 is a diagram illustrating an example of the hardware configuration of the behavior determination device 100 according to an embodiment of the present disclosure. The behavior determination device 100 described above may be physically configured as a computer device including a processor 1001, a memory 1002, a storage 1003, a communication device 1004, an input device 1005, an output device 1006, a bus 1007, etc.

[0062] In the following description, the term "apparatus" can be interpreted as a circuit, a device, a unit, etc. The hardware configuration of the behavior determination apparatus 100 may be configured to include one or more of the devices shown in the figure, or may be configured to exclude some of the devices.

[0063] Each function in the behavior determination device 100 is realized by loading specified software (programs) onto hardware such as the processor 1001 and memory 1002, causing the processor 1001 to perform calculations, control communication via the communication device 1004, and control at least one of reading and writing data in the memory 1002 and storage 1003.

[0064] The processor 1001 controls the entire computer by running, for example, an operating system. The processor 1001 may be configured by a central processing unit (CPU) including an interface with peripheral devices, a control device, an arithmetic unit, a register, etc. For example, the image analysis unit 102, the behavior determination unit 103, the threshold update unit 104, etc. may be realized by the processor 1001.

[0065] The processor 1001 also reads programs (program codes), software modules, data, etc. from at least one of the storage 1003 and the communication device 1004 into the memory 1002 and executes various processes in accordance with these programs. The programs used are those that cause a computer to execute at least some of the operations described in the above-described embodiments. For example, the image analysis unit 102, the behavior determination unit 103, and the threshold update unit 104 may be implemented by a control program stored in the memory 1002 and running on the processor 1001, and similar implementations may be used for other functional blocks. While the above-described various processes have been described as being executed by a single processor 1001, they may also be executed simultaneously or sequentially by two or more processors 1001. The processor 1001 may be implemented by one or more chips. The programs may also be transmitted from a network via a telecommunications line.

[0066] The memory 1002 is a computer-readable recording medium and may be configured, for example, by at least one of a read-only memory (ROM), an erasable programmable ROM (EPROM), an electrically erasable programmable ROM (EEPROM), a random access memory (RAM), etc. The memory 1002 may also be called a register, a cache, a main memory (primary storage device), etc. The memory 1002 can store executable programs (program codes), software modules, etc. for implementing the behavior determination method according to one embodiment of the present disclosure.

[0067] Storage 1003 is a computer-readable recording medium, and may be composed of at least one of, for example, an optical disk such as a CD-ROM (Compact Disc ROM), a hard disk drive, a flexible disk, a magneto-optical disk (e.g., a compact disk, a digital versatile disk, a Blu-ray (registered trademark) disk), a smart card, a flash memory (e.g., a card, a stick, a key drive), a floppy (registered trademark) disk, a magnetic strip, etc. Storage 1003 may also be referred to as an auxiliary storage device. The above-mentioned storage medium may be, for example, a database, a server, or other appropriate medium including at least one of memory 1002 and storage 1003.

[0068] The communication device 1004 is hardware (transmission / reception device) for communicating between computers via at least one of a wired network and a wireless network, and is also referred to as, for example, a network device, a network controller, a network card, or a communication module. The communication device 1004 may include a high-frequency switch, a duplexer, a filter, a frequency synthesizer, etc. to realize at least one of frequency division duplex (FDD) and time division duplex (TDD). For example, the image data acquisition unit 101 and the communication connection unit 101a described above may be realized by the communication device 1004. The communication device 1004 may be implemented with a transmitter and a receiver that are physically or logically separated from each other.

[0069] The input device 1005 is an input device (e.g., a keyboard, a mouse, a microphone, a switch, a button, a sensor, etc.) that receives input from the outside. The output device 1006 is an output device (e.g., a display, a speaker, an LED lamp, etc.) that outputs to the outside. Note that the input device 1005 and the output device 1006 may be integrated into one device (e.g., a touch panel).

[0070] Furthermore, each device, such as the processor 1001 and the memory 1002, is connected by a bus 1007 for communicating information. The bus 1007 may be configured using a single bus, or may be configured using different buses between each device.

[0071] The behavior determination device 100 may also be configured to include hardware such as a microprocessor, a digital signal processor (DSP), an application specific integrated circuit (ASIC), a programmable logic device (PLD), or a field programmable gate array (FPGA), and some or all of the functional blocks may be realized by the hardware. For example, the processor 1001 may be implemented using at least one of these pieces of hardware.

[0072] The notification of information is not limited to the aspects / embodiments described in the present disclosure and may be performed using other methods. For example, the notification of information may be performed by physical layer signaling (e.g., Downlink Control Information (DCI) and Uplink Control Information (UCI)), higher layer signaling (e.g., Radio Resource Control (RRC) signaling, Medium Access Control (MAC) signaling, broadcast information (Master Information Block (MIB) and System Information Block (SIB))), other signals, or a combination thereof. Furthermore, the RRC signaling may be referred to as an RRC message, and may be, for example, an RRC Connection Setup message, an RRC Connection Reconfiguration message, or the like.

[0073] The order of the procedures, sequences, flowcharts, etc. of each aspect / embodiment described in this disclosure may be changed unless it is consistent. For example, the methods described in this disclosure present elements of various steps using an example order, and are not limited to the particular order presented.

[0074] Input and output information may be stored in a specific location (for example, memory) or may be managed using a management table. Input and output information may be overwritten, updated, or added to. Output information may be deleted. Input information may be sent to another device.

[0075] The determination may be made based on a value represented by one bit (0 or 1), a Boolean value (true or false), or a numerical comparison (e.g., comparison with a predetermined value).

[0076] The aspects / embodiments described in this disclosure may be used alone, in combination, or switched depending on the implementation. Notification of predetermined information (e.g., notification that "X is true") is not limited to explicit notification, but may be implicit (e.g., not notifying the predetermined information).

[0077] Although the present disclosure has been described in detail above, it is clear to those skilled in the art that the present disclosure is not limited to the embodiments described herein. The present disclosure can be implemented in modified and altered forms without departing from the spirit and scope of the present disclosure as defined by the claims. Therefore, the description of the present disclosure is intended to be illustrative and does not have any limiting meaning on the present disclosure.

[0078] Software shall be construed broadly to mean instructions, instruction sets, code, code segments, program code, programs, subprograms, software modules, applications, software applications, software packages, routines, subroutines, objects, executable files, threads of execution, procedures, functions, etc., whether referred to as software, firmware, middleware, microcode, hardware description language, or otherwise.

[0079] Software, instructions, information, etc. may also be transmitted or received over a transmission medium. For example, if software is transmitted from a website, server, or other remote source using wired technologies (such as coaxial cable, fiber optic cable, twisted pair, Digital Subscriber Line (DSL)), and / or wireless technologies (such as infrared, microwave), then these wired and / or wireless technologies are included within the definition of transmission media.

[0080] The information, signals, etc. described in this disclosure may be represented using any of a variety of different technologies. For example, data, instructions, commands, information, signals, bits, symbols, chips, etc. that may be referred to throughout the above description may be represented by voltages, currents, electromagnetic waves, magnetic fields or magnetic particles, optical fields or photons, or any combination thereof.

[0081] Note that terms described in this disclosure and terms necessary for understanding this disclosure may be replaced with terms having the same or similar meanings. For example, at least one of a channel and a symbol may be a signal (signaling). Furthermore, a signal may be a message. Furthermore, a component carrier (CC) may be called a carrier frequency, a cell, a frequency carrier, etc.

[0082] Furthermore, the information, parameters, etc. described in the present disclosure may be expressed using absolute values, may be expressed using relative values ​​from a predetermined value, or may be expressed using other corresponding information. For example, a radio resource may be indicated by an index.

[0083] The names used for the above-described parameters are not intended to be limiting in any way. Furthermore, the mathematical expressions using these parameters may differ from those explicitly disclosed in this disclosure. The various channels (e.g., PUCCH, PDCCH, etc.) and information elements may be identified by any suitable names, and therefore the various names assigned to these various channels and information elements are not intended to be limiting in any way.

[0084] In this disclosure, the terms "Mobile Station (MS)," "user terminal," "User Equipment (UE)," "terminal," and the like may be used interchangeably.

[0085] A mobile station may also be referred to by those skilled in the art as a subscriber station, mobile unit, subscriber unit, wireless unit, remote unit, mobile device, wireless device, wireless communication device, remote device, mobile subscriber station, access terminal, mobile terminal, wireless terminal, remote terminal, handset, user agent, mobile client, client, or some other suitable terminology.

[0086] As used in this disclosure, the terms "determining" and "determining" may encompass a wide variety of actions. "Determining" and "determining" may include, for example, judging, calculating, computing, processing, deriving, investigating, looking up, searching, inquiring (e.g., searching in a table, database, or other data structure), ascertaining, and the like. "Determining" and "determining" may also include receiving (e.g., receiving information), transmitting (e.g., sending information), input, output, accessing (e.g., accessing data in memory), and the like. Furthermore, "judgment" and "decision" can include regarding resolving, selecting, choosing, establishing, comparing, etc. as having been "judged" or "decided." In other words, "judgment" and "decision" can include regarding some action as having been "judged" or "decided." Furthermore, "judgment (decision)" can be interpreted as "assuming," "expecting," "considering," etc.

[0087] The terms "connected," "coupled," or any variation thereof, refer to any direct or indirect connection or coupling between two or more elements, and may include the presence of one or more intermediate elements between two elements that are "connected" or "coupled" to each other. The coupling or connection between elements may be physical, logical, or a combination thereof. For example, "connected" may be read as "access." As used in this disclosure, two elements may be considered to be "connected" or "coupled" to each other using one or more wires, cables, and / or printed electrical connections, as well as electromagnetic energy having wavelengths in the radio frequency range, microwave range, and optical (both visible and invisible) range, as some non-limiting and non-exhaustive examples.

[0088] As used in this disclosure, the phrase "based on" does not mean "based only on," unless expressly stated otherwise. In other words, the phrase "based on" means both "based only on" and "based at least on."

[0089] As used in this disclosure, any reference to an element using a designation such as "first," "second," etc. does not generally limit the quantity or order of those elements. These designations may be used in this disclosure as a convenient method of distinguishing between two or more elements. Thus, a reference to a first and a second element does not imply that only two elements may be employed or that the first element must in some way precede the second element.

[0090] When the terms "include," "including," and variations thereof are used in this disclosure, these terms are intended to be inclusive, similar to the term "comprising." Furthermore, when the term "or" is used in this disclosure, it is not intended to be an exclusive or.

[0091] In this disclosure, where articles are added by translation, such as a, an, and the in English, the disclosure may include that the nouns following these articles are in the plural form.

[0092] In the present disclosure, the term "A and B are different" may mean "A and B are different from each other." The term may also mean "A and B are each different from C." Terms such as "separate" and "coupled" may also be interpreted in the same way as "different."

[0093] 100... Behavior determination device, 101... Image data acquisition unit, 101a... Communication connection unit, 102... Image analysis unit, 103... Behavior determination unit, 104... Threshold update unit, 105... Fraud processing unit, 150... Fraudulent riding DB, 200... Camera, 300... Ticket gate.

Claims

1. An acquisition unit that acquires the user state of a user, a modification unit that changes the criterion for determining an important action for the subsequent actions of the user when the user state indicates a certain state, and an action determination unit that determines the important action of the user according to the criterion, wherein the modification unit changes the criterion to a criterion that makes it easier to determine that the important action is being performed.

2. The apparatus according to claim 1, wherein the user state is the action of the user or the appearance of the user.

3. The apparatus according to claim 2, wherein when the user state is the action of the user, the modification unit changes the criterion when the moving speed of the user before passing through the determination position of the important action is equal to or higher than a reference speed.

4. The apparatus according to claim 2, wherein when the user state is the appearance of the user, the modification unit does not change the criterion when the appearance of the user is an exceptional state.

5. The apparatus according to claim 1, wherein the user state indicates whether the user has an object for legitimate behavior.

6. The apparatus according to claim 1, further comprising a communication unit that accesses a storage unit that stores history information of illegal behavior, wherein the modification unit changes the criterion for determining the important action based on the history information.

7. The apparatus according to claim 5, wherein when the user is at the determination position of the important action and the user does not have an object for legitimate behavior, the action determination unit determines that the user is performing an important action without referring to the criterion.

8. The apparatus according to claim 1, wherein when the moving speed of the user at the determination position of the important action is equal to or higher than a predetermined speed, the action determination unit determines that it is an important action without relying on the criterion.

9. The apparatus according to claim 1, wherein the criterion includes a criterion for the user and a criterion for a specific part of the user.

10. An acquisition step of acquiring the user state of a user, a modification step of changing the criterion for determining an important action among the subsequent actions of the user when the user state indicates a certain state, and an action determination step of determining the important action of the user according to the criterion, wherein the modification step changes the criterion to a criterion that makes it easier to determine that the important action is being performed.

Images