Personal authentication system and program
The motion recognition system uses terminal device position information to accurately recognize user movements and authenticate users with a simple setup, addressing the challenges of large-scale equipment requirements and ensuring anonymity in personal authentication systems.
Patent Information
- Application Number
- JP2023195901
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2023-11-17
- Publication Date
- 2024-11-15
- Estimated Expiration
- 2043-11-17
AI Technical Summary
Existing motion capture systems require large-scale imaging devices and processing equipment, making them difficult to implement with a small-scale configuration, and existing personal authentication systems struggle with conflicting objectives of user authentication and ensuring anonymity.
A motion recognition system that uses position information from terminal devices to recognize user movements, integrating physical and positional data to achieve accurate motion recognition and authentication without requiring large-scale equipment, while ensuring anonymity through the use of location-based information.
The system accurately recognizes user movements with a simple configuration, enabling high-precision positioning and reliable user authentication based on physical feature points, ensuring anonymity by using location information alone.
Smart Images

Figure 0007584179000001_ABST
Abstract
Description
[Technical field]
[0001] The present invention relates to a motion recognition system, an individual authentication system, a terminal device, a program, and the like. [Background technology]
[0002] In recent years, a technique called motion capture has become known, in which a human body or object is detected and digitally recorded.
[0003] In particular, one known method of motion capture is an optical type in which markers attached to joints and other parts of the human body are detected by multiple cameras at different angles, and the movement of the markers is measured using the principle of triangulation to generate three-dimensional data (for example, Patent Document 1).
[0004] Meanwhile, in recent years, there has been a sharp increase in fraudulent use, such as identity theft, in services such as internet banking services and online stores via the World Wide Web (WWW).
[0005] Recently, there has been a configuration in which location information of a trading partner or a trading source is used to determine the authenticity of the trading partner or a trading source, and an approval process is executed to approve the electronic commerce transaction (for example, Patent Document 2). [Prior art documents] [Patent documents]
[0006] [Patent Document 1] JP 2014-098576 A [Patent Document 2] Patent No. 7321418 Summary of the Invention [Problem to be solved by the invention]
[0007] However, the method described in Patent Document 1 requires large-scale equipment, such as a marker to be attached to the human body, an imaging device such as a camera to recognize the marker, and a processing device to process the status of the imaged marker, making it difficult to realize motion capture processing using a small-scale configuration.
[0008] Furthermore, in the system of Patent Document 2, while taking into consideration the acquisition of personal information when performing approval processing, there is room for improvement in terms of the conflicting objective effects of authenticating the user and ensuring anonymity.
[0009] The present invention has been made to solve the above-mentioned problems, and its purpose is to provide a motion recognition system that is capable of recognizing user movements with a simple configuration by using position information.
[0010] Furthermore, the present invention has been made to solve the above-mentioned problems, and its object is to provide an identity authentication system that is capable of achieving the conflicting objectives of authenticating a user's identity and ensuring anonymity in a simple system by using the user's movements to authenticate the user. [Means for solving the problem]
[0011] (1) In order to solve the above problems, the present invention provides A motion recognition system that recognizes a user's movement using position information of a terminal device, a physical information acquiring means for acquiring information indicating physical characteristics of the user as physical information; a position information acquisition means for acquiring position information of the terminal device, the position information being associated with a part of the user's body and moving in accordance with the movement of the part; a detection means for detecting a trajectory of a part of the user's body as part trajectory information based on position information of the terminal device; a recognition processing means for executing a recognition process for recognizing a body movement of the user based on the acquired body information and the detected body part trajectory information; an output registration management means for outputting the recognized body movement as motion information or registering it in a given database; The present invention has a configuration comprising:
[0012] With this configuration, the present invention can work in conjunction with a system that performs high-precision positioning using various types of communications, such as satellite communications including GPS (Global Positioning System) and GNSS (Global Navigation Satellite System), communications with base stations for mobile phones, or short-range wireless communications such as Wi-Fi, and can detect changes in the position of parts of the user's body using position information from a terminal device.
[0013] Therefore, the present invention can recognize the trajectory of a body part by integrating detected positional changes of body parts, and therefore can accurately recognize the user's movement (i.e., motion) with a simple system configuration.
[0014] In addition, "physical information" includes, for example, height, limb length, shoulder width, body height, limb size, and head size.
[0015] In addition, "a part of the user's body" includes, for example, the wrists, ankles, top of the head, forehead, elbows, and knees, as well as parts of the body that mainly move, such as each joint, or parts that serve as the reference (center) for movement.
[0016] "Part trajectory information" refers to information in which position information acquired at every predetermined timing, such as 0.1 to 1.0 seconds, is converted into a trajectory as continuous positional changes in real space.
[0017] Furthermore, "body movements" includes not only movements of individual parts or combined parts of the body, such as rotating (including various rotating methods), raising and lowering an arm (one or both), shaking a palm (one or both), shaking (front and back, side to side) or turning the head, raising (various raising methods) or lowering a leg (either left or right), or moving or bending the upper body from side to side, but also movements of the whole body, such as walking, jumping, and changing posture (squatting, standing up, lying down, etc.).
[0018] (2) The present invention also provides The position information acquisition means continuously acquiring position information at predetermined timings during a period of a series of movements of a part of the user's body; The detection means The device is configured to detect the trajectory of a part of the user's body as part trajectory information based on a plurality of pieces of position information that are continuously acquired.
[0019] With this configuration, the present invention can obtain position information of a terminal device that moves in accordance with the movement of a part of the body at a predetermined timing, for example, every 0.1 to 1.0 seconds. In addition, since it is possible to distinguish position differences of several mm to several tens of mm, it is possible to detect position changes by associating the position of the terminal device with a part of the body.
[0020] Therefore, the present invention can recognize the trajectory of a body part by integrating detected positional changes of body parts, and therefore can accurately recognize the user's movement (i.e., motion) with a simple system configuration.
[0021] It should be noted that a "series of movements" refers to movements of a specific part from a start timing to an end timing specified based on a given instruction.
[0022] Furthermore, "during a movement period" refers to, for example, the period from the start timing to the end timing of the movement of a specified part.
[0023] (3) The present invention also provides The present invention further includes a presentation means for presenting a trajectory of a part of the user's body to the user, The recognition processing means The recognition process is configured to recognize the user's body movement based on the detected part trajectory information together with presented trajectory information indicating the presented trajectory and the acquired body information.
[0024] With this configuration, the present invention can digitize body movements based on the trajectory and position information of a specified part of the body.
[0025] Furthermore, when the accuracy of identity determination is high, the present invention can determine not only whether the movement is as instructed, but also whether the movement is unique to the user, making it possible to perform identity authentication using the user's movements.
[0026] (4) The present invention also provides a presentation means for presenting to the user a given body part of the user to be measured by the terminal device; The physical information acquisition means The system is configured to acquire position information of the terminal device based on the presented physical part, recognize the acquired position of the terminal device as the position of the presented physical part, and execute a physical information identification process to identify the physical information based on the recognized position of the body part.
[0027] With this configuration, the present invention can recognize the user's height, arm length, shoulder position, hand position, torso length, leg length, knee length, and foot position based on the position information by presenting, for example, the top of the head, shoulders, palms, waist, knees, ankles, or two or more of these as physical parts.
[0028] Therefore, the present invention can obtain physical information based on position information, and therefore can accurately recognize the user's movements (i.e., motion) with a simple system configuration.
[0029] In addition, in the "physical information identification process," the positional information of the recognized physical parts may be directly identified as physical information, or information obtained by performing a specified calculation, such as subtracting the position of the palm from the position of the shoulder and calculating the result as the arm length, may be identified as physical information.
[0030] (5) In order to solve the above problems, the present invention provides A program for recognizing a user's movement using position information of a terminal device, a physical information acquiring means for acquiring information indicating physical characteristics of the user as physical information; a position information acquiring means for acquiring position information of the terminal device, the position information being associated with a part of the user's body and moving in accordance with the movement of the part; a detection means for detecting a trajectory of a part of the user's body as part trajectory information based on position information of the terminal device; a recognition processing means for executing a recognition process for recognizing a body movement of the user based on the acquired body information and the detected body part trajectory information; and an output storage management means for outputting the recognized body movements as motion information or storing them in a given database; The present invention has a configuration that causes a computer to function as a
[0031] With this configuration, the present invention can work in conjunction with a system that performs high-precision positioning using, for example, satellite communications such as GNSS including GPS, communications with base stations for mobile phones, or short-range wireless communications such as Wi-Fi, and can detect changes in the position of parts of a user's body using position information from a terminal device.
[0032] Therefore, the present invention can recognize the trajectory of a body part by integrating detected positional changes of body parts, and therefore can accurately recognize the user's movement (i.e., motion) with a simple system configuration.
[0033] (6) In order to solve the above problems, the present invention provides A terminal device that recognizes a user's movement using location information, a physical information acquiring means for acquiring information indicating physical characteristics of the user as physical information; a position information acquisition means that is associated with a part of the user's body and receives and acquires position information that moves in accordance with the movement of the part; a detection means for detecting a trajectory of a part of the user's body as part trajectory information based on the received position information; a recognition processing means for executing a recognition process for recognizing a body movement of the user based on the acquired body information and the detected body part trajectory information; an output registration management means for outputting the recognized body movement as motion information or registering it in a given database; The present invention has a configuration comprising:
[0034] With this configuration, the present invention can work in conjunction with a system that performs high-precision positioning using, for example, satellite communications such as GNSS including GPS, communications with base stations for mobile phones, or short-range wireless communications such as Wi-Fi, and can detect changes in the position of parts of a user's body using position information from a terminal device.
[0035] Therefore, the present invention can recognize the trajectory of a body part by integrating detected positional changes of body parts, and therefore can accurately recognize the user's movement (i.e., motion) with a simple system configuration.
[0036] (7) In order to solve the above problems, the present invention provides A program for recognizing a user's movement using location information, a physical information acquiring means for acquiring information indicating physical characteristics of the user as physical information; a position information acquisition means that is associated with a part of the user's body and receives and acquires position information that moves in accordance with the movement of the part; Based on the received position information, a trajectory of a part of the user's body is calculated as a part trajectory. A detection means for detecting the information; a recognition processing means for executing a recognition process for recognizing a body movement of the user based on the acquired body information and the detected body part trajectory information; and an output storage management means for outputting the recognized body movements as motion information or storing them in a given database; The present invention has a configuration that causes a computer to function as a
[0037] With this configuration, the present invention can work in conjunction with a system that performs high-precision positioning using, for example, satellite communications such as GNSS including GPS, communications with base stations for mobile phones, or short-range wireless communications such as Wi-Fi, and can detect changes in the position of parts of a user's body using position information from a terminal device.
[0038] Therefore, the present invention can recognize the trajectory of a body part by integrating detected positional changes of body parts, and therefore can accurately recognize the user's movement (i.e., motion) with a simple system configuration.
[0039] (8) In order to solve the above problems, the present invention provides An authentication system for authenticating a user by using motion information indicating a user's movement detected using position information, an information management means for managing user information related to each of the users stored in the storage means, the information management means managing motion characteristic information indicating characteristics of a movement of a part of the body of the user as the user information; A user identification means for identifying a user who is a target of the identity authentication as a target user; a position information acquiring means for acquiring the position information that exists in correspondence with a part of the body of the target user and moves in accordance with the movement of the part; A detection means for detecting a trajectory of a part of a body part of the target user as part trajectory information based on the acquired position information; A determination processing means for executing a determination process for determining identity of movements of physical parts of the target user based on the motion feature information of the target user and the detected part trajectory information; an authentication processing means for executing an authentication process for authenticating the target user when it is determined in the determination process that the movement of the part indicated by the motion feature information and the movement of the physical part of the target user indicated by the part trajectory information are the same or are considered to be the same; The present invention has a configuration comprising:
[0040] With this configuration, the present invention can perform identity authentication based on information obtained from location information, making it possible to perform identity authentication without obtaining personal information such as name or contact details.
[0041] That is, the present invention ensures anonymity by being based only on position information, and can reliably perform identity authentication by using physical features.
[0042] The present invention can achieve the conflicting objectives of authenticating a user and ensuring anonymity by using the user's movements, using a simple system.
[0043] It should be noted that "motion characteristic information" refers to characteristic information regarding the movement of bodily parts, such as the range of motion of the limbs, head, upper body, etc., or differences between the left and right sides, or irregular movements such as habits, or the positions of parts.
[0044] (9) The present invention also provides a trajectory of the part of the body of the target user is detected as part trajectory information based on a plurality of pieces of position information acquired at predetermined timings during a motion period of a series of movements of the part of the body of the target user; The determination means: Recognizing the body movement of the target user as motion information based on the detected part trajectory information; The motion information is compared with the motion feature information to execute the determination process.
[0045] With this configuration, the present invention can acquire position information of a terminal device that moves in conjunction with the movement of a certain part of the body at a predetermined timing, for example, every 0.1 to 1.0 seconds, and can identify position differences of several mm to several tens of mm, so that it can detect position changes by correlating the position of the terminal device with a part of the body.
[0046] Therefore, the present invention can recognize the trajectory of a body part by integrating detected position changes of body parts, thereby ensuring anonymity by being based only on position information, and enabling reliable identity authentication by using physical features.
[0047] (10) The present invention also provides The present invention further includes a presentation means for presenting a trajectory of a part of the user's body to the user, The recognition processing means The recognition process is configured to recognize the user's body movement based on the detected part trajectory information together with presented trajectory information indicating the presented trajectory and the acquired body information.
[0048] With this configuration, the present invention can ensure anonymity based on the trajectory and position information of a specified body part, and can reliably perform identity authentication by using physical feature points.
[0049] Furthermore, when the accuracy of identity determination is high, the present invention can determine not only whether the movement is as instructed, but also whether the movement is unique to the user, making it possible to perform identity authentication using the user's movements.
[0050] (11) In order to solve the above problems, the present invention provides A program for authenticating a user by using motion information indicating the user's movement detected using location information, an information management means for managing user information related to each of the users stored in the storage means, the information management means managing motion characteristic information indicating characteristics of a movement of a part of the body of the user as the user information; A user identification means for identifying a user who is a subject of the identity authentication as a target user; a position information acquiring means for acquiring the position information that exists in correspondence with a part of the body of the target user and moves in accordance with the movement of the part; a detection means for detecting a trajectory of a part of the body of the target user as part trajectory information based on the acquired position information; A determination processing means for executing a determination process for determining identity of movements of physical parts of the target user based on the motion feature information of the target user and the detected part trajectory information; and In the determination process, the movement of the part indicated by the motion feature information and the movement of the physical part of the target user indicated by the part trajectory information are the same or are deemed to be the same. an authentication processing means for executing an authentication process for authenticating the target user when it is determined that the motion is an appropriate motion; The present invention has a configuration that causes a computer to function as a
[0051] With this configuration, the present invention can perform identity authentication based on information obtained from location information, making it possible to perform identity authentication without obtaining personal information such as name or contact details.
[0052] Therefore, the present invention can ensure anonymity by being based only on position information, and can reliably perform identity authentication by using physical features. That is, the present invention can achieve the conflicting objectives of authenticating a user and ensuring anonymity by using the user's movements, using a simple system. [Brief description of the drawings]
[0053] [Figure 1] 1 is a system configuration diagram showing the configuration of a motion recognition system in a first embodiment. [Diagram 2] FIG. 2 is an example of a functional block diagram illustrating a configuration of an information processing server device according to the first embodiment. [Diagram 3] 2A to 2C are diagrams for explaining a user motion capture process executed in the information processing server device of the first embodiment. [Figure 4] 6 is a flowchart showing an operation of a motion capture process executed by the information processing server device of the first embodiment. [Diagram 5] 6 is a flowchart showing an operation of a motion capture process executed by the information processing server device of the first embodiment. [Figure 6] FIG. 11 is a system configuration diagram showing the configuration of an individual authentication system according to a second embodiment. [Figure 7] FIG. 11 is a functional block diagram showing an example of a configuration of a personal authentication server device according to a second embodiment. [Figure 8] 13 is a diagram for explaining the personal authentication process based on motion information executed by the personal authentication server device of the second embodiment. FIG. [Figure 9] 13 is a flowchart showing the operation of a personal authentication process executed by the personal authentication server device of the second embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0054] Hereinafter, an embodiment of the present invention will be described with reference to the drawings.
[0055] The embodiment described below is an embodiment in which a motion recognition system using a network having a terminal device held by a user that acquires current location information for each specified period of time and an information processing server device that recognizes the user's body movements (i.e., motion) based on the current location information of the terminal device, or an embodiment in which the motion recognition system or personal authentication system of the present application is applied to the motion recognition system.
[0056] [A] First embodiment (motion recognition system) [A1] Overview of the motion recognition system First, the outline and system configuration of a motion recognition system S1 according to this embodiment will be described with reference to FIG.
[0057] FIG. 1 is a system configuration diagram showing the configuration of a motion recognition system S1 in this embodiment.
[0058] In order to avoid the diagram from becoming too complicated, FIG. 1 shows only the terminal devices 20 used by some users. That is, the actual motion recognition system S 1, there are many more terminal devices 20 than are shown in FIG.
[0059] (System Overview) As shown in FIG. 1, the motion recognition system S1 of this embodiment is a system for recognizing a user's body movements (motion) using a network while utilizing current location information for each specified period, and outputting the recognized user's body movements as motion information.
[0060] That is, the motion recognition system S1 is a system for realizing motion capture that digitally acquires the movement (so-called motion) of the user himself or a part of the user's body using current position information.
[0061] (System Configuration) As shown in FIG. 1, the motion recognition system S1 of this embodiment is composed of an information processing server device 10 that manages network services and executes various processes for outputting user motion information, and a terminal device 20 (e.g., terminal devices 20A, 20B, 20C) that is connected to the information processing server device 10 via a network such as the Internet and determines its current location based on a satellite signal transmitted from a GPS satellite 70.
[0062] The information processing server device 10 is an information processing device that executes various processes related to network services by using, for example, an API (Application Programming Interface) or a predetermined platform.
[0063] In particular, the information processing server device 10 works in conjunction with the terminal device 20 and has a function for recognizing the physical movements of a corresponding user based on current location information transmitted from the terminal device 20 and physical information having physical characteristics of each user, and for outputting the recognized physical movements of the user as motion information.
[0064] Furthermore, the information processing server device 10 may be configured with one (device, processor) or multiple (devices, processors).
[0065] The terminal device 20 is a communication terminal device that is used by a user and is configured by an information processing device such as a PC (personal computer), a tablet-type information communication terminal device, a smartphone, a mobile phone, or an HMD.
[0066] In addition, the terminal device 20 is a device that can be connected to the information processing server device 10 via a network such as the Internet (WAN) or LAN, and is configured to establish a communication line with the information processing server device 10 via wired or wireless means to send and receive various types of data.
[0067] In addition, the terminal device 20 has a configuration including a communication control function for communicating with the information processing server device 10, such as input information input by a user, a function for acquiring the current location of the terminal device 20 (i.e., current location information), and a display function for performing display control using data received from the information processing server device 10.
[0068] In particular, the terminal device 20 has a configuration for acquiring current location information of the terminal device 20 in conjunction with a system that performs high-precision positioning using communication with a GPS satellite 70 such as a Global Navigation Satellite System (GNSS) including a Global Positioning System (GPS), communication with a base station BS for mobile telephones, or short-range wireless communication with a wireless router such as Wi-Fi.
[0069] [A2] Information processing server device Next, the information processing server device 10 of this embodiment will be described with reference to FIG.
[0070] FIG. 2 is an example of a functional block diagram showing the configuration of the information processing server device 10 according to the present embodiment.
[0071] The information processing server device 10 of this embodiment includes a processing unit 100, a storage unit 170, an information storage medium 180, and a communication unit 196, as illustrated in FIG.
[0072] The information processing server device 10 does not need to include all the units in FIG. 2, and may have a configuration in which some of them are omitted.
[0073] The storage unit 170 serves as a work area for the processing unit 100 and the like, and the function thereof can be realized by hardware such as a RAM (VRAM).
[0074] Specifically, the storage unit 170 includes a main storage unit 171 that is used as a work area for executing various processes, and a user information storage unit 172 in which user information is stored.
[0075] In particular, the user information storage unit 172 stores physical information such as the height, limb length, shoulder width, body length, limb size, and head size of the corresponding user in association with the user ID of the corresponding user.
[0076] The storage unit 170 of the present embodiment may be configured such that some of the components, such as the main storage unit 171 and the user information storage unit 172, are omitted.
[0077] The information storage medium 180 is readable by a computer, and stores programs, data, and the like. That is, the information storage medium 180 stores a program for causing a computer to function as each unit of the present embodiment (a program for causing a computer to execute the processing of each unit).
[0078] The processing unit 100 can perform various processes of this embodiment based on data read from a program (data) stored in this information storage medium 180.
[0079] For example, the information storage medium 180 is an optical disk (CD, DVD), a magneto-optical disk (MO), a magnetic disk, a hard disk, a flash memory such as a solid-state drive, a magnetic tape, a memory (ROM), or a memory card.
[0080] The communication unit 196 performs various controls for communicating with the outside (for example, the terminal device 20), and its functions are realized by hardware such as various processors or communication ASICs, programs, and the like.
[0081] The processing unit 100 performs various processes of this embodiment based on programs (data) stored in the storage unit 170 .
[0082] The processing unit 100 of this embodiment may read out a program or data stored in the information storage medium 180, temporarily store the read out program or data in the storage unit 170, and perform processing based on the program or data.
[0083] In addition, the processing unit 100 (processor) uses the main memory unit 171 in the memory unit 170 as a work area. The functions of the processing unit 100 can be realized by hardware such as various processors (CPU, DSP, etc.) or programs.
[0084] Specifically, the processing unit 100 includes a communication control unit 101, a data management unit 102, a motion trajectory detection unit 103, a motion recognition unit 104, an output control unit 105, a timer management unit 110, and an information providing unit 111.
[0085] The communication control unit 101 establishes a communication line with the terminal device 20 and the like via the network, and performs mutual communication.
[0086] The data management unit 102 cooperates with the communication control unit 101 to acquire the location information transmitted from each terminal device 20 via the communication unit 196 .
[0087] Based on the acquired position information of the terminal device 20, the motion trajectory detection unit 103 detects the trajectory of a part of the body of the corresponding user as part trajectory information.
[0088] The motion recognition unit 104 executes a recognition process for recognizing the body movement of the corresponding user based on the body information of each user stored in the user information storage unit 172 and the detected body part trajectory information.
[0089] The output control unit 105 outputs the recognized body movement as motion information to another server device (not shown) (for example, the terminal device 20 or the personal authentication server device 30 of the second embodiment).
[0090] The timer management unit 110 has a function of measuring the current date and time and from a predetermined timing, and outputs the current time and the measurement result when the predetermined timing arrives.
[0091] The information providing unit 111 works in conjunction with the terminal device 20 to provide information for controlling a process of presenting a trajectory for moving the terminal device 20 in association with a part of the user's body when the terminal device 20 acquires current location information.
[0092] [A3] Method of this embodiment [A3.1] Overview Next, a motion capture process for digitizing a user's movement (that is, motion) executed by the information processing server device 10 of this embodiment will be described with reference to FIG.
[0093] FIG. 3 is a diagram for explaining the user motion capture process executed in the information processing server device 10 of this embodiment.
[0094] The information processing server device 10 of this embodiment is configured to work in conjunction with a system that performs high-precision positioning using, for example, satellite communications such as GNSS including GPS, communications with base stations for mobile phones, or short-range wireless communications such as Wi-Fi, and to detect a change in the position of a part of the user's body using position information from the terminal device 20, and to perform motion capture processing that recognizes the movement of the user as motion based on the detected position change.
[0095] Specifically, as shown in FIG. 3, the information processing server device 10 (A1) A process of acquiring information indicating physical characteristics of a user P as physical information (i.e., a process of reading out user information and a process of identifying and acquiring physical information based on input support using the terminal device 20); (A2) A process for acquiring current position information of the terminal device 20 that exists in association with a part of the body of the user P (i.e., a specific part) and moves in accordance with the movement of the part (hereinafter referred to as a "part position information acquisition process"); (A3) A process of detecting the trajectory of a part of the user's body as part trajectory information based on position information of the terminal device 20 (hereinafter referred to as "part trajectory information detection process"); (A4) a motion recognition process for recognizing a user's body movement based on the acquired body information and the detected part trajectory information; and (A5) an output control process for outputting the recognized body movement as motion information; The present invention has a configuration for executing the above.
[0096] FIG. 3 shows an example of motion capture processing in which location information of the terminal device (portable) 20 is obtained by receiving a GPS signal transmitted from a GPS satellite 70, the user's height (height above the head above ground) is obtained as physical information, and part trajectories are obtained when the right hand is waved.
[0097] By having such a configuration, the information processing server device 10 of this embodiment can integrate detected positional changes of body parts to recognize the trajectory of the body parts, thereby making it possible to accurately recognize the user's movements (i.e., motion) with a simple system configuration.
[0098] [A3.2] Physical information and specific processing of physical information Next, the physical information of the present embodiment and the physical information identification process executed by the information processing server device 10 will be described.
[0099] The physical information is information on the user's external physical characteristics (sizes), such as height, limb length, shoulder width, body length, limb size, and head size, and is stored in advance in the user information storage unit 172 in association with the user ID by a physical information identification process based on an input operation by the user or input support using the terminal device 20.
[0100] In particular, as a physical information identification process, the data management unit 102 cooperates with the information provision unit 111 to acquire current position information including the height above ground at the specified position of the terminal device 20 in units of several mm to several tens of mm when the position of the terminal device 20 is specified.
[0101] Specifically, the data management unit 102 causes the information providing unit 111 to present to the user a given physical part of the user to be measured by the terminal device 20, and obtains current location information of the terminal device 20 based on the presented physical part.
[0102] Furthermore, the data management unit 102 recognizes the acquired current location of the terminal device 20 as the location of the presented body part, and specifies body information based on the recognized location of the body part.
[0103] Then, the data management unit 102 registers the acquired current location information, or a result obtained by performing a predetermined calculation based on the acquired current location information, in the user information storage unit 172 in association with the user ID as physical information indicating physical characteristics.
[0104] For example, the data management unit 102 may specify, as physical information, information obtained by performing a predetermined calculation, such as subtracting the position of the palm from the position of the shoulder to determine the arm length.
[0105] In addition, when the physical information is acquired using the terminal device 20, the data management unit 102 When executing the motion capture process, physical information may be acquired from the terminal device 20 in conjunction with the information providing unit 111.
[0106] [A3.3] Location information acquisition process Next, a part position information acquisition process that is executed in the information processing server device 10 of this embodiment and that acquires the position information of a part of the user's body will be described.
[0107] The data management unit 102 executes part position information acquisition processing to acquire current position information of the terminal device 20 that exists in association with a part of the user's body and moves in accordance with the movement of that part.
[0108] That is, the data management unit 102 continuously acquires current position information at each predetermined timing during a period during which a series of movements of a part of the user's body is taking place.
[0109] In particular, the data management unit 102 continuously acquires current position information for each predetermined timing, regarding the movement of a specific part from a start timing to an end timing specified based on a given instruction as a series of movements.
[0110] Furthermore, the data management unit 102 determines, for example, the period from the start timing to the end timing of the movement of the identified body part as a motion period, and continuously acquires current position information of the identified body part during the motion period.
[0111] Specifically, the data management unit 102 acquires current location information of the terminal device 20 associated with parts of the user's body, such as wrists, ankles, top of the head, forehead, elbows, and knees, as well as parts of the body that mainly move, such as each joint, or parts that serve as reference points for movement.
[0112] In addition, the data management unit 102, in cooperation with the information provision unit 111, identifies the part of the body where the terminal device 20 is located, and the start and end timings of the movement of that part, and acquires this information in association with the current location information transmitted from the terminal device 20.
[0113] For example, the data management unit 102 identifies a part of the user's body and acquires current position information of the identified part (hereinafter referred to as the "specific part") in chronological order during the period from the start to the end of the movement of the identified part.
[0114] Then, the data management unit 102 outputs the acquired current position information from the start timing to the end timing of the movement of the specific part to the motion trajectory detection unit 103.
[0115] [A3.4] Body part trajectory information detection processing Next, a part trajectory information detection process that is executed in the information processing server device 10 of this embodiment and detects the trajectory of a part of the user's body as part trajectory information will be described.
[0116] The motion trajectory detection unit 103 detects the trajectory of a specific part of the user's body as part trajectory information based on the current position information of the terminal device 20 from the start timing to the end timing of the movement of the specific part, which is acquired by the data management unit 102.
[0117] In particular, the information providing unit 111 presents to the user an example of a trajectory of a specific part to be executed using voice, text, or a diagram, and the data management unit 102 performs a position information acquisition process to acquire position information of the terminal device 20 that has moved along the presented trajectory example. The motion trajectory detection unit 103 detects the trajectory of a specific part of the user's body as part trajectory information based on the current position information of the terminal device 20 whose current position is changing along the presented trajectory.
[0118] Specifically, the motion trajectory detection unit 103 detects part trajectory information of a specific part by converting position information acquired at a predetermined timing, such as 0.1 to 1.0 seconds, into trajectory information as continuous position changes in real space (by complementing adjacent acquired positions).
[0119] Then, the motion trajectory detection unit 103 outputs the part trajectory information of the detected specific part to the motion recognition unit 104.
[0120] The trajectory of the specific part presented to the user by the information providing unit 111 may be presented based on an instruction from the user, or may be presented based on a request from an application.
[0121] In addition, the presentation of examples of trajectories of specific parts may be performed when the part trajectory information detection process is being executed during the motion recognition process, or may be performed at a time when the motion recognition process is not being executed.
[0122] [A3.5] Motion recognition processing Next, a motion recognition process for recognizing a body movement of a user, which is a process executed in the information processing server device 10 of this embodiment, will be described.
[0123] The motion recognition unit 104 executes a motion recognition process to recognize the body movements of the corresponding user based on the physical information of the corresponding user acquired (read) as described above and the part trajectory information detected by the above-mentioned part trajectory information detection process.
[0124] For example, the motion recognition unit 104 recognizes, as body movements, movements of individual parts or combined parts such as rotating (including various rotating methods), raising, and lowering arms (both left and right or one side), shaking hands (both left and right or one side), shaking (front and back, left and right) and turning the head, raising (either left or right) a leg (various raising methods) and lowering, or moving and bending the upper body from side to side, as well as movements of the entire body such as walking, jumping, and changing posture (squatting, standing up, lying down, etc.).
[0125] Specifically, as a motion recognition process, the motion recognition unit 104 recognizes the user's body movement based on the detected part trajectory information together with the presented trajectory information indicating the trajectory already presented and the acquired body information.
[0126] [A3.6] Output control processing Next, an output control process that is executed in the information processing server device 10 of this embodiment and outputs body movements as motion information will be described.
[0127] The information providing unit 111 outputs the body movement recognized by the motion recognition process as motion information to the terminal device 20 or another server device (not shown).
[0128] Specifically, the information providing unit 111 may output the information as motion data for animation, or as biometric information for personal identification as described in the second embodiment.
[0129] In addition, the information providing unit 111 may output to the terminal device 20 or the second real It may be a server device for personal authentication (not shown) shown in the embodiment, or a server device for processing motion capture (not shown).
[0130] [A4] Operation in this embodiment Next, the operation of the motion capture process executed by the information processing server device 10 of this embodiment will be described with reference to FIGS.
[0131] 4 and 5 are flowcharts showing the operation of the motion capture process executed by the information processing server device 10 of this embodiment.
[0132] This operation is an operation of a motion capture process for a specific user (i.e., a specific user), and physical information of the specific user is acquired when the motion capture process is executed.
[0133] First, when the data management unit 102 receives an instruction to execute a motion capture process from the terminal device 20 of a specific user (step S101), it transmits a measurement instruction to the information provision unit 111 to measure physical characteristics of the specific user, such as the height, left and right arm lengths, left and right leg lengths, torso length, and left and right knee lengths (step S102).
[0134] At this time, the information providing unit 111 executes control for presenting to the terminal device 20 held by the specific user the body part to be measured for the specific user (hereinafter referred to as the "measurement body part").
[0135] In addition, under the control of the information providing unit 111, the terminal device 20 presents instructions to each specific user for setting the terminal device 20 at measurement sites such as the position of the top of the head, the position of both shoulders, the position of both hands, the position of the waist, and the position of both knees.
[0136] Next, the data management unit 102 identifies the part in which the terminal device 20 of the specific user is set, and acquires the current location information transmitted from the terminal device 20 in association with the identified part (step S103).
[0137] At this time, the terminal device 20 provides the data management unit 102 with the current position information of the terminal device 20 detected for each measurement site.
[0138] Next, the data management unit 102 identifies physical information such as height, limb length, shoulder width, body length, limb size, and head size based on the current position information acquired in association with the identified measurement area (step S104).
[0139] Next, the information providing unit 111, under the control of the communication control unit 101, transmits an instruction for causing the specific user to execute a motion (hereinafter, referred to as a "motion execution instruction") to the terminal device 20 (step S105).
[0140] At this time, the information providing unit 111 executes control to cause the terminal device 20 held by a specific user to be set in a specific position (for example, held in the right hand) and to notify the specific user of the start of the motion capture process.
[0141] Furthermore, under the control of the information providing unit 111, the terminal device 20 presents, for example, an instruction to a specific user to set the terminal device 20 in a specific position.
[0142] Next, when the data management unit 102 detects the start timing of the movement of the specific part acquired by the data management unit 102 (step S106), the data management unit 102 ends the movement. The current location information of the terminal device 20 is sequentially acquired until an end timing is detected (steps S107 and S108).
[0143] Next, when the data management unit 102 detects that it is time to end the movement of the specific part (step S108), the motion recognition unit 104 executes a part trajectory information detection process to detect the trajectory of the specific part of the user's body as part trajectory information based on the current position information of the terminal device 20 from the start timing to the end timing of the movement of the specific part (step S109).
[0144] Next, the motion recognition unit 104 executes a motion recognition process to recognize the body movement of the corresponding user based on the acquired body information of the user and the part trajectory information detected by the part trajectory information detection process (step S110).
[0145] Next, the information providing unit 111 instructs the terminal device 20 to end the execution of the motion capture process (step S111), outputs the body movement recognized by the motion recognition process as motion information (step S112), and ends this operation.
[0146] [A5] Variation [A5.1] Variation 1 Next, a first modified example of this embodiment will be described.
[0147] This modified example is characterized in that a part or the whole of the motion capture process executed in the information processing server device 10 is executed on the terminal device 20.
[0148] For example, when all of the processes of the motion capture processing of the information processing server device 10 are executed by the terminal device 20, the terminal device 20 is configured to manage motion characteristic information indicating the characteristics of the movement of a part of the user's body as the user information.
[0149] In addition, the terminal device 20 (A1) Identify a user who is the subject of identity authentication as a target user; (A2) acquiring the position information that exists in correspondence with a part of the body of the target user and moves in accordance with the movement of the part; (A3) detecting a trajectory of a part of the body of the target user as part trajectory information based on the acquired position information; (A4) executing a determination process for determining identity of movements of physical parts of the target user based on the motion feature information of the target user and the detected part trajectory information; (A5) When it is determined in the determination process that the movement of the part indicated by the motion feature information and the movement of the physical part of the target user indicated by the part trajectory information are the same or are considered to be the same, an authentication process is executed to authenticate the target user. It has a configuration.
[0150] [A5.2] Variation 2 Next, a motion recognition system S1 including a plurality of server devices according to a second modification of the above embodiment will be described.
[0151] In the above embodiment or the above modified example, a plurality of information processing server devices 10 may configure the motion recognition system S1.
[0152] That is, the motion recognition system S1 of this modified example may include a terminal device 20 of a specific user and a plurality of information processing server devices 10 that execute each process of the motion recognition process. .
[0153] [A5.3] Variation 3 Next, a motion recognition system S1 in which motion information is stored as digital data will be described as a third modification of the above embodiment.
[0154] In this modified example, instead of outputting the motion information recognized by the motion recognition process to an external device such as a terminal device 20 in the above embodiment, the motion information may be registered as digital data in a database within the information processing server device 10 or in a database formed on a network.
[0155] Specifically, the motion recognition system S1 of this modified example registers motion information recognized by the motion recognition process in the memory unit 170 as a database, in association with the type of each specific body part, in association with the user ID of a specific user, or in association with both.
[0156] [B] Second embodiment (personal authentication system) [B1] Overview of the identity authentication system Next, the outline and system configuration of the personal authentication system S2 of this embodiment will be described with reference to FIG.
[0157] FIG. 6 is a system configuration diagram showing the configuration of the personal authentication system S2 in this embodiment.
[0158] In order to prevent the diagram from becoming complicated, only the terminal devices 20 used by some users are shown in Fig. 6. That is, in the actual motion recognition system S1, there are many more terminal devices 20 than are shown in Fig. 1.
[0159] (System Overview) As shown in FIG. 6, the personal authentication system S2 of this embodiment is a system that performs personal authentication required when various services (that is, network services) are executed for a user via a network.
[0160] In other words, the identity authentication system S2 of this embodiment has a configuration for performing identity verification to allow a user to use the network service appropriately while avoiding unauthorized use of the network service, such as, for example, hijacking of the user's account, impersonation, or hacking.
[0161] In particular, the personal authentication system S2 of this embodiment has a configuration for utilizing the motion information obtained by the motion capture processing of the first embodiment as biometric information and for executing the personal authentication system as biometric authentication based on the motion information.
[0162] In the personal authentication system S2 of this embodiment, the same members as those in the first embodiment are denoted by the same reference numerals and the description thereof will be omitted.
[0163] (System Configuration) As shown in FIG. 6, the personal authentication system S2 of this embodiment includes an information processing server device 10 that executes a motion capture process, a terminal device 20 (e.g., terminal devices 20A, 20B, and 20C) held by a user who uses the personal authentication process, and a personal authentication server device that cooperates with the information processing server device 10 and executes various processes for approving network services, etc. The apparatus is composed of:
[0164] The personal authentication server device 30 is an information processing device that executes various processes (hereinafter referred to as "personal authentication processes") to approve a given action of a network service, for example, by using an API (application programming interface) or a specified platform.
[0165] Similarly to the information-processing server device 10, the personal authentication server device 30 may be configured as one device (processor), or may be configured as multiple devices (processors).
[0166] The identity authentication server device 30 is configured to execute identity authentication processing by determining whether or not a user is appropriate as a user of a network service, etc., based on motion information indicating the user's body movements recognized by the information processing server device 10.
[0167] [B2] Personal authentication server device Next, the personal authentication server device 30 of this embodiment will be described with reference to FIG.
[0168] FIG. 7 is an example of a functional block diagram showing the configuration of the personal authentication server device 30 of this embodiment.
[0169] The personal authentication server device 30 of this embodiment includes a processing unit 300, a storage unit 370, an information storage medium 380, and a communication unit 396, as shown in FIG.
[0170] The authentication server device 30 does not need to include all the components shown in FIG. 7, and may have a configuration in which some of them are omitted.
[0171] The storage unit 370 serves as a work area for the processing unit 300 and the like, and the function thereof can be realized by hardware such as a RAM (VRAM).
[0172] Specifically, the memory unit 370 includes a main memory unit 371 used as a work area when executing various processes, and a motion information memory unit 372 in which motion information (hereinafter referred to as "reference motion information") that serves as a standard for determining whether each user is appropriate is stored.
[0173] The storage unit 370 of this embodiment may be configured such that some of the components, such as the main storage unit 371 and the motion information storage unit 372, are omitted.
[0174] The information storage medium 380 is readable by a computer, and stores programs, data, and the like. That is, the information storage medium 380 stores a program for causing a computer to function as each unit of the present embodiment (a program for causing a computer to execute the processing of each unit).
[0175] The processing unit 300 can perform various processes of this embodiment based on data read from a program (data) stored in the information storage medium 380.
[0176] For example, the information storage medium 380 is an optical disk (CD, DVD), a magneto-optical disk (MO), a magnetic disk, a hard disk, a flash memory such as a solid-state drive, a magnetic tape, a memory (ROM), or a memory card.
[0177] The communication unit 396 performs various controls for communicating with the information processing server device 10, and its functions are realized by hardware such as various processors or communication ASICs, programs, and the like.
[0178] The processing unit 300 performs various processes of this embodiment based on the programs (data) stored in the storage unit 170. The processing unit 300 of this embodiment may read out the programs and data stored in the information storage medium 380, temporarily store the read out programs and data in the storage unit 170, and perform processes based on the programs and data.
[0179] Furthermore, the processing unit 300 (processor) performs various processes using a main memory unit in the storage unit 370 as a work area. The functions of the processing unit 300 can be realized by hardware such as various processors (CPU, DSP, etc.) or programs.
[0180] Specifically, the processing unit 300 includes a communication control unit 301 , an authentication processing unit 304 , a timer management unit 310 , and an information providing unit 311 .
[0181] The communication control unit 301 establishes a communication line with the information processing server device 10 and the like via the network, and communicates with them.
[0182] The authentication processing unit 304 manages the standard motion information of each user stored in the motion information storage unit 372, and when performing personal authentication processing, acquires motion information recognized by the information processing server device 10 (hereinafter referred to as "recognized motion information").
[0183] In addition, when identity authentication is required, such as when logging in to a network service, the authentication processing unit 304 executes a determination process (hereinafter referred to as an "authenticity determination process") for the relevant user to determine whether the user (hereinafter referred to as a "specific user") who instructs the network service to perform a given action is appropriate (i.e., genuine) based on the reference motion information and recognized motion information.
[0184] Then, when personal authentication is required, the authentication processing unit 304 executes personal authentication processing to determine whether or not to approve the action based on the result of the authenticity determination processing.
[0185] The timer management unit 310 has a function of measuring the current date and time and from a predetermined timing, and outputs the current time and the measurement result when the predetermined timing arrives.
[0186] The information providing unit 311 provides the information processing server device 10 with approval decision result information indicating the decision result of the approval process.
[0187] [B3] Method of this embodiment [B3.1] Overview Next, the personal authentication process based on the motion information executed by the personal authentication server device 30 of this embodiment will be described with reference to FIG.
[0188] FIG. 8 is a diagram for explaining the personal authentication process based on motion information executed by the personal authentication server device 30 of this embodiment.
[0189] The personal authentication server device 30 of this embodiment is a system that performs personal authentication of a user by utilizing the motion information output from the motion recognition system of the first embodiment.
[0190] In particular, the identity authentication server device 30 is configured to perform identity authentication based on information obtained from location information, without obtaining personal information such as name or contact details, and to achieve the conflicting objectives of identity authentication and ensuring anonymity with a simple system.
[0191] Specifically, the authentication server device 30 of this embodiment, as shown in FIG. (A1) managing, for each stored user, user information relating to the user, the motion characteristic information indicating the characteristics of the movement of a part of the user's body, as the user information; (A2) Identifying a user (hereinafter referred to as a “target user”) who is a target of the motion information output from the information processing server device 10; (A3) execute a determination process for determining the identity of the movements of the identified user's physical parts based on the motion feature information of the identified target user (i.e., reference motion information) and the motion information output from the information processing server device 10 (i.e., recognized motion information); (A4) In the determination process, if it is determined that the movement of the part of the body indicated by the motion feature information and the movement of the user's physical part indicated by the motion information are the same or are deemed to be the same, an authentication process is executed to authenticate the identity of the corresponding user.
[0192] FIG. 8 shows an example of motion capture processing in which location information of the terminal device (portable) 20 is obtained by receiving a GPS signal transmitted from a GPS satellite 70, the user's height (height above the head above ground) is obtained as physical information, and a part trajectory is obtained when a specific right hand is waved.
[0193] The personal authentication server device 30 of this embodiment has such a configuration, so that the present invention can ensure anonymity by relying only on location information, and can reliably perform personal authentication by using physical features.
[0194] [B3.2] Personal authentication process Next, the personal authentication process of this embodiment will be described.
[0195] (Basic principle) The authentication processing unit 304 works in conjunction with the information processing server device 10 to perform identity authentication processing based on motion information, based on a request for identity authentication processing (hereinafter referred to as an "identity authentication processing request") from a user or a network service to which the user logs in (specifically, a server device that provides the service, not shown).
[0196] Specifically, when the authentication processing unit 304 receives a user instruction or a request for identity authentication processing from a network service, it identifies the user who is the subject of the identity authentication processing, and requests the terminal device 20 of the identified user (hereinafter referred to as the "authentication target user") to provide the user ID and motion information of the authentication target user.
[0197] At this time, the terminal device 20 provides the authentication processing unit 304 with a user ID, and in conjunction with the information processing server device 10, instructs the authentication processing unit 304 to provide motion information of the user to be authenticated.
[0198] The terminal device 20 may have the information processing server device 10 provide the motion information of the user to be authenticated to the authentication processing unit 304, or the terminal device 20 may have the information processing server device 10 provide the motion information of the user to be authenticated to the authentication processing unit 304. and provide the received motion information of the user to be authenticated to the authentication processing unit 304.
[0199] On the other hand, when the authentication processing unit 304 receives the requested user ID and motion information, (A1) Based on the received user ID, the motion information storage unit 372 is searched to detect motion feature information stored in association with the input user ID; (A2) Compare the received motion information with the detected motion feature information to determine their identity. Execute the personal authentication process.
[0200] In particular, the authentication processing unit 304 determines the identity of the body parts, the contents of the motion, and the path of movement.
[0201] Specifically, the authentication processing unit 304 determines the identity of physical parts, for example, whether a movement of the right hand is a movement of the left foot, or whether the movement is the entire gait (step length, speed, posture, etc.) or only a part of it (such as the effect of an injury to one of the feet).
[0202] Furthermore, the authentication processing unit 304 determines the type of motion, such as translation, rotation, or irregular movement of a body part, or movement associated with a given action (such as swinging an arm while walking).
[0203] Furthermore, the authentication processing unit 304 determines whether the path including the ground height of the motion information and the path of the motion feature information are within a given error range.
[0204] Then, when the above three elements are the same (within the margin of error for the travel route), the authentication processing unit 304 determines that they are the same.
[0205] If the information providing unit 111 determines that the information is the same, it provides a notification to the terminal device 20 or a network service not shown that the personal authentication has been successful, and if it determines that the information is not the same, it provides a notification to the terminal device 20 or a network service not shown that the personal authentication has failed.
[0206] [B4] Operation in this embodiment Next, the operation of the personal authentication process executed by the personal authentication server device 30 of this embodiment will be described with reference to FIG.
[0207] FIG. 9 is a flowchart showing the operation of the personal authentication process executed by the personal authentication server device 30 of this embodiment.
[0208] This operation is an operation of a motion capture process for a specific user (i.e., a specific user), and physical information of the specific user is acquired when the motion capture process is executed.
[0209] Moreover, this operation will be described using an example in which, based on a request for personal authentication processing from the terminal device 20, the presence or absence of personal authentication is provided to the terminal device 20.
[0210] First, when the authentication processing unit 304 receives a request for personal authentication processing transmitted from the terminal device 20 (step S201), it requests the terminal device 20 to provide the user ID and motion information of the user to be authenticated (step S202).
[0211] When the terminal device 20 receives a request for providing the user ID and the motion information, The information processing server device 10 is requested to provide motion information on the user to be authenticated.
[0212] Next, when the authentication processing unit 304 receives the motion information transmitted from the terminal device 20 (step S203), it searches the motion information storage unit 372 based on the user ID of the user to be authenticated, and detects the motion feature information stored in association with the user ID (step S204).
[0213] Next, the authentication processing unit 304 executes a determination process for comparing the received motion information with the detected motion feature information to determine whether they are identical (step S205).
[0214] At this time, if the information providing unit 111 determines that the received motion information and the detected motion feature information are identical or considered to be identical, it transmits a message to the terminal device 20 indicating that the personal authentication was successful (step S206) and terminates this operation.
[0215] On the other hand, if the information providing unit 111 determines that the received motion information is not identical to the detected motion feature information, it transmits a message to the terminal device 20 indicating that the personal authentication has failed (step S207) and terminates this operation.
[0216] [B5] Variation [B5.1] Variation 1 Next, a first modified example of this embodiment will be described.
[0217] This modification is characterized in that a part or the whole of the personal authentication process executed in the personal authentication server device 30 is executed on the terminal device 20.
[0218] For example, when all of the processes of the motion capture process of the information processing server device 10 are executed by the terminal device 20, the terminal device 20 (A1) Manage motion feature information indicating the features of the movement of a part of a user's body as user information; (A2) Identifying a user of the motion information output from the information processing server device 10; (A3) executing a determination process for determining identity of movements of physical parts of the identified user based on the motion feature information of the identified user and the motion information output from the information processing server device 10; (A4) When it is determined in the determination process that the movement of the body part indicated by the motion feature information and the movement of the body part of the user indicated by the motion information are the same or are considered to be the same, an authentication process is executed to authenticate the user. It has a configuration.
[0219] When the personal authentication process is executed in the terminal device 20, the motion feature information may be stored in the terminal device 20, or may be obtained from a given database (not shown) via a network.
[0220] [B5.2] Variation 2 Next, a personal authentication system S2 including a plurality of server devices according to a second modification of the above embodiment will be described.
[0221] In the above embodiment or the above modified example, the personal authentication system S2 may be constituted by a plurality of information processing server devices 10, as in the first embodiment, or the personal authentication system S2 may be constituted by a plurality of personal authentication server devices 30.
[0222] [B5.3] Variation 3 Next, a description will be given of a third modification of the above embodiment, in which the timing of the motion recognition process is different.
[0223] In the above embodiment, the motion recognition process is executed when the personal authentication process is executed, but the motion recognition process may be executed at a timing different from the personal authentication process, for example, before the personal authentication process is executed or after the personal authentication process is executed.
[0224] For example, when identity authentication processing is performed that requires the user to be present at a predetermined location, such as at an ATM or during checkout at a store, if the information processing server device 10 performs motion capture processing on the user's movements, such as walking, before arriving at the location, then the identity authentication server device 30 can complete the identity authentication processing by the time the user arrives at the location.
[0225] Also, for example, if there is a time lag between a user's request for payment and the actual payment, the information processing server device 10 performs a motion capture process after the user's payment request, and the personal authentication server device 30 performs personal authentication processing using the motion information obtained by the motion capture process.
[0226] In this case, a server device (not shown) that executes a given network service may execute payment if the user authentication is successful.
[0227] [B5.4] Variation 4 Next, a fourth modification of the above embodiment will be described, in which a technique related to artificial intelligence (AI) is used in the personal authentication process.
[0228] In this modified example, in the above embodiment, reference motion information that has been modeled in advance through machine learning using AI or the like is used, and a determination process is performed to determine whether or not the reference motion information is a motion of a specific body part of the target user by inputting the target user's ID, motion information obtained by motion capture processing, and specific body part information into the reference motion information as model information.
[0229] In this case, the authentication processing unit 304 performs machine learning such as a support vector machine or a neural network (including deep learning) using the reference motion information as training data, generates model information that models the specified movements of each user, and obtains a determination result of identity as a result of inputting the user ID, specific body parts, and reference motion information into the generated model information.
[0230] In particular, when performing machine learning such as deep learning using artificial intelligence, the authentication processing unit 304 updates the number of neurons and weighting coefficients in the intermediate layer of the neural network that forms the learning model (i.e., model information as reference motion information for a specified movement), and obtains a determination result of identity as a result of inputting the user ID, specific body parts, and reference motion information into the model information.
[0231] In this case, it is preferable that the authentication processing unit 304 generates the model information in advance, but it may also generate the model information when executing the motion capture process or the personal authentication process.
[0232] Furthermore, the authentication processing unit 304 may have another device generate model information and acquire the generated model information.
[0233] Then, the authentication processing unit 304 may further learn the model information, for example, by using the determination result as an evaluation every time the authentication processing unit 304 executes the determination processing.
[0234] [C] Other The present invention is not limited to the above-described embodiment, and various modifications are possible. For example, a term cited as a broadly defined or synonymous term in the description in the specification or drawings can be replaced with a broadly defined or synonymous term in other descriptions in the specification or drawings.
[0235] The present invention includes configurations that are substantially the same as the configurations described in the embodiments (for example, configurations with the same functions, methods and results, or configurations with the same purpose and effect). The present invention also includes configurations in which non-essential parts of the configurations described in the embodiments are replaced. The present invention also includes configurations that achieve the same effects as the configurations described in the embodiments or that can achieve the same purpose. The present invention also includes configurations in which publicly known technology is added to the configurations described in the embodiments.
[0236] Although the embodiments of the present invention have been described in detail as above, it will be easily understood by those skilled in the art that many modifications are possible without substantially departing from the novel features and effects of the present invention. Therefore, all such modifications are intended to be included within the scope of the present invention. [Explanation of symbols]
[0237] S1: Motion Recognition System S2: Personal authentication system 10: Information processing server device 20: Terminal device 30: Authentication server device 70:GPS satellite 100: Processing section 101: Communication control unit 102: Data Management Department 103: Motion trajectory detection unit 104: Motion recognition unit 105: Output control section 110: Timer management unit 111: Information provision department 170: Storage section 171: Main memory 172: User information storage unit 180: Information storage medium 196: Communications Department 200: Terminal device 300: Processing section 301: Communication control section 304: Authentication processing section 310: Timer management unit 311: Information provision department 370: Storage section 371: Main memory 372: Motion information storage unit 380: Information storage medium 396: Communications Department
Claims
1. An authentication system for authenticating a user by using motion information indicating a user's movement detected using position information, an information management means for managing user information related to each of the users stored in the storage means, the information management means managing motion characteristic information indicating characteristics of a movement of a part of the body of the user as the user information; A user identification means for identifying a user who is a target of the identity authentication as a target user; a position information acquiring means for acquiring the position information that exists in correspondence with a part of the body of the target user and moves in accordance with the movement of the part; A detection means for detecting a trajectory of a part of a body part of the target user as part trajectory information based on the acquired position information; A determination processing means for executing a determination process for determining identity of movements of physical parts of the target user based on the motion feature information of the target user and the detected part trajectory information; an authentication processing means for executing an authentication process for authenticating the target user when it is determined in the determination process that the movement of the part indicated by the motion feature information and the movement of the physical part of the target user indicated by the part trajectory information are the same or are considered to be the same; Equipped with The determination processing means: An identity authentication system, comprising: a determining process that is executed at a timing different from a timing at which the authentication process is executed.
2. In the personal authentication system according to claim 1, The determination processing means: The different timing is a timing before the authentication processing is performed or a timing after the authentication processing is performed.
3. In the personal authentication system according to claim 1, a trajectory of the part of the body of the target user is detected as part trajectory information based on a plurality of pieces of position information acquired at predetermined timings during a motion period of a series of movements of the part of the body of the target user; The determination processing means: Recognizing the body movement of the target user as motion information based on the detected part trajectory information; An identity authentication system that compares the motion information with the motion feature information and executes the determination process.
4. A program for authenticating a user by using motion information indicating the user's movement detected using location information, an information management means for managing user information related to each of the users stored in the storage means, the information management means managing motion characteristic information indicating characteristics of a movement of a part of the body of the user as the user information; A user identification means for identifying a user who is a subject of the identity authentication as a target user; a position information acquiring means for acquiring the position information that exists in correspondence with a part of the body of the target user and moves in accordance with the movement of the part; a detection means for detecting a trajectory of a part of the body of the target user as part trajectory information based on the acquired position information; A determination processing means for executing a determination process for determining identity of movements of physical parts of the target user based on the motion feature information of the target user and the detected part trajectory information; and an authentication processing means for executing an authentication process for authenticating the target user when it is determined in the determination process that the movement of the part indicated by the motion feature information and the movement of the physical part of the target user indicated by the part trajectory information are the same or are considered to be the same; The computer functions as The determination processing means: The program is characterized in that the determination process is executed at a timing different from a timing at which the authentication process is executed.
Citation Information
Patent Citations
Pointing device, moving method of pointer and portable information processor
JP1998171591A
Motion capture method and motion capture device performing the motion capture method
JP2014098576A
Program for reflecting movement of user on avatar, information processing device for executing program, and method for distributing video including avatar
JP2019160295A
Communication node, multi-hop network, method and program for checking validity of device
JP2021036645A
Electronic commerce approval system, electronic commerce management system, electronic commerce approval method, electronic commerce method, and program
JP7321418B1
