Information processing device, information processing method, and computer program

Abstract

[Problem] To provide an information processing device, an information processing method, and a computer program which enable highly accurate authentication. [Solution] An information processing device according to the present disclosure is provided with: a position acquiring unit for acquiring position information of a user; a feature quantity calculating unit for calculating a feature quantity of the motion of the user, on the basis of sensor data detected by at least one sensor device; and an authentication processing unit for performing authentication processing of the user on the basis of an authentication model corresponding to the position information, and the feature quantity.

Description

[Technical field]

[0001] The present disclosure relates to an information processing device, an information processing method, and a computer program. [Background technology]

[0002] Possession authentication, memory authentication, and biometric authentication are known as means of identity authentication to confirm the authenticity of a person. Possession authentication uses an item that the person possesses, such as a key, and there is a risk of loss or theft. Memory authentication uses information such as a password that the person remembers, and like possession authentication, there is a problem of theft and leakage. There is also the problem of the hassle of remembering. Biometric authentication uses a person's biometric characteristics, such as fingerprint authentication, face authentication, and vein authentication. Biometric authentication is advantageous in terms of security and usability, but has the problem of high costs. In addition, it requires the user to act or operate by pressing a finger against a sensor or looking into a camera.

[0003] As described above, conventional authentication methods require actions or operations by the user, such as inputting a password, taking out and presenting a card, pressing a finger against a sensor, or looking into a camera.

[0004] Therefore, frictionless authentication, which identifies a person from their natural daily behavior and actions, has been attracting attention as an authentication method that does not require such user actions or operations. Gait authentication is one type of frictionless authentication. Gait authentication is performed by focusing on differences in the characteristics of the way people walk. However, in gait authentication, the accuracy of authentication may decrease depending on the place where a person walks because the way a person walks is affected by the characteristics or conditions of the road surface. Therefore, robust authentication is desired.

[0005] The following Patent Document 1 discloses a technology for authenticating a user based on information received from multiple wearable devices worn by the user and the positions of the wearable devices. This technology makes it possible to authenticate a user from the user's daily actions without the user having to perform any special actions or operations. However, with this technology, there is a possibility that the accuracy of authentication may decrease if authentication is performed in an environment different from the environment in which the operations for generating a model for authentication were performed. [Prior art documents] [Patent documents]

[0006] [Patent Document 1] International Publication No. 2018-059962 Summary of the Invention [Problem to be solved by the invention]

[0007] The present disclosure provides an information processing device, an information processing method, and a computer program that enable highly accurate authentication. [Means for solving the problem]

[0008] The information processing device disclosed herein includes a location acquisition unit that acquires location information of a user, a feature calculation unit that calculates features of the user's actions based on sensor data detected by at least one sensor device, and an authentication processing unit that performs authentication processing of the user based on an authentication model corresponding to the location information and the features.

[0009] The information processing method disclosed herein acquires location information of a user, calculates characteristics of the user's actions based on sensor data detected by at least one sensor device, and performs authentication processing of the user based on an authentication model corresponding to the location information and the characteristics.

[0010] The computer program disclosed herein causes a computer to execute the steps of acquiring location information of a user, calculating characteristics of the user's movements based on sensor data detected by at least one sensor device, and performing authentication processing of the user based on an authentication model corresponding to the location information and the characteristics. [Brief description of the drawings]

[0011] [Figure 1] 1 is a block diagram of an information processing apparatus according to a first embodiment of the present disclosure. [Diagram 2] FIG. 11 is a diagram showing a specific example of user authentication. [Diagram 3] 5A and 5B are diagrams showing a specific example of the operation of a position receiving unit. [Figure 4] FIG. 4 is a diagram showing an example of a section information DB. [Diagram 5] FIG. 13 is a diagram showing an example of a learning DB. [Figure 6] FIG. 4 is a diagram showing an example of a walking model DB. [Figure 7] 11 is a flowchart illustrating an example of an operation of the information processing device in a learning phase. [Figure 8] 10 is a flowchart illustrating an example of an operation in an authentication phase in an information processing device. [Figure 9] FIG. 13 is a diagram showing an example of an information processing device and a terminal device according to a modified example of the first embodiment. [Figure 10] FIG. 13 is a diagram showing an example in which an authentication utilization device is arranged as a server in a communication network. [Figure 11] FIG. 11 is a diagram showing an example of performing identity authentication for payment as specific example 1. [Figure 12] 1 is a flowchart of an operation of an information processing device according to a first specific example. [Figure 13] FIG. 11 is a diagram for explaining specific example 2. [Figure 14] 11 is a flowchart of the operation of an information processing device according to a second specific example. [Figure 15] FIG. 11 is a block diagram of an information processing device according to a second embodiment of the present disclosure. [Figure 16] FIG. 13 is a diagram showing a display example of a screen of an information processing device. [Figure 17] 11A and 11B are diagrams showing other display examples of the screen of the information processing device. [Figure 18] 11A and 11B are diagrams showing other display examples of the screen of the information processing device. [Figure 19] FIG. 13 is a diagram showing an example of a screen display according to a modified example of the second embodiment. [Figure 20] FIG. 13 is a diagram showing another example of a screen display according to a modified example of the second embodiment. [Figure 21] FIG. 11 is a block diagram of an information processing device according to a third embodiment of the present disclosure. [Figure 22] FIG. 4 is a diagram showing a specific example according to the present embodiment. [Figure 23] FIG. 13 is a diagram showing a display example of a screen of an information processing device. [Figure 24] 13 is a flowchart of an operation example of the information processing device according to the third embodiment. [Diagram 25] FIG. 2 is a diagram showing an example of a hardware configuration of an information processing device according to the present disclosure. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0012] Hereinafter, the embodiments of the present disclosure will be described with reference to the drawings. In one or more embodiments shown in the present disclosure, the elements included in each embodiment can be combined with each other, and the combined result also forms part of the embodiment shown in the present disclosure.

[0013] (First embodiment) FIG. 1 is a block diagram of an information processing device 101 according to the first embodiment of the present disclosure.

[0014] The information processing device 101 is a device that a user carries or wears when moving. Examples of the information processing device 101 include a smartphone, a wearable device, a mobile phone, a tablet, and a personal computer (PC). The PC includes various types of PCs such as a notebook PC and a desktop PC. Examples of the wearable device include a wristband type device, a glasses / goggle type device, an earphone type device, a finger ring type device, and a necklace type device. However, the information processing device 101 and the wearable device are not limited to these examples. For example, the information processing device 101 may be any other device that the user can carry when moving. The movement of the user means movement by one's feet, specifically, walking or running. In the following, unless otherwise specified, an example in which the user walks will be described.

[0015] The outline of the information processing device 101 will be described. The information processing device 101 performs gait authentication, which is an authentication method focusing on the characteristics of the user's movements while walking, with high accuracy, without depending on the characteristics of the path along which the user walks. The information processing device 101 has a learning phase and an authentication phase, and generates a walking model, which is an authentication model used for authenticating the user, in the learning phase. An authentication section is set in advance for the authentication use device, and the user's location in the authentication section is detected based on the user's position information. A feature amount (walking feature) of the user's walking movement is calculated from sensor data acquired while the user is walking in the authentication section. A walking model for identifying the user is generated based on the calculated walking feature. In the authentication phase, the walking feature is calculated based on sensor data acquired when the user walks in the authentication section, and the user authentication process (confirmation of whether the user is a genuine user) is performed using the calculated walking feature and the walking model generated for the authentication section. By using a walking model corresponding to the authentication section in this way, high accuracy authentication is possible regardless of the characteristics of the user's path along which the user walks.

[0016] Result information indicating whether the user authentication was successful or unsuccessful is sent to the authentication-using device, and the authentication-using device performs processing according to the result information. For example, the authentication-using device performs a specific process if the authentication is successful. Examples of authentication-using devices include facility gate systems, storage units, and devices that provide products and services at any location or at a specific location. Examples of facility gate systems include the front door of a home, a flapper gate, a ticket barrier, and an office door. Examples of storage units include shelves and lockers for storing valuables and confidential items. Examples of devices that provide products and services include servers for EC (Electronic Commerce) sites, vending machines, and payment devices in stores.

[0017] Examples of specific processing when authentication is successful include unlocking the gate or the lock in a facility gate system, and unlocking the lock in a storage. Devices that provide products and services include, for example, payment processing associated with the purchase of products and services on an EC site, product provision and payment processing in a vending machine, and payment devices in unmanned stores. Another example of providing a service is a service that provides information to a user. For example, health and medical-related personal information (calories burned, target weight, etc.) may be provided by voice or text at the midpoint or finish point of a jog. The authentication utilization device and the specific processing performed when authentication is successful described here are merely examples, and other examples may be used.

[0018] FIG. 2 shows a specific example of user authentication. Authentication zones 112 and 113 are set in the vicinity of an authentication utilization device 111 (here, a locked door system) arranged along a walkway. The authentication zone 112 is a flat road, and the authentication zone 113 is a slope. A user A is walking along a route including the authentication zone 112, and when the user A enters the authentication zone 112, an information processing device 101 carried by the user A1 calculates the gait feature amount (gait feature) of the user A walking in the authentication zone 112. The user authentication is performed using the calculated gait feature and a learned gait model (authentication model). The information processing device 101 may be stored in a pocket of the user's clothes, held in the user's hand, housed in a bag carried by the user, or worn on the body as a wearable device. The authentication zone is set according to an arbitrary criterion, such as a zone where the gait feature of an individual is likely to appear in the authentication utilization device, or a zone close to the authentication utilization device. The length of the authentication zone is also set arbitrarily from the viewpoint of the length required to acquire the gait feature of an individual.

[0019] Before the user A arrives at the authentication utilization device 111, the authentication of the user A is successful, and the information processing device 101 transmits a message indicating a successful authentication result to the authentication utilization device 111. The authentication utilization device 111 that receives the success message unlocks the door. When the user A arrives at the authentication utilization device 111, the door is unlocked, and the user can pass through the door (for example, pass through to the back side of the paper). The authentication utilization device 111 closes the door when it confirms the user's passage or after a certain period of time has elapsed. In this example, the authentication utilization device 111 unlocks the door when it confirms the success of the authentication process. As another example, the user may provide his / her identification information (ID information) to the authentication utilization device 111 by having the authentication utilization device 111 read his / her ID card, and the authentication utilization device 111 may unlock the door only when it confirms that the user read from the ID card matches the user for whom the authentication process has been successful. There may be various variations in the conditions for the authentication utilization device 111 to perform a specific operation after the user authentication process has been successful.

[0020] Although an example has been described in which user A walks in the authentication section 112, the same applies to the case where user A walks in the authentication section 113, which is a slope. In this case, a walking model different from that of the authentication section 112 is learned in advance for the authentication section 113. For user A who has entered the authentication section 113, the information processing device 101 calculates the gait feature amount (gait feature) of user A walking in the authentication section 113, and performs authentication processing of the user using the different walking model (authentication model) that has already been learned.

[0021] Even if the characteristics of user A's walking movements differ between flat roads and slopes, highly accurate user authentication (personal authentication) can be performed by using a walking model that corresponds to each. Here, the example of the road gradient is shown as a characteristic of the walkway, but other characteristics are also possible, such as the type of road surface, such as asphalt pavement, gravel road, or grass.

[0022] The information processing device 101 according to this embodiment will be described in further detail below.

[0023] 1 includes a position detection unit 11, a position reception unit 12, a position acquisition unit 13, a position determination unit 14, sensor devices 1 to N (N is an integer equal to or greater than 1), a sensor data acquisition unit (motion acquisition unit, environment acquisition unit) 15, a gait feature calculation unit (feature amount calculation unit) 16, a model generation unit 17, an authentication processing unit 19, a communication unit 20, an antenna 21, a gait model database (DB) 22, an authentication result DB 23, an interval information DB 24, a learning DB 25, an input unit 102, and an output unit 103. In addition, the information processing device 101 includes a control unit (not shown) that controls these elements.

[0024] The input unit 102 is an input device or an operation device through which a user of the information processing device 101 inputs instructions or data. The input unit is, for example, a touch panel, a voice input device (e.g., a microphone, etc.), a gesture input device, or any combination of these. The gesture input device detects a gesture of the user using, for example, a sensor, and obtains instructions or data corresponding to the gesture.

[0025] The output unit 103 is an output device that outputs instructions or data to a user of the information processing device 101. The output device is, for example, a display device (e.g., a liquid crystal display device or an organic EL display device), an audio output device (such as a speaker), a vibration device, a light emitting device, or any combination of these.

[0026] The communication unit 20 transmits and receives signals using an antenna 21. The communication unit 20 is connected to a wireless communication network and communicates with an external device via the communication network. The communication network may be a local area network or a wide area network such as the Internet. Specific examples include, but are not limited to, wireless LAN, mobile networks (4G and 5G networks), Bluetooth, and the like. The communication unit 20 may be connected to a wired network.

[0027] The position detection unit 11 detects information (position information) related to the user's position. As an example, the position detection unit 11 includes a GPS (Global Positioning System) and detects longitude and latitude as position information using the GPS. As another example, the position information may be the zone in which the user is located (authentication zone).

[0028] The position receiving unit 12 receives user position information from an external device using wireless communication.

[0029] FIG. 3 shows a specific example of the operation of the location receiving unit 12. For example, in a wireless LAN (Local Area Network), the location receiving unit 12 communicates with, for example, a base station (or access point) 105 as an external device, and receives a signal including the user's location information estimated by the base station 105. Alternatively, the location receiving unit 12 may receive information including the user's location from a cellular base station in a cellular communication network. Also, the user is captured by a camera (image sensor) 107 installed in a facility 106 along the user's walking route, and the distance to the captured user is calculated based on camera parameters calibrated in advance. Instead of a camera, a distance sensor such as a TOF (Time Of Flight) sensor may be used. The user's location information may be estimated from the position of the camera (or distance sensor) and the distance to the user. The location receiving unit 12 receives the location information estimated by the device on the facility 106 side by wireless communication. Alternatively, the location receiving unit 12 may receive data required for calculation from the device on the facility 106 side, and the location acquiring unit 13 may estimate the user's location information using the received data.

[0030] The position receiving unit 12 may also receive the user's position information from a sensor device included in another device carried or worn by the user. For example, the information processing device 101 is included in a smartphone, and the user is equipped with a wearable device (e.g., a smart watch) with a GPS. In this case, the user's position information may be received from the wearable device by Bluetooth (registered trademark), UWB (Ultra Wide Band), or infrared communication. The example of FIG. 3 shows an example in which the user wears the information processing device 101 and wearable devices 31 and 32 including at least one of a sensor and a GPS. In this example, the wearable device 31 is a wristband type device, and the wearable device 32 is an earphone type device. Note that the information processing device 101 may be a wearable device.

[0031] The position acquisition unit 13 acquires the position information of the user using the position detection unit 11 or the position reception unit 12. The position acquisition unit 13 may receive a plurality of pieces of position information using at least one of the position detection unit 11 and the position reception unit 12, and may treat the average value or median value of the received position information as the position information of the user.

[0032] The sensor devices 1 to N detect sensor data for identifying motion information of a user walking or walking environment information. Examples of the sensor devices include inertial sensors (acceleration sensors, gyro sensors), speed sensors, magnetic sensors, imaging sensors, sonic sensors, infrared sensors, environmental sensors, and biosensors. Examples of the environmental sensors include temperature sensors, humidity sensors, and air pressure sensors. Examples of the biosensors include pulse wave sensors, pulse oximeters, sweat sensors, and blood flow sensors. The above described examples of the sensor devices are merely examples, and other sensors may be used as long as they can detect the motion of the user or the walking environment.

[0033] The sensor data acquisition unit 15 acquires sensor data from at least one of the sensor devices 1 to N, a sensor device included in another device carried or worn by the user, or an external device on the communication network. The sensor data acquisition unit 15 includes an action acquisition unit that acquires action information of the user based on the sensor data, and an environment acquisition unit that acquires environmental information of the user based on the sensor data.

[0034] An example will be shown in which the sensor data acquisition unit 15 acquires sensor data from a sensor device included in another device carried or worn by the user. For example, it is assumed that the information processing device 101 is included in a smartphone, and the user is equipped with a wearable device (e.g., a smart watch) including a gyro sensor. In this case, the sensor data may be received from the wearable device by Bluetooth (registered trademark), UWB (Ultra Wide Band), or infrared communication. The sensor data may include position information of the other device. The other device may acquire position information by a method similar to the above-mentioned user position information. Alternatively, the position receiving unit 12 may locally communicate with the other device, calculate the relative position of the other device, and provide the calculated relative position to the sensor data acquisition unit 15.

[0035] An example will be shown in which the sensor data acquisition unit 15 acquires sensor data from an external device. The sensor data acquisition unit 15 acquires weather information for the user's position from, for example, a weather server as an external device (server). Alternatively, if weather information has already been acquired by an application of the information processing device 101, the weather information may be acquired from the application.

[0036] <Learning Phase> The position determination unit 14 determines whether the position condition is satisfied based on the user's position information. As an example, it is determined whether the user is in the authentication zone set for the authentication utilization device, and if the user is in the authentication zone, it is determined that the position condition is satisfied, and if the user is not in the authentication zone, it is determined that the position condition is not satisfied. For example, if it is detected that the user has entered the authentication zone, the position condition is satisfied. Also, if it is detected that the user has left the authentication zone, the position condition is not satisfied. In addition to whether the user is in the authentication zone, other conditions may be added. For example, a user may input an instruction at the timing when he / she wants to learn, and the fact that the instruction has been input may be added as a requirement for satisfying the position condition. Alternatively, instruction data for starting learning may be received from an external device, and the fact that the instruction data has been received may be added as a requirement for satisfying the position condition.

[0037] The zone information DB 24 stores information about the authentication zone set for the authentication utilization device.

[0038] FIG. 4 shows an example of the section information DB 24. The section information DB 24 holds identification information of the authentication-use device (authentication-use device ID), identification information of the authentication section (authentication section ID), and range information of the authentication section. As an example, the range of the authentication section may be specified by one or more meshes in map data divided into a two-dimensional mesh by longitude and latitude. Alternatively, the range may be specified by a plurality of coordinates (longitude, latitude). Alternatively, the range may be specified by an address. Alternatively, when the map data is composed of a plurality of objects, an object corresponding to the authentication section may be specified. The methods described here may be combined. The range may be specified by accessing a map server on the communication network via the communication unit 20, acquiring map data, and using the map data. The range may be specified by other methods.

[0039] The position determination unit 14 determines whether or not a position condition is satisfied for each authentication zone registered in the zone information DB 24. For example, it determines whether or not the user has entered or left the authentication zone.

[0040] When the position condition is satisfied for a certain authentication zone (for example, when it is detected that the user has entered the authentication zone), the position determination unit 14 provides learning start information to the model generation unit 17. The learning start information includes, for example, identification information of the authentication zone in which the user has entered and identification information of the authentication utilization device in which the authentication zone is set. When the position determination unit 14 no longer satisfies the position condition (for example, when it is detected that the user has left the authentication zone), it provides learning end information to the model generation unit 17. The learning end information includes, for example, the authentication zone in which the user has left and identification information of the authentication utilization device in which the authentication zone is set.

[0041] When the model generation unit 17 acquires learning start information from the position determination unit 14, it provides instruction data instructing the gait feature calculation unit 16 to calculate the feature amount (gait feature) of the user. When the model generation unit 17 acquires learning end information from the position determination unit 14, it provides instruction data instructing the gait feature calculation unit 16 to end.

[0042] When the gait feature calculation unit 16 receives instruction data to calculate the gait feature, it acquires sensor data via the sensor data acquisition unit 15. The sensor data may be, for example, a time-series signal waveform, or may be discrete values ​​acquired at regular time intervals. As described above, the sensor data acquisition unit 15 acquires sensor data from the sensor devices 1 to N, other wearable devices equipped by the user, external devices, or a combination of these. When the sensor data acquisition unit 15 receives instruction data to end the calculation of the gait feature, it stops acquiring the sensor data.

[0043] The gait feature calculation unit 16 uses the provided sensor data to calculate at least one feature amount (gait feature) of the user. The gait feature calculation unit 16 also acquires environmental information representing the user's walking environment (more specifically, the walking environment of the authentication section) based on the provided sensor data. The sensor data for acquiring the environmental information and the sensor data for calculating the gait feature may be the same or different. The gait feature calculation unit 16 provides the calculated gait feature of the user to the model generation unit 17 in association with the environmental information.

[0044] Examples of the walking feature include walking speed data, six-component data including three-axis acceleration and three-axis angular velocity, heart rate data as an example of biometric information, local distance data representing the distance between the information processing device 101 and another wearable device, or a combination of these. One sample may be acquired as the walking feature, or multiple samples may be acquired. For example, multiple samples of the walking feature are acquired in units of a certain time, a certain distance, or a sub-section obtained by dividing the authentication section into multiple sections. The data illustrated is merely an example, and is not limited to a specific one as long as it is a feature calculated from various sensor data using the various sensors described above. Multiple types of data may be combined, or an average of the data may be calculated.

[0045] The gait feature calculation unit 16 can use any algorithm as an algorithm for calculating the gait feature (feature calculation algorithm). For example, a neural network (e.g., deep neural network: DNN) that receives sensor data as input and estimates the gait feature can be used. Alternatively, other algorithms such as a function that receives sensor data as input and outputs the gait feature may be used.

[0046] An example of environmental information is the condition of the road surface on which the user is walking, such as a dry road, a wet road, or a snowy road. Another example of environmental information is the type of footwear worn by the user, such as leather shoes, high heels, low heels, sneakers, boots, sandals, etc. Different footwear is considered to be reflected in the user's walking style. Another example of environmental information is meteorology, such as the weather (sunny, cloudy, rainy, snowy, typhoon), temperature, humidity, or any combination thereof. The illustrated environmental information is merely an example, and is not limited to a specific one as long as it is calculated from various sensor data using the various sensors described above. A plurality of types of environmental information may be combined.

[0047] It is not necessary for the gait feature calculation unit 16 to continue acquiring sensor data while the position condition is satisfied (e.g., while the user is in the authentication zone). For example, the acquisition of sensor data may be stopped when the number of samples required for calculating the gait feature is acquired.

[0048] The model generation unit 17 associates the walking characteristics and the environmental information with the authentication section ID and the authentication-use device ID included in the learning start information, treats them as learning sample data, and stores the learning sample data in the learning DB 25. The learning sample data may further store information such as at least one of a user ID for identifying a user, a learning sample ID for identifying the learning sample data, and a current time.

[0049] In addition to the learning sample data of the present user, the learning DB 25 may store learning sample data of one or more other users. The learning sample data of the other users may be downloaded in advance from an external server and stored in the learning DB 25.

[0050] 5 shows an example of the learning DB 25. In this example, a sample ID, a user ID, an authentication device ID, an authentication section ID, walking characteristics, environmental information, and the like are included.

[0051] The model generation unit 17 identifies learning sample data including the same authentication section and the same authentication-use device ID from the learning DB 25 as teacher data for each piece of environmental information. The model generation unit 17 uses the teacher data to generate a walking model, which is an authentication model corresponding to the user's position information (in this example, the authentication section where the user is located), by machine learning. The generated walking model is stored in the walking model DB in association with the authentication section, environmental information, etc.

[0052] An example of a gait model is a regression model that regresses the degree of certainty that the user is the genuine person from the gait features. A specific example of a regression model is a neural network (e.g., DNN) that uses gait features as input and outputs the degree of certainty. Other examples include a nonlinear regression model and a support vector machine (SVM). The degree of certainty is a score that indicates the probability that the result of the authentication process is correct (the probability that the person is the real person). The score has a value of, for example, 0 or more and 1 or less. As an example, the higher the value, the higher the probability that the person is the real person. The range of the score is not limited to the range of 0 or more and 1 or less, and may be any range that is determined arbitrarily. The score may be expressed in units such as a percentage, or may be a binary value (e.g., 0 and 1). The score may also indicate a rank or class.

[0053] Here, an example of supervised learning using the learning sample data of this user as well as other users' learning sample data has been shown, but a model may be generated by unsupervised learning using only the learning sample data of this user. Examples of such models include the K-nearest neighbor method and LOF (Local outlier factor). The gait model may also be a combination of the user's gait features and a threshold value. In this case, it is possible to determine whether the user is genuine (whether the user is the person in question) depending on whether the distance between the gait features to be evaluated and the gait features included in the gait model is equal to or less than the threshold value.

[0054] In the following description, a neural network that receives gait features as input and outputs a score is assumed as the walking model, but other types of models can also be used.

[0055] The model generation unit 17 generates a walking model for each piece of environmental information. For example, if the environmental information is the type of footwear worn by the user, a walking model is generated according to the type of footwear. If the environmental information is weather, a walking model is generated according to the type of weather. As a result, multiple walking models according to the environmental information are generated for the same authentication section.

[0056] The model generation unit 17 may generate a walking model on the condition that a predetermined number or more of learning sample data are accumulated. The predetermined number may be single or multiple. Furthermore, the model generation unit 17 may update the walking model or regenerate the walking model every time the learning sample data of the user is stored in the learning DB 25 (that is, every time the user walks through the same authentication section).

[0057] FIG. 6 shows an example of a walking model DB. In this example, the database includes an authentication device ID, an authentication section ID, environmental information, walking model data, and the like. The contents of the walking model data depend on the type or format of the walking model. For example, if the walking model is a neural network, the database includes parameters of the neural network (e.g., weight coefficients of links connecting each node, etc.).

[0058] <Authentication phase> The position determination unit 14 determines whether the position condition is satisfied for each authentication zone registered in the zone information DB 24 based on the user's position information. As an example, it determines whether the user is in any authentication zone. For example, if the user is in any authentication zone, the position condition is satisfied, and if the user is not in any authentication zone, the position condition is not satisfied. For example, if it is detected that the user has entered a certain authentication zone, the position condition is satisfied. Also, if it is detected that the user has left the authentication zone, the position condition is not satisfied.

[0059] In order to determine whether the location condition is satisfied, other conditions may be added in addition to whether the user is in the authentication section. For example, a requirement for satisfying the location condition may be added such that the user inputs an instruction at the timing when he or she wishes to perform authentication, and the instruction is input. Or, a requirement for satisfying the location condition may be added such that instruction data for starting authentication is received from an external device, and the instruction data is received.

[0060] When the location condition is satisfied (for example, when it is detected that the user has entered the authentication zone), the location determination unit 14 provides authentication start information to the authentication processing unit 19. The authentication start information includes, for example, identification information of the authentication zone in which the user is located and identification information of the authentication utilization device in which the authentication zone is set. When the location condition is no longer satisfied (for example, when it is detected that the user has left the authentication zone), the location determination unit 14 provides authentication end information to the authentication processing unit 19. The authentication end information includes, for example, identification information of the authentication zone in which the user has left and identification information of the authentication utilization device in which the authentication zone is set.

[0061] When the authentication processing unit 19 acquires authentication start information from the position determination unit 14, it provides instruction data instructing the gait characteristic calculation unit 16 to calculate gait characteristics. When the authentication processing unit 19 acquires authentication end information from the position determination unit 14, it provides instruction data instructing the gait characteristic calculation to end.

[0062] When the gait feature calculation unit 16 receives instruction data instructing calculation of the gait feature, the gait feature calculation unit 16 acquires sensor data corresponding to the authentication section in which the user is located from at least one of the sensor devices 1 to N via the sensor data acquisition unit 15. The sensor data may be acquired from another wearable device equipped by the user or an external device. The gait feature calculation unit 16 calculates at least one gait feature based on the acquired sensor data. Details of the calculation of the gait feature are the same as in the learning phase. The gait feature calculation unit 16 also acquires walking environment information based on the acquired sensor data. Details of the acquisition of the environment information are also the same as in the learning phase. The gait feature calculation unit 16 provides the gait feature to the authentication processing unit 19 in association with the environment information.

[0063] The gait characteristic calculation unit 16 does not need to continue acquiring sensor data while the position condition is satisfied (e.g., while the user is in the authentication zone). For example, the acquisition of sensor data may be stopped at the point in time when data necessary for calculating the gait characteristic is acquired. Also, as described later, the authentication process may be performed multiple times within the authentication zone. In this case, it is necessary to acquire sensor data for a period of time necessary to calculate the gait characteristic at least for the number of authentication processes.

[0064] The authentication processing unit 19 acquires a corresponding gait model from the walking DB 22 based on the identification information of the authentication section and the identification information of the authentication utilization device specified in the authentication start information, and the environmental information provided by the gait feature calculation unit 16. The authentication processing unit 19 performs authentication processing of the user using the gait features provided by the gait feature calculation unit 16 as input of the gait model. Specifically, a score is acquired as an output of the gait model, and the score is compared with a threshold. If the score is equal to or greater than the threshold, it determines that the authentication processing is successful. In other words, it determines that the user of the information processing device 101 is genuine. If the score is less than the threshold, it determines that the authentication processing is unsuccessful.

[0065] The authentication processing unit 19 associates the score with the authentication section, device identification information, the result of the authentication process (success or failure), the user ID, and the current time, and stores the score in the authentication result DB 23 as authentication result data. The authentication processing unit 19 may perform the authentication process multiple times within the authentication section. That is, the calculation of the score and the determination of the success or failure of the authentication process may be performed multiple times. The authentication process is performed at regular time intervals, for example, every minute. If at least one of the multiple authentication processes is successful, the personal authentication may be determined to be successful, or if it is successful a predetermined number of times (two or more), the personal authentication may be determined to be successful. If the authentication process is successful a predetermined percentage of the predetermined number of times, the personal authentication may be determined to be successful.

[0066] The communication unit 20 transmits result information of the authentication process to the authentication utilization device. The result information of the authentication process includes, for example, a user ID and a result of the authentication process (success or failure). The result information of the authentication process may include other information (for example, identification information of the authentication section or environmental information, etc.).

[0067] The address of the authentication utilization device to which the result information is sent is stored in an arbitrary storage unit in the information processing device 101, or in an external storage device accessible from the information processing device 101, in association with the authentication utilization device. The external storage device may be a storage medium such as a USB memory or a memory card. The address of the authentication utilization device may be stored in the section information DB 24 or the walking model DB. Alternatively, the address of the authentication utilization device may be identified from a communication message received from the authentication utilization device.

[0068] The authentication processing unit 19 provides the result of the authentication processing to the output unit 103. The output unit 103 outputs the result of the authentication processing, so that the user of the information processing device 101 can confirm whether the authentication has been successful. If the output unit 103 is a display device, it displays a text indicating the success or failure of the authentication processing, and if it is an audio device, it notifies the user of the success or failure of the authentication processing by audio. In addition, depending on the form of the output unit 103, the user may be notified of the success or failure of the authentication processing by vibration or light emission. For example, the success or failure may be notified by a vibration pattern, a light emission color, or a blinking pattern. In addition, the result of the authentication processing may be transmitted to a facility-side device (for example, an authentication use device or a roadside device close to the user's position), and the facility-side device may output the result of the authentication processing. The same method as the output unit 103 can be used as the output method. The user can confirm the result of the authentication processing by looking at the facility-side device. Alternatively, it is possible not to notify the result of the authentication processing to either the user or the facility-side device.

[0069] 7 shows a flowchart of an example of the operation of the learning phase in the information processing device 101. The position acquisition unit 13 acquires user position information using at least one of the position detection unit 11 and the position reception unit 12 (S101).

[0070] The position determination unit 14 judges whether the position condition is satisfied based on the user's position information (S102). For example, it judges whether there is an authentication section that includes the user's position information among the authentication sections stored in the section information DB 24. If such an authentication section (target authentication section) exists, it is judged that the position condition is satisfied, and if not, it is judged that the position condition is not satisfied.

[0071] If the position condition is satisfied, the gait characteristic calculation unit 16 acquires sensor data using the sensor data acquisition unit 15. The gait characteristic calculation unit 16 calculates gait characteristics using the acquired sensor data (S103). Also, the gait characteristic calculation unit 16 acquires environmental information based on the acquired sensor data (same S103). The sensor data for acquiring environmental information and the sensor data for calculating gait characteristics may be the same or different.

[0072] The model generation unit 17 generates learning sample data in which the calculated gait features are associated with the environmental information, the target authentication section, and the authentication utilization device in which the target authentication section is set, and stores the learning sample data in the learning DB 25. When multiple samples of gait features are acquired, multiple learning sample data are stored. The model generation unit 17 generates a gait model (authentication model) that identifies the user by, for example, machine learning based on the learning sample data in the learning DB 25 (S104). The generated gait model is stored in the gait model DB 22. When a gait model has already been stored in the gait model DB 22, the gait model is updated.

[0073] 8 shows a flowchart of an example of the operation of the authentication phase in the information processing device 101. The position acquisition unit 13 acquires user position information using at least one of the position detection unit 11 and the position reception unit 12 (S201).

[0074] The position determination unit 14 judges whether the position condition is satisfied based on the user's position information (S202). For example, it judges whether there is an authentication section including the user's position information among the authentication sections set in the authentication-use device in the walking model DB. If such an authentication section (target authentication section) exists, it is judged that the position condition is satisfied, and if not, it is judged that the position condition is not satisfied.

[0075] If the position condition is satisfied, the gait feature calculation unit 16 acquires sensor data using the sensor data acquisition unit 15, and calculates the gait feature using the acquired sensor data (S203). The gait feature calculation unit 16 also acquires environmental information based on the acquired sensor data (S203). The sensor data for acquiring the environmental information and the sensor data for calculating the gait feature may be the same or different.

[0076] The authentication processing unit 19 identifies a walking model corresponding to the target authentication section and the environmental information in the walking model DB, and calculates a score using the walking features calculated in step S203 as an input (S204). If the score is equal to or greater than the threshold, the authentication processing unit 19 determines that the user is the user himself / herself, and determines that the authentication processing is successful. On the other hand, if the score is less than the threshold, the authentication processing unit 19 determines that the user is not the user himself / herself, and determines that the authentication processing is unsuccessful. The authentication processing unit 19 transmits the result information of the authentication processing to an authentication utilization device in which the target authentication section is set, using the communication unit 20 (S205). The authentication utilization device performs a specific process according to the result information of the authentication processing. For example, if the authentication utilization device is an entrance gate system, the gate is unlocked.

[0077] In the explanation of Fig. 7 and Fig. 8, the success or failure of the location condition is determined based on whether the user's location information is included in any of the multiple authentication zones. In contrast, when an authentication-use device to be the target of user authentication is determined in advance, the success or failure of the location condition may be determined based on whether the user's location information is included in the authentication zone set in the authentication-use device. For example, the user may specify a destination using the input unit 102, and the authentication-use device closest to the destination may be determined as the authentication-use device. The location information of the authentication-use device may be stored in the zone information DB 24, the walking model DB, or any other storage unit.

[0078] As described above, according to this embodiment, a walking model corresponding to an authentication section set for an authentication device is generated based on the feature amount (walking characteristics) of a user walking in the authentication section. When a user walks in the authentication section, the walking characteristics of the user are calculated, and the user is authenticated based on the acquired walking characteristics and the learned walking model. This allows for highly accurate authentication of the user even if the road surface characteristics of the authentication section differ for each authentication device.

[0079] According to this embodiment, environmental information representing the walking environment in the authentication section is acquired, and a walking model is registered in association with the environmental information. During authentication processing, environmental information representing the walking environment in the target authentication section is acquired, and a walking model corresponding to the acquired environmental information is used. This allows different walking models to be used when the walking environment (road surface conditions, user's footwear, etc.) differs depending on time, even in the same authentication section, and allows user authentication processing to be performed with high accuracy.

[0080] In this embodiment, the feature amount of walking motion (walking feature) is calculated as the feature amount of the user's motion, but the feature amount of running motion may be calculated. When the user travels by bicycle, the feature amount of the user's motion during travel may be calculated. In addition, the feature amount of any motion of the user may be calculated.

[0081] (Modification) In the first embodiment, the information processing device 101 is shown carried or worn by a user, but some of the elements of the information processing device 101 may exist on a communication network as the information processing device 131, and the remaining elements may be included in a terminal device carried or worn by the user.

[0082] FIG. 9 shows an example of an information processing device 131 and a terminal device 141 according to this modification. The information processing device 131 is arranged as an information processing server in a communication network 114 such as the Internet. The terminal device 141 is a device such as a smartphone or a wearable device carried or worn by a user. The communication unit 20 of the information processing device 131 and the communication unit 28 of the terminal device 141 can communicate with each other. Each block in the information processing device 131 and the terminal device 141 corresponds to a block with the same reference numeral in FIG. 1 and performs the same or substantially the same operation. The communication unit 28 of the terminal device 141 transmits data detected by the sensor devices 1 to N, data detected by the position detection unit 11, and data received by the position receiving unit 12 to the information processing device 101. The communication unit 20 of the information processing device 101 provides the data received from the terminal device 141 to the position acquisition unit 13 and the sensor data acquisition unit 15 according to the type of the received data.

[0083] By providing the information processing device 131 on the communication network 114 in this manner, a gait authentication service can be provided to a user as a cloud service. In addition, the configuration of the terminal device 141 can be simplified. In the following description, the information processing device 131 of this modified example can also be used instead of the information processing device 101.

[0084] (Example 1) 2 in the first embodiment, the authentication utilization device 111 is placed along the path the user walks, but the location of the authentication utilization device may be any location as long as the authentication utilization device can communicate with the information processing device 101. For example, when the authentication utilization device is an EC site, the authentication utilization device exists on a communication network such as the Internet.

[0085] 10 shows an example in which the authentication utilization device is a server disposed in a communication network. When authentication of user A is successful in authentication section 112, information processing device 101 accesses server 115 via communication network 114 and transmits a result notification of successful authentication to server 115.

[0086] FIG. 11 shows an example of performing identity authentication for settlement processing in the server 115 as concrete example 1. A user A is walking and wears a hearable device on his / her ear as a wearable device including an information processing device 101. The server 115 arranged in a communication network transmits (push notification) a message suggesting the purchase of a product to the information processing device 101 of the user A as an agent service. For example, the server 115 remotely monitors the refrigerator in the user A's home, and when it detects that a certain food or drink is missing from the refrigerator, it transmits a message to the user suggesting the purchase of the missing food or drink. In the example shown in the figure, a message saying "There is no milk. Would you like to buy some?" is transmitted to the information processing device 101.

[0087] The user A confirms the message from the server 115 by voice from the output unit 103 (speaker) of the information processing device 101. The user A inputs the message "Yes" from the input unit 102 (microphone) of the information processing device 101. The input unit 102 has a voice recognition function, and determines that the user A has expressed an intention to purchase milk by analyzing the voice-recognized text. When the information processing device 101 identifies the authentication section 112 set for the server 115 and detects that the user A has entered the authentication section 112, it performs authentication processing (gait authentication) of the user A. When the authentication processing is successful, a message of authentication success is transmitted from the communication unit 20 of the information processing device 101 to the server 115. The server 115, which has received the message of authentication success, completes the settlement processing of the purchase of milk by the user A. In this example, the response to the proposal message from the server 115 is transmitted by voice recognition, but the response may be transmitted by a method of selecting "Yes" or "No" by touch on the screen, a method of pressing a button for "Yes" or "No", or the like.

[0088] FIG. 12 is a flowchart of the operation of the information processing device 101 according to the first specific example. The communication unit 20 receives a message proposing the purchase of a product from the agent service of the server 115 (S301). The output unit 103 outputs the received message by voice or text, and the user who has confirmed the message uses the input unit 102 to express his / her intention to purchase (S302). For example, the intention to purchase is expressed by voice input, touch panel input, or the like. The position determination unit 14 detects that the user has entered an authentication section set for the server 115. Then, the authentication processing unit 19 performs authentication processing (gait authentication) of the user using the walking characteristics of the user based on the sensor data and a walking model corresponding to the authentication section in which the user is located (S303). If the authentication processing is successful, the communication unit 20 transmits a message notifying the server 115 of the purchase of the product and the success of the authentication (S304). The server 115 performs a settlement processing for the purchase of the product for the user A. If the authentication processing fails in step S303, this processing is terminated. In this case, information notifying the user of the failure of the authentication process may be output from the output unit 103. Note that, in this specific example, the payment process is performed by the server 115, but if a payment service app is registered in the information processing device 101, it is also possible to configure the information processing device 101 to perform the payment process. In this case, the authentication processing unit 19 may provide a message of successful authentication to the payment service app.

[0089] As described above, according to the specific example 1, when the user receives a push notification of a product purchase from the agent service while walking, the user can perform identity authentication by simply expressing the intention to purchase the product. That is, the user does not need to speak a password or PIN code or speak for voiceprint authentication for identity authentication. Therefore, there is no risk of passwords or the like being leaked by speaking, and there is no problem such as a decrease in the accuracy of voiceprint authentication due to surrounding noise. In addition, since the user does not need to perform any special work for identity authentication, the burden on the user is small. Although the specific example 1 describes an example in which the user walks outdoors, the place where the user walks is not limited to outdoors and may be indoors. This also applies to the specific example 2, the second embodiment, and the third embodiment described later.

[0090] (Example 2) In Specific Example 1, authentication is performed after a product purchase suggestion is made, but in Specific Example 2, authentication processing is performed in advance. When a product purchase suggestion is made and the user expresses an intention to purchase, that is, when authentication processing becomes necessary, it is determined that authentication processing has been completed, and a message of authentication success is returned without performing authentication processing again. This makes it possible to complete the payment processing early. Specific Example 2 will be described in detail below.

[0091] FIG. 13 shows a specific example of Specific Example 2. The following mainly describes the differences from Specific Example 1. When the information processing device 101 detects that the user A has entered the authentication section 112 set in the server 115, the information processing device 101 performs authentication processing (gait authentication) of the user A. If the authentication processing is successful, the authentication processing unit 19 holds information indicating that authentication has been successful for the user A in the authentication section 112. The success of the authentication processing of the user A is considered to be valid while the user is in the authentication section 112. After the success of the authentication processing, the user A continues to walk through the authentication section, and during that time, the user A receives a message suggesting the purchase of a product (e.g., milk) from the agent service (server 115) by push notification.

[0092] User A indicates his / her intention to purchase a product, and the information processing device 101 detects the user's intention to purchase using a voice recognition function provided in the input unit 102. The information processing device 101 determines that it is necessary to perform authentication processing, and checks whether user A is in an authenticated authentication zone based on user A's location information. Since user A is in an authenticated authentication zone, it transmits a message of authentication success to the server 115. Having received the message of authentication success, the server 115 completes the payment for the product purchase.

[0093] FIG. 14 is a flowchart of the operation of the information processing device 101 according to the second specific example. The position determination unit 14 determines whether the position condition is satisfied, that is, whether the user is in the authentication section, based on the user's position information (S401). If the user is in the authentication section, the authentication processing unit 19 performs authentication processing of the user based on the user's walking characteristics based on the sensor data and a walking model corresponding to the authentication section in which the user is located (S402). If the authentication processing is successful, the authentication processing unit 19 holds information indicating that the authentication of the current authentication section has been successful for the user. If the authentication processing is unsuccessful, this processing is terminated. Information indicating failure of the authentication processing may be output from the output unit 103. After the authentication processing is successful, when the communication unit 20 receives a message proposing the purchase of a product from the agent service (server 115) (S403), the output unit 103 outputs the received message. The user who has confirmed the message uses the input unit 102 to indicate his / her intention to purchase the product (S404). When the authentication processing unit 19 confirms that the user is in the authenticated authentication section (S405), the communication unit 20 transmits a message to the server 115 notifying the user of the product purchase and the successful authentication (S406). The server 115 that receives the message performs a payment process for the product purchase for user A. If it is determined in step S405 that the user is not in the authenticated authentication section, the authentication processing unit 19 performs the authentication process again in the same manner as in step S402 (S407). That is, the authentication processing unit 19 performs the authentication process for the user based on the walking characteristics of the user based on the sensor data and the walking model corresponding to the authenticated section in which the user is located. If the authentication process is successful, the process proceeds to step S406. If the authentication is unsuccessful, the process ends.

[0094] According to specific example 2, the user is authenticated in advance, and if the authentication process is successful, the effect of the authentication process is valid within the authentication section in which the authentication process was successful. If a request requiring authentication process (for example, a request to purchase a product and process a payment) occurs while the effect of the authentication process is valid, execution of the authentication process again is omitted. The authentication process is deemed to be successful, and a message is sent notifying the successful authentication. The execution of the request can be completed early.

[0095] Although the validity of the user authentication process is only valid within the authentication section in which the authentication process was performed, other variations are possible. For example, the validity of the authentication process may be set to be within a certain time (e.g., within 10 minutes) or within a certain distance (e.g., within 1 km) after the authentication process is successful. The range in which the authentication process is valid may be defined in other ways.

[0096] Second embodiment Fig. 15 is a block diagram of an information processing device 101 according to the second embodiment. A route generation unit 41, an information calculation unit 42, and a data processing unit 43 are added to the information processing device 101 in Fig. 1. The same elements as those in Fig. 1 are given the same reference numerals, and detailed explanations will be omitted. It is also possible to configure the information processing device 131 in Fig. 9 by adding the route generation unit 41, the information calculation unit 42, and the data processing unit 43.

[0097] A destination including an authentication utilization device is set by the user using the input unit 102. The route generation unit 41 generates a route from the user's current location to the destination. When a route application linked to map data is stored in the information processing device 101, the route generation unit 41 may generate the route by using a function of the map application, or may generate the route by using a route server on a communication network.

[0098] When there are multiple routes to the destination, the route generating unit 41 may generate the route that the user has used most frequently in the past, or may generate two or more routes in descending order of the number of times the route has been used in the past. Also, one route may be generated in descending order of the distance to the destination, or one or more routes may be generated based on other criteria. A DB that stores routes that the user has used in the past may be provided in the information processing device 101, or the routes that the user has used in the past may be acquired from an external route server.

[0099] Based on the authentication result DB 23, the information calculation unit 42 identifies an authentication section included in the path generated by the path generation unit 41, and calculates statistical information of scores previously calculated for the identified authentication section. Examples of the statistical information include, but are not limited to, statistical values ​​such as maximum, average, median, and minimum values ​​(same below). Here, the case of calculating the average value will be described as an example.

[0100] The data processing unit 43 generates data including the route generated by the route generation unit 41, the authentication section, and statistical values. The data processing unit 43 provides the data to the output unit 103. The output unit 103 displays the provided data on the screen by overlaying it on the map information.

[0101] 16 shows an example of a display on the screen of the information processing device 101. A route R1 from a starting position C to a destination G and an authentication section K1 included in the route R1 are displayed. The authentication section K1 is from a starting point S1 to the destination G. Here, a route with the highest statistical value is generated. An average value of 0.98 is displayed near the authentication section K1 as a statistical value of past scores. Note that, when the authentication success or failure is determined by performing authentication processing multiple times in the authentication section K1, a representative value (maximum value, average value, etc.) of the scores of these authentication processes may be calculated and the statistical value of the representative value may be used.

[0102] 17 shows another display example on the screen of the information processing device 101. In this example, the top two routes R1 and R2 with the highest statistical values ​​are generated. Authentication sections K1 and K2 and score statistical values ​​of 0.98 and 0.88 are displayed for the routes R1 and R2. The authentication section K2 is from the starting point S2 to the destination G. The display mode (color, line type, etc.) may be made different for the routes R1 and R2 so that the user can easily identify the route with the highest statistical value. By selecting the route with the highest statistical value, the user can increase the success rate of the authentication process.

[0103] FIG. 18 shows another example of the display on the screen. For the user's current position H1, a score of 0.91 is displayed in an inverted triangle mark. Authentication processing is performed at regular time intervals in the authentication section K1, and the maximum score of 0.91 from the start position S1 of the authentication section K1 to the current position H1 is displayed. That is, the maximum score of the user is displayed in real time. The maximum value is an example, and other values ​​such as the average value, the minimum value, or the median value may be displayed. By checking the real-time score, for example, when the user's score is low, the user can check whether he or she is performing an action different from usual and correct the action to raise the score. If the score is below the threshold, a message to call attention, such as "If this continues, the authentication processing will not be successful," may be displayed on the screen or output by voice. In addition, the display color or background color of the score may be a specific color to notify the user that the score is below the threshold or above the threshold.

[0104] (Modification) The scores of other users for the route to the destination may be acquired, and the user with the highest score may be displayed. For example, the data processing unit 43 receives data including the maximum score of the other users for the target authentication section and the identification information of the other users from the information processing device of the other users or a server that manages multiple users via the communication unit 20. The identification information of the user may be, for example, a user name such as a handle name. The maximum value is an example, and other values ​​such as an average value, a median value, and a minimum value may be used. The data processing unit 43 identifies a user who has previously achieved the highest score among the user and the other users, and causes the output unit 103 to display the identification information of the identified user. This makes it possible to realize a game in which users compete against each other for a high score.

[0105] Fig. 19 shows an example of a screen display according to this modification. Since Tom was the one who had the highest score in the past on route R1, the user name "Tom" is displayed along with the score. Note that although the display of the authentication section and the start position of the authentication section are omitted, the authentication section may be displayed.

[0106] FIG. 20(A) shows another display example of the screen according to this modified example. When there are multiple routes to a destination, the user name and score of the user with the highest score are displayed for each route. As an example, for each route, the user with the highest score is selected from multiple users, and the user name and score of the selected user are displayed. In this example, Tom has the highest score on route R1, Jack on route R3, and Mary on route R4. A game may be played in which participants compete for the highest score for each route. For example, a game can be realized in which the user with the highest score for each route registers the route as "MyGateWay."

[0107] Figure 20(B) shows an example of displaying the ranking in descending order of score compared to Figure 20(A). Tom has the highest score, followed by Jack and Mary, so Tom is ranked 1st, Jack 2nd, and Mary 3rd. The maximum score for each route and the ranking of users among the routes can also be used as a guide to determine which route is most likely to result in successful authentication.

[0108] Third embodiment Fig. 21 is a block diagram of an information processing device 101 according to the third embodiment. An information calculation unit 42 and a route selection unit 51 are added to the information processing device 101 in Fig. 1. The same elements as those in Fig. 1 or 15 are given the same reference numerals, and detailed explanations will be omitted. It is also possible to configure the information processing device 131 in Fig. 9 by adding the information calculation unit 42 and the route selection unit 51.

[0109] When it becomes necessary to perform authentication processing of the user, the route selection unit 51 selects a route with a high probability of successful authentication processing as a recommended route. The route selection unit 51 provides data indicating the recommended route to the output unit 103. The data indicating the recommended route may include data for guiding a route change to the recommended route. The output unit 103 displays the recommended route on the screen by superimposing it on map information. A voice guidance message for guiding the user to the recommended route may be output via the output unit 103 or a wearable device. By walking along the recommended route, when it becomes necessary to perform authentication processing, the user can achieve early success with a high probability.

[0110] To select a recommended route, the route selection unit 51, for example, selects a route with the highest score statistics (maximum value, average value, etc.) or above a threshold value from among multiple routes to the user's destination. For this reason, the route selection unit 51 requests the information calculation unit 42 to calculate the score statistics for multiple routes. If the user's destination is not set, the recommended route may be selected from multiple routes close to the user's current location.

[0111] The information calculation unit 42 identifies past scores of the authentication sections included in each route based on the authentication result DB 23, and calculates statistical values ​​(maximum value, average value, etc.) of the identified scores. The statistical values ​​of the scores calculated for each route are provided to the route selection unit 51. Note that, when one route includes multiple authentication sections, any authentication section (for example, the authentication section closest to the user's current location) may be targeted. Alternatively, a statistical value for each authentication section may be calculated, and the maximum value, average value, etc. of the calculated statistical values ​​may be used.

[0112] The route selection unit 51 selects a recommended route based on the statistical value of the score of each route provided from the information calculation unit 42. When the user's current route is different from the recommended route, the route selection unit 51 may notify the user of voice information for guiding the user to change to the recommended route via the output unit 103 or a hearable device. As an example of guiding the user, "Turn right at the next corner" or "Walk along the recommended route displayed on the screen" may be output to the user.

[0113] An example of a case where user authentication processing is required is when the information processing device 101 receives a message proposing the purchase of a product from a server providing an agent service on the communication network, and the user expresses an intention to purchase the product. The information processing device 101 needs to perform user authentication processing to complete the purchase of the product (i.e., complete the payment). A specific example will be described with reference to FIG. 22.

[0114] 22 shows a specific example of this embodiment. User A is walking and is wearing a hearable device on his / her ear as a wearable device including an information processing device 101. A server 115 arranged in a communication network serves as an agent service and transmits (push notification) a message suggesting the purchase of a product to the information processing device 101 of user A who is walking. In the example shown in the figure, a message stating "There is no milk. Would you like to purchase some?" is transmitted to the information processing device 101.

[0115] The user A confirms the message from the server 115 by voice from the output unit 103 (speaker) of the information processing device 101. The user A inputs the message "Yes" from the input unit 102 (microphone) of the information processing device 101. The information processing device 101 determines that the user A has expressed an intention to purchase milk by voice recognition of the message. The information processing device 101 determines that it is necessary to perform recognition processing of the user A, and selects a recommended route that encourages the user to walk. For example, the route with the highest score statistics (maximum value, average value, etc.) is set as the recommended route. The information processing device 101 outputs a message that guides the user to the recommended route. In the example of the figure, since the recommended route exists in the direction of turning right at the next corner as seen from the user, a message is notified saying "Turn right at the next corner and go straight". The user A turns right at the next corner according to the guidance of the message. When the information processing device 101 detects that the user A has entered the authentication section 112 set for the server 115, it performs authentication processing (gait authentication) of the user A. If the authentication process is successful, a message notifying the purchase of the product and the success of the authentication is sent from the communication unit 20 to the server 115. Upon receiving the message, the server 115 completes the payment process for the product purchase.

[0116] In the example of FIG. 22, the information processing device 101 is a hearable device, but a specific example in which the information processing device 101 is a smartphone will be shown.

[0117] FIG. 23 shows a display example of the screen of the information processing device 101. The user is walking along a route R5 from a starting position C to a destination G while referring to the screen shown in FIG. 22, for example. When the user is at a position H2, the server providing the agent service receives a message proposing the purchase of a product. When the user indicates his / her intention to purchase using the input unit 102, the route selection unit 51 selects the route R1 having the highest score statistic (maximum value, average value, etc.) as the recommended route. The route selection unit 51 notifies the user of a message guiding the user to change the route to the route R1. For example, since the route R1 is in the right hand direction as seen from the user, the route selection unit 51 notifies the user of a voice or text message saying "Turn right at the next corner". In addition, the passing route R7 for moving to the route R1 is displayed on the screen. The user moves to the route R1 via the passing route R7. When the user enters the authentication section K1 on the route R1, the information processing device 101 performs authentication processing (gait authentication) of the user A. When the authentication processing is successful, a message including the purchase of the product and authentication success is transmitted to the server 115. Server 115, which receives the message, completes the payment process for User A's product purchase.

[0118] FIG. 24 is a flowchart of an operation example of the information processing device 101 according to the third embodiment. The communication unit 20 receives a message proposing the purchase of a product from the server 115 (S501). The output unit 103 outputs the received message by voice or text, and the user who has confirmed the message uses the input unit 102 to indicate his / her intention to purchase (S502). The route selection unit 51 selects, as a recommended route, a route with the highest score statistic (maximum value, average value, etc.) or a threshold value or higher, from among a plurality of routes to the user's destination (S503). The route selection unit 51 notifies the user of a message guiding the user to change the route to the selected recommended route via the output unit 103 or the wearable device. Note that, if the route the user is currently walking matches the recommended route, the guidance to the recommended route may be omitted. Alternatively, the user may be notified of a message recommending that the user continue walking without changing the route he / she is currently walking. When the information processing device 101 detects that the user A has entered the authentication section 112 set for the server 115, it performs authentication processing (gait authentication) of the user A. If the authentication process is successful, a message including the product purchase and authentication success is sent to server 115 via communication unit 20. Server 115, which has received the message, completes the settlement process for User A's product purchase.

[0119] As described above, according to the third embodiment, after expressing an intention to purchase a product, the user can be quickly and successfully authenticated with a high success rate simply by walking along the recommended route guided by the information processing device 101.

[0120] (Hardware configuration) Fig. 25 shows an example of a hardware configuration of the information processing device 101 of Fig. 1, 15 or 21. The information processing device 101 is configured by a computer device 200. The information processing device 131 and the terminal device 141 of Fig. 9 are configured similarly. The computer device 200 includes a CPU 201, an input device 202, an output device 203, a communication device 204, a main storage device 205 and an external storage device 206, which are connected to each other by a bus 207.

[0121] The CPU (Central Processing Unit) 201 executes an information processing program, which is a computer program, on the main storage device 205. The information processing program is a program that realizes each of the above-mentioned functional configurations of the information processing device 101. The information processing program may be realized by a combination of multiple programs or scripts, rather than a single program. Each functional configuration is realized by the CPU 201 executing the information processing program.

[0122] The input device 202 is a circuit for inputting operation signals from input devices such as a touch panel, a microphone, a sensor, a keyboard, and a mouse to the information processing device 101 .

[0123] The output device 203 outputs data from the information processing device 101. The output device 203 is, but is not limited to, a display device, an audio output device (speaker), a vibration device, a light emitting device, or the like. Data output from the computer device 200 can be output from this output device 203.

[0124] The communication device 204 is a circuit for the information processing device 101 to communicate with an external device wirelessly or via a wire. Data can be input from the external device via the communication device 204. The data input from the external device can be stored in the main memory device 205 or the external memory device 206.

[0125] The main memory device 205 stores an information processing program, data required for executing the information processing program, data generated by executing the information processing program, etc. The information processing program is deployed and executed on the main memory device 205. The main memory device 205 is, for example, a RAM, a DRAM, or an SRAM, but is not limited to these. A database in the information processing device 101 may be constructed on the main memory device 205.

[0126] The external storage device 206 stores an information processing program, data required for executing the information processing program, data generated by executing the information processing program, etc. These information processing programs and data are read into the main storage device 205 when the information processing program is executed. The external storage device 206 is, for example, a hard disk, an optical disk, a non-volatile memory (e.g., a flash memory), and a magnetic tape, but is not limited to these. A database in the information processing device 101 may be constructed on the external storage device 206.

[0127] The information processing program may be pre-installed in the computer device 200, or may be stored in a storage medium such as a CD-ROM. The information processing program may also be uploaded onto the Internet.

[0128] Furthermore, the information processing device 101 may be configured as a single computer device 200, or may be configured as a system made up of a plurality of computer devices 200 connected to each other.

[0129] The above-described embodiment shows an example for realizing the present disclosure, and the present disclosure can be implemented in various other forms. For example, various modifications, substitutions, omissions, or combinations thereof are possible without departing from the gist of the present disclosure. Such modifications, substitutions, omissions, etc. are also included in the scope of the present disclosure, as well as in the scope of the invention and its equivalents described in the claims.

[0130] Furthermore, the effects of the present disclosure described in this specification are merely examples, and other effects may be available.

[0131] The present disclosure may also be configured as follows. [Item 1] A location acquisition unit that acquires location information of a user; a feature amount calculation unit that calculates a feature amount of the user's action based on sensor data detected by at least one sensor device; an authentication processing unit that performs authentication processing of the user based on an authentication model corresponding to the position information and the feature amount; An information processing device comprising: [Item 2] The location information indicates a section in which the user is located. Item 1. An information processing device according to item 1. [Item 3] An environment acquisition unit that acquires environmental information of the user based on a sensor device that detects the environment of the user or from an external server, The authentication processing unit uses an authentication model according to the environmental information and the position information. 3. The information processing device according to item 1 or 2. [Item 4] The environmental information includes at least one of information on a road surface condition where the user is located, a weather condition where the user is located, and footwear worn by the user. Item 3. An information processing device according to item 3. [Item 5] The feature amount is based on at least one of acceleration information, angular velocity information, velocity information, and biometric information of the user. 5. The information processing device according to any one of items 1 to 4. [Item 6] a communication unit that transmits result information indicating the success or failure of the authentication process to an authentication utilization device that performs processing according to the success or failure of the authentication process; 6. The information processing device according to any one of items 1 to 5, comprising: [Item 7] After determining that the authentication process is successful, a result of the authentication process is valid while the user is in a section where the authentication process is successful or for a certain period of time; When it becomes necessary to perform the authentication process while a result of the authentication process is valid, the authentication processing unit determines that the authentication process is successful without performing the authentication process. Item 3. An information processing device according to item 2. [Item 8] a data processing unit that provides data designating a section in the route along which the user is traveling, where the authentication process is to be performed, to a display device that is visible to the user; 3. The information processing device according to item 2, [Item 9] The authentication processing unit calculates a score of the authentication processing, and determines whether the authentication processing is successful or unsuccessful based on the score; an information calculation unit that calculates statistical information of the score calculated for a route traveled by the user; a data processing unit that provides data including the route and the statistical information to a display device that displays the data; 9. The information processing device according to any one of items 1 to 8, comprising: [Item 10] The authentication processing unit calculates a score of the authentication processing, A data processing unit that provides data relating the score to the user's position to a display device that displays the data. 10. The information processing device according to any one of items 1 to 9, comprising: [Item 11] The data processing unit provides data in which identification information of the plurality of users and the scores are associated with the route to a display device that displays the data. 11. The information processing device according to any one of items 1 to 10, comprising: [Item 12] The authentication processing unit calculates a score of the authentication processing, an information calculation unit that calculates statistical information of the score calculated for a route traveled by the user; a route selection unit that selects a recommended route that is a route recommended to the user based on the statistical information, and provides data indicating the recommended route to a display device that displays the data; 12. The information processing device according to any one of items 1 to 11, comprising: [Item 13] The route selection unit provides data for guiding the user to the recommended route to a display device that displays the data or a voice output device that outputs the data by voice. Item 13. An information processing device according to item 12. [Item 14] the route selection unit selects the recommended route when it becomes necessary to perform the authentication process. Item 14. An information processing device according to item 13. [Item 15] The specific process includes at least one of a process for settling a fee, a process for unlocking a gate, a process for unlocking a key, a process for providing a product, and a process for providing a service. Item 8. An information processing device according to item 7. [Item 16] The position acquisition unit acquires position information of the user from at least one of the sensor device and an external device disposed on a route along which the user moves. 16. The information processing device according to any one of items 1 to 15. [Item 17] a model generation unit that generates an authentication model of the user based on the feature amount calculated by the feature amount calculation unit, and associates the authentication model with the location information acquired by the location acquisition unit in a database; The authentication processing unit identifies an authentication model associated with the location information in the database, and performs authentication processing for the user using the identified authentication model. 17. The information processing device according to any one of items 1 to 16. [Item 18] The feature amount calculation unit calculates the feature amount based on the sensor data detected by the sensor device while the user is walking or running. 18. The information processing device according to any one of items 1 to 17. [Item 19] Obtain the user's location information, Calculating a feature amount of the user's action based on sensor data detected by at least one sensor device; performing authentication processing for the user based on an authentication model corresponding to the location information and the feature amount; Information processing methods. [Item 20] acquiring location information of a user; calculating a feature amount of the user's action based on sensor data detected by at least one sensor device; performing an authentication process for the user based on an authentication model corresponding to the location information and the feature amount; A computer program for causing a computer to execute the above. [Explanation of symbols]

[0132] 11: Position detection unit 12: Position receiver 13: Position acquisition part 14: Position determination section 15: Sensor data acquisition unit 16: Gait feature calculation unit 17: Model generation section 19: Authentication processing unit 20, 28: Communications Department 21: Antenna 22: Walking model database (DB) 23: Authentication result DB 24: Section information DB 25: Learning DB 41: Route generation unit 42: Information calculation unit 43: Data processing section 51: Route selection section 101, 131: Information processing device 102: Input section 103: Output section 111: Authentication use device 112, 113: Authentication section 114: Communication Networks 115: Server 200: Computer equipment 201: CPU 202: Input device 203: Output device 204: Communication equipment 205: Main memory 206: External storage device 207: Bus

Claims

1. A location acquisition unit that acquires user location information indicating a zone in which the user is located; a feature amount calculation unit that calculates a feature amount of the user's action based on sensor data detected by at least one sensor device; an authentication processing unit that performs authentication processing of the user based on an authentication model corresponding to the position information and the feature amount; a data processing unit that provides data designating a section in a route along which the user is traveling, where the authentication process is to be performed, to a display device that is visible to the user; An information processing device comprising:

2. A location acquisition unit that acquires user location information; a feature amount calculation unit that calculates a feature amount of the user's action based on sensor data detected by at least one sensor device; an authentication processing unit that performs authentication processing of the user based on an authentication model corresponding to the position information and the feature amount; Equipped with The authentication processing unit calculates a score of the authentication processing, and determines whether the authentication processing is successful or unsuccessful based on the score; an information calculation unit that calculates statistical information of the score calculated for a route traveled by the user; a data processing unit that provides data including the route and the statistical information to a display device that displays the data; The information processing device further comprises:

3. A location acquisition unit that acquires user location information; a feature amount calculation unit that calculates a feature amount of the user's action based on sensor data detected by at least one sensor device; an authentication processing unit that performs authentication processing of the user based on an authentication model corresponding to the position information and the feature amount; Equipped with The authentication processing unit calculates a score of the authentication processing, a data processing unit that provides data relating the score to a position of the user to a display device that displays the data; The information processing device further comprises:

4. A location acquisition unit that acquires user location information; a feature amount calculation unit that calculates a feature amount of the user's action based on sensor data detected by at least one sensor device; an authentication processing unit that performs authentication processing of the user based on an authentication model corresponding to the position information and the feature amount; Equipped with The authentication processing unit calculates a score of the authentication processing, an information calculation unit that calculates statistical information of the score calculated for a route traveled by the user; a route selection unit that selects a recommended route that is a route recommended to the user based on the statistical information, and provides data indicating the recommended route to a display device that displays the data; The information processing device further comprises:

5. The location information indicates a zone in which the user is located. The information processing device according to any one of claims 2 to 4.

6. An environment acquisition unit that acquires environmental information of the user based on a sensor device that detects the environment of the user or from an external server, The authentication processing unit uses an authentication model according to the environmental information and the position information. The information processing device according to any one of claims 1 to 4.

7. The environmental information includes at least one of information on a road surface condition where the user is located, a weather condition where the user is located, and footwear worn by the user. The information processing device according to claim 6.

8. The feature amount is based on at least one of acceleration information, angular velocity information, velocity information, and biometric information of the user. The information processing device according to any one of claims 1 to 4.

9. a communication unit that transmits result information indicating the success or failure of the authentication process to an authentication utilization device that performs a specific process in response to the success or failure of the authentication process; 5. The information processing device according to claim 1, further comprising:

10. After the authentication process is successful, a result of the authentication process is valid while the user is in the section where the authentication process was successful or for a certain period of time; the authentication processing unit, when it becomes necessary to perform the authentication processing while a result of the authentication processing is valid, determines that the authentication processing is successful without performing the authentication processing. The information processing device according to claim 1 .

11. The data processing unit provides data associating the user's identification information and the score with a route traveled by the user to a display device that displays the data. The information processing device according to claim 3 .

12. The route selection unit provides data for guiding the user to the recommended route to a display device that displays the data or a voice output device that outputs the data by voice. The information processing device according to claim 4.

13. the route selection unit selects the recommended route when it becomes necessary to perform the authentication process. The information processing device according to claim 12.

14. The specific process includes at least one process of a fee settlement process, a gate unlocking process, a key unlocking process, a product provision process, and a service provision process. The information processing device according to claim 9.

15. The position acquisition unit acquires position information of the user from at least one of the sensor device and an external device disposed on a route along which the user moves. The information processing device according to any one of claims 1 to 4.

16. a model generation unit that generates an authentication model of the user based on the feature amount calculated by the feature amount calculation unit, and associates the authentication model with the location information acquired by the location acquisition unit in a database; the authentication processing unit identifies an authentication model associated with the location information in the database, and performs authentication processing of the user using the identified authentication model; The information processing device according to any one of claims 1 to 4.

17. The feature calculation unit calculates the feature based on the sensor data detected by the sensor device while the user is walking or running. The information processing device according to any one of claims 1 to 4.

18. Acquiring user location information indicating a zone in which the user is located; Calculating a feature of the user's action based on sensor data detected by at least one sensor device; performing authentication processing of the user based on an authentication model corresponding to the location information and the feature amount; providing data designating a section in the route along which the user is traveling, in which the authentication process is to be performed, to a display device visible to the user; A computer implemented information processing method.

19. Acquire location information of a user, Calculating a feature of the user's action based on sensor data detected by at least one sensor device; performing authentication processing of the user based on an authentication model corresponding to the location information and the feature amount; Calculating a score for the authentication process and determining success or failure of the authentication process based on the score; Calculating statistical information of the score calculated for the route traveled by the user; providing data including the route and the statistical information to a display device that displays the data; A computer implemented information processing method.

20. Acquire location information of a user, Calculating a feature of the user's action based on sensor data detected by at least one sensor device; performing authentication processing of the user based on an authentication model corresponding to the location information and the feature amount; Calculating a score for the authentication process; providing data relating the score to a location of the user to a display device that displays the data; A computer implemented information processing method.

21. Acquire location information of a user, Calculating a feature of the user's action based on sensor data detected by at least one sensor device; performing authentication processing of the user based on an authentication model corresponding to the location information and the feature amount; Calculating a score for the authentication process; Calculating statistical information of the score calculated for the route traveled by the user; selecting a recommended route that is a route recommended to the user based on the statistical information, and providing data indicating the recommended route to a display device that displays the data; A computer implemented information processing method.

22. A step of acquiring user location information representing a zone in which the user is located; calculating a feature amount of the user's action based on sensor data detected by at least one sensor device; performing an authentication process for the user based on an authentication model corresponding to the location information and the feature amount; providing data designating a section in a route along which the user is traveling, in which the authentication process is to be performed, to a display device visible to the user; A computer program for causing a computer to execute the above.

23. A step of acquiring user location information; calculating a feature amount of the user's action based on sensor data detected by at least one sensor device; performing an authentication process for the user based on an authentication model corresponding to the location information and the feature amount; calculating a score for the authentication process and determining success or failure of the authentication process based on the score; Calculating statistical information of the score calculated for a route traveled by the user; providing data including the route and the statistical information to a display device that displays the data; A computer program for causing a computer to execute the above.

24. A step of acquiring user location information; calculating a feature amount of the user's action based on sensor data detected by at least one sensor device; performing an authentication process for the user based on an authentication model corresponding to the location information and the feature amount; calculating a score for the authentication process; providing data relating the score to the user's location to a display device that displays the data; A computer program for causing a computer to execute the above.

25. A step of acquiring user location information; calculating a feature amount of the user's action based on sensor data detected by at least one sensor device; performing an authentication process for the user based on an authentication model corresponding to the location information and the feature amount; calculating a score for the authentication process; Calculating statistical information of the score calculated for a route traveled by the user; selecting a recommended route that is a route recommended to the user based on the statistical information, and providing data indicating the recommended route to a display device that displays the data; A computer program for causing a computer to execute the above.

Images