Information processing device, data providing method, program, behavioral data providing processing system, and behavioral data providing processing method

Abstract

To provide an information processing device which allows a user from whom action data is collected to easily understand contents of the action data to be collected and handling of the data.SOLUTION: An information processing device includes: a receiving unit for receiving face image data from a camera; a control unit for collecting action data on the basis of the face image data; and a transmission unit for transmitting the action data to a server of a business operator. The control unit transmits, to a terminal, first screen data for accepting agreement for a provision service of the action data to the business operator, and second screen data for accepting agreement for usage of the action data by the business operator.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present disclosure relates to an information processing device, a data providing method, and a program. [Background technology]

[0002] In recent years, various data has been collected with the use of artificial intelligence (hereinafter sometimes referred to as AI). For example, behavioral data on human behavior is collected using image data from cameras installed in the city and in stores. By having AI learn from the collected behavioral data, it becomes possible to, for example, predict crowds and purchasing situations, and provide recommendations that match the user's own hobbies and preferences in real time.

[0003] Patent Document 1 discloses a device that allows a user to select the type of data to be provided to a business operator. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2018-25938 A Summary of the Invention [Problem to be solved by the invention]

[0005] Incidentally, in a service that uses cameras to collect people's behavioral data and provides the collected behavioral data to various businesses, it is important to have a mechanism that allows the people whose behavioral data is collected to easily understand the content of the collected behavioral data and how the data should be handled.

[0006] Non-limiting examples of the present disclosure contribute to providing an information processing device, a data providing method, and a program that enable people whose behavioral data is collected to easily understand how to handle the behavioral data in a service that collects behavioral data and provides it to businesses. [Means for solving the problem]

[0007] An information processing device according to one embodiment of the present disclosure includes a receiving unit that receives facial image data from a camera, a control unit that collects behavioral data based on the facial image data, and a transmitting unit that transmits the behavioral data to an operator's server, and the control unit transmits to a terminal first screen data for accepting consent to the provision of the behavioral data to the operator, and second screen data for accepting consent to the operator's use of the behavioral data.

[0008] A data providing method according to one embodiment of the present disclosure receives facial image data from a camera, collects behavioral data based on the facial image data, transmits the behavioral data to an operator's server, and transmits to a terminal first screen data for accepting consent to the provision of the behavioral data to the operator as a service, and second screen data for accepting consent to the operator's use of the behavioral data.

[0009] A program according to one embodiment of the present disclosure causes a computer to execute a process of receiving facial image data from a camera, collecting behavioral data based on the facial image data, transmitting the behavioral data to an operator's server, and transmitting to a terminal first screen data for accepting consent to the behavioral data being provided to the operator as a service, and second screen data for accepting consent to the operator's use of the behavioral data.

[0010] These comprehensive or specific aspects may be realized as a system, an apparatus, a method, an integrated circuit, a computer program, or a recording medium, or may be realized as any combination of a system, an apparatus, a method, an integrated circuit, a computer program, and a recording medium. Effect of the Invention

[0011] According to an embodiment of the present disclosure, in a service that collects behavioral data and provides it to a business, a person whose behavioral data is collected can easily understand how the behavioral data is handled. Also, a person whose behavioral data is collected can check the contents of the collected data by himself, and can manage and provide the behavioral data by himself, such as by requesting deletion as necessary.

[0012] Further advantages and benefits of an embodiment of the present disclosure will become apparent from the specification and drawings, in which such advantages and / or benefits are provided by some of the embodiments and features described in the specification and drawings, respectively, but not necessarily all of which are provided to obtain one or more identical features. [Brief description of the drawings]

[0013] [Figure 1] FIG. 1 is a diagram for explaining an overview of a data providing service according to an embodiment of the present disclosure. [Diagram 2] A diagram showing an example of the configuration of a data provision system that realizes a data provision service. [Diagram 3] A diagram showing an example of a server block configuration [Figure 4] An example of the screen for the first consent step of the two-step consent method [Diagram 5] A diagram showing an example of a screen for selecting and changing the recipient of behavioral data [Figure 6] An example of the screen for the second consent step of the two-step consent method [Figure 7] A diagram showing an example of a screen for selecting and changing behavioral data to be provided to a recipient business operator [Figure 8] FIG. 13 is a diagram showing an example of the configuration of user registration data stored in the server; [Figure 9] FIG. 13 is a diagram showing an example of the configuration of destination-related data stored in a server; [Figure 10] FIG. 13 is a diagram showing an example of the configuration of behavior data stored in a server; [Figure 11] FIG. 1 is a diagram for explaining an example of operations related to collection and provision of behavioral data of a server. [Figure 12]A flowchart showing an example of operations related to user registration and user settings of a server [Figure 13] Flowchart showing an example of operation of the server for providing behavioral data DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0014] Hereinafter, the embodiments of the present disclosure will be described in detail with reference to the drawings as appropriate. However, more detailed explanation than necessary may be omitted. For example, detailed explanation of already well-known matters or duplicate explanation of substantially the same configuration may be omitted. This is to avoid the following explanation becoming unnecessarily redundant and to facilitate understanding by those skilled in the art.

[0015] It should be noted that the accompanying drawings and the following description are provided to enable those skilled in the art to fully understand the present disclosure, and are not intended to limit the subject matter described in the claims.

[0016] <Outline of data provision service> Fig. 1 is a diagram illustrating an overview of a data providing service according to an embodiment of the present disclosure. Fig. 1 illustrates a user 1, a terminal 2, a data providing PF (PF: Platform) 3, cameras 4a to 4e, businesses 5a to 5c, and IC card systems 6a to 6c.

[0017] Using the terminal 2, the user 1 accesses the data provision PF 3 and registers for the data provision service provided by the data provision PF 3. At this time, the user 1 registers personal data to the data provision PF 3. The personal data is, specifically, personal information that the user 1 can input, such as name, age, sex, address, date of birth, financial accounts, credit cards, and face image. The behavioral data is data that indicates the behavior of the user 1, and specifically, possible data include the purchase history of goods, movement route information, entrance and exit information, boarding / alighting stations, visited facilities, and the like.

[0018] Furthermore, the user 1 uses the terminal 2 to select (designate) which of the behavioral data of the user 1 may be provided to the data provision PF 3 and to which of the businesses 5a to 5c the data may be provided. That is, the user 1 can select the businesses 5a to 5c to which the behavioral data of the user 1 may be provided. The terminal 2 may be, for example, a device such as a smartphone, a tablet terminal, or a personal computer.

[0019] The data providing PF3 shown in FIG. 1 performs a service (hereinafter, sometimes referred to as a data providing service) in which a person (user) registered in advance in the data providing PF3 is authenticated using face recognition on a captured image (hereinafter, referred to as face image data) including the face of the user captured by the cameras 4a to 4e, the person (user)'s behavior data is collected, and the collected behavior data is provided to the business operators 5a to 5c with data that the person (user) has permitted to be provided. At this time, the user is authenticated using face recognition, but an authentication method other than face recognition may be used. In such a case, the captured image captured by the camera does not need to include the user's face, and it is sufficient that the image is capable of recognizing a person. Although the use of a camera is exemplified for collecting the behavior data, a sensor capable of collecting the behavior data may be used. The data providing PF3 may be managed by a business operator (not shown) different from the business operators 5a to 5c that receive the data providing service.

[0020] The business operator managing the data provision PF3 recruits users whose behavioral data may be collected, for example, by using the cameras 4a to 4e. The users whose behavioral data may be collected register with the data provision service provided by the data provision PF3. As described above, the registration is performed by inputting necessary personal data. At this time, recruitment may be triggered by starting to use the service provided by the business operator managing the data provision PF3. When registering with the data provision service together with the service, it is also possible to ensure convenience by allowing the provision to the target service at the same time as registration. User 1 shown in FIG. 1 indicates a user who has registered with the data provision service provided by the data provision PF3.

[0021] The data providing PF3 is a platform that realizes a data providing service. For example, the data providing PF3 authenticates the user 1 based on the face image data of the user 1 captured by the cameras 4a to 4e, and collects (acquires) behavioral data of the user 1. Specifically, the data providing PF3 authenticates the user 1 based on the face image data of the user 1 captured by the cameras 4a to 4e, and collects behavioral data such as the user 1's movement between stations, the movement routes in the premises and on the streets, and the purchase of goods at a store.

[0022] More specifically, information on the stations that user 1 entered and exited can be collected by authenticating user 1 from facial image data captured by a camera installed at the ticket gate for paying fares, the movement route of user 1 can be collected by authenticating user 1 from facial image data captured by cameras installed inside the station or on the streets, and purchase information of items by user 1 can be collected by authenticating user 1 from facial image data captured by a facial payment camera in a store.

[0023] The data providing PF3 transmits the collected behavioral data of the user 1 to the businesses 5a to 5c selected by the user 1. For example, if the user 1 selects the businesses 5a and 5b, the data providing PF3 transmits the collected behavioral data of the user 1 to the businesses 5a and 5b.

[0024] The cameras 4a to 4e are installed in various locations and capture images of users. The cameras 4a to 4e transmit captured facial image data of the users to the data providing PF 3. The data providing PF 3 performs facial authentication using the received facial image data. The cameras are installed at traffic ticket gates, entrances and exits of venues, checkpoints and other passing points, in front of cash registers, store entrances and exits, and other locations where people move around. These cameras may also be installed at gates that manage entrance and exit.

[0025] For example, the camera 4a is installed at a ticket gate and captures an image of a user passing through the ticket gate. The camera 4a transmits the captured face image data of the user to the data providing PF3.

[0026] For example, the camera 4b is installed near a cash register in a store or the like, and captures an image of a user who has made a payment for an item. The camera 4b transmits the captured face image data of the user to the data providing PF3.

[0027] For example, the camera 4c is installed near the entrance of a store or the like, and captures images of users who enter or leave the store. The camera 4c transmits the captured face image data of the users to the data providing PF3.

[0028] For example, the camera 4d is installed on a structure such as a building or a utility pole, and captures a user passing through a passageway or a street in the building. The camera 4d transmits the captured face image data of the user to the data providing PF3.

[0029] For example, the camera 4e is installed at an entrance / exit management gate at the entrance of amusement parks, theme parks, etc., and captures a user passing through the gate. The camera 4e transmits the captured face image data of the user to the entrance / exit management system and also to the data providing PF3.

[0030] In this way, the cameras 4a to 4e are installed in various locations, so that the data providing PF 3 can collect, over a wide range, behavioral data of the user 1 registered in the data providing PF 3. The cameras 4a to 4e may be surveillance cameras.

[0031] In addition, although the facial image data of the user captured by the camera is collected, the behavioral data of the user may be collected by performing person detection, movement line analysis, etc. on the captured images of the camera, without being limited to the facial image data. For example, by tracking the user 1 identified from the facial image data in the captured images of multiple cameras, behavioral data such as the movement line of the user 1 can also be collected.

[0032] The business entities 5a to 5c are provided with behavioral data of the user 1 registered in the data provision PF 3 by the data provision PF 3. However, the business entities 5a to 5c are provided with the behavioral data of the user 1 when the user 1 selects the business entities 5a to 5c as a recipient of behavioral data. The business entities 5a to 5c may be business entities that manage, for example, amusement parks, commercial facilities, accommodation facilities, retail stores, etc.

[0033] The user 1 can select the detailed type of behavioral data to be provided to each destination, and only the selected type of data is provided to the destination businesses 5a to 5c.

[0034] The business operators 5a to 5c may provide O2O (one to one) services to the user 1 using the behavioral data of the user 1 provided by the data provision PF3. For example, the business operators 5a to 5c may input the behavioral data of the user 1 provided by the data provision PF3 to an AI and provide a service suited to the user 1 (individual). The business operators 5a to 5c may also use the behavioral data of the user 1 provided by the data provision PF3 to determine the location of a store or the like. For example, the business operators 5a to 5c may input the behavioral data of the user 1 (which may be behavioral data of multiple people) provided by the data provision PF3 to an AI and determine the optimal location of a store.

[0035] The IC card systems 6a to 6c are, for example, transportation IC card systems managed by transportation companies such as trains, buses, or airplanes. The IC card systems 6a to 6c detect the entry and exit of users into and from the premises in cooperation with cameras installed near the user's entrance and exit points such as ticket gates, and transmit the detected data to the data providing PF3. The data providing PF3 collects behavioral data of the user 1 based on the entrance and exit detection data and face image data of the camera installed near the entrance and exit points. That is, the data providing PF3 may collect behavioral data of the user 1 in cooperation with other systems such as the IC card systems 6a to 6c. In addition to transportation IC card systems, data may be collected in cooperation with a wide range of systems such as an entrance and exit management system monitoring system.

[0036] As will be explained below, in the data provision service shown in Fig. 1, two consents are obtained from the user 1. The first consent is for the data provision service in the data provision PF 3. The second consent is for the use of behavioral data by the business operators 5a to 5c selected by the user 1.

[0037] As described below, the user 1 can select the type of behavioral data to be provided to the businesses 5a to 5c. For example, the user 1 can select the type of behavioral data to be provided to the businesses 5a to 5c, such as behavioral data related to station ticket gate entry and exit logs, behavioral data related to movement paths within a station, or behavioral data related to payment within a store.

[0038] As will be described below, users 1 who provide behavioral data are given rewards such as points and coupons. The rewards provide users 1 with an incentive to register with the data provision service shown in FIG. 1. Furthermore, the business entity managing the data provision PF3 can easily recruit users who are willing to have their behavioral data collected. Furthermore, by increasing the number of users whose behavioral data is willing to be collected, the business entity managing the data provision PF3 can increase the number of businesses that want to receive user behavioral data.

[0039] Data may be rephrased as information. Behavioral data of user 1 may be regarded as personal information. An entity that manages data provision PF3 may be different from an entity that provides a data provision service. In the above, the entity that manages data provision PF3 is different from entities 5a to 5c, but one or more of entities 5a to 5c may manage data provision PF3. In addition, face image data received from cameras 4a to 4c may also include images of parts of the body other than the face.

[0040] <System configuration example> Fig. 2 is a diagram showing an example of the configuration of a data providing system 10 that realizes a data providing service. In Fig. 2, the same components as in Fig. 1 are given the same reference numerals. As shown in Fig. 2, the data providing system 10 has cameras 4a to 4e and a server 11. The server 11 realizes the function of the data providing PF3 shown in Fig. 1. The server 11 may be called an information processing device.

[0041] 2 shows a terminal 2 used by a user 1, a server 21a managed by a business operator 5a, a server 21b managed by a business operator 5b, and a server 21c managed by a business operator 5c, in addition to the data providing system 10. Also shown in FIG 2 are a server 22a constituting an IC card system 6a, a server 22b constituting an IC card system 6b, and a server 22c constituting an IC card system 6c, in addition to the data providing system 10.

[0042] Server 11 is connected to cameras 4a-4e via a network, such as a LAN (Local Area Network), the Internet, or a wireless network such as a mobile phone network, etc. Server 11 receives face image data of user 1 captured by cameras 4a-4e via the network.

[0043] The server 11 is connected to the servers 21a to 21c via a network such as a LAN, the Internet, or a wireless network. The server 11 transmits the collected behavior data of the user 1 to the servers 21a to 21c via the network.

[0044] The server 11 is connected to the servers 22a to 22c via a network such as a LAN, the Internet, or a wireless network. The server 11 receives the behavior data of the user 1 via the network.

[0045] <Server block configuration example> Fig. 3 is a diagram showing an example of a block configuration of the server 11. As shown in Fig. 3, the server 11 includes a processor 31, a RAM (Random access memory) 32, a HDD (Hard Disk Drive) 33, a communication interface 34, and a bus 35.

[0046] The processor 31 controls the entire server 11. The processor 31 may be, for example, a CPU (Central Processing Unit). The processor 31 is connected to a RAM 32, a HDD 33, and a communication interface 34 via a bus 35.

[0047] The processor 31 executes a program to function as a control unit 31a. The control unit 31a realizes the function of the data provision PF3 described with reference to FIG.

[0048] The RAM 32 temporarily stores the OS (Operating System) program and application programs to be executed by the processor 31. The RAM 32 also temporarily stores various data required for processing by the CPU 31. The RAM 32 is a storage device that temporarily stores programs and the like, and is not limited to a RAM. For example, the RAM 32 may be a storage device such as a DRAM (Dynamic RAM).

[0049] The HDD 33 stores an OS, application programs, etc. Also, the HDD 33 stores various data necessary for processing by the CPU 31. Note that the HDD 33 is a storage device that stores programs, etc., and is not limited to an HDD. For example, the HDD 33 may be a storage device such as an SSD (Solid State Drive).

[0050] The communication interface 34 communicates with the cameras 4a to 4e via networks such as a LAN, the Internet, and a mobile phone network, and also communicates with the servers 21a to 21c and the servers 22a to 22c via networks such as a LAN, the Internet, and a mobile phone network.

[0051] The servers 21a to 21c and the servers 22a to 22c may also have blocks similar to those shown in FIG.

[0052] <Handling of behavioral data> The handling of behavioral data will be described. Behavioral data is personal information of user 1. Therefore, server 11 receives (acquires) consent regarding the handling of user 1's behavioral data from user 1 via terminal 2. When consent is obtained from user 1, server 11 collects user 1's behavioral data. Furthermore, server 11 transmits the collected behavioral data to servers 21a to 21c of businesses 5a to 5c.

[0053] The server 11 adopts a two-stage consent method. That is, the server 11 acquires two consents from the user 1 via the terminal 2. The first consent is consent to the data provision service in the data provision PF 3. The second consent is consent to the use of behavioral data by the businesses 5a to 5c selected by the user 1.

[0054] In addition, the data provider PF3 will not provide the behavioral data to the business operator without the second consent, and the business operator will be able to use the data only to the extent of the second consent. The data provider PF3 will not use the acquired data for marketing its own services.

[0055] 4 is a diagram showing an example of a screen related to the first consent step of the two-step consent method. A screen 41 shown in Fig. 4 is displayed on the display of the terminal 2 by the server 11, for example, when the user 1 registers for a data provision service.

[0056] Screen 41 includes an explanation of how behavioral data (personal information) is handled by the data provision service in data provision PF 3. For example, screen 41 includes information indicating that a face image of user 1 will be stored for personal authentication, and that collected behavioral data of user 1 will be provided to third-party businesses (businesses 5a to 5c). Screen 41 also includes information indicating that the use and purpose of the behavioral data will be subject to the separate handling (second consent) of the business to which the behavioral data is provided (business to which the data will be disclosed).

[0057] Buttons 41a and 41b are displayed on the screen 41 to ask the user 1 whether or not he or she agrees to the handling of behavioral data (hereinafter, sometimes referred to as terms of use) as shown on the screen 41. For example, when the button 41a is pressed, the terminal 2 transmits information (signal) to the server 11 indicating that the user 1 agrees to the first term of use.

[0058] When User 1 agrees to the terms of use for the data provision service in Data Provision PF 3, he / she can select a provider (business) to which his / her behavioral data will be provided.

[0059] User 1 can select the destination of the behavioral data at any time. For example, User 1 can select the destination of the behavioral data immediately after agreeing to the first terms of use, or at a later date. User 1 can also change the destination of the behavioral data at any time.

[0060] Fig. 5 is a diagram showing an example of a screen for selecting and changing the destination of providing behavioral data. For example, the screen 42 shown in Fig. 5 may be displayed on the display of the terminal 2 when a button for selecting and changing the destination of providing behavioral data is pressed on a menu screen displayed on the display of the terminal 2.

[0061] A list of business entities to which behavioral data is to be provided is displayed on the screen 42. Also, on the screen 41, toggle switches 42a to 42d for selecting a business entity to which behavioral data is to be provided are displayed in correspondence with the business entities to which behavioral data is to be provided.

[0062] The destination of the behavioral data of the user 1 is selected according to the operation of the toggle switches 42a to 42d. For example, the toggle switches 42a and 42d shown in Fig. 5 indicate that the businesses (XX Corporation and ** Real Estate) corresponding to the toggle switches 42a and 42d are selected as the businesses to which the behavioral data is to be provided.

[0063] As shown in Fig. 5, multiple destinations of behavioral data may be selected. Also, one destination of behavioral data may be selected, or none may be selected. When no destination of behavioral data is selected, the behavioral data of user 1 is not provided to any business operator.

[0064] When the toggle switches 42a to 42d are switched on and off, the terminal 2 transmits information on the switched state to the server 11. When the toggle switches 42a to 42d are switched from off to on, the server 11 transmits screen data including an explanation of how the business operator that switched the toggle switches 42a to 42d on handles the behavioral data to the terminal 2. In other words, the server 11 transmits screen data related to the second consent step of the two-step consent method to the terminal 2.

[0065] Fig. 6 is a diagram showing an example of a screen related to the second consent of the two-step consent method. A screen 43 shown in Fig. 6 is displayed on the display of the terminal 2 by the server 11. The screen 43 includes an explanation (terms of use) of how the business operator selected by the user 1 as the recipient of the behavioral data handles the behavioral data. Note that the terms of use are terms of use specific to each business operator and differ from one business operator to another.

[0066] Buttons 43a and 43b are displayed on the screen 43 to ask the user 1 whether or not he or she agrees to the terms of use shown on the screen 43. For example, when the button 43a is pressed, the terminal 2 transmits to the server 11 information indicating that the user 1 agrees to the second terms of use.

[0067] When the user 1 agrees to the terms of use (second terms of use) of the business to which the behavioral data is to be provided, as shown on the screen 43, the user 1 can select the type of behavioral data to be provided to the business with which the user agrees to the second terms of use.

[0068] User 1 can select the type of behavioral data at any time. For example, User 1 can select the type of behavioral data immediately after agreeing to the second terms of use, or at a later date. User 1 can also change the type of behavioral data to be provided to the provider at any time.

[0069] Fig. 7 is a diagram showing an example of a screen for selecting and changing the behavioral data to be provided to the destination business operator. For example, the screen 44 shown in Fig. 7 may be displayed on the display of the terminal 2 when a button for selecting and changing the type of behavioral data is pressed on a menu screen displayed on the display of the terminal 2.

[0070] A list of types of behavioral data to be provided to a destination business is displayed on the screen 44. Also, the screen 44 displays toggle switches 44a to 44e for selecting a type of behavioral data in correspondence with the type of behavioral data.

[0071] The type of behavioral data of the user 1 to be provided to the destination business is selected according to the operation of the toggle switches 44a to 44e. For example, the toggle switches 44a, 44c, and 44e shown in Fig. 7 indicate that the types of behavioral data corresponding to the toggle switches 44a, 44c, and 44e (ticket gate entry / exit log, in-store flow lines, and coupon usage history) are selected as the behavioral data to be provided to the destination business.

[0072] 7, multiple types of behavioral data may be selected. Also, one destination to which behavioral data is to be provided may be selected. If no type of behavioral data is selected (for example, if all of the toggle switches 44a to 44e are off), the server 11 may transmit to the terminal 2 screen data prompting the user 1 to select one or more types of behavioral data.

[0073] The type of behavioral data may be set (may be different) for each business to which the behavioral data is provided. For example, the type of behavioral data may be different for each business to which the behavioral data is provided, selected on the screen 42 shown in FIG. 5. This is because the type of behavioral data desired may differ for each business.

[0074] <Data configuration example> Fig. 8 is a diagram showing an example of the configuration of user registration data stored in the server 11. As shown in Fig. 8, the user registration data 51 includes an ID (identifier) ​​for identifying a user, the user's name, sex, age, and address, and face image data of the user. The user registration data may also include other necessary personal data of the user.

[0075] When the user agrees to the first terms of use, the user's user registration data 51 is stored in the HDD 33 of the server 11. That is, when the user agrees to the first terms of use, the user is registered in the data provision service provided by the data provision PF3.

[0076] After obtaining consent to the first terms of use from the user 1, the server 11 transmits screen data for accepting each piece of information (data) of the user registration data 51 to the terminal 2. The terminal 2 accepts each piece of information of the user registration data 51 from the user 1, and transmits each piece of accepted information to the server 11. The server 11 stores each piece of information transmitted from the terminal 2 in the HDD 33 as the user registration data 51.

[0077] Fig. 9 is a diagram showing a configuration example of the destination-related data stored in the server 11. As shown in Fig. 9, the destination-related data 52 has an ID for identifying a user, destination business entity information, and disclosure range information.

[0078] When a user selects a recipient business of behavioral data, the recipient business information of the recipient related data 52 is stored in the HDD 33 of the server 11. For example, when a user with ID “001” selects recipient businesses of behavioral data “XX Corporation” and “** Real Estate” on the screen 42 shown in FIG. 5, information indicating the recipient businesses “XX Corporation” and “** Real Estate” is stored in the recipient business information field corresponding to ID “001” of the recipient related data 52.

[0079] When a user selects a type of behavioral data to be provided to a destination business operator, the disclosure range information of the destination related data 52 is stored in the HDD 33 of the server 11. For example, when a user with ID “001” selects the types of behavioral data “ticket gate entry / exit log” and “store flow line” on the screen 44 shown in FIG. 7, information indicating the types of behavioral data selected by the user, “ticket gate entry / exit log” and “store flow line”, is stored in the disclosure range information field corresponding to the ID “001” of the destination related data 52.

[0080] Fig. 10 is a diagram showing a configuration example of behavior data stored in the server 11. As shown in Fig. 10, the behavior data 53 has an ID for identifying a user, information related to the user's entry into a facility or the like, and information related to the user's exit from a facility or the like. The information related to entry includes information related to the date and time when the user entered the facility or the like, and information related to the location of the entry. The information related to exit includes information related to the date and time when the user exited the facility or the like, and information related to the location of the exit.

[0081] The server 11 receives face image data from the cameras 4a to 4e. The server 11 compares the face image data received from the cameras 4a to 4e with the face image data of the user registration data 51 described in FIG. 8, and determines whether the face image data received from the cameras 4a to 4e includes face image data registered in the data providing service. If the face image data received from the cameras 4a to 4e includes face image data registered in the data providing service, the server 11 stores the behavior data of the user of the face image data in the HDD 33.

[0082] The server 11 may obtain the date and time of the user's entry into and exit from a facility, etc., based on the reception time of the facial image data received from the cameras 4a to 4e. The server 11 may also obtain information on the locations (facilities, etc.) where the user entered and exited, based on information on the locations where the cameras 4a to 4e are installed.

[0083] The behavioral data 53 may also include information related to the user's payment and coupon usage. The information related to the user's payment may include, for example, information on the date and time of the payment and the location of the payment (such as a facility). The information related to the user's coupon usage may include, for example, information on the date and time of coupon usage and the location of coupon usage (such as the name of a facility).

[0084] <Explanation of collection and provision of behavioral data> Fig. 11 is a diagram for explaining an example of the operation of the server 11 regarding collection and provision of behavioral data. The server 11 receives face image data from the cameras 4a to 4e. The server 11 extracts features of the received face image data and compares it with the face image data of the user registration data 51 described in Fig. 8. In other words, the server 11 compares the face image data received from the cameras 4a to 4e with the face image data of the users registered in the data providing service.

[0085] If the result of the collation is that the facial image data received from the cameras 4a to 4e does not match the facial image data of the user registered with the data provision service, the server 11 determines that the user of the facial image data received from the cameras 4a to 4e is not registered with the data provision service (see arrow A1 in FIG. 11). If the server 11 determines that the user of the facial image data received from the cameras 4a to 4e is not registered with the data provision service, it discards the facial image data received from the cameras 4a to 4e.

[0086] On the other hand, if the result of the comparison shows that the facial image data received from the cameras 4a to 4e matches the facial image data of a user registered with the data provision service, the server 11 determines that the user of the facial image data received from the cameras 4a to 4e is registered with the data provision service (see arrow A2 in Figure 11).

[0087] In addition, the server 11 may determine that the facial image data received from the cameras 4a to 4e matches the facial image data of the user registered with the data provision service if the degree of match between the facial image data received from the cameras 4a to 4e and the facial image data of the user registered with the data provision service is equal to or greater than a certain threshold.

[0088] When the server 11 determines that the user of the facial image data received from the cameras 4a to 4e is registered with the data providing service, the server 11 stores the behavior data of the user of the facial image data received from the cameras 4a to 4e (see arrow A3 in FIG. 11). For example, the server 11 stores the behavior data 53 described in FIG. 10 in the HDD 33.

[0089] Furthermore, when the server 11 determines that the user of the facial image data received from the cameras 4a to 4e is registered with the data providing service, the server 11 refers to the user registration data 51 described in Fig. 8 to acquire the ID of the user of the facial image data. The server 11 refers to the destination-related data 52 described in Fig. 9 based on the acquired ID and determines whether the destination-related data 52 stores destination business information of the user of the facial image data received from the cameras 4a to 4e (hereinafter, sometimes referred to as a registered user).

[0090] When the server 11 determines that the destination business information of the registered user is stored in the destination related data 52, the server 11 transmits the behavioral data of the registered user to the server of the destination business indicated by the destination business information. At that time, the server 11 extracts the type of behavioral data based on the disclosure range information of the registered user (see the destination related data 52 in FIG. 9) and transmits it to the server of the destination business indicated by the destination business information (see the arrow A4 in FIG. 11).

[0091] On the other hand, when the server 11 determines that the destination business information of the registered user is not stored in the destination related data 52, the server 11 does not transmit the behavioral data of the registered user to the business server (see arrow A5 in FIG. 11). For example, when the registered user has not selected any business to which the behavioral data is to be provided on the screen 42 in FIG. 5, the server 11 does not transmit the behavioral data of the registered user to the business server.

[0092] The server 11 may transmit the behavioral data of the registered users to the servers 21a to 21c of the destination business in real time. Also, the server 11 may transmit the behavioral data of the registered users stored (accumulated) in the HDD 33 to the servers 21a to 21c of the destination business at a predetermined timing, for example, at midnight.

[0093] Furthermore, when the user selects a destination business entity to which the behavior data is to be provided, if there is any behavior data that has not been transmitted to the selected destination business entity, the server 11 may transmit the untransmitted behavior data dating back a certain period of time from the present to the server of the destination business entity. Furthermore, when the user selects a type of behavior data, if there is any behavior data of the type that has not been transmitted, the server 11 may transmit the untransmitted behavior data dating back a certain period of time from the present to the server of the destination business entity.

[0094] <Server 11 operation example> 12 is a flowchart showing an example of an operation related to user registration and user settings of the server 11. The server 11 may execute the process of the flowchart shown in FIG.

[0095] S1: The server 11 accepts consent to the use of the data provision service from the user via the terminal 2. For example, the server 11 accepts consent to the use of the data provision service from the user via the screen 41 of the terminal 2 described in Fig. 4. That is, the server 11 accepts consent to the first terms of use from the user.

[0096] S2: The server 11 registers the user who has agreed to the first terms of use. For example, the server 11 accepts information about the user registration from the user via the terminal 2, and stores the accepted information in the HDD 33 (see user registration data 51 in FIG. 8).

[0097] S3: The server 11 accepts the business to which the behavioral data is to be provided from the user via the terminal 2. For example, the server 11 accepts the business to which the behavioral data is to be provided from the user via the screen 42 of the terminal 2 described in FIG.

[0098] S4: The server 11 accepts, via the terminal 2, consent to the terms of use of the destination business accepted in S3 from the user. For example, the server 11 accepts consent to the terms of use of the destination business from the user via the screen 43 of the terminal 2 described in FIG. 6. That is, the server 11 accepts consent to the second terms of use from the user. Note that, upon accepting consent to the second terms of use, the server 11 stores the destination business information of the destination business accepted in S3 in the HDD 33 (see the destination business information of the destination related data 52 in FIG. 9).

[0099] S5: The server 11 accepts disclosure range information of the behavioral data from the user via the terminal 2. For example, the server 11 accepts the disclosure range information (type of behavioral data to be provided to the business operator) via the screen 44 of the terminal 2 described in Fig. 7. The server 11 stores the disclosure range information accepted in S5 in the HDD 33 (see the disclosure range information of the provision destination related data 52 in Fig. 9).

[0100] Through the above operations, the user is registered with the data providing service. In addition, information regarding the destination and type of the user's behavioral data is set in the data providing service.

[0101] The process of user registration and user setting is not limited to the order of the flowchart shown in Fig. 12. For example, the server 11 may receive a provider of behavioral data from a registered user at any time. The server 11 may also receive disclosure range information of behavioral data from a registered user at any time.

[0102] Fig. 13 is a flowchart showing an example of an operation related to the provision (transmission) of behavioral data by the server 11. The server 11 may execute the process of the flowchart shown in Fig. 13, for example, at regular intervals.

[0103] S11: The server 11 receives face image data from the cameras 4a to 4e.

[0104] S12: The server 11 performs authentication processing of the face image data received in S11. For example, the server 11 extracts features of the received face image data and compares it with the face image data of the user registration data 51 described in Fig. 8. That is, the server 11 compares the face image data received from the cameras 4a to 4e with the face image data of the user registered in the data providing service.

[0105] S13: The server 11 judges whether or not the user of the facial image data received from the cameras 4a to 4e is a user registered with the data provision service based on the facial recognition process of S12. For example, the server 11 may judge that the user of the facial image data received from the cameras 4a to 4e is a registered user when the degree of coincidence between the facial image data received from the cameras 4a to 4e and the facial image data of the user registered with the data provision service is equal to or greater than a certain threshold.

[0106] S14: If the server 11 determines in S13 that the user of the facial image data received from the cameras 4a to 4e is not a user registered with the data providing service (No in S13), the server 11 discards the facial image data received from the cameras 4a to 4e. This protects the privacy of users who are not registered with the data providing service. After discarding the facial image data, the server 11 ends the processing of this flowchart.

[0107] S15: When the server 11 determines in S13 that the user of the face image data received from the cameras 4a to 4e is a user (registered user) registered in the data providing service (Yes in S13), the server 11 stores the behavior data of the registered user. For example, the server 11 stores the behavior data 53 described in FIG. 10 in the HDD 33.

[0108] S16: The server 11 judges whether or not the destination business information of the registered user for which the answer is determined to be "Yes" in S13 is stored in the destination related data 52 (see FIG. 9). For example, the server 11 refers to the user registration data 51 described in FIG. 8, and acquires the ID of the registered user for which the answer is determined to be "Yes" in S13. The server 11 judges whether or not the destination business information of the registered user is stored in the destination related data 52, by referring to the destination related data 52 in FIG. 9, based on the acquired ID. When the server 11 judges that the destination business information of the registered user is not stored in the destination related data 52 (No in S16), the server 11 ends the processing of the flowchart. That is, the server 11 does not transmit the behavior data of the registered user for which the answer is determined to be "Yes" in S13 to the business's servers 21a to 21c.

[0109] S17: If the server 11 determines that the destination business information of the registered user is stored in the destination related data 52 (Yes in S16), it extracts the type of behavioral data based on the disclosure range information of the registered user (see the destination related data 52 in Figure 9) and transmits it to the server of the destination business indicated by the destination business information.

[0110] Through the above operations, the behavioral data of the type selected by the user is transmitted (provided) to the destination business operator selected by the user.

[0111] The order of the behavioral data transmission process is not limited to that of the flowchart shown in Fig. 13. For example, the server 11 may provide the behavioral data of the registered user stored (accumulated) in the HDD 33 to the destination business operator at a predetermined timing such as midnight.

[0112] <Summary of the embodiment> As described above, the server 11 includes a receiving unit (communication interface 34) that receives facial image data from the cameras 4a to 4e, a control unit 31a that collects behavioral data of the user 1 based on the facial image data, and a transmitting unit (communication interface 34) that transmits the collected behavioral data to the servers 21a to 21c of the operators 5a to 5c.

[0113] The control unit 31a transmits, to the terminal 2, first screen data for receiving consent to the provision of services of the behavioral data to the businesses 5a to 5c, and second screen data for receiving consent to the use of the behavioral data by the businesses 5a to 5c. For example, the control unit 31a transmits, to the terminal 2, first screen data for displaying the screen 41 shown in Fig. 4 on the display of the terminal 2, and second screen data for displaying the screen 43 shown in Fig. 6 on the display of the terminal 2.

[0114] As a result, in a data providing service that collects behavioral data of the user 1 and provides it to a business operator, the user 1, whose behavioral data is collected, can easily understand how the behavioral data is handled. For example, the user 1 can understand from the screen 41 of the terminal 2 based on the first screen data that the behavioral data is collected by (the business operator of) the data providing service and provided to the businesses 5a to 5c, and can understand from the screen 43 of the terminal 2 based on the second screen data how the behavioral data is used by the businesses 5a to 5c, so that the user 1 can easily understand how the behavioral data is handled.

[0115] After consent to the data provision service is obtained, the control unit 31a transmits the second screen data to the terminal 2. This allows the user to clearly distinguish between how the behavioral data is handled in the data provision service and how the behavioral data is handled by the businesses 5a to 5c, and thus allows the user to more easily understand how the behavioral data is handled.

[0116] Furthermore, the control unit 31a transmits third screen data for selecting the business operators 5a to 5c to which the behavioral data is to be provided to the terminal 2. For example, the control unit 31a transmits third screen data for displaying the screen 42 shown in Fig. 5 on the display of the terminal 2 to the terminal 2. This allows the user to control the provider to which the behavioral data is to be provided.

[0117] Furthermore, the control unit 31a transmits the second screen data of the business selected in the third screen data to the terminal 2. For example, the control unit 31a transmits data of the consent acceptance screen (screen 43 in FIG. 6) of the business selected in the screen 42 in FIG. 5 to the terminal 42. This allows the user to determine whether or not to consent to the use of the behavioral data by the business selected by the user.

[0118] Furthermore, the control unit 31a transmits fourth screen data for selecting the type of behavioral data to be provided to the businesses 5a to 5c to the terminal 2. For example, the control unit 31a transmits fourth screen data for displaying the screen 44 shown in Fig. 7 on the display of the terminal 2 to the terminal 2. This allows the user to control the type of behavioral data to be provided to the businesses 5a to 5c.

[0119] Furthermore, the control unit 31a transmits the fourth screen data of the business for which consent has been obtained in the second screen data to the terminal 2. For example, the control unit 31a transmits data of the behavioral data type selection screen (screen 44 in FIG. 7) of the business for which consent has been obtained in the screen 43 in FIG. 6 to the terminal 2. This allows the user to select the type of behavioral data from the behavioral data of the business for which the user has consented to use the behavioral data.

[0120] <Variation 1> The control unit 31a may provide a privilege to the user 1 according to the type of selected behavioral data. For example, the control unit 31a may provide more points to the user 1 as the selected type of behavioral data is more important to the businesses 5a to 5c. This provides an incentive to the user 1 to register for a behavioral data providing service. Furthermore, the businesses 5a to 5c can obtain behavioral data that is more important to the businesses 5a to 5c.

[0121] 7, along with displaying the types of behavioral data and toggle switches 44a to 44e for selecting the types of behavioral data, the contents of the benefits to be given to the user 1 may be displayed for each type of behavioral data. In this way, when selecting behavioral data to be provided, the contents of the benefits to be given can be easily seen and serve as a criterion for selection.

[0122] Furthermore, the control unit 31a may stop providing the benefit when the selection of the type of behavioral data is cancelled, thereby providing an incentive to the user 1 to maintain the selection (provision) of the behavioral data.

[0123] <Variation 2> Some users 1 may wish to delete behavioral data stored (accumulated) in the server 11. In response to a request from the user 1, the control unit 31a may delete the behavioral data stored in the server 11. In this case, the control unit 31a may accept a deletion period for the behavioral data. For example, the control unit 31a may accept a deletion period for the behavioral data, such as a period going back three months from the present.

[0124] When deleting the behavioral data, the control unit 31a may collect the benefit given to the user 1. For example, the control unit 31a may subtract points according to the deletion period from the points given to the user 1.

[0125] Furthermore, when collecting the reward, the control unit 31a may transmit the details of the collection to the terminal 2 of the user 1. For example, the control unit 31a may transmit the number of points to be subtracted to the terminal 2 of the user 1. This allows the user 1 to know the amount of the reward to be collected by deleting the behavioral data.

[0126] <Modification 3> In the present disclosure, the behavioral data of the user 1 collected by the data providing PF 3 is provided to the businesses 5a to 5c, but the data providing PF 3 may provide not only the behavioral data but also the personal data of the user 1 held by the data providing PF 3 to the businesses 5a to 5c. In this case, the personal data provided to the businesses 5a to 5c is treated in the same way as the behavioral data, and it is possible to select the recipients of the data, grant benefits, etc.

[0127] In the above-described embodiments, the notation "... part" used for each component may be replaced with other notations such as "... circuit", "... assembly", "... device", "... unit", or "... module".

[0128] Although the embodiments have been described above with reference to the drawings, the present disclosure is not limited to such examples. It is clear that a person skilled in the art can come up with various modified or altered examples within the scope of the claims. It is understood that such modified or altered examples also belong to the technical scope of the present disclosure. In addition, the components in the embodiments may be arbitrarily combined within the scope of the present disclosure.

[0129] The present disclosure can be realized by software, hardware, or software in cooperation with hardware. Each functional block used in the description of the above embodiment may be realized partially or entirely as an LSI, which is an integrated circuit, and each process described in the above embodiment may be controlled partially or entirely by one LSI or a combination of LSIs. The LSI may be composed of individual chips, or may be composed of one chip that includes some or all of the functional blocks. The LSI may have input and output of data. Depending on the degree of integration, the LSI may be called an IC, a system LSI, a super LSI, or an ultra LSI.

[0130] The method of integration is not limited to LSI, and may be realized by a dedicated circuit, a general-purpose processor, or a dedicated processor. In addition, after LSI manufacturing, a programmable FPGA (Field Programmable Gate Array) or a reconfigurable processor that can reconfigure the connections and settings of circuit cells inside the LSI may be used. The present disclosure may be realized as digital processing or analog processing.

[0131] Furthermore, if a new integrated circuit technology that can replace LSI appears due to the progress of semiconductor technology or a derivative technology, it is possible to integrate the functional blocks using that technology. The application of biotechnology is also a possibility. [Industrial Applicability]

[0132] The present disclosure is useful for data providing services using camera images. [Explanation of symbols]

[0133] 1 User 2. Terminal 3 Data provision platform 4a~4e Camera 5a~5c Operator 6a~6c IC card system 11, 21a~21c, 22a~22c servers

Claims

1. an acquisition unit that receives face image data of a user from a camera; a control unit that collects behavioral data of the user as a history of face recognition processing based on the face image data; Equipped with The control unit is transmit to the terminal first screen data including image data of an image of terms of use regarding the handling of the user's behavioral data, which indicates that the user's facial image data will be stored and that the user's behavioral data will be provided to a server of a business operator selected by the user, and an image for accepting a selection by the user as to whether or not the user agrees to the terms of use regarding the handling of the user's behavioral data; When the terminal accepts the consent on the screen of the first screen data, second screen data including image data of an image of terms of use regarding the business operator's use of the user's behavioral data and an image for accepting a selection of whether the user agrees to the terms of use regarding the use of the user's behavioral data is transmitted to the terminal; When the terminal accepts the consent on the screen of the second screen data, third screen data is transmitted to the terminal, the third screen data accepting a selection from the user as to whether or not to provide a plurality of types of behavioral data of the user to the business operator; extracting the user's behavior data to be provided for each of the businesses selected by the user on the screen of the third screen data, and transmitting the data to a server of the business; Information processing device.

2. The control unit transmits the behavioral data of the user selected by the user to a server of the business in real time. The information processing device according to claim 1 .

3. The control unit transmits the first screen data, and after a selection is made on a screen of the first screen data to agree to terms of use regarding the handling of the behavioral data with respect to the behavioral data being provided to the business operator, transmits the second screen data to the terminal.

3. The information processing device according to claim 1 or 2.

4. The control unit transmits fourth screen data for selecting a provider of the behavioral data to the terminal. The information processing device according to claim 1 .

5. The control unit transmits the second screen data of the business operator selected in the fourth screen data to the terminal. The information processing device according to claim 4.

6. The control unit transmits to the user's terminal a screen displaying information on a privilege to be granted to the user in accordance with the type of the user's behavioral data selected by the user. The information processing device according to claim 1 .

7. The control unit stops providing the privilege information to the user when a selection of the type of behavioral data of the user is cancelled. The information processing device according to claim 6.

8. The control unit transmits, when the behavioral data of the user is deleted, a message to the user indicating that the privilege of the privilege information is to be collected to the user's terminal. The information processing device according to claim 6.

9. When the behavioral data of the user is deleted, the control unit transmits to the terminal of the user a message informing the user that the privilege will be collected from the privilege of the privilege information previously granted in accordance with a period during which the selection of the type of behavioral data was deactivated. The information processing device according to claim 6.

10. An information processing device, receiving face image data of a user from a camera; Collecting behavioral data of the user as a history of face recognition processing based on the face image data; transmit to the terminal first screen data including image data of an image of terms of use regarding the handling of the user's behavioral data, which indicates that the user's facial image data will be stored and that the user's behavioral data will be provided to a server of a business operator selected by the user, and an image for accepting a selection by the user as to whether or not the user agrees to the terms of use regarding the handling of the user's behavioral data; When the terminal accepts the consent on the screen of the first screen data, second screen data including image data of an image of terms of use regarding the business operator's use of the user's behavioral data and an image for accepting a selection of whether the user agrees to the terms of use regarding the use of the user's behavioral data is transmitted to the terminal; When the terminal accepts the consent on the screen of the second screen data, third screen data is transmitted to the terminal, the third screen data accepting a selection from the user as to whether or not to provide a plurality of types of behavioral data of the user to the business operator; extracting the user's behavior data to be provided for each of the businesses selected by the user on the screen of the third screen data, and transmitting the data to a server of the business; How data is provided.

11. On the computer, receiving face image data of a user from a camera; Collecting behavioral data of the user as a history of face recognition processing based on the face image data; transmit to the terminal first screen data including image data of an image of terms of use regarding the handling of the user's behavioral data, which indicates that the user's facial image data will be stored and that the user's behavioral data will be provided to a server of a business operator selected by the user, and an image for accepting a selection by the user as to whether or not the user agrees to the terms of use regarding the handling of the user's behavioral data; When the terminal accepts the consent on the screen of the first screen data, second screen data including image data of an image of terms of use regarding the business operator's use of the user's behavioral data and an image for accepting a selection of whether the user agrees to the terms of use regarding the use of the user's behavioral data is transmitted to the terminal; When the terminal accepts the consent on the screen of the second screen data, third screen data is transmitted to the terminal, the third screen data accepting a selection from the user as to whether or not to provide a plurality of types of behavioral data of the user to the business operator; extracting the user's behavior data to be provided for each of the businesses selected by the user on the screen of the third screen data, and transmitting the data to a server of the business; A program that executes a process.

12. A behavioral data providing processing system including a control processing device, a server of a business entity that receives behavioral data of a user transmitted from the control processing device, and a terminal that receives screen data transmitted from the control processing device, The control processing device includes: receiving face image data of a user from a camera; Collecting behavioral data of the user as a history of face recognition processing based on the face image data; transmit to the terminal first screen data including image data of an image of terms of use regarding the handling of the user's behavioral data, which indicates that the user's facial image data will be stored and that the user's behavioral data will be provided to a server of a business operator selected by the user, and an image for accepting a selection by the user as to whether or not the user agrees to the terms of use regarding the handling of the user's behavioral data; When the terminal accepts the consent on the screen of the first screen data, second screen data including image data of an image of terms of use regarding the business operator's use of the user's behavioral data and an image for accepting a selection of whether the user agrees to the terms of use regarding the use of the user's behavioral data is transmitted to the terminal; When the terminal accepts the consent on the screen of the second screen data, third screen data is transmitted to the terminal, the third screen data accepting a selection from the user as to whether or not to provide a plurality of types of behavioral data of the user to the business operator; extracting the user's behavior data to be provided for each of the businesses selected by the user on the screen of the third screen data, and transmitting the data to a server of the business; Behavioral data provision and processing system.

13. A behavioral data providing processing method for a behavioral data providing processing system including a control processing device, a server of a business entity that receives user behavioral data transmitted from the control processing device, and a terminal that receives screen data transmitted from the control processing device, comprising: The control processing device, receiving face image data of a user from a camera; Collecting behavioral data of the user as a history of face recognition processing based on the face image data; transmit to the terminal first screen data including image data of an image of terms of use regarding the handling of the user's behavioral data, which indicates that the user's facial image data will be stored and that the user's behavioral data will be provided to a server of a business operator selected by the user, and an image for accepting a selection by the user as to whether or not the user agrees to the terms of use regarding the handling of the user's behavioral data; When the terminal accepts the consent on the screen of the first screen data, second screen data including image data of an image of terms of use regarding the business operator's use of the user's behavioral data and an image for accepting a selection of whether the user agrees to the terms of use regarding the use of the user's behavioral data is transmitted to the terminal; When the terminal accepts the consent on the screen of the second screen data, third screen data is transmitted to the terminal, the third screen data accepting a selection from the user as to whether or not to provide a plurality of types of behavioral data of the user to the business operator; extracting the user's behavior data to be provided for each of the businesses selected by the user on the screen of the third screen data, and transmitting the data to a server of the business; How behavioral data is provided and processed.

Images