Information processing system, information processing device, program and information processing method

Abstract

To provide an information processing system, an information processing device, a program and an information processing method that can identify person images which are usefully utilized in various activities.SOLUTION: An information processing system performs: behavior information generation processing which generates behavior information including behavior and attribute of a user; person image information generation processing which identifies a person image of the user based on the behavior information generated by the behavior information generation processing and generates person image information; and face image information generation processing which generates a face image of the user as face image information based on the person image information generated by the person image information generation processing.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present invention relates to an information processing system, an information processing device, a program, and an information processing method, and more particularly to an information processing system, an information processing device, a program, and an information processing method that can identify a person's image. [Background technology]

[0002] For example, technologies are being used to identify or estimate the personalities of people who are the targets of various activities, such as matching job seekers with employers, or investors with advisors, or marketing products or services.

[0003] Patent document 1 proposes a technology that classifies nodes based on a tree diagram generated by nodes representing opinions created by multiple users and links showing the relationships between each node, and identifies the user's personality based on the results of the node classification. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2017-68706 A Summary of the Invention [Problem to be solved by the invention]

[0005] Incidentally, with the widespread use of portable information terminals such as smartphones and tablet terminals, it has become common to analyze the behavior or activity trends of users based on the user's location information, attribute information, etc., acquired by the user's portable information terminal.

[0006] If this type of information can be used to identify or estimate the personality of the user corresponding to that information, it is expected that the identified or estimated personality can be used effectively for various activities.

[0007] The present invention has been made in consideration of the above circumstances, and aims to provide an information processing system, an information processing device, a program, and an information processing method that can identify a person's image that can be usefully utilized in various activities. [Means for solving the problem]

[0008] In order to achieve the above-mentioned object, the information processing system of the present invention executes a behavioral information generation process that generates behavioral information including the user's behavior and attributes, a personal image information generation process that identifies the user's image based on the behavioral information generated by the behavioral information generation process and generates personal image information, and a face image information generation process that generates an image of the user's face as face image information based on the personal image information generated by the face image information generation process.

[0009] This makes it possible to generate character information that identifies a user's personality based on the user's behavioral information. Since this character information is assumed to be based on the user's behavior or activity tendencies, it can be usefully utilized for various activities based on the identified character information.

[0010] For example, depending on the identified person profile, it can be usefully utilized in marketing activities aimed at a user corresponding to that person profile or other users whose person profile is similar to that of this user.

[0011] Furthermore, since the facial image information of the user corresponding to the generated person image information is generated based on the generated person image information, the user's person image can be perceived visually and intuitively. In this way, by using the person image identified as image information for various activities, it is expected that the range of applications will be expanded.

[0012] The person image information generation process of this information processing system may be one that autonomously generates person image information based on a machine learning model, and the face image information generation process may be one that autonomously generates face image information based on a machine learning model.

[0013] The behavioral information generation process of this information processing system may generate behavioral information based on user information acquired via the user's terminal device, or may acquire user information by selecting a user display displayed on geospatial information.

[0014] The person profile information generation process of this information processing system generates person profile information based on persona information relating to the attributes of the user in addition to behavioral information.

[0015] In order to achieve the above-mentioned object, the information processing device of the present invention is an information processing device having a processor and a memory in which a program is stored, and by executing the program by the processor, executes a behavioral information generation process that generates behavioral information including the user's behavior and attributes, a personal image information generation process that identifies the user's image based on the behavioral information generated by the behavioral information generation process and generates personal image information, and a face image information generation process that generates an image of the user's face as face image information based on the personal image information generated by the person image information generation process.

[0016] To achieve the above-mentioned object, the program of the present invention causes an information processing device implemented by a computer to execute a behavioral information generation process that generates behavioral information including the user's behavior and attributes, a personal image information generation process that identifies the user's image based on the behavioral information generated by the behavioral information generation process and generates personal image information, and a face image information generation process that generates an image of the user's face as face image information based on the personal image information generated by the face image information generation process.

[0017] In order to achieve the above-mentioned object, the information processing method of the present invention is one in which an information processing device implemented by a computer executes a behavioral information generation process that generates behavioral information including the user's behavior and attributes, a personal image information generation process that identifies the user's image based on the behavioral information generated by the behavioral information generation process and generates personal image information, and a face image information generation process that generates an image of the user's face as face image information based on the personal image information generated by the face image information generation process. [Effects of the Invention]

[0018] According to the present invention, it is possible to generate person image information that can be effectively utilized in various activities. [Brief explanation of the drawings]

[0019] [Figure 1] 1 is a block diagram illustrating an outline of the configuration of an information processing system according to an embodiment of the present invention. [Figure 2] FIG. 10 is a block diagram illustrating an outline of the configuration of a user terminal of the information processing system according to the present embodiment. [Figure 3] 1 is a block diagram illustrating an outline of the configuration of an information processing device of the information processing system according to the present embodiment. [Figure 4] 1 is a block diagram for explaining an outline of the functions of an information processing device of the information processing system according to the present embodiment. [Figure 5] 10 is a diagram for explaining an outline of processing by the information processing device of the information processing system according to the present embodiment. FIG. [Figure 6] FIG. 10 is a diagram for explaining an outline of behavioral information processed by the information processing system according to the present embodiment. [Figure 7] FIG. 10 is a diagram for explaining an outline of a prompt processed by the information processing system according to the present embodiment. [Figure 8] 1 is a block diagram for explaining an outline of processing of an information processing device of the information processing system according to the present embodiment. [Figure 9]FIG. 10 is a diagram for explaining an outline of person image information processed by the information processing system according to the present embodiment. [Figure 10] FIG. 10 is a diagram for explaining an outline of person image information processed by the information processing system according to the present embodiment. [Figure 11] 10 is a diagram for explaining an outline of a facial image generation prompt processed by the information processing system according to the present embodiment. FIG. [Figure 12] 1 is a block diagram for explaining an outline of processing of an information processing device of the information processing system according to the present embodiment. [Figure 13] 10 is a flowchart outlining the processing of the information processing system according to the present embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0020] Next, an information processing system according to an embodiment of the present invention will be described with reference to FIGS.

[0021] 1 is a block diagram illustrating an outline of the configuration of an information processing system according to this embodiment. As shown in the figure, the information processing system 10 mainly comprises a plurality of user terminals 20, which are terminal devices, a generation AI 30, and an information processing device 40, which are connected to each other via a network N such as the Internet.

[0022] Furthermore, in this embodiment, the generation AI 30 and a program (to be described later) stored in the information processing device 40 are linked (connected) via an API (Application Programming Interface).

[0023] In this embodiment, the user terminal 20 is owned by multiple users 1 who use a service using an information processing system 10 provided by a provider 3 described below, and the generation AI 30 is managed by a generation AI provider 2 that operates a service that provides the generation AI 30.

[0024] In this embodiment, the service using the information processing system 10 is a service that provides any business with the person image information and facial image information described below, which are generated based on the behavioral information described below, including the behavior and attributes of user 1, and other information.

[0025] Next, the specific configuration of each part of the information processing system 10 will be described.

[0026] In this embodiment, the user terminal 20 is implemented as a smartphone, which is a portable information terminal, but it may also be implemented as any information processing terminal, such as a tablet computer, a desktop or notebook computer, etc.

[0027] 2 is a block diagram illustrating an outline of the configuration of the user terminal 20. As shown in the figure, the user terminal 20 includes a control unit 21, a display 22, and sensors 23 as its main components.

[0028] In this embodiment, the control unit 21 controls each part of the user terminal 20, such as the display 22 and the sensors 23, and is composed of, for example, a processor, a memory, a storage, a transmitting / receiving unit, and the like.

[0029] In this embodiment, this control unit 21 stores an application that provides user information of user 1, which will be described later, to the services provided by the information processing system 10, and provides user information of user 1 from the user terminal 20 via the application based on the processing of a program in the information processing device 40.

[0030] In this embodiment, the display 22 displays various screen interfaces of applications executed on the user terminal 20.

[0031] The display 22 is a so-called touch panel that accepts information input by touching the display surface, and is implemented using various technologies such as a resistive film system or a capacitive system.

[0032] In this embodiment, information for operating an application is input via the display 22. This information is input based on an arbitrary action of the user 1 on the display 22 (for example, an action of tapping or swiping the screen, or an action of dragging and dropping an icon or the like displayed on the screen), and in this embodiment, for example, arbitrary text information is input.

[0033] In this embodiment, the sensors 23 are configured with a GPS sensor, a gyro sensor, an acceleration sensor, etc., and detect the latitude and longitude of the current location of the user terminal 20, the orientation of the user terminal 20, etc. as user information.

[0034] The generation AI 30 shown in Figure 1 is a machine learning model constructed using deep learning, and in this embodiment, it performs a process of generating the later-described personal image information and facial image information of user 1 based on behavioral information of user 1, etc., generated by the information processing device 40.

[0035] In this embodiment, the information processing device 40 is implemented by, for example, a desktop or notebook computer.

[0036] 3 is a block diagram illustrating an outline of the hardware configuration of the information processing device 40. As shown in the figure, the information processing device 40 mainly includes a processor 41, a memory 42, a storage 43, a transmission / reception unit 44, and an input / output unit 45, which are electrically connected to each other via a bus 46.

[0037] The processor 41 is an arithmetic unit that controls the operation of the information processing device 40, controls the transmission and reception of data between the elements, and performs processes required for executing application programs.

[0038] In this embodiment, the processor 41 is, for example, a CPU (Central Processing Unit), and executes application programs loaded in a memory 42 (to be described later) to perform various processes.

[0039] The memory 42 is implemented by a main storage device that is configured as a volatile storage device such as a DRAM (Dynamic Random Access Memory).

[0040] The memory 42 is used as a working area for the processor 41, and also stores a BIOS (Basic Input / Output System) that is executed when the information processing device 40 is started up, various setting information, and the like.

[0041] The storage 43 stores data and the like used for various processes by application programs and the like.

[0042] The transceiver 44 connects the information processing device 40 to the network N. The transceiver 44 may be compatible with a wireless communication standard such as Wi-Fi, or may include a short-range communication interface such as Bluetooth (registered trademark) or BLE (Bluetooth Low Energy).

[0043] If necessary, information input devices such as a keyboard and a mouse and output devices such as a display are connected to the input / output unit 45. In this embodiment, a keyboard, a mouse, and a display are connected.

[0044] The bus 46 transmits, for example, address signals, data signals, and various control signals between the processor 41, memory 42, storage 43, transmission / reception unit 44, and input / output unit 45 that are connected to it.

[0045] 4 is a block diagram illustrating an outline of the functions of the information processing device 40. As shown in the figure, the information processing device 40 includes a user information storage unit 40a, a behavior information generation unit 40b, a behavior information storage unit 40c, a prompt input reception unit 40d, a portrait information generation unit 40e, a portrait information output unit 40f, a face image generation prompt input reception unit 40g, a face image information generation unit 40h, and a face image information output unit 40i.

[0046] The user information storage unit 40a and the behavior information storage unit 40c are realized by partitioning the memory area of ​​the storage 43, and the behavior information generation unit 40b, the prompt input receiving unit 40d, the portrait information generation unit 40e, the portrait information output unit 40f, the facial image generation prompt input receiving unit 40g, the facial image information generation unit 40h and the facial image information output unit 40i are realized by the processor 41 executing programs stored in the memory 42.

[0047] In this embodiment, the user information storage unit 40a stores user information acquired from the user terminal 20 in the form of a database.

[0048] The behavioral information generation unit 40b executes a process for generating behavioral information. In this embodiment, the information processing device 40 acquires user information by accessing people flow data, which is geospatial information, and stores the acquired user information in the user information storage unit 40a, and generates behavioral information based on the user information (behavioral information generation process).

[0049] 5 is a diagram illustrating an outline of people flow data. As shown in the figure, the people flow data displays an icon representing user 1 at a position on map information corresponding to the actual geographical location where user 1 is located, based on user information (location information) of user terminal 20 of user 1, and plots the trajectory of user 1's movement on the map information, following the movement of user 1 in geographical space.

[0050] In this embodiment, when an icon of any user 1 is selected on the people flow data, the behavior information generation unit 40b obtains user information of user 1 via the user terminal 20 of user 1 corresponding to the selected icon and generates behavior information.

[0051] FIG. 6 is a diagram illustrating an overview of behavioral information. As shown in the figure, behavioral information is information that includes the behavior of user 1 as understood from user information detected by user terminal 20 and the attributes of user 1 estimated based on that behavior.

[0052] In this embodiment, this behavioral information includes, for each user 1 (each user terminal 20), data regarding the behavior of user 1 derived from user information such as data ID, user ID, location, date and time, etc., as well as data regarding user 1's attributes such as user 1's home address, workplace address, gender, number of people in household (family composition), occupation (industry and occupation), annual income, user 1's responses to any questionnaire, etc.

[0053] The data ID is an ID assigned to the behavioral information of each user 1, the user ID is an ID assigned to each user 1, the location is data related to latitude and longitude or an address, location, facility, etc. derived from latitude and longitude, and the date and time is data related to the date and time when user 1 visited the location.

[0054] The home address and workplace address of user 1 may be estimated, for example, by analyzing user information, and the gender, number of people in household (family structure), occupation (industry and occupation), annual income, etc. may be estimated, for example, by the information processing device 40 accessing open data disclosed by the government, etc. or external data provided by various organizations and referring to this data, or may be estimated by the generation AI 30.

[0055] In this embodiment, the behavioral information storage unit 40c stores the behavioral information generated by the behavioral information generation unit 40b in the form of a database.

[0056] In this embodiment, the prompt input receiving unit 40d executes a process of receiving a prompt input to the generation AI 30 which cooperates (is connected to) the program of the information processing device 40 via an API.

[0057] 7 is a block diagram illustrating an outline of a prompt received by the prompt input receiving unit 40d. As shown in the figure, in this embodiment, the prompt is made up of a metacognitive approach, a command, a task, behavioral information, and persona information.

[0058] The metacognitive approach is a protocol that sets out methods for generating character information, which will be described later. For example, it sets out methods such as "analyzing the content of the question," "creating an initial answer to the question," "critically evaluating whether the answer is correct," and "taking into account the evaluation, taking a deep breath, creating a final answer and explaining the reasons."

[0059] The command is a protocol that sets conditions for generating character profile information, such as, "You are a professional in information analysis, behavioral psychology, and marketing. Please analyze user behavioral information and output it as profiling data in the form of a reference persona."

[0060] A task is a protocol that sets out tasks for generating information about a person, such as "analyze the provided data from multiple angles," "analyze the correlation between the time of stay and frequently visited places," "analyze behavioral patterns on weekdays and weekends and summarize them in 300 characters," "output keywords extracted from the analysis results," "create profiling data based on a reference persona," and "come up with a fictitious name and add (pseudonym) at the end."

[0061] As described above, the behavior information is information including the attributes and behavior of the user 1, and is extracted from the behavior information storage unit 40c and inserted into the prompt.

[0062] Persona information is reference information for generating character profile information, and is composed of persona attributes such as "name," "place of residence," "place of work," "industry," "annual income," and "family composition."

[0063] 8 is a block diagram illustrating an outline of the processing of the person image information generation unit 40e. As shown in the figure, when a prompt P1 is input to the generation AI 30, which cooperates (connects) with the program of the information processing device 40 via an API, the person image information generation unit 40e executes processing to autonomously generate person image information P2 (person image information generation processing).

[0064] 9 is a diagram for explaining an outline of the person image information P2 generated by the person image information generating unit 40e. As shown in the figure, the person image information P2 is made up of behavior patterns and keywords.

[0065] 10 is a diagram outlining an example of a behavior pattern. As shown in the figure, the behavior pattern is text information that identifies the personality of user 1 by estimating the behavior patterns of user 1 on weekdays and holidays based on prompt P1 received by prompt input receiving unit 40c.

[0066] The keywords shown in FIG. 9 are text information relating to the character of user 1 extracted as keywords from the behavioral patterns, and are composed of phrases such as "car," "family," "bookstore," and "shopping."

[0067] In this embodiment, the person image information output unit 40f shown in Figure 4 performs a process of outputting the person image information P2 generated by the person image information generation unit 40e to the information processing device 40 or an information processing terminal of an arbitrary business operator.

[0068] In this embodiment, the facial image generation prompt input receiving unit 40g executes a process of receiving a facial image generation prompt input to the generation AI 30 which cooperates (is connected) with the program of the information processing device 40 via an API.

[0069] 11 is a block diagram illustrating an outline of a facial image generation prompt received by the facial image generation prompt input receiving unit 40g. As shown in the figure, in this embodiment, the facial image generation prompt is made up of a command, a task, and portrait information.

[0070] The command is a protocol that sets conditions for generating face image information, and for example, a condition such as "You are a photographer skilled in behavioral psychology, profiling, photography, etc." is set.

[0071] A task is a protocol that sets out challenges for generating facial image information, such as "analyze a person's image from portrait information and generate a photographic image," "the person must be Japanese," "output a realistic photograph," "not an illustration," and "personal image information must not be included in the image."

[0072] As described above, the portrait information is portrait information P2 generated by portrait information generation unit 40d, and is inserted into the facial image generation prompt when generating facial image information of user 1 corresponding to the generated portrait information P2.

[0073] 12 is a block diagram illustrating an outline of the processing of the facial image information generation unit 40h. As shown in the figure, when a facial image generation prompt P1a is input to the generation AI 30, which cooperates (connects) with the program of the information processing device 40 via an API, the facial image information generation unit 40g executes processing to autonomously generate facial image information P2a (facial image information generation processing).

[0074] In this embodiment, the facial image information output unit 40i shown in Figure 4 executes a process of outputting the facial image information P2a generated by the facial image information generation unit 40g to the information processing device 40 or an information processing terminal of any business operator.

[0075] Next, an outline of the processing of the information processing system 10 according to this embodiment will be described.

[0076] 13 is a flowchart outlining the processing of the information processing system 10. First, the information processing device 40 accesses people flow data, and as shown in the figure, in step S1, an icon of any user 1 in the people flow data is selected to acquire user information. In step S2, behavioral information is generated based on the user information of the selected user 1 or by referring to various information (behavioral information generation processing).

[0077] Next, in step S3, the generated behavioral information is inserted into the prompt P1, and the prompt P1 with the behavioral information inserted is input to the generation AI 30, whereupon a process of accepting the input of the prompt P1 is executed.

[0078] When the input of the prompt P1 is accepted, in step S4, the generation AI 30, which is linked (connected) to the program of the information processing device 40 via an API, autonomously generates portrait information P2 of the selected user 1 (portrait information generation process), and in step S5, outputs the generated portrait information P2 to the information processing device 40 or an information processing terminal of any operator.

[0079] Next, in step S6, the generated person image information P2 is inserted into the facial image generation prompt P1a, and the facial image generation prompt P1a with the person image information P2 inserted is input into the generation AI30, whereupon a process is executed to accept the input of the facial image generation prompt P1a.

[0080] When the input of the facial image generation prompt P1a is received, in step S7, the generation AI 30, which is linked (connected) to the program of the information processing device 40 via an API, autonomously generates facial image information P2a of the selected user 1 (facial image information generation process), and in step S8, outputs the generated facial image information P2a to the information processing device 40 or an information processing terminal of any operator.

[0081] In this way, based on the behavioral information of user 1, it is possible to generate character information P2 that identifies the personality of user 1. Since this character information P2 is assumed to be based on the user's behavior or activity tendencies, it can be usefully utilized for various activities based on the identified personality.

[0082] For example, depending on the identified personality, it can be effectively utilized in marketing activities aimed at the user 1 corresponding to that personality or other users 1 whose personality is similar to that of this user 1.

[0083] Furthermore, based on the generated person image information P2, facial image information P2a of user 1 corresponding to that person image is generated, allowing the user 1 to visually and intuitively grasp the person image of user 1. In this way, by using the person image identified as image information for various activities, it is expected that the range of applications will be expanded.

[0084] The present invention is not limited to the above-described embodiment, and various modifications are possible without departing from the spirit of the invention.

[0085] In the above embodiment, we have described a case where the information processing device 40 accesses people flow data to obtain user information for user 1, but it is also possible to obtain user information using various methods without accessing people flow data, such as by selecting an arbitrary user 1 from data listing multiple users 1.

[0086] The acquisition of user information may be such that a single user 1 is selected and a single piece of user information is acquired, or such that multiple users 1 are selected and multiple pieces of user information are acquired, or such that multiple arbitrary users 1 are selected as a group and multiple pieces of user information belonging to the group are selected.

[0087] Furthermore, the user information may be selected randomly, for example, by random number processing.

[0088] In the above embodiment, the case where the information processing device 40 functions as the behavioral information generator 40b to generate behavioral information has been described, but the behavioral information may be generated by, for example, a processing device implemented in another computer connected to the information processing device 40. In this case, the other processing device may be managed by the business operator 3 or another business operator.

[0089] In the above embodiment, we have described a case where the generation AI 30 is provided by the generation AI provider 2, but for example, the generation AI may be stored in the information processing device 40 and processing may be performed by this generation AI.

[0090] In the above embodiment, the case where the prompt P1 includes a metacognitive approach has been described, but the prompt may not include a metacognitive approach.

[0091] In the above embodiment, the case where the information processing device 40 is implemented on a computer managed by the business operator 3 has been described, but for example, the information processing device 40 may be a computer implemented in a cloud environment. [Explanation of symbols]

[0092] 1 user 3 Business operators 10 Information Processing Systems 20 User terminal 30 Generation AI 40 Information processing equipment

Claims

1. A behavior information generation process for generating behavior information including user behavior and attributes; a person image information generation process for generating person image information by identifying a person image of the user based on the behavior information generated in the behavior information generation process; a face image information generation process for generating an image of the user's face as face image information based on the person image information generated in the person image information generation process; An information processing system that executes the above.

2. The person image information generation process includes: The information processing system according to claim 1 , wherein the person image information is generated autonomously based on a machine learning model.

3. The facial image information generation process includes: The information processing system according to claim 1 , wherein the facial image information is generated autonomously based on a machine learning model.

4. The behavioral information generation process includes: The information processing system according to claim 1 , wherein the behavior information is generated based on user information acquired via a terminal device of the user.

5. The behavioral information generation process includes: generating the behavior information based on user information acquired via a terminal device of the user; The information processing system according to claim 1 , wherein the user information is acquired by selecting an image of the user displayed on geospatial information.

6. The person image information generation process includes: The information processing system according to claim 1 , wherein the person profile information is generated based on persona information relating to attributes of the user in addition to the behavioral information.

7. An information processing device including a processor and a memory in which a program is stored, When the program is executed by the processor, A behavior information generation process for generating behavior information including user behavior and attributes; a person image information generation process for generating person image information by identifying a person image of the user based on the behavior information generated in the behavior information generation process; a face image information generation process for generating an image of the user's face as face image information based on the person image information generated in the person image information generation process; An information processing device that executes the above.

8. An information processing device implemented by a computer, A behavior information generation process for generating behavior information including user behavior and attributes; a person image information generation process for generating person image information by identifying a person image of the user based on the behavior information generated in the behavior information generation process; a face image information generation process for generating an image of the user's face as face image information based on the person image information generated in the person image information generation process; A program that executes the following.

9. An information processing device implemented by a computer, A behavior information generation process for generating behavior information including user behavior and attributes; a person image information generation process for generating person image information by identifying a person image of the user based on the behavior information generated in the behavior information generation process; a face image information generation process for generating an image of the user's face as face image information based on the person image information generated in the person image information generation process; An information processing method that performs the above.

Images