Information processing device, information processing method, program, and information processing system

The information processing device addresses the burden of manual survey analysis by acquiring and analyzing user emotional and movement data within designated areas, thereby reducing the time and effort required for evaluating area quality.

JP7660620B2Active Publication Date: 2025-04-11KDDI CORP
View PDF 6 Cites 0 Cited by

Patent Information

Application Number
JP2023123259
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2023-07-28
Publication Date
2025-04-11
Estimated Expiration
2043-07-28

AI Technical Summary

Technical Problem

Conventional methods for analyzing the quality of a given area, such as stores or event venues, burden visitors and area managers with the need to input survey answers, which is time-consuming and labor-intensive.

Method used

An information processing device that acquires emotional and movement information from user terminals, analyzes the stay period and emotions of users within a designated area, and outputs judgment results and emotional information to reduce the burden on visitors and area managers.

Benefits of technology

The system effectively reduces the burden on visitors and area managers by automating the analysis of user emotions and stay periods, providing insights into area quality without the need for manual surveys.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007660620000001
    Figure 0007660620000001
  • Figure 0007660620000002
    Figure 0007660620000002
  • Figure 0007660620000003
    Figure 0007660620000003
Patent Text Reader

Abstract

To reduce the burden on visitors and an area manager associated with quality analysis regarding a predetermined area.SOLUTION: An information processing device 1 includes: an acquisition unit 131 that acquires emotion information for identifying an emotion of a user and movement information for identifying a movement of the user from a user terminal 2 used by the user; a behavior identification unit 133 that identifies a duration of stay during which the user stayed in a designation area designated based on the movement information; a determination unit 134 that determines whether or not the duration of stay identified by the behavior identification unit 133 is equal to or greater than a predetermined threshold; an emotion identification unit 135 that identifies the emotion of the user at a predetermined time point between immediately before entering the designation area and immediately after leaving the designation area based on the emotion information; and an output unit 137 that outputs the determination result determined by the determination unit 134 and information indicating the emotion of the user identified by the emotion identification unit 135.SELECTED DRAWING: Figure 2
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to an information processing device, an information processing method, a program, and an information processing system. [Background technology]

[0002] Conventionally, there is known a system for analyzing the quality of a predetermined area such as a store, an event venue, etc. Patent Document 1 discloses a technology for analyzing the results of questionnaire responses by visitors. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Patent Publication No. 2021-163403 Summary of the Invention [Problem to be solved by the invention]

[0004] Conventional technology requires visitors to input their responses to a questionnaire, which places a heavy burden on both the visitors who input the responses and the area managers who manage the areas where visitors are asked to respond to the questionnaires.

[0005] The present invention has been made in consideration of these points, and aims to reduce the burden on visitors and area managers involved in analyzing the quality of a specified area. [Means for solving the problem]

[0006] An information processing device in a first aspect of the present invention has an acquisition unit that acquires emotion information for identifying the emotion of a user and movement information for identifying the movement of the user from a user terminal used by a user, a period determination unit that determines a stay period during which the user stayed in a designated area based on the movement information, a determination unit that determines whether the stay period determined by the period determination unit is equal to or greater than a predetermined threshold, an emotion determination unit that determines the emotion of the user at a predetermined time point between immediately before entering the designated area and immediately after leaving the designated area based on the emotion information, and an output unit that outputs a determination result determined by the determination unit and information indicating the emotion of the user determined by the emotion determination unit.

[0007] The information processing device may further include a counting unit that counts the number of users whose emotions at the specified time point identified by the emotion identification unit correspond to a specified emotion and whether or not the stay period is equal to or longer than the specified threshold, and the output unit outputs the number of users counted by the counting unit.

[0008] The designated area may have a plurality of entrances and exits, and the period determination unit may identify the entrances and exits used by the user based on the movement information, and the counting unit may further count the number of users whose emotions at the specified time point identified by the emotion determination unit correspond to a specified emotion, by dividing the number of users by the entrances and exits of the designated area.

[0009] The acquisition unit may acquire payment information for identifying the payment made by the user, and the counting unit may further count the number of users whose emotion at the specified time point identified by the emotion identification unit corresponds to a specified emotion, based on whether the payment information indicates that the user made a payment in the designated area.

[0010] The acquisition unit may acquire application information indicating whether or not a specified application program is installed in the user terminal, and the counting unit may further count the number of users whose emotion at the specified time point identified by the emotion identification unit corresponds to a specified emotion, based on whether or not the application information indicates that the specified application program is installed in the user terminal.

[0011] The information processing device may further have a receiving unit that receives a designation of the specified emotion, and the counting unit may count the number of users whose emotion at the specified time corresponds to a designated emotion, which is the specified specified emotion.

[0012] The information processing device may further have a memory unit that stores an association between an industry and an emotion, and a reception unit that receives a designation of an industry, and the counting unit may count the number of users whose emotions at the specified time correspond to emotions associated with a designated industry, which is the industry designated in the memory unit.

[0013] The information processing device may further have a memory unit that stores business types and emotions in association with each other, and a reception unit that receives a designation of a business type, and the counting unit may count the number of users whose emotions at the specified time point correspond to emotions associated with a designated business type, which is the business type designated in the memory unit.

[0014] The information processing device may further have a reception unit that receives designation of the specified threshold, and the determination unit may determine whether the stay period identified by the period determination unit is equal to or greater than a designated threshold, which is the specified threshold.

[0015] An information processing method in a second aspect of the present invention includes the steps of: acquiring emotion information for identifying the emotion of a user and movement information for identifying the movement of the user from a user terminal used by a computer; identifying a period of stay during which the user stayed in a designated area based on the movement information; determining whether the identified period of stay is equal to or longer than a predetermined threshold; identifying the emotion of the user at a predetermined time point between immediately before entering the designated area and immediately after leaving the designated area based on the emotion information; and outputting the determined determination result and information indicating the identified emotion of the user.

[0016] A program in a third aspect of the present invention causes a computer to function as an acquisition unit that acquires, from a user terminal used by a user, emotion information for identifying the emotion of the user and movement information for identifying the movement of the user, a period identification unit that identifies a stay period during which the user stayed in a designated area based on the movement information, a determination unit that determines whether the stay period identified by the period identification unit is equal to or greater than a predetermined threshold, an emotion identification unit that identifies the emotion of the user at a predetermined time point between immediately before entering the designated area and immediately after leaving the designated area based on the emotion information, and an output unit that outputs a determination result determined by the determination unit and information indicating the emotion of the user identified by the emotion identification unit.

[0017] An information processing system according to a fourth aspect of the present invention is an information processing system having a user terminal used by a user and an information processing device, wherein the user terminal has a terminal transmission unit that transmits a designated area designated by the user to the information processing device, and the information processing device has an acquisition unit that acquires, from the user terminal used by the user, emotion information for identifying the emotion of the user and movement information for identifying the movement of the user, a period identification unit that identifies a stay period during which the user stayed in the designated area based on the movement information, a determination unit that determines whether the stay period identified by the period identification unit is equal to or greater than a predetermined threshold, an emotion identification unit that identifies the emotion of the user at a predetermined time point between immediately before entering the designated area and immediately after leaving the designated area based on the emotion information, and a device transmission unit that transmits, to the user terminal, a determination result determined by the determination unit and emotion identification information indicating the emotion of the user identified by the emotion identification unit, and the user terminal further has a display control unit that displays the determination result and the emotion identification information on a display unit. Effect of the Invention

[0018] According to the present invention, it is possible to reduce the burden on visitors and area managers involved in analyzing the quality of a specific area. [Brief description of the drawings]

[0019] [Figure 1] 1 is a diagram for explaining an overview of an information processing system S. [Diagram 2] FIG. 1 is a block diagram of an information processing device 1. [Diagram 3] FIG. 2 is a diagram illustrating an example of a configuration of a behavior management database. [Figure 4] FIG. 13 is a diagram illustrating a display screen of an information processing service. [Diagram 5] 4 is a flowchart showing a process flow of the information processing device 1. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0020] [Outline of Information Processing System S] FIG. 1 is a diagram for explaining an overview of an information processing system S. The information processing system S is a system used for providing an information processing service to a user. The information processing service is a service for providing information on the emotions of visitors who have visited a specified area. The specified area is, for example, an area of ​​an indoor facility such as a street store, a shopping mall including multiple stores, some stores included in a shopping mall, or an outdoor facility such as a park or a stadium. The information processing system S has an information processing device 1, a user terminal 2, and a user terminal 3.

[0021] The information processing device 1 is a device that manages an information processing service, and is, for example, a server. An administrator that manages the information processing device 1 is, for example, a telecommunications carrier. The information processing device 1 manages information about users. A user is, for example, a person who uses a communication service provided by the administrator of the information processing device 1.

[0022] The user terminal 2 is a terminal used by a user, such as a smartphone or a tablet terminal. The user terminal 2 performs mobile data communication by utilizing a communication service provided by the administrator of the information processing device 1. The user terminal 2 has, for example, a position measurement function for measuring the position of the user terminal 2. The user terminal 2 acquires the user's biometric information (e.g., heart rate, blood oxygen, electrocardiogram, body temperature, sleep, etc.) measured by a wearable device (e.g., a smart watch, etc.) worn by the user from the wearable device. A user ID (identifier) ​​for identifying the user in the communication service is set in the user terminal 2.

[0023] The user terminal 3 is a terminal used by a user of the information processing service, and is, for example, a smartphone, a tablet terminal, a personal computer, etc. The user is, for example, an area manager who manages a specific area, such as a store clerk, a manager of an outdoor facility, or a host of an event held in an indoor or outdoor facility.

[0024] When a user wishes to obtain information for analyzing the quality of a specified area (for example, visitors who have visited a specified area evaluate the level of satisfaction with the specified area, the attractiveness of the area, etc.), it may be possible to conduct a survey of the visitors. However, in conducting a survey, the user must ask the visitors to complete the survey, and the visitors must complete the survey, which imposes a large burden on both the user and the visitors. Therefore, there is a demand for obtaining information for analyzing the quality of a specified area without obtaining survey responses from visitors.

[0025] The quality of a predetermined area may be analyzed based on the length of stay of a visitor in the predetermined area and the emotion of the visitor. For example, if the visitor's excitement level before visiting the predetermined area is low but the stay period in the predetermined area is long, the visitor may have a high evaluation of the predetermined area (for example, the layout of the predetermined area (for example, the appearance of the store), the attraction to the predetermined area, the event held in the predetermined area, etc. are highly satisfied or attractive). For example, if the visitor's excitement level during the stay in the predetermined area is high and the stay period in the predetermined area is long, the visitor may have a high evaluation of the predetermined area (for example, the satisfaction level or the attraction to the content provided in the predetermined area, the attraction to the designated area, the event held in the designated area, etc. are highly satisfied or attractive). For example, regardless of the visitor's excitement level, if the stay period is short, the visitor may have a low evaluation of the predetermined area.

[0026] In this way, if a user has information indicating the length of stay in a specific area and the emotions of visitors, the user can analyze the quality of the specific area. Therefore, the information processing system S presents to the user the length of stay in a specific area and information indicating the emotions of visitors based on the information acquired from the user terminal 2. The processes executed by the information processing system S will be described below.

[0027] First, the information processing device 1 acquires emotion information and movement information from the user terminal 2 ((1) in FIG. 1). The emotion information is information for identifying the emotion of the user, and is, for example, biometric information of the user measured by a wearable device. The movement information is information for identifying the movement of the user, and is, for example, time-series information indicating the position of the user terminal 2 measured by the position measurement function of the user terminal 2.

[0028] When a user performs an operation on the user terminal 3 to access a website that provides an information processing service, the user terminal 3 displays a display screen of the information processing service. The display screen of the information processing service has an item for designating an area, and when a user performs an operation to designate a specific area on the display screen of the information processing service displayed on the user terminal 3, the user terminal 3 transmits information indicating the designated area, which is the specific area designated by the user, to the information processing device 1 ((2) in FIG. 1).

[0029] The information processing device 1 identifies the duration of stay that the user stayed in the designated area based on the movement information ((3) in FIG. 1). The information processing device 1 also identifies the emotion of the user who stayed in the designated area based on the emotion information ((4) in FIG. 1). The user's emotion is, for example, the degree of excitement indicating the degree of excitement, or the type of emotion such as joy, anger, sadness, and happiness. Although details are omitted as these are known technologies, various methods have been proposed for estimating the emotion of a user from the user's biometric information, which is emotion information, and the information processing device 1 identifies the user's emotion using these known technologies.

[0030] Then, the information processing device 1 transmits the determination result of the length of stay of the identified user and information indicating the emotion of the identified user to the user terminal 3 ((5) in FIG. 1). After that, the user terminal 3 displays the determination result and the information indicating the emotion of the user on the display screen of the information processing service.

[0031] In this way, the information processing system S can provide the user with information for analyzing the quality of a specified area based on the information acquired from the user terminal 2. This allows the information processing system S to eliminate the work required of the user to obtain responses to the questionnaire. As a result, the information processing device S can reduce the burden on the user associated with analyzing the quality of a specified area. The configuration of the information processing device 1 will be described below.

[0032] [Configuration of information processing device 1] Fig. 2 is a block diagram of the information processing device 1. In Fig. 2, the arrows indicate main data flows, and there may be data flows other than those shown in Fig. 2. In Fig. 2, each block indicates a configuration in functional units, not a configuration in hardware (device) units. Therefore, the blocks shown in Fig. 2 may be implemented in a single device, or may be implemented separately in multiple devices. Data may be exchanged between blocks via any means, such as a data bus, a network, or a portable storage medium.

[0033] The information processing device 1 includes a communication unit 11, a storage unit 12, and a control unit 13. The information processing device 1 may be configured by connecting two or more physically separated devices by wire or wirelessly. The information processing device 1 may also be configured by a cloud that is a collection of computer resources.

[0034] The communication unit 11 has a communication controller for transmitting and receiving data to and from the user terminal 2 or the user terminal 3 via the network. The communication unit 11 notifies the control unit 13 of data received from the user terminal 2 or the user terminal 3 via the network. In addition, the communication unit 11 transmits data output from the control unit 13 to the user terminal 2 or the user terminal 3 via the network.

[0035] The storage unit 12 is a storage medium including a ROM (Read Only Memory), a RAM (Random Access Memory), a hard disk drive, etc. The storage unit 12 may be provided outside the information processing device 1, in which case data may be exchanged between the storage unit 12 and the control unit 13 via a network. The storage unit 12 stores in advance a program to be executed by the control unit 13. The storage unit 12 stores information about users who use the communication service (e.g., user ID, user gender, user age, etc.). The storage unit 12 also stores a behavior management database that manages information about user behavior.

[0036] Fig. 3 is a diagram showing an example of the configuration of the behavior management database. In the example shown in Fig. 3, the behavior management database stores a user ID, a stay area, and a stay period in association with each other. The stay area is information indicating an area where a user stayed, such as the name of the area, the location coordinates of the area, etc. The stay period is the period during which a user stayed in the stay area.

[0037] 2, the control unit 13 has an acquisition unit 131, a reception unit 132, a behavior identification unit 133, a determination unit 134, an emotion identification unit 135, a counting unit 136, and an output unit 137. The control unit 13 is a processor such as a CPU (Central Processing Unit), and functions as the acquisition unit 131, the reception unit 132, the behavior identification unit 133, the determination unit 134, the emotion identification unit 135, the counting unit 136, and the output unit 137 by executing a program stored in the storage unit 12.

[0038] The acquisition unit 131 acquires emotion information and movement information from the user terminal 2. For example, for each user ID included in the information about the user stored in the storage unit 12, the acquisition unit 131 acquires emotion information and movement information from the user terminal 2 in which the user ID is set.

[0039] The acquisition unit 131 may acquire emotion information from the user terminal 2 at a predetermined interval, or may acquire time-series emotion information measured at a predetermined interval from the user terminal 2. Furthermore, the acquisition unit 131 may acquire movement information by acquiring position information from the user terminal 2 at a predetermined interval, or may acquire movement information that is time-series position information measured at a predetermined interval from the user terminal 2.

[0040] The reception unit 132 receives input information input by a user on a display screen of the information processing service. The input information includes at least information indicating a designated area. The information indicating the designated area is, for example, a name of the designated area, position coordinates indicating the range of the designated area, etc.

[0041] The input information may further include a specified threshold, a specified time point, a specified period, a specified attribute, and a specified emotion, etc. The specified threshold is a threshold specified by the user and is a threshold used to determine the length of stay. The specified time point is a time point specified by the user and is a time point at which the user's emotion is identified. The specified period is a period specified by the user and is a period for which the stay period and the user's emotion are identified. The specified attribute is a user attribute specified by the user (e.g., gender, age, etc.). The specified emotion is a user emotion specified by the user (e.g., type of emotion such as joy, anger, sadness, happiness, etc., or degree of excitement (e.g., large, medium, small, etc.)).

[0042] For example, the user terminal 3 has a transmission unit that transmits information to the information processing device 1. In this case, first, when the user inputs information on the display screen of the information processing service, the transmission unit of the user terminal 3 transmits the input information input by the user to the information processing device 1. Then, the reception unit 132 acquires the input information from the user terminal 3, and thereby receives the input information.

[0043] The behavior identifying unit 133 functions as a period identifying unit, and identifies the stay period during which the user stayed in the designated area, based on the movement information acquired by the acquiring unit 131. Specifically, the behavior identifying unit 133 identifies the stay period of the user by executing the following two steps.

[0044] As a first step, when the acquisition unit 131 acquires the movement information, the behavior identification unit 133 identifies the stay period of the stay area in which the user stayed based on the movement information. The stay area is, for example, a facility where the user enters and leaves.

[0045] For example, first, the behavior identifying unit 133 refers to map information and identifies a stay area included in the movement route traveled by the user identified by the movement information. Then, the behavior identifying unit 133 identifies the stay period during which the user stayed in the identified stay area based on the movement information. For example, the behavior identifying unit 133 identifies the stay period of the user in the stay area by identifying the period from when the position of the user terminal 2 enters the stay area to when the position of the user terminal 2 leaves the stay area.

[0046] When the behavior identifying unit 133 identifies the stay period, it stores the user ID, information indicating the stay area, and the identified stay period in the behavior management database in association with each other. When the movement information includes multiple stay areas, the behavior identifying unit 133 identifies the user's stay period in each stay area for each stay area. Furthermore, when the acquiring unit 131 acquires multiple pieces of movement information from multiple user terminals 2, the behavior identifying unit 133 identifies the user's stay period in the stay area for each piece of acquired movement information.

[0047] As a second step, the behavior identifying unit 133 identifies the user's stay period in the designated area from the user's stay period in the identified stay area. For example, the receiving unit 132 first receives input information including a predetermined area designated by the user. Then, the behavior identifying unit 133 identifies the user's stay period in the designated area by selecting a stay period stored in association with the designated area, which is the predetermined area received by the receiving unit 132, from the stay periods stored in the behavior management database.

[0048] In the above, an example has been described in which the behavior identifying unit 133 identifies the user's stay period in the stay area in advance, but this is not limiting. For example, the behavior identifying unit 133 may identify the user's stay period in a designated area in response to a user's designation of the designated area.

[0049] Specifically, first, when the receiving unit 132 receives input information including the designated area, the behavior identifying unit 133 identifies a user who was in the designated area based on the movement information. For example, the behavior identifying unit 133 refers to map information and searches whether the designated area is included in the movement route traveled by the user identified by the movement information, and identifies the user who traveled the movement route including the designated area as a user who was in the designated area. Then, the behavior identifying unit 133 identifies the stay period during which the user stayed in the designated area based on the movement information of the identified user.

[0050] The determination unit 134 determines whether the stay period identified by the behavior identification unit 133 is long or not. Specifically, the determination unit 134 determines whether the stay period identified by the behavior identification unit 133 is equal to or longer than a predetermined threshold. The predetermined threshold is, for example, a threshold for determining whether the stay period is long or short. The predetermined threshold may be a threshold common to each area, or may be a threshold determined for each area. The predetermined threshold may be a specified threshold determined by a user.

[0051] Specifically, first, the receiving unit 132 receives a designation of a predetermined threshold. Then, the determining unit 134 determines whether the stay period identified by the behavior identifying unit 133 is equal to or greater than the designated threshold, which is the predetermined threshold designated and accepted by the receiving unit 132. In this manner, the information processing device 1 can determine whether the stay period is long or short based on the user's criteria.

[0052] The emotion identification unit 135 identifies the emotion of the user at a predetermined time based on the emotion information acquired by the acquisition unit 131. The emotion identification unit 135 identifies the emotion of the user based on the emotion information, for example, by using a known technique. The predetermined time is a time between immediately before entering the designated area and immediately after leaving the designated area, and is a designated time designated by the user. For example, the display screen of the information processing service is provided with a selection item for selecting the predetermined time from before entering, during stay, and after leaving.

[0053] In this case, when the user designates one of the three time points, the emotion identification unit 135 identifies the emotion of the user based on emotion information measured at the designated time point when the designation was accepted by the accepting unit 132. For example, when the user designates "before coming", the emotion identification unit 135 identifies the emotion of the user based on emotion information measured before the user came to the designated area and measured at the time point closest to the time point when the user came to the designated area. Also, for example, when the user designates "during stay", the emotion identification unit 135 identifies the emotion of the user based on emotion information measured while the user was staying in the designated area. Also, for example, when the user designates "after leaving", the emotion identification unit 135 identifies the emotion of the user based on emotion information measured after the user left the designated area and measured at the time point closest to the time point when the user left the designated area. Note that, when the user designates multiple time points, the emotion identification unit 135 may identify the emotion of the user for each designated time point based on emotion information measured at the designated time point.

[0054] In the above, an example in which a user selects one of three time points has been described, but this is not limiting. For example, the predetermined time point may be determined according to the type of business (e.g., retail, food and beverage, service, finance, real estate, education, etc.) or type of business (e.g., department store, supermarket, convenience store, specialty store, etc.). For example, in the retail business, it may be desired to know the number of users who correspond to a predetermined emotion before visiting the store. Also, for example, in the food and beverage business, it may be desired to know the number of users who correspond to a predetermined emotion while staying at the store. In this way, the time point at which the user's emotion is to be identified may be determined according to the user's business, and a quantitative evaluation for each business type or business type is also possible by setting conditions in advance according to the user's business. Therefore, the emotion identification unit 135 may identify the user's emotion at the predetermined time point according to the business type or business type specified by the user.

[0055] For example, the storage unit 12 stores a business type or business format in association with a preset set time point. In this case, first, the reception unit 132 receives a designation of a business type or business format from a user. The business type or business format designated by the user is, for example, a business type or business format corresponding to a business carried out by the user. Then, the emotion identification unit 135 identifies the user's emotion based on emotion information measured at a set time point stored in the storage unit 12 in association with the business type or business format designated by the reception unit 132. In this way, the information processing device 1 can identify the user's emotion at a time point corresponding to the business type or business format designated by the user.

[0056] The emotion identifying unit 135 identifies the emotion of the user at a predetermined time point, for example, when the receiving unit 132 receives input information. The emotion identifying unit 135 may identify the emotion of the user when the acquiring unit 131 acquires emotion information.

[0057] For example, first, when the acquisition unit 131 acquires emotion information, the emotion identification unit 135 identifies the emotion of the user at a predetermined timing (for example, every minute, every 10 minutes, every hour, etc.) based on the emotion information measured at the timing. When the emotion identification unit 135 identifies the emotion of the user, the emotion identification unit 135 associates the user ID, information indicating the identified emotion of the user, and the measurement date and time at which the emotion information used to identify the emotion of the user was measured, and stores them in the storage unit 12. Then, when the reception unit 132 receives input information, the emotion identification unit 135 identifies the emotion of the user at the predetermined time by selecting, from the information indicating the emotion of the user stored in the storage unit 12, information indicating the emotion of the user stored in the storage unit 12 in association with the ID of the user whose stay period has been identified by the behavior identification unit 133 and the measurement date and time corresponding to the predetermined time.

[0058] The output unit 137 outputs the determination result determined by the determination unit 134 and information indicating the user's emotion identified by the emotion identification unit 135. For example, the output unit 137 transmits the determination result determined by the determination unit 134 and the information indicating the user's emotion identified by the emotion identification unit 135 to the user terminal 3, thereby causing the user terminal 3 to display the determination result determined by the determination unit 134 and the information indicating the user's emotion identified by the emotion identification unit 135. For example, the user terminal 3 further has a display control unit that displays information on the display unit, and the display control unit of the user terminal 3 causes the display unit to display the determination result acquired from the information processing device 1 and the information indicating the user's emotion. For example, the output unit 137 outputs, for each user who has stayed in the designated area, information related to the user (for example, gender, age, etc.), the determination result corresponding to the user, and the information indicating the user's emotion.

[0059] The output unit 137 may output the number of users that have been counted. Specifically, the counting unit 136 first counts the number of users whose emotions at a given time point identified by the emotion identifying unit 135 correspond to a given emotion, by dividing the number of users whose stay period is equal to or longer than a given threshold. For example, for each given emotion (type of emotion or degree of excitement), the counting unit 136 counts the number of users whose emotions at a given time point identified by the emotion identifying unit 135 correspond to the given emotion, by dividing the number of users whose stay period is long or short.

[0060] Then, the output unit 137 outputs the number of users counted by the counting unit 136. The output unit 137 outputs, for example, the number of users for each predetermined emotion counted by the counting unit 136, divided into the number of users with long and short stay periods. In this way, the information processing device 1 can make it easier for the user to analyze the quality related to a predetermined area.

[0061] The output unit 137 may output the number of users who meet the conditions other than the designated area. For example, the output unit 137 outputs the number of users who stayed in the designated area during a predetermined period designated by the user as the condition other than the designated area.

[0062] Specifically, first, the receiving unit 132 receives a designation of a predetermined period. The counting unit 136 counts the number of users who stayed in the designated area during the designated period, which is the predetermined period for which the receiving unit 132 received the designation. Then, the output unit 137 outputs the number of users counted by the counting unit 136. In this manner, the information processing device 1 can present to the user the number of users who stayed during the period designated by the user.

[0063] The output unit 137 may output the number of users corresponding to a predetermined attribute designated by the user as a condition other than the designated area. Specifically, first, the reception unit 132 receives the designation of the predetermined attribute. The counting unit 136 refers to information related to users stored in the storage unit 12, identifies users corresponding to the designated attribute, which is the predetermined attribute designated by the reception unit 132, and counts the number of identified users. Then, the output unit 137 outputs the number of users counted by the counting unit 136. In this manner, the information processing device 1 can present to the user the number of users corresponding to the attribute designated by the user.

[0064] The output unit 137 may output the number of users corresponding to a predetermined emotion designated by the user as a condition other than the designated area. Specifically, first, the receiving unit 132 receives the designation of the predetermined emotion. The counting unit 136 identifies users whose emotions at a predetermined time point correspond to the designated emotion, which is the predetermined emotion designated by the receiving unit 132 and accepted from the user, and counts the number of identified users. Then, the output unit 137 outputs the number of users counted by the counting unit 136. In this manner, the information processing device 1 can present to the user the number of users corresponding to the emotion designated by the user.

[0065] The predetermined emotion may be determined according to the type of business. Therefore, the output unit 137 may output the number of users who fall under the predetermined emotion determined according to the type of business designated by the user. For example, the storage unit 12 stores the emotion in association with the type of business.

[0066] In this case, first, the receiving unit 132 receives a designation of an industry from a user. The counting unit 136 counts the number of users whose emotions at a given time point correspond to emotions associated with the designated industry, which is the industry designation received from the user by the receiving unit 132 in the storage unit 12. Then, the output unit 137 outputs the number of users counted by the counting unit 136. In this way, the information processing device 1 can present the number of users whose emotions correspond to the industry to the user.

[0067] The predetermined emotion may be determined according to the business type. Therefore, the output unit 137 may output the number of users who fall under the predetermined emotion determined according to the business type designated by the user. For example, the storage unit 12 stores the business type and the emotion in association with each other.

[0068] In this case, first, the receiving unit 132 receives a designation of a business type from a user. The counting unit 136 counts the number of users whose emotions at a given time point correspond to an emotion associated with the designated business type, which is the business type designated by the receiving unit 132 and is stored in the memory unit 12. Then, the output unit 137 outputs the number of users counted by the counting unit 136. In this way, the information processing device 1 can present the number of users whose emotions correspond to the business type to the user.

[0069] The output unit 137 may further output the number of users counted according to conditions other than the length of stay. For example, if there are multiple entrances and exits in the designated area, the number of users may be output according to the entrances and exits in the designated area as a condition other than the length of stay.

[0070] Specifically, first, the behavior identification unit 133 identifies an entrance / exit used by the user among a plurality of entrances in the designated area based on the movement information. The "entrance / exit used by the user" is at least one of an entrance / exit used by the user when entering the designated area and an entrance / exit used by the user when exiting the designated area.

[0071] The counting unit 136 counts the number of users whose emotions at the predetermined time point identified by the emotion identification unit 135 correspond to the predetermined emotions, by dividing the number of users into entrances and exits of the designated area. Then, the output unit 137 outputs the number of users counted by the counting unit 136.

[0072] Fig. 4 is a diagram showing a schematic diagram of a display screen of an information processing service. The display screen of the information processing service shown in Fig. 4 shows an area R1 for inputting conditions such as a designated area, and an area R2 for displaying a counting result. The area R1 has input fields for inputting various information including the designated area, and when a user inputs information into each input field in the area R1 and presses a counting button, the reception unit 132 receives the input information input by the user into each input field. The output unit 137 then displays the counting result counted by the counting unit 136 based on the input information received by the reception unit 132 in the area R2.

[0073] 4, since there are two entrances in the designated area designated by the user, the output unit 137 displays in the region R2 a graph showing the number of users whose stay period is equal to or longer than the designated threshold and the number of users whose stay period is shorter than the designated threshold for each entrance in the designated area. In this way, the information processing device 1 can make it easier for the user to analyze the quality of a specific area.

[0074] The output unit 137 may output the number of users divided into those who made a payment in the designated area as information other than the length of stay. Specifically, first, the acquisition unit 131 acquires payment information for identifying a user's payment. The acquisition unit 131 acquires the payment information from, for example, the user terminal 2. The acquisition unit 131 may acquire the user's payment information from a payment management device (not shown) that manages payments.

[0075] The counting unit 136 counts the number of users whose emotions at a given time point identified by the emotion identification unit 135 correspond to a given emotion, further dividing the number into whether or not the payment information indicates that the user made a payment in the designated area. Then, the output unit 137 outputs the number of users counted by the counting unit 136, dividing the number into the length of stay time and the presence or absence of payment in the designated area.

[0076] In this way, the information processing device 1 can make it easier for the user to analyze the quality of a specific area. The output unit 137 may output the number of users counted by the counting unit 136 by whether or not they made a payment in the specified area, instead of by the length of their stay.

[0077] The output unit 137 may output the number of users divided into those who have a predetermined application program (hereinafter, referred to as a "predetermined application") installed, as information other than the length of stay period. Specifically, first, the acquisition unit 131 acquires application information. The application information is information indicating whether a predetermined application is installed in the user terminal 2, and is, for example, information indicating a list of application programs installed in the user terminal 2.

[0078] The counting unit 136 counts the number of users whose emotions at a given time point identified by the emotion identification unit 135 correspond to a given emotion, further dividing the number into whether or not the application information indicates that a given application is installed in the user terminal 2. Then, the output unit 137 outputs the number of users counted by the counting unit 136, divided into long and short stay times and whether or not the given application is installed.

[0079] In this way, the information processing device 1 can make it easier for the user to analyze the quality of a specific area. Note that the output unit 137 may output the number of users counted by the counting unit 136 by whether or not a specific application has been installed, instead of by the length of stay time.

[0080] [Processing of information processing device 1] Next, a description will be given of the processing flow of information processing device 1. Fig. 5 is a flowchart showing the processing flow of information processing device 1. This flowchart starts when acquisition section 131 acquires emotion information and movement information from each of the multiple user terminals 2 (S1).

[0081] The behavior identifying unit 133 identifies the duration of stay during which the user stayed in the designated area based on the movement information acquired by the acquiring unit 131 (S2). The determining unit 134 determines whether the duration of stay identified by the behavior identifying unit 133 is equal to or greater than a predetermined threshold (S3). The emotion identifying unit 135 identifies the emotion of the user at a predetermined point in time based on the emotion information acquired by the acquiring unit 131 (S4).

[0082] The counting unit 136 counts the number of users whose emotions at a given time point identified by the emotion identifying unit 135 correspond to a given emotion, dividing the number into those whose duration of stay is equal to or longer than a given threshold (S5). The output unit 137 outputs the number of users counted by the counting unit 136 as the counting result of the counting unit 136, dividing the number into those determined by the determining unit 134 (S6).

[0083] [Effects of this embodiment] As described above, the information processing device 1 outputs a determination result of whether or not the stay period during which the user stayed in the designated area, which is determined based on the movement information acquired from the user terminal, is equal to or longer than a predetermined threshold, and information indicating the user's emotion, which is determined based on the movement information acquired from the user terminal, at a predetermined time point between immediately before entering the designated area and immediately after leaving the designated area. In this way, the information processing device 1 can provide the user with information for analyzing the quality of the designated area, based on the information acquired from the user terminal 2. This allows the information processing device 1 to save the user and the user the work required to obtain a response to the questionnaire. As a result, the information processing device 1 can reduce the burden on the user and the user associated with the analysis of the quality of the designated area.

[0084] Furthermore, this invention will make it possible to contribute to Goal 9 of the United Nations' Sustainable Development Goals (SDGs), which is to "build resilient infrastructure, promote industry, innovation and infrastructure."

[0085] Although the present invention has been described above using the embodiments, the technical scope of the present invention is not limited to the scope described in the above embodiments, and various modifications and changes are possible within the scope of the gist of the present invention. For example, all or part of the device can be configured by distributing or integrating functionally or physically in any unit. In addition, new embodiments resulting from any combination of multiple embodiments are also included in the embodiments of the present invention. The effect of the new embodiment resulting from the combination combines the effect of the original embodiment. [Explanation of symbols]

[0086] 1. Information processing device 11 Communications Department 12 Storage section 13 Control section 131 Acquisition Department 132 Reception 133 Behavior Specification Department 134 Judgment section 135 Emotion identification part 136 Counting Department 137 Output section 2. User terminal 3. User terminal S Information Processing System

Claims

1. A storage unit that stores a predetermined emotion determined according to a business type and the business type, or a business form and a predetermined emotion determined according to the business form in association with each other; an acquisition unit that acquires, from a user terminal used by a user, emotion information for identifying an emotion of the user and movement information that is time-series information indicating a position of the user terminal measured by the user terminal; a period determination unit that determines a period during which the user stayed in a designated area based on the movement information; a determination unit that determines whether the stay period identified by the period identification unit is equal to or greater than a predetermined threshold; an emotion identification unit that identifies an emotion of the user at a predetermined time point between immediately before entering the designated area and immediately after leaving the designated area based on the emotion information; a reception unit that receives a designation of a business type when a business type is associated with a predetermined emotion in the storage unit, and receives a designation of a business type when a business type is associated with a predetermined emotion in the storage unit; an output unit that outputs information indicating a related emotion, which is a predetermined emotion associated with a designated industry that is an industry designated in the storage unit or a designated business type that is a business type designated in the storage unit, and a determination result determined by the determination unit, the determination result corresponding to the user in which the emotion of the user identified by the emotion identification unit corresponds to the related emotion; An information processing device having the above configuration.

2. The information processing device further includes a counting unit that counts the number of users whose emotions at the predetermined time point identified by the emotion identifying unit correspond to the related emotions and whether or not the stay period is equal to or longer than the predetermined threshold, The output unit outputs the number of users counted by the counting unit. The information processing device according to claim 1 .

3. The designated area has a plurality of entrances and exits; The period determination unit determines the entrance / exit used by the user based on the movement information, the counting unit further counts the number of users whose emotions at the predetermined time point identified by the emotion identifying unit correspond to the related emotions, by the entrances and exits of the designated area; The information processing device according to claim 2 .

4. The acquisition unit acquires payment information for identifying a payment made by the user, The counting unit counts the number of users whose emotions at the predetermined time point identified by the emotion identifying unit correspond to the related emotions, further dividing the number of users into those whose emotions at the predetermined time point correspond to the related emotions and those whose emotions at the predetermined time point correspond to the related emotions, based on whether or not the payment information indicates that the users have made a payment in the designated area. The information processing device according to claim 2 .

5. the acquiring unit acquires application information indicating whether a predetermined application program is installed in the user terminal; the counting unit counts the number of users whose emotions at the predetermined time point identified by the emotion identifying unit correspond to the related emotions, further based on whether or not the application information indicates that the predetermined application program is installed in the user terminal; The information processing device according to claim 2 .

6. The reception unit further receives a designation of the predetermined threshold value, The determination unit determines whether the stay period identified by the period identification unit is equal to or greater than a designated threshold, which is the specified threshold. The information processing device according to claim 1 .

7. A method for executing a method for detecting a predetermined emotion according to a business type and the predetermined emotion according to the business type, or a method for detecting a predetermined emotion according to a business type and the predetermined emotion according to the business type, acquiring, from a user terminal used by a user, emotion information for identifying an emotion of the user, and movement information which is time-series information indicating a position of the user terminal measured by the user terminal; Identifying a period of stay during which the user stayed in a designated area based on the movement information; determining whether the identified stay period is equal to or greater than a predetermined threshold; determining an emotion of the user at a predetermined time point between immediately before entering the designated area and immediately after leaving the designated area based on the emotion information; accepting a designation of a business type when a business type is associated with a predetermined emotion in the storage unit, and accepting a designation of a business type when a business type is associated with a predetermined emotion in the storage unit; outputting information indicating a related emotion, which is a predetermined emotion associated with a designated industry, which is an industry designated in the storage unit, or a designated business type, which is a business type designated in the storage unit, and a determination result corresponding to the user in which the identified emotion of the user corresponds to the related emotion; An information processing method comprising the steps of:

8. A computer having a memory unit that associates and stores a predetermined emotion determined according to an industry and the industry, or a business form and a predetermined emotion determined according to the business form, an acquisition unit that acquires, from a user terminal used by a user, emotion information for identifying an emotion of the user and movement information that is time-series information indicating a position of the user terminal measured by the user terminal; a period identification unit that identifies a period of stay during which the user stayed in a designated area based on the movement information; a determination unit that determines whether the stay period identified by the period identification unit is equal to or greater than a predetermined threshold; an emotion identification unit that identifies an emotion of the user at a predetermined time point between immediately before entering the designated area and immediately after leaving the designated area based on the emotion information; a reception unit that receives a designation of a business type when a business type is associated with a predetermined emotion in the storage unit, and receives a designation of a business type when a business type is associated with a predetermined emotion in the storage unit; an output unit that outputs information indicating a related emotion, which is a predetermined emotion associated with a designated industry that is an industry designated in the storage unit or a designated business type that is a business type designated in the storage unit, and a determination result determined by the determination unit, the determination result corresponding to the user in which the emotion of the user identified by the emotion identification unit corresponds to the related emotion; A program to function as a

9. An information processing system having a user terminal used by a user and an information processing device, the user terminal has a terminal transmission unit that transmits a designated area designated by the user to the information processing device; The information processing device includes: A storage unit that stores a business type and a predetermined emotion determined according to the business type, or a business form and a predetermined emotion determined according to the business form, in association with each other; an acquisition unit that acquires, from a user terminal used by a user, emotion information for identifying an emotion of the user and movement information that is time-series information indicating a position of the user terminal measured by the user terminal; a period determination unit that determines a period during which the user stayed in the designated area based on the movement information; a determination unit that determines whether the stay period identified by the period identification unit is equal to or greater than a predetermined threshold; an emotion identification unit that identifies an emotion of the user at a predetermined time point between immediately before entering the designated area and immediately after leaving the designated area based on the emotion information; a reception unit that receives a designation of a business type when a business type is associated with a predetermined emotion in the storage unit, and receives a designation of a business type when a business type is associated with a predetermined emotion in the storage unit; a device transmission unit that transmits to the user terminal information indicating a related emotion, which is a predetermined emotion associated with a designated business type that is a business type designated in the storage unit or a designated business type that is a business type designated in the storage unit, and a determination result determined by the determination unit, the determination result corresponding to the user whose emotion identified by the emotion identification unit corresponds to the related emotion; having The user terminal further includes a display control unit that causes the information indicating the related emotion and the determination result to be displayed on a display unit. Information processing system.

Citation Information

Patent Citations

  • Server device, information processing method, program, terminal device, and information communication system

    JP2020052748A

  • Customer management system, program, device and method

    JP2021026452A

  • Terminal device, emotion analysis device, emotion analysis system, and emotion analysis method

    JP2021129891A

  • Questionnaire system

    JP2021163403A

  • Behavior management device, behavior management program, behavior management system, and behavior analysis device

    JP2021168073A