Information processing device and information processing program

Abstract

To provide an information processor and an information processing program which allow a user to get a distribution situation of emotions of persons in a target space.SOLUTION: A server 10 includes: a specification unit 11A for specifying positional information showing the position of a person in a target space and specifying an emotional value showing the level of a predetermined type of emotion of the person; and a presentation unit 11B for presenting the information showing the level of the emotion indicated by the emotional level specified by the specification unit 11A to allow the specification of the position shown by the corresponding positional information.SELECTED DRAWING: Figure 2

Description

Technical Field

[0001] The present invention relates to an information processing apparatus and an information processing program.

Background Art

[0002] Conventionally, the following technologies have existed as technologies that can contribute to improving communication between users inside and outside a building.

[0003] Patent Document 1 discloses a monitoring device aimed at enabling a user to be notified in real time that a target person is emitting a non-verbal message.

[0004] This monitoring device includes an acquisition unit that acquires time-series data representing the behavior of a target person, and a determination unit that inputs the time-series data into a determination model generated by unsupervised learning and determines whether or not the time-series data includes an outlier based on the output of the determination model. Further, this monitoring device includes an update unit that updates parameters included in the determination model based on the time-series data, and a notification unit that notifies a user when it is determined that the time-series data includes an outlier.

[0005] Also, Patent Document 2 discloses an audio analysis system aimed at determining the atmosphere of a place from the voice of a speaker.

[0006] This speech analysis system comprises a first sound collection device for collecting the first voice of a first speaker, and a second sound collection device for collecting the second voice of a second speaker. The speech analysis system also comprises a calculation device that calculates a first emotion vector from the first voice, which is a vector representation of the first speaker's multiple types of quantified emotions with multiple components, and a second emotion vector from the second voice, which is a vector representation of the second speaker's multiple types of quantified emotions with multiple components, and uses the first emotion vector and the second emotion vector to calculate an atmosphere vector, which is a vector representation of the atmosphere of the space between the first speaker and the second speaker with multiple components. The speech analysis system also comprises a display device that displays at least one component of the first emotion vector, at least one component of the second emotion vector, and the length of the atmosphere vector.

[0007] Furthermore, Patent Document 3 discloses a communication analysis device aimed at enabling intervention in communication.

[0008] This communication analysis device analyzes communication between multiple participants and includes a microphone that acquires the voices of multiple participants as audio data, and a camera that acquires image data of multiple participants. The communication analysis device also includes an analysis and evaluation unit that evaluates the communication based on the audio data and the image data. The communication analysis device also includes a feedback unit that provides the evaluation results from the analysis and evaluation unit, or feedback based thereon, to the multiple participants in real time. [Prior art documents] [Patent Documents]

[0009] [Patent Document 1] Japanese Patent Publication No. 2020-91527 [Patent Document 2] Japanese Patent Publication No. 2019-56879 [Patent Document 3] International Publication No. 2018 / 174088 [Overview of the Initiative] [Problems that the invention aims to solve]

[0010] Incidentally, knowing what emotions people are experiencing most often at different locations within a given space is extremely important for improving communication within that space.

[0011] However, the technologies disclosed in Patent Documents 1 to 3 do not take into account the distribution of different types of emotions among multiple people present in a target space. Therefore, the technologies disclosed in the above documents have the problem that they cannot grasp the distribution of emotions among people present in a target space.

[0012] This disclosure is made in view of the above circumstances and aims to provide an information processing device and information processing program that can grasp the distribution of human emotions present in a target space. [Means for solving the problem]

[0013] The information processing device according to claim 1 comprises a specification unit that identifies location information indicating the location of a person present in a target space, and an emotion value indicating the level of a predetermined type of emotion of the person, and a presentation unit that presents information indicating the level of emotion indicated by the emotion value in a way that allows for the identification of the location indicated by the corresponding location information.

[0014] According to the information processing device of the present invention as described in claim 1, location information indicating the position of a person present in a target space and an emotion value indicating the level of a predetermined type of emotion of that person are identified, and information indicating the level of emotion indicated by the emotion value is presented in a way that allows the location indicated by the corresponding location information to be identified, thereby enabling the understanding of the distribution of emotions of people present in a target space within that target space.

[0015] Claim 1 The information processing apparatus according to the present invention described herein is ,before The display unit further displays co-occurrence values, which indicate the degree to which the emotions occur simultaneously in multiple individuals, using the emotion values ​​of multiple individuals.

[0016] Claim 1 According to the information processing device of the present invention described above, by using the emotional values ​​of multiple people and further presenting co-occurrence values ​​that indicate the degree to which emotions occur simultaneously among those multiple people, it is possible to grasp these co-occurrence values ​​as well, thereby contributing to the improvement of communication more effectively.

[0017] Claim 1 The information processing apparatus according to the present invention described herein is ,before The display unit calculates the co-occurrence value C using the following formula, where dE is the change in the sum of the emotional values ​​of the multiple people after a predetermined time has elapsed, and Y is the number of people whose emotional values ​​are above a predetermined threshold.

[0018] C = dE × (Y-1)

[0019] Claim 1 According to the information processing apparatus of the present invention described above, the co-occurrence value can be obtained relatively easily by calculating the co-occurrence value C using the above formula.

[0020] Claim 2 The information processing apparatus according to the present invention described in claim 1 The information processing device described herein is such that the predetermined types of emotions include positive emotions.

[0021] According to the information processing apparatus according to the present invention described in 2 Claim, by including a positive emotion in the predetermined types of emotions, it is possible to contribute more effectively to the improvement of communication as compared with the case where the predetermined types of emotions are only negative emotions.

[0022] According to the information processing program according to the present invention described in 3 Claim, it specifies position information indicating the position of a person existing in the target space and an emotion value indicating the height of a predetermined type of emotion of the person, and presents information indicating the height of the emotion indicated by the emotion value in a manner that enables the position indicated by the corresponding position information to be specified. In a process that uses the emotion values ​​of multiple persons to further present a co-occurrence value indicating the degree to which the emotion occurs simultaneously among those multiple persons, the co-occurrence value C is calculated by the following formula, where dE is the change in the sum of the emotion values ​​of the multiple persons after a predetermined time has elapsed, and Y is the number of persons whose emotion values ​​are equal to or greater than a predetermined threshold: C = dE × (Y - 1) The computer is caused to execute the process.

[0023] According to the information processing program according to the present invention described in 3 Claim, it specifies position information indicating the position of a person existing in the target space and an emotion value indicating the height of a predetermined type of emotion of the person, and by presenting information indicating the height of the emotion indicated by the emotion value in a manner that enables the position indicated by the corresponding position information to be specified, it is possible to grasp the distribution situation of the emotions of the people existing in the target space in the target space.

Effect of the Invention

[0024] As described above, according to the present invention, it is possible to grasp the distribution situation of the emotions of the people existing in the target space in the target space.

Brief Description of the Drawings

[0025] [Figure 1] It is a block diagram showing an example of the hardware configuration of the communication space evaluation system according to the embodiment. [Figure 2] It is a block diagram showing an example of the functional configuration of the server according to the embodiment. [Figure 3] It is a flowchart showing an example of the information processing according to the embodiment. [Figure 4] It is a schematic diagram showing an example of the presentation screen according to the embodiment. [Figure 5] This is a schematic diagram showing another example of the display screen according to the embodiment. [Figure 6] This is a schematic diagram showing another example of the display screen according to the embodiment. [Modes for carrying out the invention]

[0026] Hereinafter, embodiments for carrying out the present invention will be described in detail with reference to the drawings. In this embodiment, the present invention will be described in which one floor of a commercial facility is applied as the target space of the present invention, and the system will be an exchange space evaluation system having terminal devices owned by multiple users of the commercial facility and a server that functions as an information processing device of the present invention.

[0027] First, the configuration of the AC space evaluation system 90 according to this embodiment will be described with reference to Figures 1 and 2. Figure 1 is a block diagram showing an example of the hardware configuration of the AC space evaluation system 90 according to this embodiment.

[0028] As shown in Figure 1, the communication space evaluation system 90 according to this embodiment includes a server 10 and a plurality of terminal devices 30, each of which is able to access the network 80. Examples of the server 10 include various computers such as personal computers and server computers. Examples of the terminal devices 30 include portable devices such as smartphones, tablet terminals, and PDAs (Personal Digital Assistants).

[0029] The terminal device 30 according to this embodiment is a terminal owned by each visitor (hereinafter simply referred to as "user") to the target space corresponding to the interaction space evaluation system 90.

[0030] The terminal device 30 includes a CPU (Central Processing Unit) 31, a memory 32 as a temporary storage area, a non-volatile storage unit 33, an input unit 34 such as a touch panel, a display unit 35 such as a liquid crystal display, a media read / write (R / W) device 36, and a wireless communication unit 38. The CPU 31, memory 32, storage unit 33, input unit 34, display unit 35, media read / write device 36, and wireless communication unit 38 are connected to each other via bus B1. The media read / write device 36 reads information written to the recording medium 37 and writes information to the recording medium 37.

[0031] The memory unit 33 is implemented by an HDD (Hard Disk Drive), SSD (Solid State Drive), flash memory, etc. The memory unit 33, as a storage medium, stores the emotion distribution display program 33A. The emotion distribution display program 33A is stored (installed) in the memory unit 33 when the recording medium 37 on which the program 33A is written is set in the media read / write device 36, and the media read / write device 36 reads the program 33A from the recording medium 37. The CPU 31 reads the emotion distribution display program 33A from the memory unit 33, loads it into memory 32, and sequentially executes the processes that the emotion distribution display program 33A has.

[0032] On the other hand, the server 10 is a device that plays a central role in the AC spatial evaluation system 90 and functions as an information processing device of the present invention, as described above. The server 10 includes a CPU 11, a memory 12 as a temporary storage area, a non-volatile storage unit 13, an input unit 14 such as a keyboard and mouse, a display unit 15 such as a liquid crystal display, a media read / write device 16, and a communication interface (I / F) unit 18. The CPU 11, memory 12, storage unit 13, input unit 14, display unit 15, media read / write device 16, and communication I / F unit 18 are connected to each other via bus B2. The media read / write device 16 reads information written to the recording medium 17 and writes information to the recording medium 17.

[0033] The storage unit 13 is implemented by an HDD, SSD, flash memory, etc. The storage unit 13, as a storage medium, stores an information processing program 13A. The information processing program 13A is stored (installed) in the storage unit 13 when the recording medium 17 on which the program 13A is written is set in the media read / write device 16, and the media read / write device 16 reads the program 13A from the recording medium 17. The CPU 11 reads the information processing program 13A from the storage unit 13, loads it into memory 12, and sequentially executes the processes contained in the information processing program 13A.

[0034] Furthermore, as shown in Figure 1, the AC space evaluation system 90 according to this embodiment includes a camera 50 and a display device 60, both of which are capable of accessing the network 80.

[0035] The imaging device 50 in this embodiment is installed in the target space and is a 360-degree camera so that almost the entire area of ​​the target space is within the field of view, but it is not limited to this. For example, the target space may be divided into multiple areas, and one imaging device 50 may be installed in each divided area. Also, in this embodiment, an imaging device 50 that captures color moving images is used, but it is not limited to this. An imaging device 50 that captures monochrome moving images may be used, or an imaging device 50 that captures color or monochrome still images may be used.

[0036] Furthermore, while the display device 60 according to this embodiment is a large, color monitor device installed in a relatively conspicuous location within the target space (in this embodiment, near the entrance / exit of the target space), it goes without saying that it is not limited to this.

[0037] In this embodiment, public communication lines such as the Internet and telephone networks are used as network 80, but the embodiment is not limited to this configuration. For example, corporate communication lines such as LANs (Local Area Networks) and WANs (Wide Area Networks) may be used as network 80, or a combination of these corporate communication lines and public communication lines may be used.

[0038] Next, the functional configuration of the server 10 according to this embodiment will be described with reference to Figure 2. Figure 2 is a block diagram showing an example of the functional configuration of the server 10 according to this embodiment.

[0039] As shown in Figure 2, the server 10 according to this embodiment includes a specific unit 11A and a presentation unit 11B. The CPU 11 of the server 10 executes an information processing program 13A, which enables the specific unit 11A and the presentation unit 11B to function.

[0040] The identification unit 11A according to this embodiment identifies location information indicating the position of a person in the target space, and an emotion value indicating the level of a predetermined type of emotion of that person.

[0041] In this embodiment, the identification unit 11A uses an image obtained by the imaging device 50 to identify location information indicating the position of a person in the target space, and an emotion value indicating the level of a predetermined type of emotion of that person, but it is not limited to this. For example, if the terminal device 30 is equipped with an imaging device, the location information and emotion value may be identified using an image obtained by imaging with the imaging device. Also, in this embodiment, the emotion value is set to a value in the range of 0 (zero) to 100, with 0 (zero) representing the lowest emotion level and 100 representing the highest emotion level, but it goes without saying that it is not limited to this.

[0042] Furthermore, the presentation unit 11B according to this embodiment presents information indicating the level of emotion indicated by the emotion value identified by the identification unit 11A, in a way that allows for the identification of the location indicated by the corresponding location information.

[0043] In this embodiment, the information indicating the intensity of emotion is displayed by superimposing it onto the corresponding location on a plan view of the target space, in order to present the information indicating the intensity of emotion in a way that allows the location indicated by the corresponding location information to be identified. However, this embodiment is not limited to this. For example, the information indicating the intensity of emotion may be displayed together with coordinate information indicating the corresponding location, and this can be applied as a way to present the information indicating the intensity of emotion in a way that allows the location indicated by the corresponding location information to be identified.

[0044] Furthermore, the display unit 11B according to this embodiment further displays a co-occurrence value indicating the degree to which emotions occur simultaneously among the multiple persons, using the emotion values ​​of the multiple persons. In this embodiment, dE is the amount of change in the sum of the emotion values ​​of the multiple persons after a predetermined time has elapsed, and Y is the number of persons whose emotion values ​​are above a predetermined threshold, and the co-occurrence value C is calculated by the following formula (1).

[0045] C = dE × (Y-1) (1)

[0046] Furthermore, in this embodiment, both positive and negative emotions are applied as the predetermined types of emotions mentioned above. Positive emotions include joy, surprise, admiration, empathy, enthusiasm, excitement, and praise. Negative emotions include anger, sadness, fear, and disgust. In this embodiment, five types of positive and negative emotions are applied: joy, surprise, anger, disgust, and contempt, but it goes without saying that this is not the only way to apply them. Alternatively, only positive emotions or only negative emotions may be applied as the predetermined types of emotions mentioned above.

[0047] Furthermore, in this embodiment, the presentation of various information by the presentation unit 11B is performed by display on the display device 60, but this is not the only method. For example, presentation by printing on an image forming device such as a printer, or presentation by sound on a sound generation device, may also be applied as the presentation of various information by the presentation unit 11B.

[0048] Next, referring to Figures 3 and 4, the operation of the server 10 when performing information processing as part of the operation of the exchange space evaluation system 90 according to this embodiment will be explained. Figure 3 is a flowchart of an example of information processing according to this embodiment.

[0049] In this embodiment, when a user of the server 10 issues an instruction input via the input unit 14 to start the execution of the information processing program 13A, the CPU 11 of the server 10 executes the information processing program 13A, thereby executing the information processing shown in Figure 3.

[0050] In step 100 of Figure 3, the CPU 11 instructs the imaging device 50 to start imaging. In response to this instruction, the imaging device 50 starts imaging and transmits the image information obtained from the imaging to the server 10 in real time.

[0051] Therefore, in step 102, the CPU 11 waits until it receives image information for one frame. In step 104, the CPU 11 extracts the image region of a person's face (hereinafter referred to as the "face image region") from the image indicated by the received image information (hereinafter referred to as the "captured image"). Then, by identifying the position of the extracted face image region, the CPU 11 identifies the position information indicating the location of the corresponding person.

[0052] In this embodiment, a method using artificial intelligence, which is one of the biometric authentication technologies, is applied as the method for extracting the face image region, but this is not limited to this. For example, conventionally known image recognition technologies such as pattern matching may be applied to extract the face image region. Also, in this embodiment, position information of a two-dimensional coordinate system in the horizontal direction within the target space of the face image region is applied as position information indicating the location of the corresponding person, but this is not limited to this. For example, position information of a three-dimensional coordinate system including the height direction may be applied as position information indicating the location of the corresponding person.

[0053] Furthermore, in step 104, the CPU 11 further identifies the emotion value of the corresponding person using the image information of the extracted facial image region. In this embodiment, the method of identifying the emotion value of the person is to use Affectiva's emotion recognition software, product name Affdex, but it is not limited to this. For example, Fujitsu Limited's facial recognition technology (Internet<URL:https: / / www.fujitsu.com / jp / about / research / article / 202103-facial-expression-recognition.html> ), Nonverbal message analysis technology by ACES Corporation (Internet<URL:https: / / prtimes.jp / main / html / rd / p / 000000024.000044470.html> Other technologies, such as those mentioned above, may also be applied as a method for identifying the emotional value of the person.

[0054] In step 106, the CPU 11 uses the emotion values ​​of each person obtained in step 104 to derive co-occurrence values ​​for each type of emotion, as shown below.

[0055] First, the CPU 11 takes the number of people recognized in the captured image as X, and calculates the sum of each person's emotion value En, TE, for each type of emotion using the following equation (2).

[0056] TE = E1 + E2 + ... EX (2)

[0057] Next, the CPU 11 takes ΔTE as the difference in the total value TE between frames, and Δt as the elapsed time between frames, and calculates the change in emotion value dE for each type of emotion using the following equation (3).

[0058] dE = ΔTE ÷ Δt (3)

[0059] The CPU 11 then calculates a co-occurrence value C for each type of emotion using the following equation (4), where Y is the number of people expressing the corresponding emotion within the frame. In this embodiment, the number of people Y is the number of people whose corresponding emotion value is equal to or greater than a predetermined threshold (10 in this embodiment), but this is not the only way. For example, the number of people Y may be the number of people whose emotion value is not 0 (zero).

[0060] C = dE × (Y-1) (4)

[0061] By multiplying by (Y-1) in equation (4), the co-occurrence value C becomes 0 (zero) when only one subject expresses the corresponding emotion within the frame. In other words, the co-occurrence value C does not change unless the emotional values ​​of multiple people change simultaneously.

[0062] For example, let's assume that three people, A, B, and C, are captured on video and their faces are recognized.

[0063] Here, assume that at a certain point in time (time t=0), the emotional values ​​of A, B, and C for the same type of emotion (hereinafter referred to as "same type of emotion") are EA=0, EB=0, and EC=0 respectively, and that in the next frame, the emotional values ​​of A, B, and C for the same type of emotion are EA=0, EB=50, and EC=25 respectively, and that 0.5 seconds (=Δt) have elapsed between frames.

[0064] In this case, at t=0 (zero), the number of people X whose faces are recognized in the frame is 3, and the number Y of subjects expressing the same type of emotion in the frame is 0 (zero). Then, at t=0.5, that is, after 0.5 seconds have passed, the number of people X whose faces are recognized in the frame is 3, and the number Y of subjects expressing the same type of emotion in the frame is 2.

[0065] In this case, when t=0 (zero), the sum of emotions of the same type, TE, is 0 (=EA+EB+EC=0+0+0). Also, when t=0.5, the sum of emotions of the same type, TE, is 75 (=EA+EB+EC=0+50+25).

[0066] Therefore, the change in emotion of the same type, dE, is 150 (=ΔTE÷Δt=75÷0.5), and using these values, the co-occurrence value C at time t=0.5 is 150 (=dE×(Y-1)=150×(2-1)).

[0067] Thus, since the co-occurrence value C in this embodiment uses the difference between frames, it is not possible to derive the co-occurrence value C when step 106 is executed for the first time after the execution of this information processing has started. Therefore, the co-occurrence value C will be derived when the processing of step 106 is executed for the second time or later.

[0068] In step 108, the CPU 11 uses the information obtained through the above processes to create information indicating a predetermined display screen (hereinafter referred to as "display screen information") and stores it in the storage unit 13. In step 110, the CPU 11 controls the display device 60 to display the display screen using the created display screen information. Figure 4 shows an example of a display screen according to this embodiment.

[0069] As shown in Figure 4, the display screen according to this embodiment shows a plan view of the target space, along with the distribution of a predetermined type of emotion (in the example shown in Figure 4, joy) within that space. The circular and elliptical areas in Figure 4 represent the distribution of the corresponding emotion, with higher concentrations indicating a larger number of people experiencing that emotion. As mentioned above, the co-occurrence value C is not displayed at this point.

[0070] In step 112, the CPU 11 determines whether the predetermined termination timing for ending this information processing has arrived. If the determination is negative, the process proceeds to step 114. In step 114, the CPU 11 waits until a predetermined period (0.5 seconds in this embodiment) has elapsed, and then returns to step 102.

[0071] As described above, in the information processing according to this embodiment, the processes from step 102 to step 114 are repeatedly executed until the termination timing arrives. Therefore, as a result of the co-occurrence value C being derived by the processing of step 106 from the second time onward after the start of information processing, the co-occurrence value C is displayed on the display screen shown on the display device 60 by the processing of step 110 from the second time onward, as shown in Figure 4 as an example.

[0072] In this embodiment, the termination timing is determined by the timing at which a user of the server 10 gives an instruction to terminate the execution of the information processing program 13A via the input unit 14. Thus, in this embodiment, the execution period of the information processing is determined according to the user's instruction, but this is not the only option. For example, a predetermined period (for example, from 6:00 to 23:00 every day) set as the evaluation period by the exchange space evaluation system 90 may be applied as the execution period of the information processing.

[0073] On the other hand, if the result in step 112 is positive, the process proceeds to step 116, where the CPU 11 instructs the camera 50, which was started by the processing in step 100, to stop taking images, and then terminates this information processing.

[0074] Furthermore, the display screen shown in Figure 4, for example, which is the display screen information stored in the memory unit 13 through the above information processing, can be displayed by the display unit 35 of the terminal device 30 owned by each user when the CPU 31 of the terminal device 30 executes the emotion distribution display program 33A.

[0075] As described above, according to this embodiment, location information indicating the position of a person present in the target space and an emotion value indicating the level of a predetermined type of emotion of that person are identified, and information indicating the level of emotion indicated by the emotion value is presented in a way that allows the location indicated by the corresponding location information to be identified. Therefore, it is possible to grasp the distribution of emotions of people present in the target space within that space.

[0076] Furthermore, according to this embodiment, co-occurrence values ​​are presented, which indicate the degree to which emotions occur simultaneously among multiple people, using the emotional values ​​of those multiple people. As a result, these co-occurrence values ​​can also be grasped, which can contribute to improving communication more effectively.

[0077] Furthermore, according to this embodiment, the co-occurrence value C is calculated using equation (4). Therefore, the co-occurrence value can be obtained relatively easily.

[0078] Furthermore, according to this embodiment, positive emotions are included in the predetermined types of emotions. Therefore, compared to the case where the predetermined types of emotions consist only of negative emotions, it can contribute to improving communication more effectively.

[0079] In the above embodiment, as an example, an image showing the distribution of emotions such as joy was described on the display screen, as shown in Figure 4, but this is not the only example. For example, an image showing the distribution of other emotions such as anger or surprise may be displayed on the display screen.

[0080] Furthermore, the configuration of the display screen is not limited to that shown in Figure 4; the configurations shown in Figures 5 and 6 may also be applied to the display screen. Figures 5 and 6 are schematic diagrams showing other examples of the display screen according to this embodiment.

[0081] In the display screen shown in Figure 5, the target space is divided into multiple regions, and for each region, the emotional values ​​(in this case, the average emotional values ​​of people in the corresponding region) for each emotion—Joy, Anger, Disgust, Surprise, and Contempt—are displayed as a radar chart. Therefore, by referring to this display screen, users can understand the trends of various emotions in each region.

[0082] Furthermore, in the display screen shown in Figure 6, the co-occurrence value C is displayed in real time as a speedometer-type graph. Therefore, users can intuitively grasp the changes in the co-occurrence value C by referring to this display screen.

[0083] In addition, the above-mentioned display screen may show graphs that show the ratio of the total emotional values ​​of people in the target space for some of the emotions being targeted (for example, only "joy" or "positive emotions") to the total emotional values ​​of people in the target space for other emotions, or graphs that show the cumulative value of each person's emotional values ​​over time.

[0084] Furthermore, although the above embodiment describes the case in which the co-occurrence value C is derived for each type of emotion, it is not limited to this. For example, the co-occurrence value C may be derived by combining multiple types of positive emotions, or by combining multiple types of negative emotions.

[0085] Furthermore, although the above embodiment describes the case in which the co-occurrence value C is derived using equation (4), it is not limited to this. For example, the co-occurrence value C may be derived without using the number of people Y in equation (4).

[0086] Furthermore, in the above embodiment, for example, the hardware structure of the processing unit that executes the processing of the specific unit 11A and the presentation unit 11B can be any of the following types of processors. As mentioned above, these types of processors include a CPU, which is a general-purpose processor that executes software (programs) and functions as a processing unit, as well as a programmable logic device (PLD), such as an FPGA (Field-Programmable Gate Array), which is a processor whose circuit configuration can be changed after manufacturing, and a dedicated electrical circuit, such as an ASIC (Application Specific Integrated Circuit), which is a processor with a circuit configuration specifically designed to execute a particular process.

[0087] The processing unit may consist of one of these various processors, or it may consist of a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Alternatively, the processing unit may consist of a single processor.

[0088] Examples of configuring a processing unit with a single processor include, firstly, a configuration where one or more CPUs and software combine to form a single processor, as is common in client and server computers, and this processor functions as the processing unit. Secondly, a configuration using a processor that realizes the functions of the entire system, including the processing unit, on a single IC (Integrated Circuit) chip, as is common in System-on-a-Chip (SoC) systems. Thus, the processing unit is configured, in terms of hardware structure, using one or more of the above-mentioned types of processors.

[0089] Furthermore, the hardware structure of these various processors can more specifically utilize electrical circuits, which are combinations of circuit elements such as semiconductor devices. [Explanation of symbols]

[0090] 10 servers 11 CPU 11A Specific part 11B Presentation section 12 memory 13 Storage section 13A Information Processing Program 14 Input section 15 Display section 16. Media reading / writing device 17 Recording media 18 Communication I / F Section 30 Terminal devices 31 CPU 32 memory 33 Storage section 33A Sentiment Distribution Display Program 34 Input section 35 Display section 36 Media reading / writing device 37 Recording media 38 Wireless Communication Section 50 Imaging device 60 Display device 80 Networks 90 Interaction Space Evaluation System

Claims

1. A unit that identifies location information indicating the position of a person in the target space, and an emotional value indicating the level of a predetermined type of emotion of that person, A display unit that displays information indicating the level of emotion indicated by the emotion value in a way that allows for the identification of the location indicated by the corresponding location information, An information processing device equipped with, The display unit, using the emotion values ​​of multiple persons, further displays co-occurrence values ​​indicating the degree to which the emotion occurs simultaneously in those multiple persons, Let dE be the change in the sum of the emotional values ​​of the multiple people after a predetermined time has elapsed, and Y be the number of people whose emotional values ​​are above a predetermined threshold. Then, calculate the co-occurrence value C using the following formula: C = dE × (Y - 1) Information processing device.

2. The aforementioned predetermined types of emotions include positive emotions. The information processing apparatus according to claim 1.

3. Identify location information indicating the position of a person in the target space, and emotion values ​​indicating the level of a predetermined type of emotion of that person. A process that presents information indicating the level of emotion as indicated by the emotion value in a way that allows for the identification of the location indicated by the corresponding location information, In presenting co-occurrence values ​​that indicate the degree to which the emotions occur simultaneously in multiple individuals, using the emotion values ​​of multiple individuals, Let dE be the change in the sum of the emotional values ​​of the multiple people after a predetermined time has elapsed, and Y be the number of people whose emotional values ​​are above a predetermined threshold. Then, calculate the co-occurrence value C using the following formula: C = dE × (Y - 1) An information processing program that causes a computer to perform a task.

Images