Psychological state visualization device, method thereof, program, and system

The psychological state visualization device addresses the challenge of poor intuitiveness in existing techniques by using onomatopoeia icons and emotional illustrations to visually represent and understand psychological states, enhancing user interaction and comprehension.

WO2026009417A1PCT designated stage Publication Date: 2026-01-08NT T INC
View PDF 5 Cites 0 Cited by

Patent Information

Application Number
PCT/JP2024/024420
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Filing Date
2024-07-05
Publication Date
2026-01-08

AI Technical Summary

Technical Problem

Existing psychological state visualization techniques require inputting psychological state affective expressions as text data, leading to poor intuitiveness and difficulty in understanding.

Method used

A psychological state visualization device that accepts input of psychological state emotional expression icons, which are visually represented and displayed in a format allowing temporal fluctuations to be visible, including the use of onomatopoeia icons and emotional illustrations.

Benefits of technology

The device provides intuitive operation and understanding of psychological states by using onomatopoeia icons and emotional illustrations, allowing users to instantly grasp and specify emotions.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure JP2024024420_08012026_PF_FP_ABST
    Figure JP2024024420_08012026_PF_FP_ABST
Patent Text Reader

Abstract

The present invention provides a psychological state visualization technology that is easy to understand or operate intuitively. This psychological state visualization device includes: an input unit that receives input of a psychological state / sensitivity expression icon visually indicating a user's psychological state at a certain point in time and a corresponding time; and a presentation unit that visualizes and presents the psychological state / sensitivity expression icon in a format that makes temporal variations visually perceptible. The input unit displays a list of psychological state / sensitivity expression icons, and receives a psychological state / sensitivity expression icon selected by the user from the list of psychological state / sensitivity expression icons.
Need to check novelty before this filing date? Find Prior Art

Description

Psychological state visualization device, method, program, and system

[0001] The present invention relates to a psychological state visualization device, a method, a program, and a system for visualizing a user's psychological state.

[0002] Patent Document 1 is known as a conventional technique for a device that visualizes a user's psychological state. In Patent Document 1, psychological state affective expressions that represent the user's psychological state at a certain point in time and psychological state index values ​​that indicate the user's psychological state corresponding to the psychological state affective expressions are input, and the character strings of the psychological state affective expressions and the psychological state index values ​​are visualized and presented in a format that allows visual recognition of temporal fluctuations.

[0003] International Publication No. 2020 / 217373

[0004] However, in Patent Document 1, since it is necessary to input the psychological state affective expression words as text data, there are problems in that intuitive operability is not possible, and since the psychological state affective expression words are displayed as text data, there are problems in that they are not easy to understand.

[0005] In view of these problems, an object of the present invention is to provide a psychological state visualization technique that is intuitively easy to operate or understand.

[0006] In order to solve the above problem, according to one aspect of the present invention, a psychological state visualization device includes an input unit that accepts as input a psychological state emotional expression icon that visually represents a user's psychological state at a certain point in time and a corresponding time, and a presentation unit that visualizes and presents the psychological state emotional expression icon in a format that allows temporal fluctuations to be visible, and the input unit displays a list of psychological state emotional expression icons and accepts a psychological state emotional expression icon selected by the user from the list of psychological state emotional expression icons.

[0007] The present invention has the effect of being intuitively easy to operate or understand.

[0008] 1 is a functional block diagram of a psychological state visualization device according to a first embodiment; FIG. 2 is a diagram showing an example of a processing flow of the psychological state visualization device according to the first embodiment; FIG. 3 is a diagram showing an example of onomatopoeia icons; FIG. 4 is a diagram showing an example of onomatopoeia icons; FIG. 5 is a diagram showing an example of a display of a mobile terminal, personal computer terminal, etc., displaying an input field for onomatopoeia icons; FIG. 6 is a diagram showing an example of visualization; FIG. 7 is a diagram showing an example of visualization; FIG. 8 is a diagram showing an example of visualization; FIG. 9 is a functional block diagram of a psychological state visualization device according to a second embodiment; FIG. 10 is a diagram showing an example of a processing flow of the psychological state visualization device according to the second embodiment; FIG. 11 is a diagram showing an example of a table made up of learning data;

[0009] Hereinafter, an embodiment of the present invention will be described. In the drawings used in the following description, components having the same functions and steps performing the same processes are denoted by the same reference numerals, and redundant description will be omitted.

[0010] First Embodiment FIG. 1 is a functional block diagram of a psychological state visualization device according to a first embodiment, and FIG. 2 shows the processing flow thereof.

[0011] The psychological state visualization device includes an input unit 110 and a presentation unit 120 .

[0012] The psychological state visualization device receives inputs of psychological state emotion expression icons, psychological state index values, and corresponding times, and visualizes and presents a time series of psychological states. The psychological state emotion expression icons are icons (small pictures, figures, or symbols displayed on a computer or smartphone screen) that represent a user's psychological state at a given time. They visually represent psychological states and are designed to allow users to intuitively understand or operate them. For example, the psychological state emotion expression icons are a general term for icons representing words categorized as at least one of onomatopoeia and exclamation. Furthermore, onomatopoeia is a general term for words categorized as at least one of onomatopoeia, mimetic words, and emotional words. Here, onomatopoeia is a linguistic expression of actual sounds, mimetic words are linguistic expressions of non-sound sensations, and emotional words are linguistic expressions of psychological states. Note that exclamations are sometimes called interjections. Furthermore, for example, the psychological state index value indicates a user's psychological state and represents the degree of the psychological state at a given time. The following describes the case where the word represented by the psychological state emotion expression icon is an onomatopoeia, but similar processing is possible when the word is an exclamation. A psychological state emotion expression icon representing an onomatopoeia is also called an onomatopoeia icon. Onomatopoeia icons are, for example, speech bubbles that display onomatopoeias inside (see FIG. 3), or emotion illustrations that express emotions (see FIG. 4), etc.

[0013] The color and shape of speech bubbles may vary depending on the emotion, type, and category of onomatopoeia. For example, onomatopoeia icons, particularly speech bubbles, may be colored to match the colors of Plutchik's Wheel of Emotions. For example, onomatopoeia that expresses anger may have a red background, and onomatopoeia that expresses sadness may have a blue background. Another example of coloring onomatopoeia icons is to use similar colors for icons that are close to each other in a two-dimensional space formed by axes of two emotions (e.g., "pleasure / discomfort" and "arousal / disarousness"). The color scheme may also be determined based on the degree of emotion. Examples of the shape of onomatopoeia icons, particularly speech bubbles, may be based on emotional expression methods used in manga and illustrations. For example, onomatopoeia that express positive emotions such as fun and amusement may have a cloud-shaped speech bubble, and onomatopoeia that expresses anger may have a sharp-looking speech bubble.

[0014] Emotional illustrations are illustrations that show a person's emotions or facial expressions that correspond to their feelings, or that show a person's attitude.

[0015] The psychological state visualization device is a special device configured by loading a special program into a publicly known or dedicated computer having, for example, a central processing unit (CPU), a main memory (RAM), etc. The psychological state visualization device executes each process under the control of, for example, the central processing unit. Data input to the psychological state visualization device and data obtained from each process are stored, for example, in the main memory, and the data stored in the main memory is read by the central processing unit as needed and used for other processes. At least a portion of each processing unit of the psychological state visualization device may be configured with hardware such as an integrated circuit. Each memory unit included in the psychological state visualization device may be configured, for example, with a main memory such as a random access memory (RAM), or middleware such as a relational database or a key-value store. However, each memory unit does not necessarily have to be included inside the psychological state visualization device itself; it may be configured with an auxiliary memory device including a hard disk, optical disk, or semiconductor memory element such as a flash memory, and be configured external to the psychological state visualization device.

[0016] For example, the psychological state visualization device may be implemented in a mobile terminal, a tablet terminal, or the like.

[0017] Each part will be explained below.

[0018] <Input Unit 110 > The input unit 110 receives input from the user of an onomatopoeia icon that expresses the user's current state, the psychological state index value at that time, and the corresponding time (S 110 ), and outputs these to the presentation unit 120 .

[0019] The psychological state index value is, for example, a value that expresses a preset scale in multiple stages (9 stages or 5 stages in the above example), such as: (1) a 9-point scale that represents the positive degree of emotion, with 4 representing a pleasant state and -4 representing an unpleasant state; (2) a 5-point scale that represents the degree of enjoyment, with 4 representing a fun state and 0 representing a boring state; or (3) a 5-point scale that represents the degree of motivation, with 4 representing a highly motivated state and 0 representing a lack of motivation.

[0020] The psychological state index value may be one (for example, any of the above (1) to (3)) or may be multiple (for example, the above (1) and (3)).

[0021] For example, an input field for an onomatopoeia icon and an input field for a psychological state index value are displayed on the display of a mobile terminal, tablet terminal, or the like, and the user inputs the onomatopoeia icon and the psychological state index value via an input unit such as a touch panel.

[0022] The input field may be configured to display and select predetermined types of onomatopoeia icons or psychological state index values ​​expressed in a plurality of preset stages.

[0023] FIG. 5 shows an example of a display of a mobile terminal, personal computer terminal, or the like, which displays an input field for an onomatopoeia icon.

[0024] For example, a list of onomatopoeia icons (e.g., the speech bubbles or emotion illustrations mentioned above) is displayed, and the user selects an emotion by tapping or clicking on an onomatopoeia icon via an input unit such as a touch panel. For example, a storage unit (not shown) stores multiple pairs of onomatopoeia icons (image data) and their identifiers (e.g., text data of the corresponding onomatopoeia), and the input unit 110 retrieves the onomatopoeia icons (image data) from the storage unit (not shown), generates image data for displaying an input field for the onomatopoeia icon on the display, and outputs the image data to the display.

[0025] The device may also be configured so that the user can add text describing the situation or details at each point in time when an onomatopoeia icon is selected. In this case, a text input field is displayed on the display, and the user inputs the text via an input unit such as a touch panel. The text addition function makes it possible to record emotions that cannot be fully recorded using onomatopoeia icons alone.

[0026] The corresponding time may be the time (input time) when the user inputs the onomatopoeia icon and the psychological state index value via an input unit such as a touch panel, or the time (reception time) when the onomatopoeia icon and the psychological state index value are received by the input unit 110. In the case of the input time, the input unit such as a touch panel may be configured to obtain the time from a built-in clock, an NTP server, or the like and output it to the input unit 110, and in the case of the reception time, the input unit 110 may be configured to obtain the reception time from, for example, a built-in clock, an NTP server, or the like.

[0027] For example, the input unit 110 stores a set of the identifier of the input onomatopoeia icon, the psychological state index value corresponding to the onomatopoeia icon, the corresponding time, and the text added by the user as emotion record data in a memory unit (not shown).

[0028] <Presentation Unit 120> The presentation unit 120 receives an onomatopoeia icon, a psychological state index value corresponding to the onomatopoeia icon, and a corresponding time. Based on this information, the presentation unit 120 visualizes and presents the onomatopoeia icon and the psychological state index value corresponding to the onomatopoeia icon in a format that allows visual recognition of temporal fluctuations (S120). For example, the presentation unit 120 retrieves from a storage unit (not shown) multiple pairs of the input onomatopoeia icon identifier, the psychological state index value corresponding to the onomatopoeia icon, the corresponding time, and text added by the user. The presentation unit 120 then retrieves from the storage unit (not shown) an onomatopoeia icon (image data) corresponding to the onomatopoeia icon identifier, generates image data to be displayed on the display, and outputs the image data to the display. In this embodiment, the presentation unit 120 displays information about the onomatopoeia icon corresponding to the time near a marker representing the psychological state index value (hereinafter also referred to as the psychological state level) corresponding to the same time (see FIGS. 6-9 ).

[0029] When only one psychological state level is presented (for example, the degree of enjoyment described above), the level is visualized as a two-dimensional graph with time on the horizontal axis and the psychological state level on the vertical axis, as shown in Figures 6 and 7. In this example, an onomatopoeia icon corresponding to the same time is displayed near the marker representing the psychological state level. The time axis (horizontal axis) may be in any form that allows the passage of time (chronological order) to be grasped, such as a form that displays time information as shown in Figure 6 or a form that displays icons corresponding to time as shown in Figure 7. In other words, any form that allows the temporal fluctuation of the onomatopoeia icon and the psychological state level to be visually recognized is acceptable. In the example of Figure 7, the psychological state level value itself is also displayed near the marker that visualizes the temporal fluctuation of the psychological state level.

[0030] When two psychological state levels are presented, for example, as shown in Figure 8, the vertical and horizontal axes are set to represent different psychological state levels, and pairs of psychological state levels for each time are represented by markers, and arrows are drawn connecting the markers at a certain time and the markers at the next time, visualizing the temporal changes in the two psychological state levels for each time. In other words, the onomatopoeia icons and the two psychological state levels are presented in a way that makes it clear the chronological order.

[0031] However, when multiple psychological state levels are associated, it is not necessary to use all of them as the axes of the graph as in Figure 8. For example, as in Figure 9, a graph like Figures 6-8 (in this example, Figure 7) may be displayed using some (one or two) of the psychological state levels, and the remaining psychological state levels may be visualized using icons, graphs, etc. In Figure 9, the "spirit" of the psychological state levels is visualized as a meter icon in a form separate from the graph. In this example, a day is divided into four time periods, and the representative values ​​of the spirit levels corresponding to the onomatopoeia icons acquired in each time period are represented by the scale of the meter, thereby visually visualizing and presenting the temporal fluctuations of spirit.

[0032] As described above, the presentation unit may visualize the temporal fluctuation of at least one psychological state level in a multidimensional space using a graphic (graph), and may display onomatopoeia icons near positions on the graphic corresponding to each time. Alternatively, the magnitude of at least one psychological state level may be visualized and presented by associating it with a scale, length, or size.

[0033] <Effects> This configuration realizes a psychological state visualization device that is intuitively easy to operate and understand. By using onomatopoeia icons when inputting, the meaning can be grasped instantly, and emotions can be specified instantly, making input intuitive and easy. In addition, emotions can be more easily grasped intuitively when they are presented.

[0034] <Modifications> In the present embodiment, the psychological state visualization device has been described as being implemented in a mobile terminal, a tablet terminal, or the like. However, for example, the psychological state visualization device may be implemented on a server that uses a mobile terminal, a tablet terminal, or the like as a client. In this case, the presentation unit 120 outputs information related to the visualized information to be presented and presents the information on a display of the mobile terminal, the tablet terminal, or the like. The information related to the visualized information to be presented may be, for example, the image to be presented itself, or parameters used when generating the image to be presented on the mobile terminal, the tablet terminal, or the like.

[0035] Second Embodiment The following description will focus on the differences from the first embodiment.

[0036] In the first embodiment, the user inputs both an onomatopoeia icon and a psychological state index value every hour in the input unit 110, but in the second embodiment, the user inputs only an onomatopoeia icon, and the difference is that a configuration is added to estimate a psychological state index value corresponding to the onomatopoeia icon input by the user.

[0037] FIG. 10 is a functional block diagram of a psychological state visualization device according to the second embodiment, and FIG. 11 shows the processing flow thereof.

[0038] The psychological state visualization device includes an input unit 210 , a psychological state estimation unit 230 , and a presentation unit 120 .

[0039] <Input Unit 210> The input unit 210 receives input of an onomatopoeia icon expressing the user's current state and the corresponding time from the user (S210), and outputs the onomatopoeia icon to the presentation unit 120 and the psychological state estimation unit 230, and outputs the corresponding time to the presentation unit 120. The reception method is the same as in the first embodiment, except that a psychological state index value is not used. For example, the input unit 210 stores a set of the identifier of the input onomatopoeia icon, the corresponding time, and text added by the user as emotion record data in a storage unit (not shown).

[0040] <Mental State Estimation Unit 230> The mental state estimation unit 230 receives an onomatopoeia icon as input, estimates a mental state index value corresponding to the onomatopoeia icon using a mental state estimation model (S230), and outputs the estimated value to the presentation unit 120. For example, the mental state estimation unit 230 retrieves an identifier of the input onomatopoeia icon from a storage unit (not shown), estimates a mental state index value corresponding to the onomatopoeia icon using the mental state estimation model, and stores a set of the identifier of the input onomatopoeia icon, the mental state index value corresponding to the onomatopoeia icon, the corresponding time, and text added by the user as emotion record data in the storage unit (not shown).

[0041] The psychological state estimation model is a model that converts an input onomatopoeia icon into a psychological state index value corresponding to the onomatopoeia, and is created in advance using data (learning data) that associates onomatopoeia icons with psychological state index values ​​obtained in advance from multiple people.

[0042] The learning data may be similar to the data input to the input unit 110 in the first embodiment collected from multiple people. In this case, the corresponding time may be omitted. In other words, a large number of combinations of onomatopoeia icons expressing the user's mental state and the mental state index value at that time may be prepared and used as learning data.

[0043] 12 shows an example of a table made up of learning data. In this example, energy, joy, anger, and sadness are expressed using a five-level scale from 0 to 4, with higher values ​​indicating higher degrees of each. Pleasure and discomfort are expressed using a nine-level scale from -4 to 4, with stronger degrees of "pleasure" indicated by positive values ​​and stronger degrees of "discomfort" indicated by negative values.

[0044] (Example 1 of a psychological state estimation model) A psychological state estimation model is a table or list, for example, in which each onomatopoeia icon is associated with its corresponding psychological state index value. Each psychological state index value in the table or list is, for example, a representative value (such as the average or median) of the psychological state index values ​​assigned by each person to a certain onomatopoeia icon in the training data.

[0045] (Example 2 of Mental State Estimation Model) In this example, the mental state estimation model is a model trained by machine learning, such as a neural network, based on training onomatopoeia icons and corresponding training mental state index values. For example, a neural network that receives an onomatopoeia icon as input and outputs a mental state index value corresponding to the onomatopoeia icon is used as the mental state estimation model. In this case, the mental state estimation model is trained by repeatedly updating the parameters of the neural network, to which appropriate initial values ​​have been set in advance, so that the estimated mental state index value obtained by inputting an onomatopoeia icon in the training data approaches the mental state index value associated with the onomatopoeia icon in the training data. Note that when training data in which multiple mental state index values ​​are input for one onomatopoeia icon is used, the output of the mental state estimation model may also be trained as a list (set) of multiple mental state index values.

[0046] <Effects> With this configuration, it is possible to obtain the same effects as in the first embodiment. Furthermore, it is possible to save the user the trouble of inputting a psychological state index value.

[0047] <Modification> In the input section of the first and second embodiments, the user is assumed to input onomatopoeia icons, but the present invention is not limited to inputting the icons themselves.

[0048] <Third Embodiment> The following mainly describes differences from the second embodiment. In the second embodiment, a mental state index value corresponding to an onomatopoeia icon input by a user was estimated, but in this embodiment, a mental state index value is not estimated. The mental state visualization device inputs an onomatopoeia icon and a corresponding time, and visualizes and presents a time series of mental states. In this embodiment, the mental state is visualized and presented using onomatopoeia icons without using a mental state index value.

[0049] FIG. 13 is a functional block diagram of a psychological state visualization device according to the third embodiment, and FIG. 14 shows the processing flow thereof.

[0050] The psychological state visualization device includes an input unit 310 and a presentation unit 320 .

[0051] <Input Unit 310> The input unit 310 receives input of an onomatopoeia icon expressing the user's current state and the corresponding time from the user (S310), and outputs the onomatopoeia icon and the corresponding time to the presentation unit 320. For example, when the psychological state visualization device of this embodiment is applied to a web conference application, a list of onomatopoeia icons (speech bubbles or emotion illustrations) is displayed on the web conference screen as shown in FIG.

[0052] Instead of inputting the onomatopoeia text, users (conference participants) select emotions by clicking on the onomatopoeia icon. Note that users can click on the icon at any time during the web conference.

[0053] For example, when a user (conference participant) clicks and selects an onomatopoeia icon, the time and emotion are recorded, and the onomatopoeia icons are displayed in chronological order on the web conference screen.

[0054] Emotions can be recorded at any time, and onomatopoeia can be deleted at any time. By providing this deletion function, emotions can be recorded more accurately.

[0055] Furthermore, the system may be configured so that, at each point in time when an onomatopoeia icon is designated, a conference participant can add text describing the situation or details at that time. In this case, a text input field is displayed on the display, and the user inputs the text via an input unit such as a touch panel.

[0056] Providing deletion and text addition functions enables more accurate and detailed emotion recording. For example, the input unit 310 stores a set of the input onomatopoeia icon identifier, the corresponding time, and the text added by the user as emotion recording data in a storage unit (not shown).

[0057] <Presentation Unit 320> The presentation unit 320 receives onomatopoeia icons and corresponding times. Based on this information, the presentation unit 320 visualizes and presents the onomatopoeia icons in a format that allows visual recognition of temporal changes (S320). In this embodiment, the presentation unit 320 displays information about the onomatopoeia icons corresponding to the time. For example, the presentation unit 320 retrieves from a storage unit (not shown) multiple pairs of the input onomatopoeia icon identifiers, corresponding times, and text added by the user. The presentation unit 320 then retrieves from the storage unit (not shown) onomatopoeia icons (image data) corresponding to the onomatopoeia icon identifiers, generates image data to be displayed on the display, and outputs the image data to the display. FIG. 15 shows an example of a screen displayed on the display. Note that the spacing between the onomatopoeia icons may be equal to visualize only the chronological order of the onomatopoeia icons, or may be aligned with the time intervals.

[0058] For example, when the psychological state visualization device of this embodiment is applied to a web conference application, the emotional transitions of all or selected conference participants may be displayed in a list on the same timeline (see FIG. 16). In the example of FIG. 16, a series of emotional transitions is displayed for each conference participant. In this example, the chronological order of onomatopoeia icons for each participant is displayed. Also, in FIG. 16, text added by the participant is displayed together with the onomatopoeia icon. For example, in item 2 of user 1, the text "Post your presentation..." is displayed together with the onomatopoeia icon.

[0059] <Effects> With this configuration, it is possible to obtain the same effects as in the second embodiment. Furthermore, when the psychological state visualization device of this embodiment is applied to a web conference app, it is possible to easily grasp the emotional transitions of the conference participants at a glance, making it easier to review the emotional records of not only oneself but the entire conference. Furthermore, when inputting using text, there are problems such as it takes time to input, and when trying to input while participating in a web conference, it interferes with concentration on the conference. However, when inputting using onomatopoeia icons, the meaning can be grasped instantly and emotions can be specified instantly.

[0060] <Modification> In the third embodiment, the conference participants are identified, but the conference participants may be anonymous without being identified.

[0061] The conference participants can be anonymized, and multiple conference participants can be grouped together as one emotion transition without being distinguished, and displayed as one emotion transition series.

[0062] Fig. 17 shows an example of a web conference screen in an anonymized state. In Fig. 17, the anonymized list is displayed in a separate sequence for each type of emotion (positive emotion, negative emotion, etc.). This configuration makes it possible to display a sequence of multiple emotional transitions.

[0063] In the example of FIG. 17, positive emotions and negative emotions are each divided by degree into seven levels: "high," "medium," "low," and "neutral," and seven emotion transition sequences are displayed.

[0064] This structure makes it easier to understand the emotional transitions throughout the meeting.

[0065] In the second and third embodiments, since there is no need to use a psychological state index value as input, an automatically extracted onomatopoeia icon entered by a user when creating an email or a comment to post on the web may be used as input.

[0066] Furthermore, a device (terminal) for using the device, system, or method of the present invention via a network (telecommunications line) may also be included. The "device (terminal) for use" may be equipped with functions (e.g., control function, decoding function, restoration function, input / output function, etc.) necessary to obtain the effects of implementing the device, system, or method of the present invention. Note that a configuration including a device (terminal) for using the device or method of the present invention via a network (telecommunications line) is also referred to as a psychological state visualization system.

[0067] <Other Modifications> The present invention is not limited to the above-described embodiments and modifications. For example, the various processes described above may not only be executed in chronological order as described, but may also be executed in parallel or individually depending on the processing capacity of the device that executes the processes or as needed. Other modifications are possible as long as they do not deviate from the spirit of the present invention.

[0068] <Program and Recording Medium> The various processing functions of each device described in the above embodiment and modified examples may be realized by a computer. In this case, the processing content of the functions that each device should have is described by a program. Then, by executing this program on a computer, the various processing functions of each device are realized on the computer.

[0069] The program describing the processing contents can be recorded on a computer-readable recording medium, which may be, for example, a magnetic recording device, an optical disk, a magneto-optical recording medium, a semiconductor memory, or any other suitable recording medium.

[0070] The program may be distributed, for example, by selling, transferring, lending, etc. portable recording media such as DVDs and CD-ROMs on which the program is recorded. Furthermore, the program may be distributed by storing the program in a storage device of a server computer and transferring the program from the server computer to other computers via a network.

[0071] A computer that executes such a program may first temporarily store the program recorded on a portable recording medium or transferred from a server computer in its own memory. Then, when executing a process, the computer reads the program stored in its own memory and executes the process in accordance with the read program. As another embodiment of the program, the computer may read the program directly from a portable recording medium and execute the process in accordance with the program. Furthermore, the computer may execute the process in accordance with the received program each time a program is transferred from a server computer to the computer. Alternatively, the server computer may not transfer the program to the computer, but may instead execute the process through a so-called ASP (Application Service Provider) service that realizes the processing function by issuing an execution instruction and obtaining the results. Note that the program may include information used for computer processing that is equivalent to a program (such as data that is not a direct instruction to the computer but has properties that define computer processing).

[0072] Furthermore, although each device is configured by executing a predetermined program on a computer, at least a part of the processing content may be realized by hardware.

Claims

1. A psychological state visualization device comprising: an input unit that receives as input a psychological state emotion expression icon that visually represents a user's psychological state at a certain point in time and a corresponding time; and a presentation unit that visualizes and presents the psychological state emotion expression icon in a format that allows temporal fluctuations to be visible, wherein the input unit displays a list of psychological state emotion expression icons and accepts a psychological state emotion expression icon selected by the user from the list of psychological state emotion expression icons.

2. A psychological state visualization device according to claim 1, wherein the input unit receives inputs of psychological state emotion expression icons and corresponding times from one or more users, and the presentation unit displays the received inputs of psychological state emotion expression icons in a list in the same chronological order.

3. The psychological state visualization device according to claim 2, wherein the presentation unit anonymizes the one or more users and displays them in a list.

4. A psychological state visualization device according to claim 1, wherein the psychological states represented by the psychological state emotion expression icons are displayed in separate series for each type.

5. A psychological state visualization method including: an input step in which the psychological state visualization device receives as input a psychological state emotion expression icon that visually represents the user's psychological state at a certain point in time and the corresponding time; and a presentation step in which the psychological state visualization device visualizes and presents the psychological state emotion expression icon in a format in which temporal fluctuations are visible, wherein in the input step, a list of psychological state emotion expression icons is displayed and the user selects a psychological state emotion expression icon from the list of psychological state emotion expression icons and receives the selected icon.

6. A program for causing a computer to function as the psychological state visualization device of claim 1.

7. A psychological state visualization system comprising: the psychological state visualization device of claim 1; and a device for using said psychological state visualization device via a network.

Citation Information

Patent Citations

  • Feeling matching device, feeling matching method, and program

    JP2010250528A

  • Emotion evaluation support system and emotion evaluation support method

    JP2019208885A

  • Information processing device, information processing method and program

    JP2021189556A

  • Information processing device and method, and program

    WO2008090859A1

  • Psychological state visualization device, method, and program

    WO2020217373A1