Information processing method, information processing system, and program
By adjusting display size based on user creativity levels, the method enhances divergent thinking and productivity through an ambient environment that evokes awe, addressing the lack of effective spatial controls for creative thinking.
Patent Information
- Application Number
- JP2024118800
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2024-07-24
- Publication Date
- 2026-02-05
AI Technical Summary
Existing environmental designs and spatial controls do not effectively induce creative thinking in individuals, despite their importance in enhancing intellectual productivity.
An information processing method that involves acquiring biometric information to determine a user's creativity level and adjusting the display size of awe-evoking images based on this level, using a system comprising sensors, servers, and displays to create an ambient environment that enhances divergent thinking.
This method induces a creative thinking state by adjusting image display size according to user creativity, thereby enhancing intellectual productivity while minimizing energy and physical burden.
Smart Images

Figure 2026017804000001_ABST
Abstract
Description
[Technical Field]
[0001] The present disclosure relates to an information processing method, an information processing system, and a program. [Background technology]
[0002] Against the backdrop of labor shortages in a society with a declining birthrate and aging population, the government is promoting work style reform. Companies are working to create various systems to improve the intellectual productivity of their employees. Employee motivation and office space are closely related, and efforts are being made to develop environmental designs and spatial controls that increase intellectual productivity. In order to increase intellectual productivity, it is important not only whether employees are able to concentrate on their work, but also whether they are able to think more creatively. Creative thinking can be divided into convergent thinking, in which logical thinking is carried out from known information to arrive at a single solution, and divergent thinking, in which new ideas are generated by thinking about known information.
[0003] For example, Patent Documents 1 and 2 disclose techniques for improving the creativity and productivity of users. [Prior art documents] [Patent documents]
[0004] [Patent Document 1] Japanese Patent Publication No. 2020-016943 [Patent Document 2] Patent Publication No. 2021-070959 Summary of the Invention [Problem to be solved by the invention]
[0005] However, there is room for further investigation into what kind of environmental design or spatial control can induce people to think creatively.
[0006] One of the problems that this disclosure aims to solve is to create an ambient environment that can induce a person into a creative state of thinking. [Means for solving the problem]
[0007] An information processing method according to one aspect of the present disclosure is an information processing method executed by at least one processor in an information processing device having the at least one processor, and includes acquiring biometric information of a user, determining a level of creativity of the user based on the biometric information, displaying a first image that evokes a sense of awe on a display member, and changing the display size of the first image so that the display size of the first image when it is determined that the user's level of creativity is low is larger than the display size of the first image when it is determined that the user's level of creativity is high.
[0008] An information processing method according to one aspect of the present disclosure is an information processing method executed by at least one processor in an information processing device having the at least one processor, and includes determining a display image to be displayed on a display element, determining whether the display image is a first image that evokes a sense of awe or a second image that is different from the first image, and if it is determined that the display image is the first image, causing the display element to display the display image at a first size, and if it is determined that the display image is the second image, causing the display element to display the display image at a second size smaller than the first size. [Effects of the Invention]
[0009] According to the present disclosure, it is possible to create an ambient environment that can induce people into a state of creative thinking. [Brief explanation of the drawings]
[0010] [Figure 1] FIG. 1 is a diagram illustrating an example of a configuration of a display system according to an embodiment. [Figure 2] FIG. 2 is a diagram illustrating an example of a hardware configuration of an information processing device that realizes each device included in the display system according to the embodiment. [Figure 3] FIG. 3 is a diagram illustrating the relationship between the sense of awe and the size of a display image in relation to information processing according to the embodiment. [Figure 4] FIG. 4 is a diagram illustrating the relationship between the sense of awe and the size of a display image in relation to information processing according to the embodiment. [Figure 5] FIG. 5 is a flowchart showing an example of the flow of information processing executed in the display system according to the first embodiment. [Figure 6] FIG. 6 is a flowchart showing an example of the flow of information processing executed in the display system according to the second embodiment. [Figure 7] FIG. 7 is a diagram illustrating an example of the configuration of the respect score information according to the second embodiment. [Figure 8] FIG. 8 is a diagram showing an example of a display screen displayed on a display in the display system according to the second embodiment. [Figure 9] FIG. 9 is a flowchart showing an example of the flow of information processing executed in the display system according to the third embodiment. [Figure 10] FIG. 10 is a diagram illustrating a first application example of the display system according to the embodiment. [Figure 11] FIG. 11 is a diagram illustrating a first application example of the display system according to the embodiment. [Figure 12] FIG. 12 is a diagram illustrating a change in the display size in the display system according to the embodiment. [Figure 13] FIG. 13 is a diagram illustrating a change in the display size of the display system according to the embodiment. [Figure 14] FIG. 14 is a diagram illustrating a second application example of the display system according to the embodiment. [Figure 15] FIG. 15 is a diagram illustrating a second application example of the display system according to the embodiment. [Figure 16]FIG. 16 is a diagram illustrating a second application example of the display system according to the embodiment. [Figure 17] FIG. 17 is a diagram illustrating a change in the display size in the display system according to the embodiment. DETAILED DESCRIPTION OF THE INVENTION
[0011] Hereinafter, with reference to the drawings, embodiments of an information processing method, an information processing device, an information processing system, a program, and a recording medium according to the present disclosure will be described.
[0012] In the description of the present disclosure, components having the same or substantially the same functions as those described above with respect to the previously-mentioned drawings may be given the same reference numerals, and descriptions thereof may be omitted as appropriate. Furthermore, even when the same or substantially the same parts are shown, the dimensions and proportions may be different depending on the drawing. Furthermore, for example, in order to ensure the visibility of the drawings, reference numerals may be given to only the main components in the description of each drawing, and reference numerals may not be given to components having the same or substantially the same functions as those described above with respect to the previously-mentioned drawings.
[0013] In the description of the present disclosure, components having the same or substantially the same functions may be distinguished by adding an alphanumeric character to the end of the reference symbol. Alternatively, when multiple components having the same or substantially the same functions are not distinguished, they may be collectively described by omitting the alphanumeric character at the end of the reference symbol.
[0014] (First embodiment) 1 is a diagram showing an example of the configuration of a display system 1 according to an embodiment. Here, the display system 1 according to the embodiment is an example of an information processing system or a light detection system according to the present disclosure.
[0015] 1, the display system 1 includes a sensor 3, a server 5, and a display 7. In the display system 1, the server 5 is communicatively connected to each of the sensor 3 and the display 7 via a network such as the Internet or a dedicated communication line (not shown).
[0016] The server 5 may be configured to be able to transmit a control signal to the sensor 3 and control the operation of the sensor 3.
[0017] The sensor 3 is a biometric device configured to acquire biometric information of a user. This biometric information of the user is information used to determine the user's level of creativity. In the display system 1 according to the present disclosure, the biometric information of the user is, for example, information corresponding to at least one of cerebral blood flow, electroencephalograms, heart rate, facial features, and skeletal movement. Note that the biometric information of the user may be information that changes with the user's mental state or its transition, and other biometric information such as respiration and body temperature may also be used. That is, in the display system 1 according to the present disclosure, the sensor 3 has a detector that detects the user's biometric information or information used to generate the biometric information. Furthermore, the biometric device may be a camera, a smartwatch, a cerebral blood flow monitor, an electroencephalogram monitor, a heart rate monitor, a smartphone, a personal computer (PC), a tablet PC, a server device, or any other device appropriate for the biometric information to be measured.
[0018] As an example, in the light detection system, the sensor 3 has a photodetector (not shown) that detects light from a user. This photodetector may be, for example, an image sensor that captures light incident on a detection surface (e.g., an imaging surface) and generates an image signal (electrical signal) with a signal level corresponding to the intensity of the received light. As the image sensor, a solid-state imaging element such as a charge coupled device (CCD) or a complementary metal-oxide semiconductor (CMOS) can be appropriately used. The image sensor also performs analog processing such as noise reduction, amplification, and A / D conversion on the generated electrical signal (analog signal), and outputs a digital electrical signal (digital signal). Note that some or all of this analog processing may be implemented in at least one other circuit (e.g., at least one processor 81 of the sensor 3 or the server 5) provided downstream of the image sensor as an analog front end (AFE).
[0019] As an example, in the light detection system, the sensor 3 further includes at least one processor 81 (see FIG. 2) that generates biometric information of the user based on an electrical signal (measurement signal) output from the photodetector. Note that the biometric information may be generated based on the electrical signal output from the photodetector by at least one processor included in an information processing device external to the sensor 3, such as the server 5. In other words, the sensor 3 may be configured as a device that outputs an electrical signal based on light from the user detected by the photodetector.
[0020] The photodetector may have sensitivity not only to visible light but also to near-infrared light (NIR) or infrared light (IR). That is, the light from the user detected by the sensor 3 may be visible light, near-infrared light, or infrared light. The photodetector may further include a light source (not shown) that irradiates the user with irradiating light including light of a wavelength corresponding to the light-receiving sensitivity of the image sensor, such as infrared light. In this case, the photodetector may detect return light (e.g., field light beam) returning from the user due to the irradiating light.
[0021] For example, the information corresponding to cerebral blood flow may be cerebral blood flow (more specifically, the amount of oxygenated hemoglobin (OxyHb)) measured using near-infrared light with a wavelength (e.g., 800 nm) that is easily absorbed by hemoglobin, its change, or a value based on these. For example, the bioinstrumentation device that acquires the information corresponding to cerebral blood flow may be a non-contact near-infrared spectroscopy (NIRS) device, or a smart watch, smartphone, personal computer, tablet PC, server device, or the like that cooperates with the NIRS device.
[0022] For example, the information corresponding to the brain waves may be a voltage fluctuation (scalp electroencephalogram: EEG) due to the electrical activity of nerve cells (neurons) in the cerebral cortex, the amount of change, or a value based on these. For example, the biometric device that acquires the information corresponding to the brain waves may be an electroencephalograph, or a smart watch, smartphone, personal computer, tablet PC, server device, etc. that cooperates with the electroencephalograph.
[0023] For example, the information corresponding to the heartbeat may be the heart rate, the heartbeat interval, the amount of change therein, or a value based on these. The information corresponding to the heartbeat may be information corresponding to the heartbeat in response to an input image including a region in which the influence of changes in arterial blood flow in response to heartbeat is visualized, such as a user's fingertip or face, or may be output from a machine learning model whose parameters have been determined (trained) to output information based on the information corresponding to the heartbeat, or information based on the output. For example, the biometric device that acquires the information corresponding to the heartbeat may be a heart rate monitor, a camera, a smartwatch, or a smartphone, or may be a smartwatch or smartphone, personal computer, tablet PC, server device, or the like that cooperates with a heart rate monitor or a camera.
[0024] For example, the information corresponding to facial features may be blink frequency (eye closure rate), gaze, facial orientation, facial expression, changes therein, or values based on these. Here, the information related to facial expressions may be information indicating facial expressions such as a smile, a troubled face, or a frown, or information indicating a user's state corresponding to facial expressions such as a tense (stressed) state or a relaxed state, or information regarding the position of the corners of the mouth or whether or not the mouth is open. The information corresponding to facial features may be output from a machine learning model whose parameters are determined (trained) to output facial features or information based on facial features in response to an input of an image including the user's face, or information based on the output. For example, the biometric device that acquires information corresponding to facial features may be a camera, a smartwatch or smartphone that works in conjunction with a camera, a personal computer, a tablet PC, a server device, or the like.
[0025] For example, information corresponding to skeletal movement may be posture, such as the orientation of the face or body, or the position of the arms, the presence or absence of changes (body movement), the amount of change, or values based on these. Note that information corresponding to skeletal movement may also be output from a machine learning model in which parameters are determined (trained) to output skeletal movement or information based on skeletal movement in response to input of an image including the user's body, or information based on the output. For example, a biometric device that acquires information corresponding to skeletal movement may be a camera, a smartwatch or smartphone that works in conjunction with a camera, a personal computer, a tablet PC, a server device, or the like.
[0026] As the machine learning model for generating the user's biometric information, any machine learning model such as a convolutional neural network (CNN) can be used as appropriate depending on the processing. The structure and parameters of this machine learning model may be stored in the storage unit 52 of the server 5, or may be stored in the information processing device 8 or storage external to the server 5.
[0027] As shown in FIG. 1, the sensor 3 includes a signal processing unit 31, a storage unit 32, and a communication unit 33.
[0028] The signal processing unit 31 acquires an electrical signal output from a detector such as a photodetector of the sensor 3 and generates biometric information of the user based on the electrical signal. For example, the signal processing unit 31 performs signal processing on the measurement signal (measurement value) output from the detector to generate measurement data in a predetermined format as biometric information of the user. As an example, the signal processing unit 31 performs signal processing to convert an image signal (measurement signal) from a camera into text data in a CSV (Comma-Separated Values) format or the like. For example, the signal processing unit 31 converts an image signal representing an image including the user's face into text data representing information corresponding to facial features or information used to generate the information. This reduces the amount of data of the user's biometric information and the communication volume when transmitting the information from the sensor 3 to the server 5. Note that the conversion to text data may involve, for example, converting the image signal itself represented by the image signal into text.
[0029] Note that the "image" in the present disclosure may be a "moving image (video)" including multiple frames, or may be at least one "still image." The following explanation will mainly exemplify the case where a video is presented to a user.
[0030] The storage unit 32 stores programs and parameters, data being processed, and data resulting from processing, relating to each process executed by the sensor 3.
[0031] The communication unit 33 communicates with the outside of the sensor 3. As an example, the communication unit 33 transmits the acquired biometric information of the user to the server 5.
[0032] The server 5 controls the display size of the video being viewed by the user based on the evaluation result (determination result) as to whether the user feels "awe" while viewing the video. Details of the control of the display size will be described later.
[0033] Here, "awe" refers to the respect and reverence felt for something sublime or a great person, and describes the feeling of being overwhelmed by its grandeur or splendor. For example, images that evoke a sense of awe in users (subjects) include images of natural landscapes, historical buildings, and skyscrapers. However, because what evokes a sense of awe varies culturally and individually, users may also feel a sense of awe from images other than those mentioned above. Examples of such images include slow-motion footage, religious ceremonies, and artisans at work.
[0034] As shown in FIG. 1, the server 5 includes a communication unit 51, a storage unit 52, and a processing unit 53.
[0035] The communication unit 51 communicates with the outside of the server 5. As an example, the communication unit 51 receives biometric information of the user from the sensor 3. As an example, the communication unit 51 transmits data such as a video to be presented to the user to the display 7.
[0036] The storage unit 52 stores programs, parameters, data being processed, and data on the results of processing related to each process executed by the server 5. As an example, the storage unit 52 stores data indicating the determined degree of creativity 5311. The "degree of creativity" will be described later.
[0037] The calculation processing unit 53 realizes each function of the server 5, including a determination unit 531 and a screen size determination unit 532.
[0038] The determination unit 531 determines the degree of creativity of the user watching the video. As an example, the determination unit 531 determines the degree of creativity of the user based on biometric information of the user.
[0039] The screen size determination unit 532 determines the video to be displayed on the display 7 (display member). The screen size determination unit 532 also transmits the determined video to the display 7 to display it. As an example, the screen size determination unit 532 causes the display 7 to display a first image that is predetermined as an image (video) that evokes "awe" and that is stored in the storage unit 52 or the like.
[0040] Furthermore, the screen size determination unit 532 controls the display size of the image on the display 7 (display member). As an example, when the determination unit 531 determines that the user has not demonstrated much creativity, the screen size determination unit 532 changes the display size to a larger size than when the determination unit 531 determines that the user has not demonstrated much creativity.
[0041] Here, the screen size determination unit 532 according to the embodiment is an example of an image determination unit and a size determination unit.
[0042] The display 7 is, for example, a touch panel display. The display 7 displays various screens, such as a screen for accepting user operations and a screen for displaying images. Here, the display 7 according to the embodiment is an example of a display member. As an example, the display 7 displays an image based on display information from the server 5. For example, the display information from the server 5 includes data of the image to be displayed on the display 7. Note that, for example, when the image to be displayed is stored in the internal memory of the display 7, the display information may specify the image to be displayed. As an example, the display information from the server 5 includes control information instructing the display size of the image on the display 7. Note that the screen display on the display 7 may display an image of the display screen received from the server 5 as display information, or may generate and display an image of the display screen based on the display information received from the server 5 in accordance with layout information included in the display information or stored in the internal memory.
[0043] FIG. 2 is a diagram showing an example of the hardware configuration of an information processing device 8 that realizes each device (sensor 3, server 5, display 7) included in the display system 1 according to the embodiment.
[0044] The information processing device 8 is a device that comprehensively controls the operations of each device that it implements. As shown in Fig. 2, the information processing device 8 has a processor 81, a main memory device 82, an auxiliary memory device 83, and a device I / F (interface) 84. The processor 81, the main memory device 82, the auxiliary memory device 83, and the device I / F 84 are interconnected by a bus or the like, and have a hardware configuration that utilizes a normal computer. Note that each component of the information processing device 8 may be implemented by a combination of two or more components.
[0045] The processor 81 is, for example, at least one CPU (Central Processing Unit). The processor 81 executes, for example, a program to comprehensively control the operation of the information processing device 8 and realize each function of the information processing device 8. Note that some or all of the functions of the information processing device 8 may be realized by a dedicated hardware circuit.
[0046] Here, the processor 81 according to the embodiment is an example of at least one processor in the information processing device 8. As the at least one processor, at least one other processor may be used instead of or in addition to the CPU. As the other processor, various processors such as a CPU, a GPU (Graphics Processing Unit), a DSP (Digital Signal Processor), or a dedicated arithmetic circuit realized by an ASIC (Application Specific Integrated Circuit) or an FPGA (Field Programmable Gate Array) can be used as appropriate.
[0047] As an example, in an information processing device 8 that realizes the sensor 3, the processor 81 may load a program stored in the auxiliary storage device 83 into the main storage device 82 and execute the program, thereby realizing each function of the sensor 3, including the signal processing unit 31, the memory unit 32, and the communication unit 33 illustrated in Fig. 1. As an example, in an information processing device 8 that realizes the server 5, the processor 81 may load a program stored in the auxiliary storage device 83 into the main storage device 82 and execute the program, thereby realizing each function of the server 5, including the communication unit 51, the memory unit 52, and the arithmetic processing unit 53 illustrated in Fig. 1.
[0048] In the example of FIG. 1, only functions necessary for explaining the main parts of this embodiment are illustrated, but the functions possessed by each device of the display system 1 are not limited to these.
[0049] Furthermore, in each device of the display system 1 according to the embodiment, two or more components may be configured as an integrated unit. For example, in the server 5, the determination unit 531 and the screen size determination unit 532 may be integrated and realized as a single function. Furthermore, part of the functional configuration and hardware configuration of each device of the display system 1 according to the embodiment may be realized by an information processing device 8 external to each device.
[0050] The main storage device 82 is, for example, at least one RAM (Random Access Memory). The main storage device 82 temporarily stores data required for various processes by the processor 81. Here, the main storage device 82 according to the embodiment is an example of at least one memory in the information processing device 8.
[0051] The auxiliary storage device 83 is, for example, at least one ROM (Read Only Memory). The auxiliary storage device 83 stores programs and parameters that realize various processes by the processor 81, and various data used for the processes. Here, the auxiliary storage device 83 according to the embodiment is an example of at least one memory in the information processing device 8. As the at least one memory, at least one other memory may be used instead of or in addition to the ROM. As the other memory, various storage media and storage devices such as an HDD (Hard Disk Drive), an SSD (Solid State Drive), and a flash memory can be used as appropriate.
[0052] As an example, in the information processing device 8 that realizes the sensor 3, the main memory device 82 and the auxiliary memory device 83 may realize the memory unit 32. As an example, in the information processing device 8 that realizes the server 5, the main memory device 82 and the auxiliary memory device 83 may realize the memory unit 52.
[0053] The device I / F 84 is an interface for various inputs / outputs and / or communications in the information processing device 8. For example, the device I / F 84 may be configured to be connectable to an external output device that outputs audio, images, or video, or may include an output interface configured to function as the output device. As the output device, various displays (display components) such as a liquid crystal display (LCD), an organic electroluminescence (EL) display, a projector, or a tablet PC, or speakers, can be used as appropriate. For example, the device I / F 84 may be configured to be connectable to an external input device that acquires user operations, or may include an input interface configured to function as the input device. As the input device, a keyboard, a mouse, a touch panel, a microphone, a tablet PC, or the like can be used as appropriate. For example, the device I / F 84 may be configured to be connectable to an external communication device that communicates with the outside of the information processing device 8, or may include a communication interface configured to function as the communication device. As a communication interface, a communication circuit for wired communication such as USB (Universal Serial Bus (registered trademark)) or Ethernet (registered trademark), or a communication circuit for wireless communication compatible with various standards such as 3G, LTE, 4G, 5G, 6G, Wi-Fi (registered trademark), Bluetooth (registered trademark), and infrared communication can be used as appropriate.
[0054] As an example, in the information processing device 8 realizing the sensor 3, the device I / F 84 may realize a detector (not shown) that detects the user's biometric information or information used to generate the biometric information, and a communication interface (communication unit 33) for communicating with an external device such as the server 5. Note that this detector may be a photodetector (not shown) that detects light from the user. Furthermore, in the information processing device 8 realizing the sensor 3, the device I / F 84 may realize a light source (not shown) that irradiates the user with irradiation light. As an example, in the information processing device 8 realizing the server 5, the device I / F 84 may realize an input interface (acquisition unit) that connects or realizes an input device (e.g., the sensor 3), an output interface (output unit) that connects or realizes an output device (e.g., the display 7), and a communication interface (communication unit 51) for communicating with an external device such as the sensor 3. As an example, in the information processing device 8 realizing the display 7, the device I / F 84 may realize a communication interface (communication unit (not shown)) for communicating with an external device such as the server 5.
[0055] Each device included in the display system 1, including the sensor 3, the server 5, and the display 7, may be realized by an information processing device 8 shared with the other devices, or each may be realized by a different information processing device 8. For example, the server 5 may be realized by an information processing device 8 shared with the sensor 3 and / or the display 7. For example, the sensor 3 and the display 7 may be realized by a common information processing device 8.
[0056] The display system 1 according to the embodiment is exemplified as accepting user operations such as input and selection by voice input using a sensor 3 configured to acquire video and audio, but is not limited thereto. The display system 1 may be provided with a user terminal (not shown) such as a smartphone or tablet PC configured to acquire user operations such as input and selection and transmit the acquired operation results to the server 5. Such a user terminal can also be realized by an information processing device 8 exemplified in FIG. 2.
[0057] (Findings that formed the basis of this disclosure) Here, the findings of the present inventors will be explained.
[0058] 3 and 4 are diagrams for explaining the relationship between "reverence" and "size of displayed image" in relation to information processing according to the embodiment.
[0059] There are two types of creative thinking: "convergent thinking," which involves logically thinking from known information to arrive at a single solution, and "divergent thinking," which involves generating new ideas by thinking through known information. Here, "divergent thinking" contributes to a user's creativity. In other words, users in a "divergent thinking" state are in a state where they demonstrate a high degree of creativity. It has also been reported that positive "awe" contributes to creativity (Kazuaki Sawada and Michio Nomura, "The Influence of Awe on Divergent Thinking," 18th Annual Meeting of the Japanese Society of Cognitive Psychology (2021)).
[0060] In this context, the inventors of the present invention conducted the following experiment to clarify the conditions that evoke the "awe" that contributes to creativity.
[0061] (Experimental flow) As shown in Figure 3, this experiment involved four 10-minute tasks, with breaks in between. Each task consisted of 12 trials of approximately 1 minute each. In each trial, the subjects viewed a 30-second image (video) and then responded to six questions about how they felt while viewing it by pressing a button to indicate a four-point scale from "1" to "4." These responses were then tallied as ratings. The six questions were "grandeur," "awe," "smallness," "cuteness," "unpleasant-pleasant," and "sleepiness-awakening." In other words, one of the questions in this experiment was, "Did you feel awe?"
[0062] (Experimental conditions) As shown in Figure 3, the experimental conditions for this experiment consisted of four conditions: "high reverence condition," "low reverence condition," "high control condition," and "low control condition." These four conditions correspond to the four tasks in this experiment. Note that for each of tasks (1) to (4), the condition to be used (high reverence condition), "low reverence condition," "high control condition," or "low control condition) was randomly determined for each subject. This experiment used 12 types of video for each of these four conditions. These 12 types of video correspond to 12 trials, respectively. Note that which of the 12 types of video was used for each trial was randomly determined for each subject.
[0063] The "high awe condition" and "low awe condition" are "awe conditions" that use images that evoke a sense of awe. On the other hand, the "high control condition" and "low control condition" are "control conditions" that use images that produce similar levels of "pleasantness / unpleasantness" and "arousal" to those in the "awe condition." The "control condition" in this experiment uses images that show cute small animals.
[0064] The "large reverence condition" and the "large control condition" are "large conditions" that use large-sized images. On the other hand, the "small reverence condition" and the "small control condition" are "small conditions" that use small-sized images that are smaller than the "large condition."
[0065] As shown in Figure 3, the "large reverence condition" and the "small reverence condition" use the same images, but with different display sizes. Furthermore, the images are paired with music, and both the images and the music are the same between the "large reverence condition" and the "small reverence condition." Similarly, the "large control condition" and the "small control condition" use the same images, but with different display sizes. Furthermore, the images are paired with music, and both the images and the music are the same between the "large control condition" and the "small control condition."
[0066] (Experimental results) Figure 4 shows an example of the average rating of "awe" obtained in this experiment. The graph in Figure 4 shows the average rating for each condition regarding the rating results for "Did you feel a sense of awe while watching the video?" As shown in Figure 4, in the "awe condition," it was found that participants felt a significant sense of awe when the display size was large (p<0.001). On the other hand, in the "control condition," it was found that there was no significant difference in display size.
[0067] Therefore, by presenting a video that evokes a sense of awe at a larger size, it becomes easier to evoke a sense of awe. In other words, by using video and sound of a particular landscape and changing the display size, creativity (divergent thinking state) can be enhanced. Based on this knowledge, the information processing disclosed herein is configured to change the display size of a video that evokes a sense of awe in accordance with the user's divergent thinking state, which is one aspect of creativity.
[0068] An example of the operation of the display system 1 according to the embodiment will be described below with reference to the drawings. Note that the processing described below is an example, and it is possible to change the processing order, delete some processing, or add other processing.
[0069] FIG. 5 is a flowchart showing an example of the flow of information processing executed in the display system 1 according to the first embodiment. The flow in FIG. 5 is started when a user enters a predetermined space to which the display system 1 according to the embodiment is applied, such as a private room (booth) or a vehicle interior, or when the user instructs the start of a "creativity mode." Here, the "creativity mode" is a mode that supports improving or maintaining a user's creativity by presenting an image (first image) that evokes "awe." That is, the image in the creativity mode corresponds to the image (image) used in the experimental condition of the above-mentioned "awe condition" and is an example of the first image. Note that the image in the creativity mode is not limited to being expressed as an image (image) that evokes "awe," but may also be expressed as an image (image) that makes the user feel "awe" or an awe image (awe image). The image in the creativity mode is, for example, predetermined and stored in the storage unit 52. Note that the image in the creativity mode may be an image (image) that the user has previously evaluated as inspiring "awe."
[0070] First, the server 5 displays an image in the creative mode on the display 7 (S101). Then, the server 5 acquires biometric information of the user from the sensor 3 (S102), and determines whether the user is in a divergent thinking state based on the acquired biometric information (S103). Here, the user being in a divergent thinking state means that the user is in a state where the degree of creativity is high. Similarly, the user not being in a divergent thinking state means that the user is in a state where the degree of creativity is low.
[0071] As an example, the determination unit 531 in the server 5 determines that the user is in a divergent thinking state when the amount of variation in facial features such as the position and orientation of the user's face and the direction of gaze and / or the amount of variation in skeletal movement, or the rate of eye closure, is greater than each threshold value that is predetermined and stored in the storage unit 52 or the like. Similarly, the determination unit 531 determines that the user is in a more divergent thinking state as each amount of variation or the rate of eye closure increases. A more divergent thinking state means that the user is closer to a divergent thinking state or the degree of the divergent thinking state is increasing.
[0072] As an example, the determination unit 531 in the server 5 determines that the user is in a diffuse thinking state when an index (e.g., a difference or a ratio) of the increase in cerebral blood flow in the center of the user's forehead relative to the increase in the cerebral blood flow at the edge of the forehead is greater than a predetermined threshold value stored in the storage unit 52. Similarly, the determination unit 531 determines that the user is in a more diffuse thinking state as the index of the increase increases.
[0073] As an example, the determination unit 531 in the server 5 performs FFT (Fast Fourier Transform) processing on the heartbeat interval and pulse wave interval for a certain period of time to calculate a component coefficient of variance high frequency (ccvHF) indicating the degree of relaxation and a ccv low frequency (ccvLF) indicating the degree of concentration, and determines that the user is in a divergent thinking state if the ccvHF and ccvLF are greater than their respective thresholds that are predetermined and stored in the storage unit 52 or the like. Similarly, the determination unit 531 determines that the user is in a more divergent thinking state as the ccvHF and ccvLF increase.
[0074] If it is determined that the user is in a divergent thinking state (S103: Yes), the server 5 maintains or reduces the display size of the video (S104). Here, the reduced display size of the video is an example of the second size.
[0075] On the other hand, if it is not determined that the user is in a divergent thinking state (S103: No), the server 5 changes the display size of the video to a larger size (S105). Here, the display size of the video that has been changed to a larger size is an example of the first size.
[0076] Thereafter, the server 5 determines whether to end the determination of the user's mental state (S106). For example, when the user leaves a predetermined space to which the display system 1 according to the embodiment is applied, such as a private room (booth) or a vehicle interior, or when the user instructs to end the "creative mode," the server 5 determines to end the determination of the user's mental state.
[0077] As an example, when the display system 1 according to the embodiment is applied to a private room (booth), it is determined that the assessment of the user's thought state is to be terminated when the user finishes their work (creative activity) inside the vehicle and presses the end button displayed on the user's smartphone or display 7, when the user falls asleep, or when the reserved time for the booth ends.
[0078] As an example, when the display system 1 according to the embodiment is applied to a vehicle, it is determined that the assessment of the user's thought state has ended when the user finishes work (creative activity) inside the vehicle and presses the end button displayed on the user's smartphone or display 7, when the vehicle, which has been driving autonomously or manually by the driver, arrives at its destination, when the user falls asleep, when another mode is activated by a timer, or when the vehicle door is opened or closed.
[0079] If it is determined that the judgment has not ended (S106: No), the flow in Fig. 5 returns to the process of S103. On the other hand, if it is determined that the judgment has ended (S106: Yes), the flow in Fig. 5 ends after the server 5 stores the judgment result of the thinking state in the memory unit 52 (S107).
[0080] As described above, the information processing according to this embodiment displays on the display 7 an image that is generally considered to evoke a sense of awe, and controls the display size to change depending on the divergent thinking state. Specifically, the information processing according to this embodiment determines the level of creativity, and increases the display size of the image on the display 7 if the level of creativity is low. In this way, by controlling the display size of the image depending on the level of creativity of the user, it is possible to induce the divergent thinking state in the user by changing the display size. In other words, this embodiment can create an ambient environment that can induce a person into a creative thinking state.
[0081] Furthermore, constantly displaying images on a large screen raises the indoor temperature, which is undesirable from the viewpoint of energy conservation. Furthermore, rising indoor temperatures increase the physical burden on the user. In this situation, the information processing according to this embodiment, which controls the image display size according to the user's level of creativity, prevents images from being displayed at a large size all the time, thereby reducing the energy and physical burden on the user.
[0082] Other embodiments of the present disclosure will be described below with reference to the drawings. In the following description of each embodiment, differences will be mainly described, and descriptions of content that overlaps with the above-described content will be omitted as appropriate.
[0083] (Second embodiment) The information processing according to the above-described embodiment may change the display size of the image on the display 7 depending on whether the displayed image is an image (first image) that evokes "awe," regardless of the user's biometric information.
[0084] FIG. 6 is a flowchart showing an example of the flow of information processing executed in the display system 1 according to the second embodiment.
[0085] First, the server 5 determines the video to be displayed on the display 7 (S201). As an example, a user selects the video to be viewed from the display screen of the display 7 (see FIG. 8) in a predetermined space to which the display system 1 according to the embodiment is applied, such as a private room (booth) or the interior of a vehicle. Note that the user may also select the video to be viewed outside the predetermined space, for example, by using a smartphone. Then, the server 5 determines the video to be displayed on the display 7 according to the user's selection.
[0086] The server 5 determines whether the selected video is an "awe-inspiring" video (awe-inspiring video) (S202). As an example, the server 5 determines whether the selected video is an "awe-inspiring" video based on awe score information 522 that is predetermined and stored in the storage unit 52.
[0087] Fig. 7 is a diagram showing an example of the configuration of the awe score information 522 according to the second embodiment. As shown in Fig. 7, the awe score information 522 has a memory configuration including a "video number" that is identification information for uniquely identifying a video, a "tag" that is information indicating an outline or attribute of the video, flag information that indicates whether the video is an "awe video," and an "awe score" that is information that indicates the degree of "awe" evoked by the video, i.e., the degree of the awe video.
[0088] Note that a video that inspires "awe" (awesome video) corresponds to a video in the creative mode according to the above-described embodiment, and is, for example, a video having an "awe score" higher than a predetermined threshold value stored in the storage unit 52. As an example, in the example of FIG. 7, the awe score information 522 stores a value of "1" as flag information indicating that the video is an "awesome video" for a video having an awe score higher than "3." Note that the awe score information 522 may also store a value of "1" as flag information for a video that the user previously rated as an "awesome" video.
[0089] Here, the "awe score" is, for example, the average value of the rating values of "awe." This average value may be the average value for each user, the average value for at least one specific user attribute, or the average value for all users. In the awe score information 522, the "awe score" may be updated (corrected) for a video that a user has rated as a video that inspires "awe." This correction may be the addition of a predetermined value, multiplication by a predetermined coefficient, or correction using a predetermined correction formula.
[0090] If the selected image is not an image (first image) that evokes "awe" (S202: No), that is, if the selected image is an image (second image) that is different from the awe-inspiring image, the server 5 displays the selected image on the display 7 at a second size that is smaller than the first size for displaying the awe-inspiring image (S203).
[0091] Here, the image (second image) different from the awe-inspiring image refers to at least another image (non-awe-inspiring image) of the awe-inspiring image. In other words, the non-awe-inspiring image corresponds to the image (image) used in the experimental condition of the "control condition" described above and is an example of the second image. For example, the non-awe-inspiring image (second image) may be an image that does not evoke "awe" or an image that evokes a very small degree of "awe" compared to the awe-inspiring image (first image). As an example, the non-awe-inspiring image (second image) may be an image featuring a small animal as a subject. For example, the non-awe-inspiring image (second image) may be an image whose "awe score" is equal to or less than a predetermined threshold value stored in the storage unit 52. As an example, in the awe score information 522 in the example of FIG. 7, for an image whose awe score is "3" or less, a value "0" indicating that the image is another image (non-awe-inspiring image) of the "awe-inspiring image" is stored as flag information. In awe score information 522, a value of "0" may be stored as flag information for a video that a user previously rated as not inspiring "awe." The threshold for determining whether a video is non-awesome may be the same as or different from the threshold for determining whether a video is awe-inspiring. In other words, the non-awe-inspiring video may be all videos other than the awe-inspiring video, or may be some of the videos other than the awe-inspiring video, among the videos that can be provided to the user by display system 1.
[0092] The second size of the other images of the awe video is, for example, a fixed display size that does not change depending on the degree of user creativity. Note that the other images of the awe video may not be displayed at the same size as the first size, in which case the display size (second size) of the other images of the awe video is smaller than the first size for displaying the awe video.
[0093] On the other hand, if the selected image is an awe-inspiring image (S202: Yes), the server 5 displays the selected image on the display 7 in the first size for displaying awe-inspiring images (S204).
[0094] Thereafter, the server 5 stores information indicating the selected video in the storage unit 52 (S205). The server 5 also determines whether a new user operation has been performed to instruct a change of the displayed video (S206). If the displayed video is to be changed (S206: Yes), the flow in FIG. 6 returns to the processing of S201. On the other hand, if the displayed video is not to be changed (S206: No), the flow in FIG. 6 ends.
[0095] Here, a description will be given of the selection of a display video in the flow of Fig. 6. Fig. 8 is a diagram showing an example of a display screen 701 displayed on the display 7 in the display system 1 according to the second embodiment.
[0096] As shown in FIG. 7 , the display screen 701 includes, for example, at least one tab 711 for instructing various screen transitions and an icon 721 representing at least one video selection candidate. The tab 711 may include a “Home” tab 711a that displays a default initial screen, such as presenting at least one video selection candidate based on the user's viewing history, depending on the selection. The tab 711 may include a “Recommended” tab 711b that displays at least one recommended video depending on the selection. The tab 711 may include a “Favorites” tab 711c that displays at least one video that the user has registered as a favorite depending on the selection. The tab 711 may include a “Popular” tab 711d that displays at least one video that is popular with other users depending on the selection. The tab 711 may include a “Settings” tab 711e that displays a settings screen for various settings, such as registering user information 521 and inputting ratings for awesome videos depending on the selection.
[0097] Note that the image of at least one selection candidate displayed in the "Favorites" tab 711c may be updated as appropriate, for example, in accordance with the selection results of the target user saved in S205 of Fig. 6. Also, the image of at least one selection candidate displayed in the "Popular" tab 711d may be updated in accordance with the selection results saved for multiple users.
[0098] In the display system 1 according to the present embodiment, the selection results may be stored in the storage unit 52 in association with user information 521. This user information 521 may be acquired from a reservation history (usage history) of a predetermined space to which the display system 1 according to the embodiment is applied, such as a private room (booth) or a vehicle compartment. When saving the selection results, a questionnaire such as "Did you feel awe?" or "Would you like to register this as a favorite?" may be displayed on the display 7 or a tablet PC of the device I / F 84, and the input results may be acquired.
[0099] In this way, the information processing according to this embodiment controls the display size to change depending on whether the image selected by the user as the image to be displayed is an image that evokes "awe." Specifically, when an awe-inspiring image that correlates with the degree of creativity is selected, the information processing according to this embodiment displays the selected image on the display 7 at a predetermined first size. On the other hand, when an image other than the awe-inspiring image is selected, the information processing displays the selected image on the display 7 at a second size smaller than the first size for displaying the awe-inspiring image. In this way, by setting a display size smaller than the awe-inspiring image for images that do not significantly affect the degree of creativity displayed by the user, increasing the display size of the awe-inspiring image contributes to improving creativity, while suppressing power consumption and increases in indoor temperature associated with image display, thereby reducing energy and physical burdens.
[0100] (Third embodiment) The information processing according to the above-described embodiments can be combined as appropriate. Fig. 9 is a flowchart showing an example of the flow of information processing executed in the display system 1 according to the third embodiment.
[0101] First, the server 5 determines the image to be displayed on the display 7 based on, for example, a user selection (S201), and determines whether the selected image is an image that inspires "awe" (awe image) based on, for example, awe score information 522 (S202).
[0102] If the selected image is not an image (first image) that evokes "awe" (S202: No), that is, if the selected image is an image (second image) that is different from the awe-inspiring image, the server 5 displays the selected image on the display 7 at a second size that is equal to or smaller than the first size for displaying the awe-inspiring image (S203). Thereafter, the flow of FIG. 9 proceeds to the process of S206.
[0103] On the other hand, if the selected image is an awe image (S202: Yes), the server 5 displays the selected image on the display 7 in a first size for displaying awe images (S204).The server 5 then acquires biometric information of the user from the sensor 3 (S102), and determines whether the user is in a divergent thinking state based on the acquired biometric information (S103).
[0104] If it is determined that the user is in a divergent thinking state (S103: Yes), the server 5 maintains or reduces the display size of the video (S104). After that, the flow of FIG. 9 proceeds to the process of S206.
[0105] On the other hand, if the server 5 does not determine that the user is in a divergent thinking state (S103: No), the server 5 increases the display size of the video (S105).
[0106] Thereafter, the server 5 determines whether a new user operation has been performed to instruct a change in the displayed image (S206). If the displayed image is to be changed (S206: Yes), the flow in Fig. 9 returns to the processing of S201. On the other hand, if the displayed image is not to be changed (S206: No), the server 5 stores the thought state determination result in the storage unit 52 (S107), and then the flow in Fig. 9 ends.
[0107] In this manner, the information processing according to this embodiment controls the display size to be changed depending on both whether the image selected by the user as the image to be displayed is an image that evokes "awe" and the user's state of divergent thinking. Specifically, when an awe-inspiring image, which is correlated with the level of creativity, is selected and the level of creativity is low, the information processing according to this embodiment increases the display size (first size) of the selected image on the display 7. On the other hand, when an image other than the awe-inspiring image is selected, the information processing displays the selected non-awe-inspiring image on the display 7 at a second size smaller than the first size for displaying the awe-inspiring image. This configuration reduces the energy and physical burden compared to the configuration according to the first embodiment, while improving creativity compared to the configuration according to the second embodiment.
[0108] Hereinafter, application examples of the display system 1 according to the present disclosure will be described with reference to the drawings.
[0109] (First application example) 10 and 11 are diagrams for explaining a first application example of the display system according to the embodiment. This application example illustrates a usage scene in which the display system 1 according to the embodiment is applied to a booth 201 (a predetermined space), which is a private room where a user P performs work (creative activity) that demonstrates creativity. FIGS. 10 and 11 illustrate a case in which the user P performs creative activity in the booth 201 using a user terminal 4.
[0110] As shown in FIGS. 10 and 11, the display 7 according to this application example includes three displays 7a to 7c. In the examples of FIGS. 10 and 11, the displays 7a to 7c are provided on the wall of the booth 201. For example, the display 7a (first display) is disposed in front of the user P (ZX plane), which is a position facing the user P when the user P is seated. For example, the displays 7b and 7c are disposed on the sides of the display 7a. Here, "on the side of the display 7a" means either the left or right side of the display 7a. More specifically, "disposed on the side of the display 7a" means being disposed at any of the left, upper left, lower left, right, upper right, and lower right positions relative to the display 7a. The display 7b (second display) is disposed on the left side of the user P (YZ plane on the -X side), which is in the horizontal direction (e.g., the X direction) of the display 7a. The display 7c (third display) is disposed, for example, on the right side (+X side YZ plane) of the user P, which is in the horizontal direction (for example, the X direction) of the display 7a.
[0111] The heights (positions in the Z direction) of the displays 7a to 7c may all be the same, may be different from one another, or may be partially the same. For example, the displays 7b and 7c may each be located to the left, upper left, lower left, right, upper right, or lower right of the display 7a. Furthermore, for example, the displays 7b and 7c may be located only on either the left or right side of the display 7a. The sizes of the displays 7a to 7c may all be the same, may be different from one another, or may be partially the same. Furthermore, the displays 7a to 7c may be configured as a single display 7 whose display surface is bent or curved in two or more directions.
[0112] 10 and 11, a camera 301 (sensor 3) is placed in booth 201, for example, near the ceiling, so as to be able to capture an image of user P. Note that camera 301 may be configured to be able to capture the voice uttered by user P, or a microphone for capturing the voice of user P may be separately provided in booth 201. Also, display 7 may be equipped with a speaker that outputs voice along with the image, or a speaker (not shown) may be separately provided in booth 201.
[0113] FIG. 10 illustrates an example in which user P starts using booth 201, or when it is determined that user P is in a divergent thinking state (high level of creativity). In such a case, the display system 1 according to this application example displays, on the display 7, a second-size image 731b (first image) that evokes a sense of awe. For example, the display system 1 according to this application example displays the image 731 using only one display 7a of the three displays 7a to 7c. That is, in the example of FIG. 10, a non-display area 732b exists. This makes it possible to achieve energy savings, such as suppressing an increase in indoor temperature and reducing utility costs.
[0114] On the other hand, FIG. 11 illustrates a case where it is determined that the user P is not in a divergent thinking state (the level of creativity is low). In such a case, the display system 1 according to this application example displays an image 731a (first image) of a first size that evokes a sense of awe on the display 7. For example, the display system 1 according to this application example displays the image 731 using all three displays 7a to 7c. This can improve the level of creativity of the user P and induce him or her into a divergent thinking state.
[0115] 10 and 11 show an example in which three displays 7a to 7c are arranged in a U-shape (angled U-shape), but the present invention is not limited to this. The display 7 may have one, two, or four or more displays, or the display surfaces may be arranged in other U-shape configurations, or any one of the displays 7 may have a display area and a non-display area.
[0116] FIG. 12 is a diagram illustrating how the display system 1 according to the embodiment changes the display size. As shown in FIG. 12, an area where an image 731 is displayed and a non-display area 732 may be provided on any one display 7. As an example, when the display system 1 determines that the level of creativity is low, the display system 1 may display an image 731a of a first size across the entire display 7, or may display an image 731b of a second size in the center and provide a non-display area 732b. The display size of the image 731 may be three or more levels. Alternatively, an image 731c of a third size smaller than the second size may be displayed, providing a non-display area 732c larger than the non-display area 732b when the image 731b of the second size is displayed. In this configuration, for example, the other images in the awe image are displayed in the second or third size. When the level of creativity is determined to be low, the awe image is displayed in the first size, and when the level of creativity is determined to be high, the awe image is displayed in the second or third size.
[0117] FIG. 13 is a diagram illustrating a change in display size of the display system 1 according to the embodiment. Adjacent display surfaces of multiple displays 7 do not necessarily have to be perpendicular to each other, but may be arranged on a single plane, or may be arranged at any angle therebetween, as shown in FIG. 13. For example, display 7a may be positioned directly facing the user P, while displays 7b and 7c adjacent to display 7a may be positioned at an angle (e.g., 127 degrees) relative to display 7a that conforms to the human field of view (approximately 178 degrees). Also, as shown in FIG. 13, a video 731 may be displayed across multiple displays 7. In the example of FIG. 13, a second-size video 731b is displayed across the entire surface of display 7a (first region), a portion of display 7b on the display 7a side (second region), and a portion of display 7c on the display 7a side (second region).
[0118] When switching between displaying and hiding an image on a display-by-display basis using multiple displays 7, the display 7 that first displays the image is arbitrary. On the other hand, when increasing the image display size, the display 7 adjacent to the currently displayed display 7 is put into the display state. Similarly, when decreasing the image display size, the display 7 at either end of the currently displayed display 7 is put into the non-display state.
[0119] The change in display size may be achieved by displaying the video at multiple positions directly facing (opposite) the user P and at different distances from the user P. For example, as illustrated in Figures 10 and 11, when the user P is working at a desk using the user terminal 4, if it is determined that the user P is demonstrating a high level of creativity, the video may be displayed in a range close to the user terminal 4 where the user is working, and if it is determined that the user P is demonstrating a low level of creativity, the video may be displayed in a range farther from the user terminal 4, i.e., in a wider range.
[0120] Between adjacent display surfaces among the plurality of display surfaces, a blank space where no image is displayed may be provided depending on the arrangement or structure thereof.
[0121] (Second application example) 14 and 15 are diagrams for explaining a second application example of the display system 1 according to the embodiment. This application example illustrates a case where the display system 1 according to the embodiment is applied to a moving body such as a vehicle. This application example illustrates a usage scene where the display system 1 according to the embodiment is applied to a vehicle interior 6 (a predetermined space) of the vehicle. This vehicle interior 6 is an example of a passenger space (cabin) of a moving body. FIGS. 14 and 15 illustrate a case where a user P performs a creative task (a creative act) in the vehicle interior 6.
[0122] Here, the mobile object may be any type of vehicle, such as an EV vehicle, an electric vehicle, or the like, powered by a motor, an automobile, or the like, powered by an engine (internal combustion engine), or a hybrid vehicle, or the like, powered by both an engine and a motor. The mobile object may be, for example, a passenger car, truck, motorcycle, or other automobile (vehicle), but may also be an electric bicycle, electric kick scooter, electric wheelchair, construction machine, agricultural machine, ship, train, airplane, or the like. The mobile object may be configured to be autonomously mobile, or may be configured to be mobile in response to direct or remote control by a driver.
[0123] When the display system 1 according to the embodiment is applied to a mobile body such as a vehicle, each device included in the display system 1, including the sensor 3, the server 5, and the display 7, may be integrated with a computer mounted on the mobile body. For example, the information processing device 8 that realizes the sensor 3 may be integrated with an on-board sensor such as a drive recorder, or a computer that controls the operation of the on-board sensor. For example, the information processing device 8 that realizes the display 7 may be integrated with a car navigation device of the mobile body that is configured to be able to perform functions such as route guidance.
[0124] The computer (information processing device 8) mounted on these mobile objects may be a computer such as an ECU (Electronic Control Unit) provided inside the mobile object (e.g., a vehicle), a DCU (Domain Control Unit) such as a CDC (Cockpit Domain Controller) that integrates multiple ECUs, or an OBU (On Board Unit). Alternatively, the computer mounted on the mobile object may be an external computer installed in the passenger space (cabin) of the mobile object, for example, near the dashboard or in the trunk.
[0125] In addition, the computer (information processing device 8) that realizes each device included in the display system 1 may be communicatively connected to computers in other mobile bodies (e.g., vehicles) via an in-vehicle network including a CAN (Controller Area Network), Ethernet (registered trademark), USB (registered trademark), etc., within the mobile body.
[0126] 14 and 15 , the display 7 according to this application example is disposed, for example, between a front seat 61 and a rear seat 62 provided in the vehicle interior 6 so that an image can be viewed by a user P seated in the rear seat 62. The display 7 according to this application example is disposed in a position facing (directly facing) the user P when the user P is seated in the rear seat 62 (in front of the user P), and may also be disposed to the side of the user P, as in the first application example described above. The display 7 according to this application example may be a partition between the front seat 61 or a side or rear window configured using a transparent organic light-emitting diode (OLED), or may be a screen onto which light from a projector disposed in the vehicle interior 6 is projected.
[0127] FIG. 15 illustrates a case where a user is starting work in the vehicle interior 6 or where it is determined that the user is in a divergent thinking state (high level of creativity). In such a case, the display system 1 according to this application example displays, on the display 7, an image 731b (first image) of a second size that evokes a sense of awe. For example, the display system 1 according to this application example displays the image in a narrow range at eye level when it determines that the user's level of creativity is high, and displays the image in a wide range when it determines that the user's level of creativity is low. Specifically, the display system 1 according to this application example displays the image 731 in a first region of the single display 7 that is at or above the eye level of a user seated in the rear seat 62, such as the center or upper portion (e.g., two-thirds of the vertical area of a 55-inch display). That is, in the example of FIG. 15, a non-display region 732b (second region) exists. This makes it possible to achieve energy conservation, such as suppressing an increase in the interior temperature and reducing utility costs.
[0128] On the other hand, Fig. 16 illustrates a case where it is determined that the user P is not in a divergent thinking state (the degree of creativity is low). In such a case, the display system 1 according to this application example displays an image 731a (first image) of a first size that evokes "awe" on the display 7. For example, the display system 1 according to this application example displays the image 731 in the entire area (the area overlapping the first area and the second area) of one display 7, including the first area and at least the non-display area 732 (second area) below it. This can improve the degree of creativity of the user P and induce the user P to enter a divergent thinking state.
[0129] The location where the image is displayed may be changeable as appropriate to suit the eye height or preferences of the passenger (user) of the vehicle. For example, the user may be able to freely set the top, bottom, left, and right positions of the smallest screen for the image display.
[0130] 15 and 16 illustrate an example in which the display area and the non-display area are arranged in the vertical direction, but this is not limiting. FIG. 17 is a diagram for explaining a change in display size in a display system according to an embodiment. As shown in FIG. 17, the display area and the non-display area 732 of an image 731 may be arranged in the horizontal direction. In the example of FIG. 17, for example, on a landscape 48-inch display, if it is determined that the level of creativity is high, an image 731b of the second size may be displayed in a narrow area in the center, and if it is determined that the level of creativity is low, an image 731a of the first size may be displayed in a wide area including the left and right areas.
[0131] Generally, the greater the change in the period, amplitude, and acceleration of the vehicle's motion, the greater the likelihood of motion sickness. Furthermore, the changes in the period, amplitude, and acceleration of the vehicle's motion are most likely to cause motion sickness in the upward direction, the forward / backward direction, and the left / right direction, in that order. Therefore, from the perspective of suppressing motion sickness, a large-screen display 7 is preferably configured to display images in a narrow range at eye height when it is determined that the degree of motion sickness is high, in order to suppress vertical eye and neck movement.
[0132] In addition, the non-display area 732 may display information indicating the name of the video being displayed and the mode being used.
[0133] In each of the above-mentioned embodiments, "is it A?" refers to at least one of "is A" and "is not A." In other words, in each of the above-mentioned embodiments, the determination of "is A?" may be realized by determining "is A," or by determining "is not A," or by determining both of these.
[0134] The programs executed by each device of the display system 1 according to each of the above-described embodiments may be provided as files recorded in an installable or executable format on a computer-readable recording medium (Computer Program Product) such as a CD-ROM, FD, CD-R, or DVD.
[0135] The programs executed by the devices of the display system 1 according to the above-described embodiments may be stored on a computer connected to a network such as the Internet and provided by being downloaded via the network. The programs executed by the devices of the display system 1 according to the above-described embodiments may be provided or distributed via a network such as the Internet.
[0136] Furthermore, the programs executed by the devices of the display system 1 according to the above-described embodiments may be provided by being pre-installed in a ROM or the like.
[0137] According to at least one of the embodiments described above, it is possible to create an ambient environment that can induce a person into a creative thinking state.
[0138] Although several embodiments of the present invention have been described, these embodiments are presented as examples and are not intended to limit the scope of the invention. These embodiments can be implemented in various other forms, and various omissions, substitutions, and modifications can be made without departing from the spirit of the invention. These embodiments and their modifications are included within the scope and spirit of the invention, as well as within the scope of the invention described in the claims and their equivalents.
[0139] (Addendum) The above description of the embodiments discloses the following techniques. (1) a photodetector for detecting light from a user; at least one processor that generates biometric information of the user based on the electrical signal output from the photodetector; a display that displays the awe-inspiring first image; The at least one processor: determining a degree of creativity of the user based on the biometric information; changing a display size of the first image on the display member so that a display size of the first image when it is determined that the user's creativity is low is larger than a display size of the first image when it is determined that the user's creativity is high; Optical detection system. [Explanation of symbols]
[0140] 1 Display System Booth 201 3 sensors 301 Camera 31 Signal processing section 32 Storage section 33 Communications Department 4. User terminal 5 Server 51 Communications Department 52 Storage section 521 User Information 522 Awe Score Information 53 Processing unit 531 Judgment section 5311 Degree of creativity 532 Screen size determination unit (image determination unit, size determination unit) 6 Cabin 61 Front seat 62 back seat 7, 7a, 7b, 7c Display (display member) 701 Display screen 711 tabs 721 Icons 731 Video 731a First size video 731b Second size video 731c 3rd size video 732 Hidden area 8. Information processing equipment 81 processors 82 Main storage 83 Auxiliary storage device 84 Equipment I / F P User
Claims
1. An information processing method executed by at least one processor in an information processing device including the at least one processor, acquiring biometric information of a user; determining a degree of creativity of the user based on the biometric information; displaying an awe-inspiring first image on the display member; changing the display size of the first image so that the display size of the first image when it is determined that the user has demonstrated a low level of creativity is larger than the display size of the first image when it is determined that the user has demonstrated a high level of creativity; Information processing methods.
2. the first image includes at least one of a natural landscape, a historical building, and a high-rise building as a subject; The information processing method according to claim 1 .
3. The display member is disposed between the front seat and the rear seat of the vehicle, the display member includes a first region and a second region located below the first region, When it is determined that the user has demonstrated a high level of creativity, the first image is displayed in the first area; When it is determined that the degree of creativity of the user is low, the first image is displayed in an area overlapping the first area and the second area. The information processing method according to claim 1 .
4. The display member is disposed within the booth; the display member includes a first display disposed at a position facing the user when the user is seated, and a second display disposed to the side of the first display, When it is determined that the degree of creativity of the user is high, the first image is displayed on the first display; When it is determined that the degree of creativity of the user is low, the first image is displayed on the first display and the second display. The information processing method according to claim 1 .
5. The biological information corresponds to at least one of cerebral blood flow, electroencephalogram, heart rate, facial feature amount, and skeletal movement. The information processing method according to claim 1 .
6. The biometric information is information obtained by converting an image signal into text data. The information processing method according to claim 1 .
7. The method further includes displaying a second image on the display member, the second image being different from the first image that evokes a sense of awe; When it is determined that the degree of creativity of the user is low, the display size of the second image is smaller than the display size of the first image. The information processing method according to claim 1 .
8. The display size of the second image does not change depending on the degree of creativity of the user. The information processing method according to claim 7.
9. further comprising pre-storing a plurality of images and an awe score indicating the degree of awe evoked by each of the plurality of images; The first image is an image among the plurality of images that has the awe score higher than a predetermined threshold. The information processing method according to claim 1 .
10. An information processing method executed by at least one processor in an information processing device including the at least one processor, determining a display image to be displayed on a display member; determining whether the displayed image is a first awe-inspiring image or a second image different from the first image; When it is determined that the display image is the first image, the display image is displayed on the display member at a first size; When it is determined that the display image is the second image, the display image is displayed on the display member at a second size smaller than the first size. Information processing methods.
11. a sensor for acquiring biometric information of a user; a display member that displays an awe-inspiring first image; at least one processor; The at least one processor: determining a degree of creativity of the user based on the biometric information; changing a display size of the first image on the display member so that a display size of the first image when it is determined that the user has demonstrated a low level of creativity is larger than a display size of the first image when it is determined that the user has demonstrated a high level of creativity; Information processing system.
12. At least one processor determining a display image to be displayed on the display member; determining whether the displayed image is a first image that evokes a sense of awe or a second image that is different from the first image; When it is determined that the display image is the first image, the display image is displayed on the display member at a first size; When it is determined that the display image is the second image, the display image is displayed on the display member at a second size smaller than the first size. Information processing system.
13. acquiring biometric information of a user; determining a degree of creativity of the user based on the biometric information; displaying an awe-inspiring first image on the display member; changing the display size of the first image so that the display size of the first image when it is determined that the user's creativity is low is larger than the display size of the first image when it is determined that the user's creativity is high; program.
14. determining a display image to be displayed on a display member; determining whether the displayed image is a first awe-inspiring image or a second image different from the first image; When it is determined that the display image is the first image, the display image is displayed on the display member at a first size; When it is determined that the display image is the second image, the display image is displayed on the display member at a second size smaller than the first size. program.
Citation Information
Patent Citations
Creativity evaluation device, method and program
JP2020016943A
Booth
JP2021070959A