Information processing device, information processing method, and program

Abstract

To provide a new and improved technique that can more effectively encourage a user to change his / her behavior.SOLUTION: An information processing device includes a control unit that performs predetermined processing when standby time elapses from time when a timer unit starts measuring time, and sets the standby time according to intensity of emotion measured by a measurement unit that measures intensity of emotion of the user.SELECTED DRAWING: Figure 1

Description

Technical Field

[0001] The present invention relates to an information processing apparatus, an information processing method, and a program.

Background Art

[0002] Recently, various technologies for changing human behavior have been studied for the purpose of promoting health and the like. For example, assuming that an environment in which employees can work healthily leads to an improvement in productivity, technologies for prompting employees to take actions that contribute to the improvement of employees' health have been studied. As an example, there is a technology for increasing the opportunity to make a smile. When the time that employees spend smiling at the workplace increases, employees can build good relationships with those around them, and it is expected that the stress of the employees themselves will be reduced or their immunity will be improved.

[0003] As a technology focusing on the above point, for example, Patent Document 1 discloses a system in which when an employee's smile is detected, the lock of the entrance door of the workplace or the personal computer is released, or the time card is punched.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0005] However, it is desired to provide a technology that enables more effectively prompting the change of user behavior.

[0006] Therefore, the present invention has been made in view of the above problems, and an object of the present invention is to provide a novel and improved technology that can more effectively prompt the change of user behavior.

Means for Solving the Problems

[0007] To solve the above problem, according to one aspect of the present invention, when the waiting time has elapsed from the time measurement by the timer unit starts, Unlocking process A control unit that performs the user Smile degree indicates the degree of a smile on the face. Measured by a measuring unit that measures The aforementioned smile degree Depending on the circumstances, The higher the degree of smile, the shorter the waiting time. Set the aforementioned waiting time The system then displays information on the display unit corresponding to the waiting time and the elapsed time from the start of the measurement to the present. An information processing device is provided, which includes a control unit.

[0011] The information provided may include information indicating the ratio of the elapsed time or the remaining time (the waiting time minus the elapsed time) to the waiting time.

[0012] The aforementioned information is the aforementioned Smile level In accordance with the user, Smile level It may include guiding statements that encourage changes.

[0013] The control unit counts the total counts that are counted by the timer unit at a predetermined counting rate. Smile level The waiting time may be set based on the above.

[0014] The control unit controls the counting speed at which the total count is counted by the timer unit. Smile level The waiting time may be set based on the above.

[0015] The control unit, after setting the waiting time, Smile level When the measurement unit detects a change in the waiting time, the waiting time is changed to Smile level It may be updated accordingly.

[0016] The control unit may update the displayed information based on the updated waiting time and the elapsed time from the start of the measurement to the time when the change was detected.

[0017] The control unit may update the standby time by updating the total count number counted at a predetermined count speed by the timer unit according to the changed Smile level .

[0018] The control unit may update the standby time by updating the count speed at which the total count number is counted by the timer unit according to the changed Smile level .

[0019] When the control unit acquires the past Smile level of the user measured by the measurement unit, the standby time may be set based on the acquired past Smile level .

[0021] The measurement unit may acquire the face image from an imaging unit that images the face image of the user, and measure the smiling degree by analyzing the face image.

[0022] The measurement unit may detect a face area from the face image and measure the smiling degree from the face area.

[0023] Also, according to another aspect of the present invention to solve the above problems, when the standby time has elapsed since the start of time measurement by the timer unit Unlocking process is performed, and according to the Smile degree indicates the degree of a smile on the face. measured by the measurement unit that measures the The aforementioned smile degree of the user, The higher the degree of smile, the shorter the waiting time. the standby time is set The system then displays information on the display unit corresponding to the waiting time and the elapsed time from the start of the measurement to the present. . An information processing method executed by a computer including this is provided.

[0024] Also, according to another aspect of the present invention to solve the above problems, a computer is a control unit that performs Unlocking process when the standby time has elapsed since the start of time measurement by the timer unit, and according to the Smile degree indicates the degree of a smile on the face. measured by the measurement unit that measures the The aforementioned smile degree of the user, The higher the degree of smile, the shorter the waiting time. the standby time is set The system then displays information on the display unit corresponding to the waiting time and the elapsed time from the start of the measurement to the present.A program is provided to enable it to function as a control unit. [Effects of the Invention]

[0025] As described above, the present invention provides a novel and improved technology that can more effectively encourage behavioral change in users. [Brief explanation of the drawing]

[0026] [Figure 1] This is a conceptual diagram illustrating an information processing system according to one embodiment of the present invention. [Figure 2] This is a block diagram showing an example of the functional configuration of the information processing device 20 according to this embodiment. [Figure 3] This is a sequence diagram illustrating an example of the operation of the information processing system according to this embodiment. [Figure 4] This is an explanatory diagram showing a specific example of a waiting time table. [Figure 5] This is an explanatory diagram illustrating an example of a screen displayed on the display unit 260 and a first specific example of screen transitions corresponding to changes in the degree of smile. [Figure 6] This is an explanatory diagram illustrating an example of a screen displayed on the display unit 260 and a second specific example of screen transitions corresponding to changes in the degree of smile. [Figure 7] This is an explanatory diagram illustrating an example of a screen displayed on the display unit 260 and a third specific example of screen transitions corresponding to changes in the degree of smile. [Figure 8] This is an explanatory diagram illustrating a specific example of the counter setting table referenced by the control unit 240 in the first modified example. [Figure 9] This is an explanatory diagram illustrating a specific example of the counter setting table referenced by the control unit 240 in the second modified example. [Figure 10] This is an explanatory diagram illustrating a specific example of a past information table stored in the memory unit 210. [Figure 11] This figure shows an example of the hardware configuration of an information processing device 20 according to one embodiment of the present invention. [Modes for carrying out the invention]

[0027] Preferred embodiments of the present invention will be described in detail below with reference to the attached drawings. In this specification and drawings, components having substantially the same functional configuration are denoted by the same reference numerals, and redundant descriptions will be omitted.

[0028] Furthermore, in this specification and drawings, multiple components having substantially the same functional configuration may be distinguished by adding different numbers after the same reference numeral. However, if there is no need to particularly distinguish each of multiple components having substantially the same functional configuration, each of the multiple components will be given only the same reference numeral.

[0029] <0. Overview> First, an overview of embodiments of the present invention will be described. Figure 1 is a conceptual diagram illustrating an information processing system according to one embodiment of the present invention. As shown in Figure 1, the information processing system according to this embodiment includes a startup device 10, an information processing device 20, and a controlled device 30. The startup device 10, the information processing device 20, and the controlled device 30 are configured to communicate via wired connection. However, the startup device 10, the information processing device 20, and the controlled device 30 may also be configured to communicate via wireless communication.

[0030] User U is an employee working in an office. In the example shown in Figure 1, User U is assumed to have walked to the door of the office entrance, which includes an information processing device 20 and a controlled device 30, in order to enter the office. It is also assumed that User U has entered the detection range of the activation device 10.

[0031] The activation device 10 is a device that has the function of activating the information processing device 20 when it detects a user within the detection range. The activation device 10 may be implemented, for example, by a human presence sensor using infrared light. In the example shown in Figure 1, the activation device 10 activates the information processing device 20 when it detects user U.

[0032] The information processing device 20 starts processing when it is activated by the activation device 10. The information processing device 20 has the function of capturing a facial image of user U and measuring the intensity of user U's emotions from the facial image. In this embodiment, the information processing device 20 measures the degree of smile, which indicates how much user U is smiling, as an example of the intensity of user U's emotions. Here, as will be explained later, the degree of smile is only one example of the intensity of user U's emotions. Therefore, the degree of smile may be replaced with the intensity of other emotions (for example, positivity). Furthermore, the information processing device 20 has the function of setting a waiting time based on the measured degree of smile and performing a predetermined process when the set waiting time has elapsed. In this embodiment, the predetermined process is the process of unlocking the door lock. In the example shown in Figure 1, the information processing device 20 sets the waiting time according to user U's degree of smile, and when the waiting time has elapsed, it controls the controlled device 30 to unlock the door lock. At this time, the information processing device 20 according to this embodiment sets the waiting time so that it becomes shorter the higher user U's degree of smile is. Therefore, the higher the user U's smile level, the faster the door lock will unlock.

[0033] The controlled device 30 is a device whose operation, such as turning the power on or off, or unlocking and locking, is controlled by the information processing device 20. In the example shown in Figure 1, the controlled device 30 is an electric lock for an office entrance door, which is included in the door itself. Such a controlled device 30 may include semiconductor switching elements, such as a solid-state relay. In this case, the unlocking or locking operation of the controlled device 30 is controlled according to the signal level (High or Low) output from the information processing device 20.

[0034] (Organizing the issues) Recently, various technologies are being explored to change people's behavior for purposes such as promoting health. For example, since a healthy working environment for employees leads to increased productivity, technologies are being considered to encourage employees to take actions that contribute to their health. One example is a technology to increase opportunities to smile. If employees spend more time smiling at work, they can build better relationships with those around them, and it is also expected that their own stress levels will decrease or their immunity will improve.

[0035] Focusing on the points mentioned above, for example, Patent Document 1 discloses a system in which, when an employee's smile is detected, the door to the workplace entrance or the lock on a personal computer is unlocked, or a time card is punched.

[0036] In a system like the one described above, if the lock is not released without exception unless an employee's smile is detected, there is a concern that congestion will occur at the entrance / exit doors or time card locations. Furthermore, if an employee is unable to smile due to unavoidable reasons such as illness, the lock cannot be released, causing inconvenience. In this regard, the technology disclosed in Patent Document 1 is configured to release the lock and emit a sound effect to alert the operator if an employee's smile is not detected. The sound effect is disclosed to be some kind of word or sound that serves to remind the operator that they should smile when operating the target device. Examples of such sound effects include words such as "Good morning" and "Good work."

[0037] However, while the above configuration resolves the aforementioned concerns or inconveniences, it also allows for unlocking the device in the same way as when a smile is detected, although the aforementioned sound effect plays even when a smile is not detected. This means employees no longer see the benefit of smiling. Consequently, there is a problem in that employees' motivation to smile is reduced.

[0038] Therefore, embodiments of the present invention will primarily describe technologies that enable more effective promotion of user behavior change. More specifically, embodiments of the present invention will primarily describe technologies that enable promotion of user behavior change by enhancing emotional motivation (for example, the motivation for employees to smile).

[0039] The outline of embodiments of the present invention has been described above. Hereinafter, the functional configuration and operation of the information processing device 20 according to this embodiment will be described in detail.

[0040] <1. Example of Functional Configuration> Figure 2 is a block diagram showing an example of the functional configuration of the information processing device 20 according to this embodiment. As shown in Figure 2, the information processing device 20 includes a storage unit 210, an imaging unit 220, a measurement unit 230, a control unit 240, a display generation unit 250, a display unit 260, and a timer unit 270. When such an information processing device 20 is started by the startup device 10, it begins its operation.

[0041] The measurement unit 230, the control unit 240, and the display generation unit 250 include a computing device such as a CPU (Central Processing Unit) or a GPU (Graphics Processing Unit), and their functions can be realized by the CPU loading a program stored in memory such as ROM (Read Only Memory), a hard disk drive, or flash memory into RAM (Random Access Memory) and executing it. In this case, a computer-readable recording medium on which the program is recorded may also be provided. Alternatively, these blocks may be configured with dedicated hardware or implemented with a combination of multiple hardware components. Data necessary for calculations by the computing device is appropriately stored in the storage unit 210.

[0042] (Storage unit 210) The storage unit 210 stores programs and calculation parameters used by the measurement unit 230, the control unit 240, and the display generation unit 250. The storage unit 210 may also temporarily store programs used in the execution of the measurement unit 230, the control unit 240, and the display generation unit 250, as well as parameters that change as appropriate during their execution. Such a storage unit 210 may be composed of memory such as RAM, a hard disk drive, or flash memory.

[0043] (Imaging Unit 220) The imaging unit 220 is a camera capable of capturing moving images including the face of user U. The imaging unit 220 outputs the captured moving images to the measurement unit 230 and the display generation unit 250. The imaging unit 220 may also capture still images instead of moving images. In this case, the imaging unit 220 may output the captured still images to the measurement unit 230 and the display generation unit 250. The measurement unit 230 and the display generation unit 250 may use the still images instead of the moving images. Furthermore, since the imaging unit 220 is merely one example of a sensor for obtaining data to measure the intensity of emotion, other sensors (for example, a Doppler sensor) may be used instead of the imaging unit 220.

[0044] (Measurement unit 230) The measurement unit 230 acquires the video from the imaging unit 220 and captures a face image of user U from the video. Furthermore, the measurement unit 230 has the function of measuring the degree of smile by analyzing the captured face image. Such a measurement unit 230 has the functions of a face detection unit 231 and a smile degree measurement unit 233.

[0045] The face detection unit 231 has the function of detecting face regions from the face image. For example, the face detection unit 231 may detect face regions from the face image using a model that has learned the relationship between face images and face regions through machine learning. The face detection unit 231 outputs the detected face regions to the smile degree measurement unit 233.

[0046] The smile level measurement unit 233 has the function of measuring the degree of smiles of user U from the face region on the face image detected by the face detection unit 231. The smile level measurement unit 233 may, for example, extract facial feature points (e.g., the position of the center of the mouth, the position of the corners of the mouth, etc.) from the face region, calculate the degree to which the left and right corners of the mouth of user U are raised from the center of the mouth based on the extracted feature points, and measure the degree of smiles based on the degree to which the corners of the mouth are raised. In this embodiment, the smile level measurement unit 233 measures the degree of smiles in three stages: high, medium, and low, but the stages of the degree of smiles do not have to be limited to three stages, and may be two stages or no stages at all. The smile level measurement unit 233 outputs the measured degree of smiles to the control unit 240.

[0047] (Control unit 240) The control unit 240 has the function of controlling the overall operation of the information processing device 20. The control unit 240 also has the function of performing a predetermined process after a waiting period has elapsed from the time measurement by the timer unit 270 has started. The control unit 240 sets the waiting period according to the degree of smile measurement measured by the measurement unit 230. In this case, the control unit 240 may set the waiting period so that it becomes shorter as the degree of smile increases. The control unit 240 also controls the timer unit 270, which will be described later, to start or stop the measurement of time.

[0048] Furthermore, the control unit 240 has a function to display information corresponding to the smile level on the display unit 260. For example, the control unit 240 may display information corresponding to the waiting time set based on the smile level on the display unit 260. As an example, the information may be a gauge displaying the waiting time and the elapsed time from the start of time measurement to the present. As another example, the information may be information (for example, a numerical value) indicating the length of the waiting time, the elapsed time, or the remaining time which is the waiting time minus the elapsed time. Specific examples of the information displayed on the display unit 260 by the control unit 240 will be explained in more detail later in the operation example of this information processing system.

[0049] (Display generation unit 250) The display generation unit 250 has the function of generating screens of various information to be displayed on the display unit 260, in accordance with the control of the control unit 240. For example, the display generation unit 250 generates the display of the above-mentioned information in accordance with the control of the control unit 240. The display generation unit 250 also captures a still image from the moving image captured by the imaging unit 220 at the time of smile degree measurement by the measurement unit 230 and outputs it to the display unit 260. Alternatively, the display generation unit 250 may output the moving image directly to the display unit 260 instead of the still image, or it may output an avatar display to the display unit 260 instead of the still image.

[0050] (Display section 260) The display unit 260 has the function of displaying various information in accordance with the control unit 240. For example, the display unit 260 displays the above-mentioned presentation information and the captured face image output from the display generation unit 250 in accordance with the control unit 240. The form of the display unit 260 may be, for example, a liquid crystal display (LCD) device or an OLED (Organic Light Emitting Diode) device.

[0051] (Timer unit 270) The timer unit 270 has a function for measuring time. The timer unit 270 starts or stops measuring time according to the control unit 240. The control unit 240 causes the timer unit 270 to measure the elapsed time of a set waiting period. Such a timer unit 270 is implemented by a hardware timer. Alternatively, the timer unit 270 may be implemented by a programmable timer. Furthermore, the timer unit 270 may measure time based on the total count and count rate, as described in the modified examples below.

[0052] The functional configuration example of the information processing device 20 has been described above with reference to Figure 2. Next, an example of the operation of the information processing system according to this embodiment will be described with reference to Figure 3.

[0053] <2. Example of operation> Figure 3 is a sequence diagram illustrating an example of the operation of the information processing system according to this embodiment. First, user U approaches the activation device 10 and enters the detection range of the activation device 10 (S1). When the activation device 10 detects the approach of user U, it activates the information processing device 20 (S3).

[0054] The control unit 240 controls the display generation unit 250 and the display unit 260, causing the display unit 260 to display the information to be presented (S5). In this example, the control unit 240 causes the display unit 260 to display a guide message encouraging user U to smile. Next, the measurement unit 230 and the display generation unit 250 capture a face image from the video image of user U output from the imaging unit 220 (S7).

[0055] The face detection unit 231 detects the face region from the captured face image (S9). The information processing device 20 repeats the processing of frame F1 (S5-S9) until the face detection unit 231 detects the face region from the face image.

[0056] In the processing of S9, the face detection unit 231 may detect a face region from the face image and identify the user U included in the face image by performing image recognition. Furthermore, the face detection unit 231 may output identification information (hereinafter also referred to as "user ID") indicating the identified user U along with the detected face region to the control unit 240. Here, the method for identifying user U is not limited to a specific method. For example, if past face images and user IDs are associated and stored in the storage unit 210 for each user, the face detection unit 231 may obtain from the storage unit 210 the user ID associated with a past face image whose similarity to the detected face image is above a predetermined similarity. Alternatively, if feature quantities extracted from past face images are associated and stored in the storage unit 210 for each user, the face detection unit 231 may extract feature quantities from the detected face image and obtain from the storage unit 210 the user ID associated with a feature quantity whose similarity to the extracted feature quantities is above a predetermined similarity.

[0057] When the face detection unit 231 detects a face region from the face image, the control unit 240 sets an initial value for the waiting time (S11). The initial value for the waiting time may be, for example, the length of the waiting time set for the lowest smile level among the waiting times set according to the smile level, as described later.

[0058] Next, the control unit 240 operates the timer unit 270 and causes the timer unit 270 to start measuring the length of the set waiting time (S13). Furthermore, the control unit 240 displays information corresponding to the set waiting time on the display unit 260 (S15). In this example of operation, the control unit 240 displays a gauge on the display unit 260 that shows the ratio of elapsed time to the waiting time.

[0059] The measurement unit 230 and the display generation unit 250 capture a face image again from the video of user U output from the imaging unit 220 (S17). The face detection unit 231 detects the face region from the face image. The smile degree measurement unit 233 measures the smile degree of user U from the face region detected on the face image (S19).

[0060] The control unit 240 updates the waiting time according to the smile level measured by the measurement unit 230 (S21).

[0061] Here, with reference to Figure 4, a specific example of a waiting time set according to the degree of smile will be explained. Figure 4 is an explanatory diagram showing a specific example of a waiting time table. The control unit 240 refers to the waiting time table and sets the waiting time according to the degree of smile. The waiting time table T1 may be stored in the storage unit 210 in advance before the operation processing of the information processing device 20 starts. Alternatively, the waiting time table T1 may be set by the operator of the information processing device 20 and stored in the storage unit 210.

[0062] As shown in Figure 4, the waiting time table T1 includes smile level and waiting time. It is understood that the smile level includes three categories: low, medium, and high.

[0063] It is understood that the waiting time is 3 seconds when the smile level is low. It is also understood that the waiting time is 2 seconds when the smile level is medium, and 1 second when the smile level is high. Therefore, according to the waiting time table T1 shown in Figure 4, it is understood that the control unit 240 sets the waiting time so that the waiting time decreases as the smile level increases.

[0064] Returning to Figure 3, let's continue the explanation of the operation example of this information processing system. Next, the information processing device 20 repeats the operation of frame F2 (S13~S21) until the timer unit 270 measures that the waiting time has elapsed. In this operation example, the update interval from the time the smile level is first measured in frame F2 until the smile level is measured again is assumed to be 0.5 seconds.

[0065] Here, with reference to Figures 5 to 7, we will explain specific examples of the screens displayed on the display unit 260 and screen transitions when the operation processing of frame F2 is repeated before the waiting time elapses. Here, we will explain an example where the operation processing of frame F2 is repeated and the smile level is measured twice by the measurement unit 230 before the waiting time elapses.

[0066] First, we will explain a specific example of screen transitions when, in S19, the smile level of user U measured the first time by the measurement unit 230 is low, and the smile level of user U measured the second time is also low. Figure 5 is an explanatory diagram illustrating an example of a screen displayed on the display unit 260 and a first specific example of screen transitions in response to changes in the smile level.

[0067] Display screen D is an example of a screen displayed on the display unit 260 according to the control of the control unit 240. Measurement result tables T2 to T3 and measurement result tables T4 to T5, described later, are tables showing the smile level measured in S19 of the above operation example, the waiting time set by the control unit 240 according to the smile level in S21, and the elapsed time measured by the timer unit 270. Display screen D1 and measurement result table T2 show an example screen at an elapsed time of 0.4 seconds, the smile level that was last measured at an elapsed time of 0.4 seconds, and the waiting time updated based on that smile level, respectively. Display screen D2 and measurement result table T3 show an example screen at an elapsed time of 0.5 seconds, the smile level at the time the second smile level measurement was performed, and the waiting time set based on that smile level, respectively.

[0068] As shown in Figure 5, the display screen D includes the user U's face image, the elapsed time gauge GA, the smile level gauge GB, and the guide text M. The elapsed time gauge GA is an example of the information displayed according to the waiting time. In the example shown in Figure 5, the elapsed time gauge GA is a circular gauge that expands and contracts according to the waiting time and elapsed time set by the control unit 240.

[0069] In the example shown in Figure 5, the length of the elapsed time gauge GA corresponds to the ratio of elapsed time to the waiting time set by the control unit 240. The elapsed time gauge GA is drawn in a manner that extends in the direction indicated by arrow A as time progresses, and completes one full rotation when the waiting time has elapsed. For example, in the example shown in Figure 5, the elapsed time gauge GA1 is drawn with a length corresponding to the ratio of elapsed time (0.4 seconds) to the waiting time (3 seconds). The elapsed time gauge GA2 is drawn with a length corresponding to the ratio of elapsed time (0.5 seconds) to the waiting time (3 seconds). This display of the elapsed time gauge GA allows user U to visually understand the waiting time, elapsed time, or remaining time until the door lock is unlocked. Furthermore, user U can visually understand the speed at which the elapsed time is approaching the waiting time based on the speed at which the elapsed time gauge GA extends.

[0070] The smile level gauge GB is an example of the information displayed according to the smile level. In the example shown in Figure 5, the smile level gauge GB is a circular gauge whose length changes according to the smile level measured by the measurement unit 230. For example, the smile level at the time when display screen D1 is displayed is low, as shown in the measurement result table T2, out of three levels: high, medium, and low. Therefore, it can be understood that the smile level gauge GB1 included in display screen D1 is displayed with a length that is one-third of the circumference of the smile level gauge GB1. Also, since the smile level at the time of display screen D2 has not changed from the smile level at the time of display screen D1, it can be understood that the length of smile level gauge GB2 has not changed from the length of smile level gauge GB1. In this way, by displaying the measured smile level on the display unit 260, user U can recognize what their current smile level is.

[0071] Guide text M is an example of guide text that encourages user U to change their smile level according to their smile level. In the example of guide text M1 included in display screen D1, it is understood that text encouraging user U to smile is displayed. The text of guide text M may change according to the smile level measured by the measurement unit 230. In the example of guide text M2 included in display screen D2, it is understood that since user U's smile level remains low and unchanged from the time of display screen D1, different text from guide text M1 is displayed, encouraging user U to smile again.

[0072] Next, referring to Figure 6, we will explain a specific example of screen transitions when the smile level measured by the measurement unit 230 was low at the time of the first measurement but changed to medium at the time of the second measurement. Figure 6 is an explanatory diagram illustrating an example of a screen displayed on the display unit 260 and a second specific example of screen transitions corresponding to changes in the smile level. In Figure 6, the display screen D1, elapsed time gauge GA1, smile level gauge GB1, arrow A1, guide text M1, and measurement result table T2 are the same as those explained above with reference to Figure 5, so a detailed explanation is omitted here.

[0073] In the example shown in Figure 6, as shown in the measurement results table T4, it is understood that after 0.5 seconds, the user U's smile level was measured as medium. It is also understood that the control unit 240, in response to the change in smile level to medium, referred to the waiting time table T1 shown in Figure 4 and updated the waiting time to 2 seconds. Furthermore, it is understood that the elapsed time gauge GA3 and the smile level gauge GB3 included in the display screen D3 are also updated according to the changed smile level and the updated waiting time.

[0074] More specifically, it is understood that the elapsed time gauge GA3 changed in length to correspond to the ratio of elapsed time (0.5 seconds) to waiting time (2 seconds). Therefore, it is understood that the elapsed time gauge GA3 appears to be longer than the elapsed time gauge GA2 shown in Figure 5. Also, it is understood that the smile level gauge GB3 is displayed in length corresponding to the medium level of smile level (twice the length of the smile level gauge GB1).

[0075] Furthermore, it is understood that guide message M3, like guide message M2, displays guide message encouraging user U to show an even higher degree of smile.

[0076] As explained above, comparing display screens D2 and D3 shown in Figures 5 and 6, it can be seen that, assuming the same elapsed time, the display unit 260 displays a longer elapsed time gauge GA the higher the degree of smiling. This display allows user U to visually recognize that the higher the degree of smiling, the shorter the waiting time or the faster the waiting time passes.

[0077] Next, referring to Figure 7, we will explain a specific example of screen transitions when the smile level measured by the measurement unit 230 changes from low at the time of the first measurement to high at the time of the second measurement. Figure 7 is an explanatory diagram illustrating an example of a screen displayed on the display unit 260 and a third specific example of screen transitions corresponding to the change in smile level. In Figure 7, the display screen D1, elapsed time gauge GA1, smile level gauge GB1, arrow A1, guide text M1, and measurement result table T2 are the same as those explained above with reference to Figure 5, so a detailed explanation is omitted here.

[0078] In the example shown in Figure 7, as shown in the measurement results table T5, it was measured that user U's smile level was high after 0.5 seconds. Therefore, the control unit 240 referred to the waiting time table T1 shown in Figure 4 and updated the waiting time to 1 second. Consequently, it can be understood that the elapsed time gauge GA4 and the smile level gauge GB4 displayed on the display screen D4 also changed.

[0079] More specifically, the elapsed time gauge GA4 is displayed as a length corresponding to the ratio of elapsed time (0.5 seconds) to waiting time (1 second). Therefore, it is understood that the elapsed time gauge GA4 appears to be longer than both the elapsed time gauge GA2 shown in Figure 5 and the elapsed time gauge GA3 shown in Figure 6. Also, it is understood that the smile level gauge GB4 is displayed as a length corresponding to the "high" level of smile level among the three levels.

[0080] Furthermore, the guide text M4 displays a message praising the smile, corresponding to the measured smile level being the highest of the three levels.

[0081] The above explanation, with reference to Figures 5 to 7, describes examples of screens displayed on the display unit 260 and specific examples of screen transitions corresponding to changes in smile intensity.

[0082] Returning to Figure 3, we will continue the explanation of the operation example of the information processing system according to this embodiment. After the processing of frame F2 has started, and the set or updated waiting time has elapsed and the timer unit 270 has finished measuring the time, the process proceeds to S23.

[0083] When the timer unit 270 outputs that the waiting time measurement has finished, the control unit 240 performs a predetermined process. In this example, the control unit 240 controls the electronic lock of the controlled device 30 to be unlocked (S23). Subsequently, the electronic lock on the controlled device 30 is unlocked (S25).

[0084] When the waiting time has elapsed, the control unit 240 stores the last measured smile level of user U in the storage unit 210, associating it with the user ID and date and time information indicating the current date and time (S27). The smile level stored in the storage unit 210 can later be used as a past smile level. The past face image or feature quantity mentioned above may be one that has been registered once and may continue to be used. Alternatively, since the user's face may change over time, the past face image or feature quantity may be updated each time the smile level is measured. In this case, in S27, the control unit 240 may update the face image or feature quantity stored in the storage unit 210 in association with user U with the face image used for the current smile level measurement or a feature quantity extracted from that face image.

[0085] The operation example of the information processing system according to this embodiment has been described above with reference to Figure 3.

[0086] <3. Effects> As described above, the present invention provides a variety of effects. For example, the control unit 240 of the information processing device 20 in this embodiment sets a waiting time according to the degree of smiling measured by the measurement unit 230. When the waiting time has elapsed, the control unit 240 performs a predetermined process (unlocking the door lock). With this configuration, the waiting time until the predetermined process is performed changes according to the degree of smiling of user U. Therefore, it is possible to further increase the motivation of user U to perform the action of smiling (as an example of an action that shows a certain emotion) by using the shortening of the waiting time as an incentive. In other words, it is possible to encourage user U to take actions that contribute to the improvement of user U's health, such as increasing the amount of time spent smiling at work.

[0087] Furthermore, in this embodiment, an example was described in which a predetermined process performed by the control unit 240 is the control of unlocking the electronic lock of the controlled device 30, which is the door lock of the office entrance. In this way, by applying the present invention to a process that user U is expected to interact with frequently, user U will have many opportunities to smile. By repeating such opportunities, it is possible to encourage behavioral change in user U.

[0088] Furthermore, the control unit 240 of the information processing device 20 in this embodiment displays information corresponding to the degree of smile on the display unit 260. More specifically, the display unit 260 displays the waiting time set according to the degree of smile, and the ratio of elapsed time or remaining time to the waiting time. In addition, when the timer unit 270 detects a change in the degree of smile, the control unit 240 updates the waiting time according to the changed degree of smile. The control unit 240 also updates the above-mentioned information based on the updated waiting time and the elapsed time at the time the change in the degree of smile was detected. With this configuration, user U can visually recognize their own degree of smile and the waiting time or elapsed time that changes according to their degree of smile. Therefore, it is possible to present to user U in a clearer way the change in the length of the waiting time, or the change in the rate at which the waiting time elapses, which can serve as an incentive for user U to smile. In other words, it is expected to have the effect of further increasing user U's motivation to smile.

[0089] <4. Variation> (First variation) In the above example of operation, in S11 and S21, the control unit 240 sets and updates different lengths of time as waiting time according to the degree of smiling. Furthermore, the control unit 240 controls the timer unit 270, which has a time measurement function, to measure the elapsed time of the above waiting time. However, the control unit 240 may set the waiting time in S11 and S21 by performing the following processing.

[0090] As an example of a variation in the method for setting the waiting time, the timer unit 270 may have a function that counts at a predetermined counting speed until the total count is reached, in accordance with the control unit 240. In this case, the control unit 240 can set the waiting time by setting the total count based on the smile level.

[0091] Here, with reference to Figure 8, a specific example of the total count set according to the degree of smile in this modified example will be explained. Figure 8 is an explanatory diagram illustrating a specific example of the counter setting table referenced by the control unit 240 in the first modified example. The control unit 240 refers to the counter setting table T6 and sets the total count according to the degree of smile.

[0092] As shown in Figure 8, the counter setting table T6 associates smile level, total count, and counting speed. Note that the smile level in counter setting table T6 is identical to the smile level in the waiting time table T1, as explained with reference to Figure 4; therefore, a detailed explanation is omitted here.

[0093] The total count indicates the total count counted by the timer unit 270. In the example shown in Figure 8, it is understood that the total count is 3000 when the smile level is low. It is also understood that the total count is 2000 when the smile level is medium, and 1000 when the smile level is high. Therefore, according to the counter setting table T6 shown in Figure 8, it is understood that the control unit 240 sets the total count so that it decreases as the smile level increases.

[0094] The counting speed indicates the speed at which the timer unit 270 performs counting. In the example shown in Figure 8, the counting speed is understood to be 1000 counts per second regardless of whether the smile level is low or high. Therefore, when the smile level is low, it is understood that the time it takes for the timer unit 270 to reach the total count (3000) is 3 seconds. Similarly, when the smile level is medium, it takes 2 seconds for the timer unit 270 to reach the total count, and when the smile level is high, it takes 1 second. In other words, the control unit 240 can set the counting speed of the timer unit 270 to a fixed value regardless of the smile level, and set or update the total count of the timer unit 270 according to the smile level, thereby setting or updating the waiting time according to the smile level.

[0095] Furthermore, in this modified example, the control unit 240 makes the length of the elapsed time gauge GA, as explained with reference to Figures 5 to 7, among the information displayed on the display unit 260 in S15 of the above operation example, correspond to the ratio of the counted number to the set or updated total count. With this configuration, in this modified example as well, the control unit 240 can display information on the display unit 260 according to the degree of smile or the waiting time.

[0096] (Second variation) As another example of how to set the waiting time, the control unit 240 may set or update the waiting time by setting the counting speed of the timer unit 270 based on the degree of smile. Figure 9 is an explanatory diagram illustrating a specific example of the counter setting table that the control unit 240 refers to in the second modified example. The control unit 240 refers to the counter setting table T7 and sets the counting speed according to the degree of smile.

[0097] As shown in Figure 9, in counter setting table T7, the degree of smile, total count, and counting speed are associated, similar to counter setting table T6 shown in Figure 8. The content of the degree of smile is the same as in counter setting table T6.

[0098] In the counter setting table T7, it is understood that the total count is 3000 regardless of whether the smile level is low or high. On the other hand, it is understood that the counting speed is 1000 counts per second when the smile level is low, 1500 counts per second when the smile level is medium, and 3000 counts per second when the smile level is high. Therefore, according to the counter setting table T7, it is understood that the control unit 240 sets the counting speed so that it increases as the smile level increases.

[0099] Thus, the control unit 240 can set or update the waiting time according to the degree of smile by setting the total count count by the timer unit 270 to a fixed value regardless of the degree of smile, and by setting or updating the counting speed of the timer unit 270 according to the degree of smile.

[0100] (Third variation) Furthermore, in the above embodiment, the control unit 240 sets and updates the waiting time based on the degree of smile measurement taken from the facial image captured from the moving image of user U captured by the imaging unit 220. However, the present invention is not limited to this example. If the control unit 240 obtains the past degree of smile of user U measured by the measurement unit 230, it may set the waiting time based on the obtained past degree of smile.

[0101] More specifically, the control unit 240 refers to the user U's past smile level by referring to the user U's smile level, user ID, and date and time information stored in the storage unit 210 in S27 of the operation example described above.

[0102] Figure 10 is an explanatory diagram illustrating a specific example of a past information table stored in the memory unit 210. The past information table T8 shown in Figure 10 associates the user ID, smile level, and recording date and time.

[0103] A user ID is an example of identification information that uniquely identifies user U. In the example shown in Figure 10, the user ID includes 001, 002, and 003.

[0104] Furthermore, in the example shown in Figure 10, it can be seen that user ID 001 has a high level of smile. Similarly, it can be seen that user IDs 002 and 003 have a medium level of smile.

[0105] The recording date and time is date and time information that indicates the time when the user ID and smile level records were recorded in the past information table T8 by the control unit 240.

[0106] In step S9 of the operation example described above, the user ID of user U, identified by the face detection unit 231 using image recognition, is output to the control unit 240. Furthermore, in this modified example, the control unit 240 checks the past information table T8 stored in the storage unit 210 to see whether or not a smile score associated with that user ID is stored there, based on the output user ID.

[0107] Next, if the memory unit 210 has stored past smile scores associated with the user ID, the control unit 240 retrieves the past smile scores and sets the waiting time in S11 based on the retrieved past smile scores.

[0108] At this time, there are several possible methods for the control unit 240 to set the waiting time based on past smile levels. For example, in S11, the control unit 240 may obtain past smile levels of user U stored in the memory unit 210 that are associated with the recording date and time on the same day as the current date and time. If the control unit 240 obtains past smile levels associated with the recording date and time on the same day as the current date and time, and the obtained past smile levels exceed a certain intensity, it may set the waiting time to 0. More specifically, for example, the control unit 240 sets the waiting time to 0 if the past smile levels are medium or higher. That is, if, at the time of the waiting time setting process, user U's smile level has already been measured on the same day and that smile level is medium or higher, the control unit 240 immediately unlocks the door.

[0109] With this configuration, if the measurement unit 230 measures that user U has made a smile of a certain intensity or higher at least once a day, user U can enter the office without waiting for the waiting time to elapse before the door lock is released. Therefore, this modification can further increase the motivation for user U to make a smile.

[0110] (Fourth variation) Alternatively, as another example of how to set the waiting time based on past smile levels, the control unit 240 may set the waiting time corresponding to past smile levels as the initial value of the waiting time. Furthermore, in the process of updating the waiting time, the control unit 240 may update the waiting time based on the smile level measured by the measurement unit 230 this time, rather than past smile levels. With this configuration, the initial value of the waiting time will be set based on past smile levels. Therefore, for user U, making a smile with a high smile level each time will shorten the initial value of the waiting time next time. Thus, this modified example can increase the motivation for user U to continuously make smiles with a high smile level.

[0111] (Fifth variation) Alternatively, as another example of how to set the waiting time based on past smile levels, the control unit 240 may, if past smile levels are of a certain intensity (e.g., high), set and update the waiting time to a value obtained by subtracting a certain amount of time from the waiting time corresponding to the currently measured smile level. More specifically, for example, if past smile levels are high, the control unit 240 may set and update the length of the waiting time corresponding to the currently measured smile level to be 0.5 seconds shorter than the length of time defined in the waiting time table. Furthermore, the control unit 240 may change the length of time shortened according to past smile levels. In this way, shortening the waiting time by a certain amount of time according to past smile levels can motivate user U to produce smiles with the highest possible smile level. Therefore, it is possible to increase user U's motivation to continuously produce smiles with high smile levels.

[0112] (Sixth variation) Furthermore, as another example of how to set the waiting time based on past smile levels, the control unit 240 may compare past smile levels with the smile level measured this time and set and update the waiting time based on the higher smile level.

[0113] <5. Hardware Configuration Example> An embodiment of the present invention has been described above. The processes performed by the information processing device 20, including measuring the degree of smile from a facial image, setting and updating the waiting time according to the measured intensity of emotion, and displaying the presented information according to the intensity of emotion, are realized through the cooperation of software and the hardware of the information processing device 20. Below, an example of the hardware configuration of the information processing device 20 according to an embodiment of the present invention will be described.

[0114] The hardware configuration example of the information processing device 20 described below is merely one example of a hardware configuration for the information processing device 20. Therefore, the hardware configuration of the information processing device 20 may be modified by removing unnecessary components from the hardware configuration of the information processing device 20 described below, or by adding new components.

[0115] Figure 11 shows an example of the hardware configuration of an information processing device 20 according to one embodiment of the present invention. The information processing device 20 may include a CPU 1001, a ROM 1002, a RAM 1003, an internal bus 1004, an input / output interface 1010, a display device 1011, an input device 1012, an audio output unit 1013, a storage device 1014, a drive 1015, a network interface 1016, and an external interface 1017.

[0116] The CPU 1001 functions as both an arithmetic processing unit and a control unit, controlling the overall operation of the information processing unit 20 according to various programs. By working in cooperation with the ROM 1002, RAM 1003, and software described later, the CPU 1001 can realize functions such as those of the measurement unit 230, the control unit 240, and the display generation unit 250.

[0117] ROM1002 stores the programs and calculation parameters used by CPU1001. RAM1003 temporarily stores the programs used in the execution of CPU1001, as well as parameters that change as appropriate during its execution.

[0118] The CPU 1001, ROM 1002, and RAM 1003 are interconnected by an internal bus 1004, and are further connected to the display device 1011, input device 1012, audio output unit 1013, storage device 1014, drive 1015, network interface 1016, and external interface 1017, which will be described later, via an input / output interface 1010.

[0119] The display device 1011 is, for example, a display device such as a CRT display, a liquid crystal display (LCD), or an OLED display, and converts video data into video and outputs it. The input device 1012 may consist of a mouse, keyboard, touch panel, buttons, microphone, sensor, switch, and control circuit. The audio output unit 1013 is an audio output device such as a speaker or headphones, and converts audio data into audio and outputs it.

[0120] The storage device 1014 is a data storage device configured as an example of the storage unit 210 according to this embodiment. The storage device 1014 may include a storage medium, a recording device for recording data on the storage medium, a reading device for reading data from the storage medium, and a deletion device for deleting data recorded on the storage medium. The storage device 1014 is composed of, for example, an HDD (Hard Disk Drive) or an SSD (Solid State Drive), or a memory having equivalent functionality. This storage device 1014 drives the storage and stores programs or various data executed by the CPU 1001.

[0121] Drive 1015 is a reader / writer for storage media and is either built into or external to the information processing unit 20. Drive 1015 reads information stored on removable storage media such as magnetic disks, optical disks, magneto-optical disks, or semiconductor memory and outputs it to RAM 1003. Drive 1015 can also write information to removable storage media.

[0122] The network interface 1016 is a communication interface composed of devices such as those used to connect to a communication network, such as the Internet. The network interface 1016 may also be a wireless LAN (Local Area Network) compatible communication device or a wired LAN communication device.

[0123] The external interface 1017 is a connection interface consisting of connection ports for connecting external devices, such as a USB (Universal Serial Bus) port, an IEEE 1394 port, a SCSI (Small Computer System Interface) port, an RS-232C port, or an optical audio terminal.

[0124] <6. Summary> Although preferred embodiments of the present invention have been described in detail above with reference to the attached drawings, the present invention is not limited to these examples. It is clear to any person with ordinary skill in the art to which the present invention belongs that various modifications or alterations can be conceived within the scope of the technical idea described in the claims, and these are also understood to fall within the technical scope of the present invention.

[0125] For example, in the above embodiment, an example was described in which the controlled object 30 is an electronic lock included in the door of an office entrance. Furthermore, it was assumed that the predetermined process performed by the information processing device 20 after a waiting time has elapsed is the process of causing the controlled object 30 to unlock the electronic lock. However, the present invention is not limited to such examples. For example, the controlled object 30 may be a personal computer. In this case, the predetermined process may be a control to unlock the screen lock of the controlled object 30, a control to log in a user to the OS running within the controlled object 30, or a process to start up the controlled object 30. Alternatively, the controlled object 30 may be an attendance management device (a so-called time card) for recording employee working hours. In this case, the predetermined process may be the time card being stamped. Furthermore, the controlled object 30 may be a robot such as an autonomous mobile device equipped with AI (Artificial Intelligence) installed in an office. The robot may be, for example, a communication robot or service robot installed in an office that responds to employees when spoken to and answers questions, or speaks to employees by voice output. In this case, the predetermined process may be a control that terminates a conversation initiated by a communication robot speaking to an employee.

[0126] Furthermore, in the above embodiment, an example was described in which the control unit 240 sets the waiting time so that it becomes shorter as the intensity of emotion increases. However, the present invention is not limited to such examples. For example, it is also possible to change the relationship between the intensity of emotion and the length of the waiting time depending on what kind of predetermined process is performed after the waiting time has elapsed by the control unit 240. For example, it is conceivable that a longer time until the predetermined process is performed may increase the emotional motivation of the user. More specifically, consider a cleaning robot in which the user inputs instructions to start cleaning by speaking into a camera and microphone. In this case, the cleaning robot may set the time from the start of the cleaning operation to the completion of the process to be longer, depending on the degree of the user's smile when inputting the instructions. Such a configuration can also increase the emotional motivation of the user.

[0127] Furthermore, in the above embodiment, an example configuration was described in which each component of the information processing device 20 (storage unit 210, imaging unit 220, measurement unit 230, control unit 240, display generation unit 250, display unit 260, and timer unit 270) is implemented on the same device. However, the present invention is not limited to such an example. For example, each component of the information processing device 20 may be implemented by a combination of multiple devices. Moreover, all or part of each component of the information processing device 20 may be implemented on a cloud server or virtual machine.

[0128] Furthermore, the effects described herein are merely descriptive or illustrative and not limiting. In other words, the technology according to the present invention may produce other effects that will be apparent to those skilled in the art from the description herein, in addition to or instead of the effects described above.

[0129] Furthermore, the steps in the operation of the information processing device 20 according to this embodiment do not necessarily have to be processed chronologically in the order shown in the flowchart. For example, each step in the operation of the information processing device 20 may be processed in an order different from the order shown in the flowchart, or may be processed in parallel.

[0130] Furthermore, it is possible to create one or more programs that enable the CPU, ROM, RAM, and other hardware built into the computer to perform functions equivalent to those of the information processing device 20 described above. [Explanation of Symbols]

[0131] 10 Starting device 20 Information Processing Devices 210 Storage section 220 Imaging Department 230 Measurement Unit 231 Face detection unit 233 Smile level measurement unit 240 Control Unit 250 Display generation section 260 Display 270 Timer section 30 Controlled device

Claims

1. A control unit that performs unlocking when a waiting period has elapsed since the timer unit started measuring time, A control unit measures the degree of smile on the user's face, and based on this degree of smile, sets the waiting time so that the higher the degree of smile, the shorter the waiting time. The control unit then displays information on the display unit corresponding to the waiting time and the elapsed time from the start of the measurement to the present. An information processing device equipped with the following features.

2. The information provided includes information indicating the ratio of the elapsed time or the remaining time (the waiting time minus the elapsed time) to the waiting time. The information processing apparatus according to claim 1.

3. The presented information includes guide text that prompts the user to change their smile level according to the degree of smile, The information processing apparatus according to claim 1.

4. The control unit sets the waiting time by setting the total number of counts counted at a predetermined counting rate by the timer unit based on the smile level. The information processing apparatus according to claim 1.

5. The control unit sets the waiting time by setting the counting speed at which the total count is counted by the timer unit based on the smile level. The information processing apparatus according to claim 1.

6. After setting the waiting time, the control unit updates the waiting time according to the changed smile level when the measurement unit detects a change in the smile level. The information processing apparatus according to claim 1.

7. The control unit updates the displayed information based on the updated waiting time and the elapsed time from the start of the measurement to the time when the change was detected. The information processing apparatus according to claim 6.

8. The control unit, The waiting time is updated by updating the total count, which is counted at a predetermined counting speed by the timer unit, according to the changed degree of smile. The information processing apparatus according to claim 6.

9. The control unit, The waiting time is updated by updating the counting speed at which the total count is counted by the timer unit according to the changed degree of smile. The information processing apparatus according to claim 6.

10. When the control unit obtains the user's past smile level measured by the measurement unit, it sets the waiting time based on the obtained past smile level. The information processing apparatus according to claim 1.

11. The measurement unit acquires the face image from the imaging unit that captures the user's face image, By analyzing the aforementioned facial image, the degree of smile is measured. The information processing apparatus according to claim 1.

12. The aforementioned measuring unit is The facial region is detected from the aforementioned facial image, and the degree of smile is measured from the aforementioned facial region. The information processing apparatus according to claim 11.

13. The unlocking process will be performed after the waiting period has elapsed since the timer unit started measuring time. The system measures the degree of smile on the user's face, and based on this degree of smile, it sets the waiting time so that the higher the degree of smile, the shorter the waiting time. It also displays information on the display unit corresponding to the waiting time and the elapsed time from the start of the measurement to the present. A computer-based information processing method, including [a specific example].

14. Computers, A control unit that performs unlocking when a waiting period has elapsed since the timer unit started measuring time, A control unit measures the degree of smile on the user's face, and based on this degree of smile, sets the waiting time so that the higher the degree of smile, the shorter the waiting time. The control unit then displays information on the display unit corresponding to the waiting time and the elapsed time from the start of the measurement to the present. A program designed to function as such.

Images