Behavioral Support System
The behavior support system uses detection and projection devices to adjust lighting based on user activity, addressing the stress of direct instructions by encouraging spontaneous engagement in activities.
Patent Information
- Application Number
- JP2023064776
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2023-04-12
- Publication Date
- 2024-12-06
- Estimated Expiration
- 2041-07-21
AI Technical Summary
Existing behavior management support systems directly instruct users, leading to a sense of obligation and stress.
A behavior support system that includes detection devices, projection devices, and control devices to indirectly prompt users through image display and lighting adjustments based on user activity, such as changing lighting color and brightness to match the user's pace.
Encourages users to engage in spontaneous activities without direct instruction, improving motivation and comfort during activities like walking, eating, and exercising.
Smart Images

Figure 0007595693000001 
Figure 0007595693000002 
Figure 0007595693000003
Abstract
Description
[Technical field]
[0001] The present disclosure relates to an action support system that supports a user's action. [Background technology]
[0002] In recent years, there has been an increasing demand for maintaining and improving health. In response, various methods have been disclosed for realizing the maintenance and improvement of health by encouraging users to engage in specific activities in daily life, such as exercise or sleep. Patent Document 1 discloses a system for managing and supporting a user's behavior by notifying the user of a message encouraging the user to exercise, using bioinformation detected by a sensor attached to the user's body and information related to the user's behavior. [Prior art documents] [Patent documents]
[0003] [Patent Document 1] JP 2004-318503 A Summary of the Invention [Problem to be solved by the invention]
[0004] However, the behavior management support system disclosed in Patent Document 1 notifies the user of a message that includes direct instructions, which may cause some users to feel a sense of obligation and stress as a result.
[0005] The present disclosure has been made to solve the above-mentioned problems, and provides an action support system that can encourage users to take voluntary action. [Means for solving the problem]
[0006] The action support system according to the present disclosure is an action support system that supports a user's activity, and includes a detection device that detects the user's state, a projection device that displays or illuminates an image, and a control device that controls the projection device to display or illuminate an image related to an action item defined in accordance with the activity to be supported based on the result detected by the detection device, and when the action item is eating, the control device analyzes the eating pace from the result detected by the detection device, and controls the projection device to change the color or brightness of the lighting in accordance with the eating pace. If the eating pace of the user is faster than a threshold, the projection device is controlled so that the illuminance and color temperature of the lighting fluctuate. . Effect of the Invention
[0007] The action support system of the present disclosure displays an image or illuminates the screen when the action item is eating, based on the result of detection by the detection device. This makes it possible to indirectly encourage the user to perform a specific activity without directly instructing the user to do so. This makes it possible to encourage the user to be more spontaneous in their activities. [Brief description of the drawings]
[0008] [Figure 1] 1 is a schematic configuration diagram showing a behavior support system 1 according to a first embodiment. [Diagram 2] FIG. 1 is a diagram for explaining a behavior support system 1 according to a first embodiment. [Diagram 3] FIG. 1 is a diagram for explaining a behavior support system 1 according to a first embodiment. [Figure 4] FIG. 1 is a diagram for explaining a behavior support system 1 according to a first embodiment. [Diagram 5] 5 is a flowchart showing an operation of the control device 13 according to the first embodiment. [Figure 6] FIG. 1 is a diagram for explaining a behavior support system 1 according to a first embodiment. [Figure 7] FIG. 1 is a diagram for explaining a behavior support system 1 according to a first embodiment. [Figure 8] FIG. 1 is a diagram for explaining a behavior support system 1 according to a first embodiment. [Figure 9]FIG. 11 is a functional block diagram showing a behavior support system 1A according to a second embodiment. [Figure 10] 10 is a flowchart showing the operation of a control device 13 according to the second embodiment. [Figure 11] FIG. 11 is a functional block diagram showing a behavior support system 1B according to a third embodiment. [Figure 12] FIG. 11 is a diagram for explaining a second output section 51 according to the third embodiment. [Figure 13] FIG. 13 is a diagram showing an evaluation image G5 displayed by the projector 12a according to the third embodiment. [Figure 14] FIG. 13 is a diagram showing an evaluation image G6 displayed by the projector 12a according to the third embodiment. [Figure 15] FIG. 13 is a diagram showing an evaluation image G7 displayed by the projector 12a according to the third embodiment. [Figure 16] FIG. 13 is a diagram showing an evaluation image G8 displayed by the projector 12a according to the third embodiment. [Figure 17] 13 is a flowchart showing the operation of a control device 13 according to the third embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0009] Embodiment 1 The action support system 1 of the first embodiment will be described with reference to the drawings. The action support system 1 is installed in, for example, a facility for elderly people. In this case, elderly people staying at the facility correspond to users of the action support system 1. The action support system 1 supports the user to perform activities defined as action items. The action items are activities performed in the daily life of a user staying at the facility classified as items, and are, for example, walking, exercise, climbing stairs, eating, conversation, hobbies, bathing, getting up, and going to bed. In other words, the action items are defined corresponding to the activities to be supported. The action support system 1 supports the user to perform at least one activity defined as an action item according to the type of the facility, etc.
[0010] Fig. 1 is a schematic configuration diagram showing an action support system 1 according to embodiment 1. As shown in Fig. 1, the action support system 1 has a detection device 11, a projection device 12, and a control device 13. The control device 13 is connected to the detection device 11 and the projection device 12 so as to be able to communicate with each other via wire or wirelessly.
[0011] The detection device 11 is a general term for a device that detects the presence or state of a user, such as an action. As the detection device 11, various devices such as a beacon, a motion detection device, an infrared sensor, a sound sensor, and a sleep sensor are adopted. The detection devices 11 are installed at multiple locations within the facility according to the activities defined as the action items. The specific devices adopted as the detection device 11 and the locations where they are installed are determined based on the type of the action item and the aspect of each action item. Details of the specific devices will be described later for each action item.
[0012] The projection device 12 is a general term for a device that projects an image or light, that is, displays an image or provides illumination. Various devices such as a projector, a display, and a lighting device are used as the projection device 12. The projection device 12 is installed at multiple locations within the facility according to the activities defined as the action items. The specific device that is used as the projection device 12 and the location where it is installed are determined based on the type of the action item and the aspect of each action item. Details of the specific devices will be described later together with the explanation of the detection device 11 for each action item.
[0013] The control device 13 is, for example, a server device having a CPU (Central Processing Unit, also called a central processing unit, processing device, arithmetic device, microprocessor, or processor). The control device 13 is installed in a room in a facility or outside the facility. The control device 13 centrally manages and controls the detection device 11 and the projection device 12. In detail, the control device 13 controls the projection device 12 so as to display or illuminate an image related to an action item based on the result detected by the detection device 11. In addition, the control device 13 controls the projection device 12 based on the result detected by the detection device 11 when the user is performing an activity defined as an action item. In other words, the control device 13 changes the specific content of the image or the lighting method according to the action performed by the user. Note that the lighting method here means the lighting mode determined by the setting contents of dimming and color adjustment, the direction of the lighting, etc.
[0014] The control device 13 has a control unit and a storage unit 22. Each function of the control unit is realized by software, firmware, or a combination of software and firmware. The software and firmware are written as programs and stored in the storage unit 22.
[0015] The control unit has a type determination unit 31, an analysis unit 32, and a first output unit 33. The type determination unit 31 determines the type of the action item that the user is about to perform based on the detection result of the detection device 11. That is, the type determination unit 31 determines which action item the user's activity corresponds to among multiple pre-set action items based on the detection result of the detection device 11. Note that, if only one action item is set, the type determination unit 31 determines whether the user's activity corresponds to the action item. After the action item is determined, the analysis unit 32 analyzes the detection result of the detection device 11 and measures the user's actions and the surrounding environment, etc. Since the method of analyzing the user's actions and the surrounding environment, etc. is a well-known video analysis method, the explanation is omitted. The first output unit 33 generates video data or a lighting control signal to be displayed on the projection device 12 based on the measurement result of the analysis unit 32, and outputs it to the projection device 12. Note that the video data is data for output that determines the content of a specific video. In addition, the specific operation of the control unit is determined based on the mode of each action item. The specific operation of the control unit will be described later together with the description of the detection device 11 and the projection device 12 for each action item.
[0016] The storage unit 22 is, for example, a non-volatile or volatile semiconductor memory such as RAM, ROM, flash memory, EPROM, or EEPROM. The storage unit 22 stores information determined at the time of installation of the action support system 1, such as the type of equipment of the detection device 11 and the projection device 12 and the installation location. The storage unit 22 also stores cumulatively information communicated during operation of the action support system 1, such as the detection results of the user's actions and the surrounding environment received from the detection device 11, and the operating states of the detection device 11 and the projection device 12. The storage unit 22 also stores a user table, etc., in which the user's physical characteristics and the types of action items set by the user or administrator to perform support are stored in correspondence with a user ID for identifying the user. Among the information stored in the storage unit 22, information specific to each action item will be described later together with the explanation of the operation of the detection device 11, the projection device 12, and the control unit for each action item.
[0017] The management terminal 14 is connected to the control device 13 by wire or wirelessly so as to be able to communicate with it. The management terminal 14 is, for example, a general-purpose PC (Personal Computer) installed in a management room or the like in the facility, or a smartphone or a dedicated terminal equipped with a CPU carried by a manager or the like of the facility. The management terminal 14 is used by a user to manage or control the behavior acquisition device and the projection device 12 via the control device 13. For example, the manager or the like can specify the behavior items stored in the user table via the management terminal 14 regardless of the detection result of the detection device 11. The manager or the like may also set the specification of the behavior items to be scheduled.
[0018] (Control by action item) In the following, the aspects of the action support system 1 corresponding to specific action items will be described. First, the action support system 1 will be described in detail in the case where the type of action items supported by the action support system 1 includes a walk. FIG. 2 is a diagram for explaining the action support system 1 according to the first embodiment. As shown in FIG. 2, the action support system 1 has a control device 13, a beacon tag 11a, a receiver 11b, a moving object detection device 11c, a projector 12a, and a lighting device 12b when the action items to be supported include a walk. The control device 13, the receiver 11b, the moving object detection device 11c, the projector 12a, and the lighting device 12b are connected to each other so as to be able to communicate with each other, for example, via the Web or a dedicated communication network. When the action items to be supported include a walk, the action support system 1 aims to make the user feel comfortable while taking a walk, improve motivation for taking a walk, and assist walking.
[0019] The beacon tag 11a is worn by a user (person P1 in FIG. 2). The beacon tag 11a transmits a wireless signal such as Bluetooth (registered trademark) to the receiver 11b. The signal sent from the beacon tag 11a to the receiver 11b includes ID information for identifying the user who wears the beacon tag 11a.
[0020] The receiver 11b is attached to the ceiling or the like of a corridor C of the facility. The corridor C is an example of a place in the facility that is set in advance in the user table as a walking place when the user takes a walk. The receiver 11b detects that a user identified by the ID information received from the beacon tag 11a is present within the detection range. The receiver 11b transmits a detection signal to the control device 13 indicating that the user is present within the detection range and including the ID information of the detected user. The receiver 11b transmits a detection signal to the control device 13 at a constant cycle while detecting that the user is present within the detection range. The receiver 11b is an example of a detection device 11 that operates together with the beacon tag 11a.
[0021] The moving object detection device 11c records video while detecting a moving object, which is a user, in the corridor C, and transmits the recorded video to the control device 13. Specifically, for example, the moving object detection device 11c detects a moving object when the amount of information increases when the corridor C is photographed for a certain period of time, starts recording, and transmits the recorded video to the control device 13. Also, for example, the moving object detection device 11c may be configured with an infrared sensor and a video camera, and when it detects a heat source emitting infrared rays, it may detect a moving object, which is a user, in the corridor C and transmit the recorded video to the control device 13. The moving object detection device 11c is an example of the detection device 11.
[0022] The storage unit 22 stores information for generating image data to be projected, such as images of scenery and images of walking routes, which will be described later.
[0023] When the determination conditions are met, the type determination unit 31 of the control device 13 determines that the action item for starting support is walking. The determination conditions are, for example, the following two conditions. The first condition is that a detection signal of a user who has set walking as the support target is received from the receiver 11b installed in the corridor C. The second condition is that recorded video is received from the moving object detection device 11c. Note that these conditions may be AND conditions or OR conditions (the same applies to other action items below).
[0024] Furthermore, the type determination unit 31 completes the walking support when a completion condition is satisfied after the determination condition is satisfied. The completion condition is, for example, that a predetermined time has elapsed without receiving a detection signal of a user who has set walking as a support target from the receiver 11b installed in the corridor C.
[0025] After the behavior items are determined, the analysis unit 32 continuously analyzes the user's body parts and movements based on the recorded video received from the moving object detection device 11c. A specific body part is the position of the feet. Specific user movements are walking posture, walking speed, stride length, etc. The stride length may be calculated by measuring the foot position. The stride length may be calculated by multiplying the user's height by a value of 0.45 to 0.50.
[0026] The first output unit 33 of the control device 13 generates video data based on the measurement results of the analysis unit 32, and outputs it to the projector 12a. The video data is output data corresponding to the image to be displayed. The projector 12a displays the video data output from the first output unit 33 as an image G on a wall surface, a floor surface, or the like. The projector 12a is an example of the projection device 12, and is attached to a wall or ceiling of the corridor C, or the like.
[0027] The first output unit 33 of the control device 13 generates a lighting control signal based on the measurement result of the analysis unit 32, and outputs the signal to the lighting device 12b. The lighting control signal is a signal including information indicating a lighting method to be operated by the lighting device 12b. Upon receiving the lighting control signal, the lighting device 12b performs the lighting method indicated by the lighting control signal. The lighting device 12b is an example of the projection device 12. The lighting device 12b is, for example, a spotlight that uses an LED (Light Emitting Diode), and is attached to a wall or ceiling of the corridor C.
[0028] The first output unit 33 outputs video data or a lighting control signal to the projector 12a or the lighting device 12b so as to perform at least one of the following four types of video display or lighting. The type of display content to be displayed is determined in advance by the user or administrator.
[0029] As a first type, the first output unit 33 uses the projector 12a to display a landscape image during hiking or the like. The landscape image is, for example, an image of a predetermined length, in which the landscape changes as the user walks. The first output unit 33 changes the landscape image stored in the storage unit 22 according to the user's walking motion and displays it on the projector 12a. Specifically, when the user walks, the landscape image is played back frame by frame by an amount corresponding to the stride length so that the user can feel that he or she has moved forward by the stride length. This makes the user feel comfortable walking, and improves motivation for walking.
[0030] As the second type, the first output unit 33 displays a walking route by the projector 12a. FIG. 3 is a diagram for explaining the action support system 1 according to the first embodiment. FIG. 4 is a diagram for explaining the action support system 1 according to the first embodiment. FIG. 3 and FIG. 4 show a case where the action item is a walk. FIG. 4 is a diagram for explaining a case where the action item is a walk in the action support system 1 according to the first embodiment. As shown in FIG. 3, the first output unit 33 displays a walking route T on the front side of the person P1 based on the posture and foot position of the user. The walking route is a route on the corridor C, and is set in advance according to the installation direction of the projector 12a. Also, as shown in FIG. 4, the first output unit 33 deletes the walking route on which the user has already finished walking from the video data so as to output only the walking route T on the front side of the person P1 based on the posture and foot position of the user. This makes it possible to assist the user's walking.
[0031] As a third type, the first output unit 33 displays a walking mark by the lighting device 12b. The walking mark indicates the position where the next stepping foot should be placed. In FIG. 2, the walking mark is shown as a walking mark L1. The first output unit 33 displays the walking mark according to the foot position, walking speed, stride length, and the like. Specifically, when the left foot is forward, the walking mark of the right foot is displayed earlier than the right foot moves forward. Similarly, when the right foot is forward, the walking mark of the left foot is displayed earlier than the left foot moves forward. The timing for displaying the walking mark is, for example, immediately after the walking mark of one foot touches the ground with the other foot. The display position of the walking mark is, for example, a position at a distance of the stride length of the target foot on the walking path described above. This makes it possible to assist the user in walking. In addition, the walking marks of the right foot and the left foot may be moved seamlessly, respectively, taking into account the walking speed. As an example, immediately after the left foot lands, the circular pattern or footprint pattern may be moved at the walking speed on each of the left and right walking paths while maintaining the shape of the pattern from the tip of the right foot to the stride. In this way, the user can be assisted in walking at an appropriate walking speed. In addition, the walking mark may be formed into a specific shape, such as a specific symbol or footprint, by installing a light-shielding sheet on which a specific graphic pattern is formed on the emission side of the lighting device 12b.
[0032] As a fourth type, the first output unit 33 displays a gaze mark by the lighting device 12b. The gaze mark is a mark that guides the user's gaze. In FIG. 2, the gaze mark is shown as gaze mark L2. The first output unit 33 displays the gaze mark away from the feet based on the user's posture and foot position. The gaze mark may have a shape such as a circle, and may be displayed brightly to attract the user's attention. In addition, the first output unit 33 causes the display position of the gaze mark to follow the user's walking. This makes it possible to guide the user's gaze away from the feet, and to encourage improvement in walking posture.
[0033] Note that a display may be used instead of the projector 12a. The walking route may be displayed using the lighting device 12b. When the walking route is displayed using the lighting device 12b, for example, the lighting devices 12b may be scattered in the corridor C and turned on only at positions corresponding to the walking route ahead. The walking marks and the gaze marks may be displayed using the projector 12a. In this case, the walking marks may be in the shape of footprints, for example.
[0034] 2 illustrates a corridor C having a ceiling, it may be an open space without a ceiling or a part of a wall. The receiver 11b, the motion detector 11c, the projector 12a, and the lighting device 12b may be installed at any position by the manager or the like as long as they can function properly.
[0035] Fig. 5 is a flowchart showing the operation of the control device 13 according to the first embodiment. The operation of the control device 13 will be described with reference to Fig. 5. First, the type determination unit 31 judges whether or not a determination condition is satisfied (S1). If the determination condition is not satisfied (S1: NO), the control device 13 waits until the determination condition is satisfied. If the determination condition is satisfied (S1: YES), the type determination unit 31 determines a walk as the action item for starting support (S2).
[0036] Next, the analysis unit 32 analyzes the recorded video received from the moving object detection device 11c and measures the user's body parts and movements (S3). Next, the first output unit 33 generates video data or a lighting control signal based on the measurement results of the analysis unit 32 (S4) and causes the projection device 12 to display the video or provide lighting (S5).
[0037] Then, the type determination unit 31 judges whether or not the completion condition is satisfied (S6). If the completion condition is not satisfied (S6: NO), the control device 13 continues the control of S3 to S5 until the completion condition is satisfied. If the completion condition is satisfied (S6: YES), the control device 13 completes the control when a walk is being performed as the action item.
[0038] In this way, the action support system 1 can make the walk feel comfortable based on the results of detection by the detection device 11, improve motivation for the walk, and provide walking assistance.
[0039] In particular, since the content of the video and the lighting method change in accordance with the user's walk, the user can experience the sensation that the content of the video and the lighting method are linked to his or her own movements, which further encourages the user to engage in spontaneous activity.
[0040] The action support system 1 will be described in detail for a case where stair climbing is included in the types of action items supported by the action support system 1. The action support system 1 has a control device 13, a beacon tag 11a, a receiver 11b, a motion detection device 11c, a projector 12a, and a lighting device 12b. When stair climbing is included in the types of action items supported by the action support system 1, the action support system 1 aims to improve motivation for stair climbing and to provide assistance for stair climbing.
[0041] Each device of the action support system 1 is the same as that of the action support system 1 when supporting stair climbing and descending, and therefore description thereof will be omitted. However, the receiver 11b, the moving object detection device 11c, the projector 12a, and the lighting device 12b are attached, for example, to a wall or ceiling near the stairs in the facility. The stairs are an example of a place that is set in advance by the user as a place for climbing and descending the stairs. Note that step climbing and descending may be regarded as an activity equivalent to stair climbing and descending, and the place where the step climbing and descending is performed may be set as the place where the stair climbing and descending is performed.
[0042] When the determination conditions are met, the type determination unit 31 of the control device 13 determines that the action item for starting support is climbing up and down stairs. The determination conditions are, for example, the following two conditions. The first condition is that a detection signal of a user who has set climbing up and down stairs as a support target is received from the receiver 11b installed near the stairs. The second condition is that a recorded video is received from the moving object detection device 11c.
[0043] Furthermore, when a completion condition is satisfied after the determination condition is satisfied, the type determination unit 31 completes the assistance for ascending and descending stairs. The completion condition is, for example, that a predetermined time has elapsed without receiving a detection signal of a user who has set ascending and descending stairs as an assistance target from the receiver 11b installed near the stairs.
[0044] After the behavior items are determined, the analysis unit 32 continuously analyzes the video received from the moving object detection device 11c, and continuously measures the user's body parts and movements. Specific body parts are the feet. Specific user movements include the up-down posture and up-down speed.
[0045] The first output unit 33 generates video data based on the measurement result of the analysis unit 32 and outputs it to the projector 12a. The first output unit 33 of the control device 13 generates a lighting control signal based on the measurement result of the analysis unit 32 and outputs it to the lighting device 12b. The first output unit 33 outputs the video data or lighting control signal to the projector 12a or the lighting device 12b so as to display or illuminate at least one of the following two types of video:
[0046] As a first type, the first output unit 33 causes the projector 12a to display, for example, a landscape image during mountain climbing. The landscape image is, for example, a video of a predetermined length, in which the gradual change of the landscape is recorded. This can improve motivation for climbing up and down stairs.
[0047] As the second type, the first output unit 33 provides lighting that brightens the user's feet in accordance with the user's going up and down the stairs, thereby making it possible to assist the user in going up and down the stairs.
[0048] The operation of the control device 13 is the same as the processing when the support target is a walk, and therefore the explanation will be omitted. As described above, the action support system 1 can make the user feel comfortable going up and down stairs based on the result detected by the detection device 11, improve the motivation for going up and down stairs, and provide walking assistance.
[0049] In particular, since the content of the image and the lighting method change in accordance with the user's movement up and down the stairs, the user can experience a sensation that is linked to his or her own movements, which can further encourage the user to engage in spontaneous activity.
[0050] The action support system 1 will be described in detail below in the case where exercises are included in the types of action items supported by the action support system 1. The action support system 1 has a control device 13, a beacon tag 11a, a receiver 11b, a motion detection device 11c, a projector 12a, and a lighting device 12b. When exercises are included in the types of action items supported by the action support system 1, the action support system 1 aims to improve motivation for exercises and to assist in the exercises.
[0051] Each device of the action support system 1 is the same as that of the action support system 1 when supporting a walk, and therefore a description thereof will be omitted. However, the receiver 11b, the moving object detection device 11c, the projector 12a, and the lighting device 12b are attached to, for example, a wall or a ceiling of a hall in the facility. The hall is an example of a place that is set in advance by the user as a place to do exercises.
[0052] When the determination conditions are met, the type determination unit 31 of the control device 13 determines that the action item for starting support is gymnastics. The determination conditions are, for example, the following two conditions. The first condition is that a detection signal of a user who has set gymnastics as the support target is received from the receiver 11b installed in the hall. The second condition is that recorded video is received from the moving object detection device 11c installed in the hall.
[0053] Furthermore, the type determination unit 31 completes the exercise support when a completion condition is satisfied after the determination condition is satisfied. The completion condition is, for example, that a predetermined time has elapsed without receiving a detection signal from the receiver 11b installed in the hall of a user who has set exercise as a support target.
[0054] After the behavior items have been determined, the analysis unit 32 continuously analyzes the video received from the moving object detection device 11c, and continuously measures the user's body parts and movements.
[0055] The first output unit 33 generates video data based on the measurement result of the analysis unit 32 and outputs it to the projector 12a. The first output unit 33 of the control device 13 generates a lighting control signal based on the measurement result of the analysis unit 32 and outputs it to the lighting device 12b. The first output unit 33 outputs the video data or lighting control signal to the projector 12a or the lighting device 12b so as to display or illuminate at least one of the following two types of video:
[0056] As a first type, the first output unit 33 displays, for example, an image of a person performing exercises on the projector 12a. This image is, for example, a video of a predetermined length in which a person performs a series of exercises such as radio exercises. This can reduce resistance to performing exercises and improve motivation to do exercises.
[0057] As the second type, the first output unit 33 changes the color or brightness of the lighting in accordance with the tempo of the exercise, thereby making it possible to assist the user in performing the exercise.
[0058] Furthermore, when the analysis result of the analysis unit 32 indicates that the user's movements are not movements corresponding to exercises, the first output unit 33 determines that there is no indication of performing exercises, and stops the display or illumination of the image.
[0059] The operation of the control device 13 is the same as the processing when the support target is a walk, and therefore the explanation will be omitted. As described above, the action support system 1 can reduce the resistance to doing exercises, improve motivation for exercises, and provide assistance with exercises based on the results detected by the detection device 11.
[0060] The action support system 1 will be described in detail in the case where eating is included in the types of action items supported by the action support system 1. FIG. 6 is a diagram for explaining the action support system 1 according to the first embodiment. As shown in FIG. 6, the action support system 1 has a control device 13, a beacon tag 11a, a receiver 11b, a moving object detection device 11c, and a lighting device 12b. When eating is included in the types of action items supported by the action support system 1, the action support system 1 aims to improve motivation for eating and to provide assistance with eating.
[0061] Each device of the action support system 1 is the same as that of the action support system 1 when the action item to be supported includes walking, and therefore a description thereof will be omitted. However, the receiver 11b, the moving object detection device 11c, and the lighting device 12b are attached to, for example, a wall or ceiling of a room R1 in the facility. The room R1 is an example of a place that is set in advance as a place to eat, such as a dining room.
[0062] When the determination conditions are met, the type determination unit 31 of the control device 13 determines that the action item for starting support is eating. The determination conditions are, for example, the following two conditions. The first condition is that a detection signal of a user who has set eating as a support target is received from the receiver 11b installed in the room R1. The second condition is that a recorded video is received from the moving object detection device 11c installed in the room R1.
[0063] Furthermore, the type determination unit 31 completes the meal support when a completion condition is satisfied after the determination condition is satisfied. The completion condition is, for example, that a predetermined time has elapsed without receiving a detection signal of a user who has set eating as the support target from the receiver 11b installed in the room R1.
[0064] After the behavioral items have been determined, the analysis unit 32 continuously analyzes the recorded video received from the moving object detection device 11c, and analyzes the number of times the user chews, the pace at which the meal is eaten, or the menu served in front of the user, etc.
[0065] Furthermore, the first output unit 33 of the control device 13 generates a lighting control signal based on the analysis result of the analysis unit 32, and outputs it to the lighting device 12b. The first output unit 33 outputs the lighting control signal to the lighting device 12b so as to perform at least one of the following three types of lighting. The control device 13 may analyze the food leftover situation, and accumulate data linked to the user, to grasp personal preferences and health conditions.
[0066] As a first type, the first output unit 33 illuminates the table with warm light, thereby making the dining environment more comfortable and improving motivation to eat.
[0067] As a second type, the first output unit 33 shines a spotlight on a specific dish. In FIG. 6, for example, a spotlight L3 is shining on a specific dish from the meal F set in front of the person P2. The specific dish is, for example, vegetables. By illuminating the vegetables first after starting the support, it is possible to encourage the person P2 to eat vegetables at the beginning of the meal and suppress the rise in blood sugar level. In addition, the specific dish may be a dish that is left uneaten in large quantities.
[0068] As a third type, the first output unit 33 changes the color or brightness of the lighting in accordance with the eating pace. Specifically, for example, if the eating pace is too fast, the first output unit 33 gently fluctuates the illuminance and color temperature of the lighting. This makes it possible to prompt the user to slow down the eating pace.
[0069] The operation of the control device 13 is the same as the processing when the support target is a walk, and therefore the description will be omitted. As described above, the action support system 1 can improve the motivation for eating and provide meal assistance based on the result detected by the detection device 11.
[0070] The action support system 1 will be described in detail in the case where the types of action items supported by the action support system 1 include conversation. FIG. 7 is a diagram for explaining the action support system 1 according to the first embodiment. As shown in FIG. 7, the action support system 1 has a control device 13, a beacon tag 11a, a receiver 11b, a moving object detection device 11c, a projector 12a, and a sound sensor 11d. When the types of action items supported by the action support system 1 include conversation, the action support system 1 aims to improve motivation for conversation.
[0071] The control device 13, the beacon tag 11a, the receiver 11b, the moving object detection device 11c, and the projector 12a are the same as the devices in the action support system 1 when supporting a walk, and therefore the description will be omitted. However, the receiver 11b, the moving object detection device 11c, and the lighting device 12b are attached to, for example, a wall or ceiling of a room R2 in the facility. The room R2 is an example of a place that is set in advance as a place where a conversation takes place. The voice sensor 11d is, for example, a microphone, and is attached to a table or the like in the room R2.
[0072] When the determination conditions are met, the type determination unit 31 of the control device 13 determines that the action item for starting support is a conversation. The determination conditions are, for example, the following two conditions. The first condition is that a detection signal of a user who has set a conversation as the support target is received from the receiver 11b installed in room R2. The second condition is that a recorded video is received from the moving object detection device 11c installed in room R2.
[0073] Furthermore, the type determination unit 31 completes the conversation support when a completion condition is satisfied after the determination condition is satisfied. The completion condition is, for example, that a predetermined time has elapsed without receiving a detection signal of a user who has set a conversation as a support target from the receiver 11b installed in the room R2.
[0074] After the action items are determined, the analysis unit 32 continuously analyzes the video received from the moving object detection device 11c and continuously measures the user's actions. Specifically, the user's actions are measured by measuring the user's facial expressions and the contents of the conversation. The analysis unit 32 also analyzes the voice of the audio sensor to extract keywords and the like contained in the conversation. The analysis unit 32 also extracts from the video stored in the storage unit 22 those matters associated with the extracted keywords. In other words, the analysis unit 32 extracts video that expands the contents of the user's conversation.
[0075] The first output unit 33 of the control device 13 generates the image extracted by the analysis unit 32 as image data based on the measurement result of the analysis unit 32, and outputs the image data to the projector 12a. In Fig. 7, an image G2 is displayed to a person P3, and an image G3 is displayed to a person P4.
[0076] The operation of the control device 13 is the same as the processing when the support target is a walk, and therefore the explanation is omitted. As described above, the action support system 1 can reduce the reluctance to have a conversation, improve the motivation for conversation, and provide support for conversation based on the result detected by the detection device 11.
[0077] The action support system 1 will be described in detail in the case where the types of action items supported by the action support system 1 include hobbies. FIG. 8 is a diagram for explaining the action support system 1 according to the first embodiment. As shown in FIG. 8, the action support system 1 has a control device 13, a beacon tag 11a, a receiver 11b, a moving object detection device 11c, a projector 12a, and a lighting device 12b. When a hobby is included in the action items supported by the action support system 1, the action support system 1 aims to improve the motivation for the hobby and to relax the user while performing the hobby.
[0078] The devices of the action support system 1 are the same as those in the case where the action item is walking, and therefore the description will be omitted. However, the receiver 11b, the moving object detection device 11c, the projector 12a, and the lighting device 12b are attached to, for example, the wall or ceiling of a room R3 in the facility. The room R3 is an example of a place, such as a living room, that is set in advance by the user as a place for carrying out hobbies.
[0079] When the determination condition is satisfied, the type determination unit 31 of the control device 13 determines that the action item is a hobby. The determination condition is, for example, to analyze the video received from the moving object detection device 11c installed in the room R3 and to determine that the video received from the moving object detection device 11c shows the user performing the activity designated as a hobby. Hobbies include, for example, handicrafts, reading, mahjong, and calligraphy, and are stored in the user table.
[0080] Furthermore, the type determination unit 31 completes the hobby support when a completion condition is satisfied after the determination condition is satisfied. The completion condition is, for example, to analyze the video received from the moving object detection device 11c installed in the room R3 and determine that the user has not performed the activity designated as a hobby for a predetermined time in the video received from the moving object detection device 11c.
[0081] After the action items are determined, the analysis unit 32 continuously analyzes the video received from the moving object detection device 11c and continuously measures the user's actions. The analysis unit 32 measures the user's activity time and the like.
[0082] The first output unit 33 generates video data based on the measurement results of the analysis unit 32 and outputs it to the projector 12a. The first output unit 33 also generates a lighting control signal based on the measurement results of the analysis unit 32 and outputs it to the lighting device 12b. The first output unit 33 outputs the video data or the lighting control signal to the projector 12a or the lighting device 12b so as to display or illuminate at least one of the following three types of video:
[0083] As the first type, the first output unit 33 displays an image related to the matter specified as the hobby. For example, if handicraft is specified as the hobby, an image of how to knit or a finished product is displayed. This can improve motivation for the hobby. In FIG. 8, G4 is displayed for person P5.
[0084] As a second type, when the user's activity time exceeds a predetermined time, the first output unit 33 displays a landscape image or an image that is not related to the hobby, etc., to prompt the user to take a break. This can prevent the user from concentrating too much on the hobby and becoming tired.
[0085] As the third type, the first output unit 33 provides illumination to brightly illuminate the user's hands. This allows the user to feel comfortable while working on handicrafts or other handicrafts, thereby improving motivation for the hobby.
[0086] The operation of the control device 13 is the same as the processing when the support target is a walk, and therefore the explanation is omitted. As described above, the action support system 1 can improve motivation for a hobby and provide support for a hobby based on the result detected by the detection device 11.
[0087] The action support system 1 will be described in detail for a case where bathing is included in the types of action items supported by the action support system 1. The action support system 1 has a control device 13, a beacon tag 11a, a receiver 11b, and a projector 12a. When bathing is included in the action items supported by the action support system 1, the action support system 1 aims to improve motivation for bathing and to assist in bathing.
[0088] Each device of the action support system 1 is the same as that of the action support system 1 when supporting a walk, so a description thereof will be omitted. However, the receiver 11b is attached to the changing room of the bathroom, etc., and the projector 12a is attached to a wall or ceiling of the hallway near the bathroom, and to a wall or ceiling inside the bathroom.
[0089] When a determination condition is satisfied, the type determination unit 31 of the control device 13 determines that the action item for which support is to be started is bathing. The determination condition is, for example, that a preset time period for taking a bath is reached.
[0090] Furthermore, the type determination unit 31 completes the bathing support when the completion condition is met after the determination condition is met. The completion condition is, for example, to satisfy one of the following two conditions. The first condition is that a pre-set time period for scheduled bathing has passed. The second condition is that the completion of the user's bathing is communicated to the behavior type determination. The completion of the user's input may be input, for example, by a terminal device such as a smartphone capable of communicating with the control device 13.
[0091] After the action item has been determined, the analysis unit 32 determines that the user is in the changing room of the bathroom or in the bathroom by receiving a detection signal of a user who has set bathing as the support target from the receiver 11b set in the changing room of the bathroom.
[0092] The first output unit 33 generates video data based on the processing result of the analysis unit 32, and outputs the video data to the projector 12a. The first output unit 33 outputs the video data to the projector 12a so as to display at least one of the following two types of video.
[0093] As a first type, the first output unit 33 causes the projector 12a provided in the hallway near the bathroom to display an arrow or the like indicating the route to the bathroom, thereby enabling the user to be smoothly guided to the bathroom.
[0094] The second type is to display an image of a forest or ocean on the ceiling or walls of the bathroom when the user is in the changing room of the bathroom. This gives the user a sense of openness, making bathing comfortable and increasing motivation to take a bath.
[0095] The operation of the control device 13 is the same as the processing when the support target is a walk, and therefore the description will be omitted. As described above, the action support system 1 can improve the motivation for bathing and provide assistance with bathing based on the result detected by the detection device 11.
[0096] The action support system 1 will be described in detail for a case where waking up is included in the types of action items that are targets of support by the action support system 1. The action support system 1 has a control device 13, a projector 12a, a lighting device 12b, and a sleep sensor (not shown). When waking up is included in the action items that are targets of support, the action support system 1 aims to assist in waking up.
[0097] The control device 13, the projector 12a, and the lighting device 12b are similar to the devices in the action support system 1 when supporting a walk, and therefore a description thereof will be omitted. However, the projector 12a and the lighting device 12b are attached to, for example, a wall or ceiling of a bedroom or the like in the facility. The sleep sensor is, for example, a mat-type sensor laid on a bed or futon on which the user sleeps. The sleep sensor outputs an electric signal according to the pressure applied to the mat.
[0098] When the determination condition is satisfied, the type determination unit 31 of the control device 13 determines that the action item for starting support is waking up. The determination condition is, for example, that a preset time period for waking up is reached.
[0099] Furthermore, when a completion condition is satisfied after the determination condition is satisfied, the type determination unit 31 completes the wake-up support. The completion condition is, for example, that a preset time period for scheduled wake-up has passed.
[0100] After the action items have been determined, the analysis unit 32 continuously analyzes the results received from the sleep sensor, and analyzes the depth of the user's sleep over time.
[0101] The first output unit 33 generates video data or a lighting control signal to perform at least one of the following two types of video display or lighting, and outputs the data to the projector 12a or the lighting device 12b.
[0102] As a first type, first output unit 33 causes projector 12a provided in the bedroom to display an image simulating surrounding people waking up, when the user's sleep becomes light.
[0103] As a second type, when the user's sleep becomes lighter, the first output unit 33 controls the lighting throughout the bedroom to have an illuminance of 500 Lux or more (on the bed or futon) and a color temperature higher than 4000K.
[0104] It is preferable that the lighting device 12b is installed next to a window and irradiates light toward the bed. This allows the user to feel as if sunlight is shining into the bedroom, and allows the user to wake up comfortably even on a cloudy or rainy day. Alternatively, a spotlight may be used for the lighting device 12b to irradiate light that is close to parallel light toward the bed.
[0105] The operation of the control device 13 is the same as the processing when the support target is a walk, and therefore the description will be omitted. As described above, the action support system 1 can provide assistance for getting up based on the result of detection by the detection device 11.
[0106] The action support system 1 will be described in detail for a case where going to sleep is included in the types of action items supported by the action support system 1. The action support system 1 has a control device 13, a projector 12a, a lighting device 12b, and a sleep sensor. When going to sleep is included in the action items supported by the action support system 1, the action support system 1 aims to assist the user in going to sleep.
[0107] The control device 13, projector 12a, and sleep sensor devices themselves and their installation locations are similar to those of the action support system 1 when supporting wake-up, and therefore description thereof will be omitted.
[0108] When the determination condition is satisfied, the type determination unit 31 of the control device 13 determines that the action item for starting support is sleeping. The determination condition is, for example, that a preset time period for sleeping is reached.
[0109] Furthermore, when a completion condition is satisfied after the determination condition is satisfied, the type determination unit 31 completes the sleep support. The completion condition is, for example, that a preset time period for the sleep schedule has passed.
[0110] After the action items have been determined, the analysis unit 32 continuously analyzes the results received from the sleep sensor, and analyzes the timing at which the user lay down in bed and the depth of sleep.
[0111] The first output unit 33 generates video data or a lighting control signal to perform at least one of the following two types of video display or lighting, and outputs the data to the projector 12a or the lighting device 12b.
[0112] As a first type, the first output unit 33 causes the projector 12a provided in the bedroom to display an image reminiscent of a night, such as a moon, on the wall of the bedroom when the user lies down on the bed. Furthermore, when the first output unit 33 determines from the analysis result of the analysis unit 32 that the user has fallen asleep, it ends the display of the image.
[0113] As the second type, the first output unit 33 causes the lighting device 12b provided in the bedroom to provide illumination of about moonlight of 10 Lux or less when the user lies down on the bed. Also, when the first output unit 33 determines from the analysis result of the analysis unit 32 that the user has fallen asleep, it ends the display of the image.
[0114] The operation of the control device 13 is the same as the processing when the support target is a walk, and therefore the description will be omitted. As described above, the action support system 1 can provide assistance for going to sleep based on the result detected by the detection device 11.
[0115] As described above, according to the first embodiment, an image related to an action item is displayed or illuminated based on the result of detection by the detection device 11. Therefore, it is possible to indirectly encourage the user to perform a specific activity without directly instructing the user to do so. Therefore, it is possible to encourage the user to perform spontaneous activities.
[0116] Embodiment 2 Fig. 9 is a functional block diagram showing a behavior support system 1A according to embodiment 2. As shown in Fig. 9, the control device 13 according to embodiment 2 differs from embodiment 1 in that it does not have a first output unit 33 and a projection device 12, but has an evaluation unit 41, an addition unit 42, and a communication unit 43. In embodiment 2, the same parts as those in embodiment 1 are given the same reference numerals and their explanations are omitted, and the following explanation will focus on the differences from embodiment 1.
[0117] Unlike the first embodiment, the action support system 1A of the second embodiment does not display images or perform illumination. The action support system 1A of the second embodiment provides social contribution points to a user who has performed an action item whose main purpose is physical exercise, such as walking, climbing stairs, or calisthenics. The control device 13 is communicably connected to an external system that performs activities that lead to the resolution of social issues, such as reforestation, building schools in developing countries, or vaccination, in exchange for the social contribution points held by the user. In other words, the user can contribute to social contribution activities by using the social contribution points accumulated through his or her own activities.
[0118] The storage unit 22 of the control device 13 stores an ID for identifying a user and a points table in which the social contribution points held by the user are stored.
[0119] The evaluation unit 41 of the control device 13 evaluates the exercise posture and the amount of exercise after the action item is completed, when the action item is a walk, climbing up and down stairs, or exercise. For example, in the case of a walk, the exercise posture may be evaluated comprehensively from the measured walking posture, walking speed, and stride length. The amount of exercise may be, for example, the walking distance calculated by multiplying the measurement time of the analysis unit 32, that is, the time from when the determination condition is satisfied to when the completion condition is satisfied, by the average walking speed. Various evaluation criteria are adopted. For example, based on the history of the detection results of the user's movements, a high numerical evaluation may be given if improvement is observed, and a low numerical evaluation may be given if no improvement is observed. In addition, a stepwise evaluation such as high, medium, or low may be given depending on the degree to which a predetermined standard is met based on the measurement results of the walking posture, walking speed, stride length, etc. of a person of similar age, sex, or physique.
[0120] The adder 42 adds different values of social contribution points to the point table depending on the evaluation result. For example, if the evaluation of the exercise posture and the amount of exercise is high, a higher value of social contribution points is added to the point table.
[0121] Although the above description is mainly about the case where the action item is walking, the exercise posture and the amount of exercise may also be calculated and evaluated for going up and down stairs and exercise. For example, when the action item is going up and down stairs, the exercise posture may be calculated from the ascent and descent posture and the ascent and descent speed, and the amount of exercise may be calculated using the number of ascent and descent steps, etc. Also, when the action item is exercise, only the amount of exercise may be calculated from the time the exercise was performed and the displayed exercise menu.
[0122] The communication unit 43 of the control device 13 subtracts the points owned by the user stored in the points table, and transmits information for requesting a point exchange to the external system S. The external system S executes the point exchange, thereby enabling the user to realize a social contribution activity.
[0123] FIG. 10 is a flowchart showing the operation of the control device 13 according to the second embodiment. The operation of the control device 13 will be described with reference to FIG. 10. The processes from S1 to S3 are the same as those described in the first embodiment, and therefore will not be described. When the user's motion and the like are analyzed and measured (S3), the type determination unit 31 determines whether or not the completion condition is met (S11). If the completion condition is not met (S11: NO), the analysis unit 32 continues to analyze and measure the user's motion and the like until the completion condition is met. If the completion condition is met (S11: YES), the evaluation unit 41 calculates the amount of exercise and the exercise posture of the user and performs an evaluation (S12). Then, based on the evaluation result performed by the evaluation unit 41, social contribution points are added to the point table (S13).
[0124] According to the second embodiment, social contribution points are awarded based on the results of detection by the detection device 11. This makes it possible to indirectly encourage the user to perform a specific activity without directly instructing the user to do so. This makes it possible to encourage the user to perform spontaneous activities.
[0125] Embodiment 3 Fig. 11 is a functional block diagram showing a behavior support system 1B according to embodiment 3. As shown in Fig. 11, in embodiment 3, a control device 13 has, in addition to the configuration of embodiment 1, an evaluation unit 41, an addition unit 42, and a communication unit 43 described in embodiment 2, as well as a second output unit 51 not included in embodiments 1 and 2. In embodiment 3, the same parts as those in embodiments 1 and 2 are denoted by the same reference numerals and description thereof is omitted, and the differences from embodiments 1 and 2 will be mainly described.
[0126] The action support system 1B of the third embodiment displays or illuminates images as described in the first embodiment. In addition, as described in the second embodiment, social contribution points are awarded to a user who has performed an action item whose main purpose is physical exercise, such as walking, climbing stairs, or exercise. Furthermore, the action support system 1B of the third embodiment displays information related to the awarded social contribution points by means of images. In the following, an example will be described in which the action item is walking.
[0127] As described above, the type determination unit 31, the analysis unit 32, and the first output unit 33 of the control device 13 of the third embodiment are similar to the type determination unit 31, the analysis unit 32, and the first output unit 33 of the first embodiment. Similarly, the evaluation unit 41 and the addition unit 42 of the control device 13 of the third embodiment are similar to the evaluation unit 41 and the addition unit 42 of the second embodiment.
[0128] When the completion condition is satisfied, the second output unit 51 of the control device 13 generates evaluation video data and outputs it to the projection device 12 to display the evaluation video. The evaluation video data is output data that determines the specific content of the evaluation video. The evaluation video is a video that includes the evaluation result of the evaluation unit 41 in its content.
[0129] FIG. 12 is a diagram for explaining the second output unit 51 according to the third embodiment. FIG. 12 shows a case where the person P6 has a high evaluation result of the exercise posture, and a case where the person P7 has a low evaluation result of the exercise posture. FIG. 13 shows an evaluation image G5 displayed by the projector 12a according to the third embodiment. FIG. 13 shows an evaluation image displayed on a wall surface or the like by the projector 12a after the person P6 has completed a walk. As shown by the dashed line M1 in FIG. 13, the second output unit 51 displays the social contribution points granted by the current activity based on the evaluation result of the evaluation unit 41. Also, as shown by the dashed line M2, the second output unit 51 displays the accumulated social contribution points by referring to the social contribution points owned by the user stored in the point table. Also, as shown by the dashed line M3, the second output unit 51 displays the social contribution points required for the purpose set in advance by the user by communicating with the external system S via the communication unit 43. As indicated by dashed line M4, comments on areas for improvement are displayed by referencing comments corresponding to the evaluation of exercise posture and amount of exercise from a list of comments previously stored in the memory unit 22. As indicated by dashed line Ic1, the second output unit 51 refers to symbol data corresponding to the evaluation of exercise posture or amount of exercise from a list of symbol data previously stored in memory, and displays a symbol indicating the evaluation. Person P6 received a high evaluation for his / her exercise posture, so the symbol "sunny" is displayed. Symbols such as "sunny", "cloudy", and "rainy" are used in descending order of the rank of the evaluation result.
[0130] FIG. 14 is a diagram showing an evaluation image G6 displayed by the projector 12a according to the third embodiment. FIG. 14 shows an evaluation image displayed on a wall surface or the like by the projector 12a after the person P7 has completed a walk. The evaluation image shown in FIG. 14 also shows the social contribution points acquired through the current activity, as shown by the dashed line M5. Also, as shown by the dashed line M6, the cumulative social contribution points are displayed. Also, as shown by the dashed line M7, the social contribution points required for the purpose set by the user in advance are displayed. Also, as shown by the dashed line M8, comments on areas for improvement are displayed. Since the evaluation result of the exercise posture of the person P7 was low, the social contribution points acquired through the current activity are lower than those of the person P6, and the evaluation result is medium, as shown by the dashed line Ic2, so the symbol "cloudy" is displayed.
[0131] Also, the following evaluation image may be additionally or instead displayed. Fig. 15 is a diagram showing an evaluation image G7 displayed by the projector 12a according to the third embodiment. Fig. 15 shows an image of the increase and growth of trees in a forest when the user selects, for example, "afforestation and nature conservation" as the use of the social contribution points. Also, the evaluation image G7 displays the amount of trees that can be planted, which corresponds to the social contribution points granted by the current activity, as shown by the area surrounded by the dashed line E1. This allows the user to visually recognize the degree of social contribution that can be made with the social contribution points granted by the current activity.
[0132] Fig. 16 is a diagram showing an evaluation image G8 displayed by the projector 12a according to the third embodiment. As shown in Fig. 16, if the user selects, for example, "humanitarian aid" as the use of the social contribution points, an image expressing children around the world becoming happy is displayed. Furthermore, as shown in the area surrounded by the dashed line E2, the evaluation image G8 displays a part of the school that corresponds to the social contribution points granted by the current activity. This allows the user to visually recognize how much social contribution can be made with the social contribution points granted by the current activity.
[0133] In addition, various types of images are displayed according to the purpose selected for the social contribution points. For example, if "ocean conservation" is selected as the purpose for the social contribution points, an image of the ocean becoming cleaner is displayed, and if "animal protection" is selected as the purpose for the social contribution points, an image of animals increasing in number and becoming healthy is projected.
[0134] FIG. 17 is a flowchart showing the operation of the control device 13 according to the third embodiment. The operation of the control device 13 will be described with reference to FIG. 17. The processes from S1 to S6 are similar to those described in the first embodiment, and therefore will not be described. If the completion condition is met (S6: YES), the evaluation unit 41 performs an evaluation based on the amount of exercise and the exercise posture of the user (S21). The addition unit 42 adds social contribution points to the point table based on the evaluation result of the evaluation unit 41 (S22). Next, the second output unit 51 generates evaluation video data (S23) and causes the video to be displayed (S24). Then, the control device 13 completes the operation when a walk is performed as the action item.
[0135] According to the third embodiment, based on the result of detection by the detection device 11, social contribution points are awarded and the degree of contribution is displayed in the form of an image. This makes it possible to indirectly encourage the user to perform a specific activity without directly instructing the user to do so. This makes it possible to encourage the user to perform spontaneous activities.
[0136] Furthermore, by displaying images, information can be conveyed in an intuitive manner to elderly users of facilities for the elderly.
[0137] The above is a description of the action support systems 1, 1A, and 1B of the present disclosure, but various modifications can be made within the scope of the spirit of the disclosure. For example, the color tone of the video data output by the first output unit 33 and the evaluation video data output by the second output unit 51 described in the first and third embodiments may be corrected. For example, the brightness of blue in the displayed image may be made brighter and the brightness of yellow may be made darker. This allows even a user who has difficulty seeing blue due to aging to feel the realism of the image.
[0138] In addition, in the first and third embodiments, when the user does exercises, the first output unit 33 may correct the video data so as to brighten and emphasize the ends or joints of the hands, feet, etc. of the person included in the video. Furthermore, when the user performs an activity of an action item whose main purpose is physical exercise, the first output unit 33 may brighten the ends or joints of the hands, feet, etc. of the user's body by the lighting device 12b, or may emphasize them by displaying the video. This makes it easier to avoid collisions between the user and people or objects around the user.
[0139] In the first and third embodiments, the first output unit 33 may provide illumination at random positions or display an image in which a figure moves randomly so that the user's line of sight moves. The image may display a figure such as a circle, for example, on a floor or wall. Generally, a user whose field of vision has narrowed due to aging may have difficulty walking, such as bumping into or tripping over objects installed on a wall or floor. By displaying random types using images or illumination, the user's line of sight can be guided and the field of vision can be improved. This leads to the maintenance and improvement of the user's walking function.
[0140] In addition, in the first and third embodiments, when an activity of an action item such as a conversation or a hobby is performed, an image related to the user may be displayed. This can prevent the user from forgetting things. The data for outputting the image may be stored in the user table of the storage unit 22 in association with the user ID by receiving a storage medium such as a photograph or a hard disk from the user or a family member when moving into a facility, for example.
[0141] In the first and third embodiments, when performing an activity of the action item of sleeping, a digest of the day's activities may be displayed. This can suppress forgetfulness of the user or strengthen short-term memory. The data for outputting the digest may be a video image taken when the user performs an activity defined as an action item, or when the user performs an activity of an action item such as conversation or hobby, the video image displayed at that time may be displayed.
[0142] In addition, in the first and third embodiments, when a person approaches the user, the direction of the person may be illuminated. Furthermore, when the distance between the user and an object installed on a wall, floor, or the like becomes smaller than a predetermined distance, the object installed on the wall, floor, or the like may be illuminated. This makes it possible to alert the user not to collide with people or objects. In particular, when the direction of a person approaching the user is illuminated, it is possible that the person is trying to talk to the user, and therefore it is possible to inform the user that there is a possibility that the person will call out to the user.
[0143] In the first and third embodiments, when a person approaches the user and light is emitted by the illumination device 12b, the emitted light may be a color preferred by each user.
[0144] The control of the projection device 12 shown in the modified examples described so far may be performed when the user is performing an activity defined as an action item, or may be performed independently when the user is not performing an activity defined as an action item.
[0145] In addition, in the third embodiment, when the evaluation video is displayed, the external system S may be accessed to display a video related to the social contribution activity that is closest to the accumulated social contribution points.
[0146] In the first to third embodiments, the control device 13 has been described as a server device, but the control device 13 may be realized as a function of the management terminal 14, for example. Also, the control device 13 may be realized as a function of the projection device 12 or the detection device 11.
[0147] The action items described in the first embodiment are merely examples, and are not necessarily limited to nine. For example, action items may be further classified, such as conversations with relatives and conversations with friends, and hobbies as handicrafts, reading, mahjong, and calligraphy. Furthermore, an action item for exercise may be provided, and walking, exercise, dancing, climbing stairs, etc. may be classified as action items belonging to exercise.
[0148] Furthermore, points that can be used for purposes other than social contribution may be used instead of the social contribution points described in the second and third embodiments. In this case, too, by linking the user's activities with the awarding of points, the motivation of the user's activities can be promoted.
[0149] In addition, in the third embodiment, the first output unit 33 may display the walking mark or the gaze mark in blue or green based on the evaluation by the evaluation unit 41. When the evaluation of the walking posture is low, the first output unit 33 may display the walking mark or the gaze mark in yellow or red. This can enhance the effect of improving the user's walking posture.
[0150] Moreover, the projection device 12 and the detection device 11 described in the first embodiment are merely examples. For example, if the place where the support image or the evaluation image is displayed is other than the space such as the floor surface, the wall surface, or the ceiling, the projection device 12 may be a display instead of the projector 12a. Also, a VR device may be used as the projection device 12. This can give the image a sense of realism. Also, a LIDAR (Laser Imaging Detection and Ranging) may be used as the detection device 11. This can, for example, measure the position of the user's feet with higher accuracy. Also, in each embodiment, the user can be identified by the beacon tag 11a. However, other indoor positioning technologies such as Wifi may be used. Also, if the user can be identified by analyzing the user's physical characteristics from the recorded image of the moving object detection device 11c, the installation or use of the beacon tag 11a and the receiver 11b may be omitted. [Explanation of symbols]
[0151] 1 Action support system, 1A Action support system, 1B Action support system, 11 Detection device, 11a Beacon tag, 11b Receiver, 11c Motion detection device, 11d Audio sensor, 12 Projection device, 12a Projector, 12b Lighting device, 13 Control device, 14 Management terminal 21 Control unit, 22 Memory unit, 31 Classification determination unit, 32 Analysis unit, 33 First output unit, 41 Evaluation unit, 42 Addition unit, 43 Communication unit, 51 Second output unit.
Claims
[Claim 1] An action support system that supports a user's activity, A detection device that detects a state of a user; A projection device for displaying or illuminating an image; a control device that controls the projection device so as to display or illuminate an image related to an action item that is determined in accordance with the activity to be supported based on a result detected by the detection device; When the action item is eating, the control device analyzes an eating pace from the result detected by the detection device, controlling the projection device so as to change the color or brightness of lighting in accordance with the eating pace; When the eating pace of the user is faster than a threshold value, the projection device is controlled so that the illuminance and color temperature of the lighting are fluctuated. Behavioral support system.
Citation Information
Patent Citations
Device, method and program for supporting action management
JP2004318503A
Information processing device and storage medium
JP2014211749A
Information processing device, information processing method and program
JP2015138532A
Meal support device, meal support system, computer program and meal support method
JP2016159096A
Table projection device
WO2020116290A1
