Information presentation method, information presentation device, information presentation system, and program

Abstract

This information presentation method includes: an information collection step (S12) for collecting at least one information item from between an information item about the posture of a subject (99) and an information item about the face orientation and / or the gaze direction of the subject (99); an action analysis step (S13) for analyzing an action of the subject (99) on the basis of the collected information item; a presentation image determination step (S15) for determining a presentation image to be presented to the subject (99), on the basis of the action analysis results, in which the presentation image is acquired from a camera (20) disposed at a position different from the viewpoint of the subject (99) and is an image of a range selected from within the range that can be imaged by the camera (20); and a presentation step (S17) for presenting the determined presentation image to the subject (99) by means of a display device (60).

Description

Information presentation method, information presentation device, information presentation system, and program

[0001] The present disclosure relates to an information presentation method, an information presentation device, an information presentation system including the information presentation device, and a program.

[0002] 2. Description of the Related Art Visual stimuli are presented to subjects to provide them with information through visual stimuli (see, for example, Patent Document 1).

[0003] JP 2009-69954 A JP 2009-87026 A

[0004] Yoshio Matsumoto, Junichi Ido, Kentaro Takemura, Tsukasa Ogasawara, Development of a Real-Time Face and Gaze Measurement System and Its Application to Intelligent Interfaces, IPSJ Transactions on Computer Vision and Image Media, vol.47, no.SIG 15(CVIM16), pp.10-21, October 2006.

[0005] However, when providing information to a subject through visual stimulation, it is desirable to present more appropriate information. Therefore, an object of the present disclosure is to provide an information presentation method and the like that can present more appropriate information to a subject through visual stimulation.

[0006] An information presentation method according to one aspect of the present disclosure includes an information collection step of collecting at least one piece of information from among information on the posture of a subject and information on at least one of the subject's facial orientation and gaze direction; a movement analysis step of analyzing the movement of the subject using the collected information; a presentation image determination step of determining a presentation image to be presented to the subject based on the movement analysis results, wherein the presentation image is an image acquired from a camera installed at a position different from the subject's viewpoint and selected from within the camera's capture range; and a presentation step of presenting the determined presentation image to the subject using a display device.

[0007] Moreover, an information presentation device according to one aspect of the present disclosure includes an information collection unit that collects at least one piece of information from among information on the posture of a subject and information on at least one of the subject's facial orientation and gaze direction; a motion analysis unit that analyzes the subject's motion using the collected information; a presentation image determination unit that determines a presentation image to be presented to the subject based on the results of the motion analysis, wherein the presentation image is an image acquired from a camera installed at a position different from the subject's viewpoint and selected from within the camera's capture range; and a presentation unit that presents the determined presentation image to the subject.

[0008] Furthermore, an information presentation system according to one aspect of the present disclosure includes the information presentation device described above, the camera, and a display device for presenting the presentation image to the subject.

[0009] Furthermore, one aspect of the present disclosure can also be realized as a program for causing a computer to execute the information presentation method described above.

[0010] These comprehensive or specific aspects may be realized as a system, an apparatus, a method, an integrated circuit, a computer program, or a non-transitory recording medium such as a computer-readable CD-ROM, or may be realized as any combination of a system, an apparatus, a method, an integrated circuit, a computer program, and a recording medium.

[0011] According to the present disclosure, it is possible to present more appropriate information to a subject.

[0012] Fig. 1 is a schematic diagram showing a use case of an information presentation system according to an embodiment. Fig. 2 is a block diagram showing a functional configuration of the information presentation system according to an embodiment. Fig. 3 is a diagram showing an example of a specific operation according to an embodiment. Fig. 4 is a diagram showing an example of a specific operation according to an embodiment. Fig. 5 is a flowchart showing the operation of an information presentation device according to an embodiment.

[0013] (Knowledge forming the basis of the disclosure) Conventionally, technologies have been developed for presenting information to a subject using visual stimuli, such as display devices such as smartphones, televisions, and projectors, as well as VR or AR. By presenting information using the above-mentioned visual stimuli in addition to the visual field, which is the range that the subject can visually recognize at that time, the subject is provided with supplementary information within the visual field or is given guidance instructions to move the visual field to another visual field, thereby providing visual assistance to the subject (see, for example, Patent Document 1).

[0014] One such visual aid is the desire to virtually visualize an area outside the subject's field of view (outside the field of view). For example, when a worker is sorting a pile of piled items, if the height of the items far exceeds the worker's height, reading a tag attached to the item requires the worker to lower the items, prepare a ladder, move to a position where the tag can be read, or move a camera or other device to a position where the tag can be read and view the captured image. Such operations are cumbersome, and performing such operations while also performing other tasks such as sorting the items is inefficient. When a subject wants to virtually visualize an area outside the field of view, as in this example, it is effective to present information outside the field of view (images captured by a camera) as a visual stimulus. However, presenting information outside the field of view requires the subject to operate a camera or other device, which can be difficult while performing other tasks. Therefore, if information outside the field of view is automatically presented when a behavior of the subject indicating a desire for the presentation of information outside the field of view is detected, it becomes possible to present information outside the field of view to the subject while reducing the possibility of the subject interfering with another task. In this way, an object of the present disclosure is to provide an information presentation method etc. that can present more appropriate information to the subject by visual stimulation.

[0015] A more specific outline of the present disclosure is as follows.

[0016] The information presentation method according to the first aspect of the present disclosure includes an information collection step of collecting at least one piece of information from among information on the subject's posture and information on at least one of the subject's facial orientation and gaze direction; a movement analysis step of analyzing the subject's movements using the collected information; a presentation image determination step of determining a presentation image to be presented to the subject based on the movement analysis results, wherein the presentation image is an image acquired from a camera installed at a position different from the subject's viewpoint and selected from within the camera's capture range; and a presentation step of presenting the determined presentation image to the subject using a display device.

[0017] According to this information presentation method, by analyzing the subject's movements using at least one of information on the subject's posture and information on at least one of the subject's facial orientation and gaze direction, it is possible to determine whether the subject's movements indicate a desire for the presentation of a presentation image. Then, depending on the results of the movement analysis, for example, if the subject does not indicate a desire for the presentation of a presentation image, the presentation image is not presented, and if the subject indicates a desire for the presentation of a presentation image, the presentation image is presented. In this way, whether or not to present a presentation image can be automatically switched depending on the subject's movements, making it possible to present more appropriate information to the subject through visual stimulation.

[0018] In addition, the information presentation method according to the second aspect is the information presentation method according to the first aspect, and in the information collection step, an image sensor is used to collect at least one piece of information on the subject's posture and at least one piece of information on the subject's facial orientation and gaze direction.

[0019] This makes it possible to use the image sensor to collect at least one piece of information from among information on the posture of the subject and at least one piece of information on the facial direction and gaze direction of the subject.

[0020] In addition, the information presentation method according to the third aspect is the information presentation method according to the first aspect, and in the information collection step, an ultrasonic sensor is used to collect at least one piece of information on the subject's posture and at least one piece of information on the subject's facial orientation and gaze direction.

[0021] This makes it possible to collect at least one piece of information from among information on the posture of the subject and information on at least one of the facial direction and gaze direction of the subject using the ultrasonic sensor.

[0022] In addition, the information presentation method according to the fourth aspect is an information presentation method according to any one of the first to third aspects, and in the presentation image determination step, if the analysis results indicate an upward shift in the subject's center of gravity in their posture, a presentation image is determined that corresponds to a field of view above the field of view of the subject.

[0023] According to this, if the analysis results indicate an upward shift in the center of gravity of the subject's posture, it is possible to present a presentation image that corresponds to a visual field range above the visual field range of the subject.

[0024] Furthermore, the information presentation method according to the fifth aspect is an information presentation method according to any one of the first to third aspects, and in the presentation image determination step, when the analysis results indicate that the subject's posture is leaning forward, a presentation image is determined that corresponds to a field of view forward of the field of view of the subject.

[0025] According to this, if the analysis result indicates that the subject is in a forward-leaning posture, it is possible to present a presentation image that corresponds to a visual field range that is further forward than the visual field range of the subject.

[0026] Furthermore, the information presentation method according to the sixth aspect is an information presentation method according to any one of the first to fifth aspects, and in the presentation step, a presentation image is output to smart glasses that are worn by the subject and have a display placed in front of the subject's eyes, thereby causing the presentation image to be presented on the display.

[0027] This allows the presentation image to be presented using smart glasses that are worn by the subject and have a display placed in front of the subject's eyes.

[0028] In addition, the information presentation method according to the seventh aspect is an information presentation method according to any one of the first to sixth aspects, and in the presentation step, a presentation image is output to a display device having a display located around the subject, thereby causing the display to present the presentation image.

[0029] This allows the presentation image to be presented using a display device having a display positioned around the subject.

[0030] Furthermore, the information presentation method according to the eighth aspect is an information presentation method according to any one of the first to seventh aspects, in which the information collection step collects information on at least one of the subject's facial direction and gaze direction, and the presentation image determination step determines a presentation image to be presented to the subject based on the results of the movement analysis and the information on at least one of the subject's facial direction and gaze direction.

[0031] This makes it possible to determine the presentation image to be presented to the subject based on the results of the movement analysis and information on at least one of the subject's facial direction and line of sight direction.

[0032] Furthermore, the information presentation method according to the ninth aspect is an information presentation method according to any one of the first to eighth aspects, in which the camera is capable of controlling at least one of the horizontal angle and the vertical angle within the photographable range, and in the presentation step, a control signal is output that controls at least one of the horizontal angle and the vertical angle of the camera in accordance with the determined presentation image, and then the image obtained from the camera is presented to the subject.

[0033] This allows at least one of the horizontal angle and vertical angle of the camera to be controlled in accordance with the image for presentation, and an image captured by the camera that has been so controlled can be presented as the image for presentation.

[0034] A program according to a tenth aspect is a program for causing a computer to execute the information presentation method according to any one of the first to ninth aspects.

[0035] According to this, by using a computer, the same effect as the information presentation method described above can be achieved.

[0036] In addition, the information presentation device according to the eleventh aspect includes an information collection unit that collects at least one piece of information from among information on the subject's posture and information on at least one of the subject's facial orientation and gaze direction; a movement analysis unit that analyzes the subject's movements using the collected information; a presentation image determination unit that determines a presentation image to be presented to the subject based on the movement analysis results, wherein the presentation image is an image acquired from a camera installed at a position different from the subject's viewpoint and selected from within the camera's capture range; and a presentation unit that presents the determined presentation image to the subject.

[0037] This provides the same effects as the information presentation method described above.

[0038] An information presentation system according to a twelfth aspect includes the information presentation device according to the eleventh aspect, a camera, and a display device for presenting a presentation image to a subject.

[0039] This makes it possible to realize an information presentation system that has the same effects as the information presentation method described above.

[0040] Furthermore, these comprehensive or specific aspects may be realized as a system, an apparatus, a method, an integrated circuit, a computer program, or a non-transitory recording medium such as a computer-readable CD-ROM, or may be realized as any combination of a system, an apparatus, a method, an integrated circuit, a computer program, and a recording medium.

[0041] Hereinafter, embodiments will be described in detail with reference to the drawings. Note that the embodiments described below are all comprehensive or specific examples. The numerical values, shapes, materials, components, component placement and connection configurations, steps, and step order shown in the following embodiments are merely examples and are not intended to limit the present disclosure. Furthermore, among the components in the following embodiments, components that are not recited in independent claims will be described as optional components. Note that each figure is a schematic diagram and is not necessarily an exact illustration. Furthermore, in each figure, substantially identical components are assigned the same reference numerals, and duplicated descriptions may be omitted or simplified.

[0042] (Embodiment) [Overview] First, an overview of an information presentation system according to an embodiment will be described. FIG. 1 is a schematic diagram illustrating a use example of an information presentation system 100 according to an embodiment (see FIG. 2 described later). FIG. 1 illustrates a subject 99 using the information presentation system 100, a load 98 placed in front of the subject 99, and a camera 20. In the figure, eight loads 98 are stacked vertically. While the subject 99 can view four loads 98 from the bottom by changing his / her posture within the field of view 99a of the subject 99, it is difficult for him / her to view the top four loads 98 that are stacked higher (upper) than his / her height. Furthermore, it is even more difficult for him / her to view the top surface of the top load 98. Therefore, when the subject 99 performs a specific action (here, an action for viewing a higher position), the action is detected by the information presentation system 100. Then, an image with a field of view range close to the field of view range 99a of the subject 99 is selected and acquired from the capture range 20d of the camera 20, and is presented by being output to a display device 60 (see Figure 2 described below) located in a position where the subject 99 can see it.

[0043] That is, the subject 99 only needs to perform a specific action, and even while performing another task, the subject 99 can easily input to the information presentation system 100 that the subject 99 desires to be presented with information outside the field of view. By inputting information using such a simple action, the information outside the field of view can be presented, thereby assisting the subject 99 in his or her original task.

[0044] [Configuration] Next, the configuration of the information presentation system 100 according to the present embodiment will be described with reference to Fig. 2. Fig. 2 is a block diagram showing the functional configuration of the information presentation system according to the embodiment.

[0045] 2, information presentation system 100 according to the present embodiment includes server 40 that realizes an information processing device, camera 20, and display device 60. Server 40, camera 20, and display device 60 are communicably connected via a network such as the Internet.

[0046] The camera 20 may be realized, for example, as a fixed camera 20a fixed to a wall or ceiling surface, or a camera-mounted robot 20b or camera-mounted drone 20c that can autonomously move and control the position and angle. Each camera 20 can control the horizontal and vertical angles (elevation / depression angles) of the shooting direction by autonomous movement or pan and tilt adjustment. Conversely, as long as the horizontal angle, vertical angle, and shooting position can be controlled, the shooting range of the camera 20 can be expanded. Alternatively, even without such control functions, it is sufficient if the fixed shooting range 20d includes a field angle that can capture the required image. The horizontal and vertical angles of the camera 20 are controlled by control signals from the server 40.

[0047] The camera 20 may have a visible light image sensor capable of capturing visible light images, or an image sensor capable of capturing images of ultrashort wavelength light such as infrared light, ultraviolet light, or X-rays. Therefore, an image of ultrashort wavelength light such as infrared light, ultraviolet light, or X-rays may be an image outside the field of view desired by the subject 99. In other words, the field of view 99a may simply refer to a spatial range, or may refer to a visible wavelength range. The outside field of view may include invisible ultrashort wavelength light such as infrared light, ultraviolet light, or X-rays. Similarly, a telephoto function or the like may be provided on the camera to enable capturing images of a narrow range in front that is unrecognizable even within the spatial field of view. Therefore, an image of a narrow range in front that is unrecognizable may be an image outside the field of view desired by the subject 99. In other words, the field of view 99a is a term that refers to the spatial range that the subject 99 can recognize. If an image is unrecognizable, it is treated as being outside the field of view even if it is within the field of view spatially.

[0048] The server 40 is realized as a cloud server or edge server that implements the functions of an information presentation device, processes input information, and outputs other information. The server 40 includes a processor and memory, and functions as an information presentation device when the processor executes a predetermined program stored in the memory. The server 40 includes an information collection unit 41, a motion analysis unit 42, a presentation image determination unit 43, and a presentation unit 44.

[0049] The information collection unit 41 is a processing unit that collects information about the subject 99. The information collection unit 41 communicates with one or more sensors (not shown) capable of sensing the position, posture, facial orientation, and gaze direction of the subject 99, such as an image sensor, an ultrasonic sensor, a position sensor, an acceleration sensor, and an electromyography sensor. The information collection unit 41 collects at least one of the posture and the facial orientation and gaze direction from the position, posture, facial orientation, and gaze direction of the subject 99 from the sensors. The information collection unit 41 acquires (collects) such information over time, thereby obtaining changes in the information over time. The sensors from which the information collection unit 41 collects information about the subject 99 may or may not include the camera 20.

[0050] The motion analysis unit 42 is a processing unit that analyzes the motion of the subject 99 based on the position, posture, facial direction, and gaze direction of the subject 99. The motion of the subject 99 is determined by at least one of the following: a change in the position of the subject 99 over time, a change in the posture of the subject 99 over time, a change in the facial direction over time, and a change in the gaze of the subject 99 over time. If at least one of the changes in the position of the subject 99 over time, the change in the posture of the subject 99 over time, the change in the facial direction over time, and the change in the gaze of the subject 99 over time satisfies a condition, the motion analysis unit 42 determines that the subject 99 is performing a specific motion. In this way, the specific motion is defined by whether or not at least one of the changes in the position of the subject 99 over time, the change in the posture of the subject 99 over time, the change in the facial direction over time, and the change in the gaze of the subject 99 over time satisfies a condition. More preferably, the specific motion is defined by whether or not a combination of two or more of the changes in the position of the subject 99 over time, the change in the posture of the subject 99 over time, the change in the facial direction over time, and the change in the gaze of the subject 99 over time satisfies a condition, which is preferable because it reduces erroneous determinations.

[0051] The movement of the subject 99 will be described in detail. FIG. 3 is a diagram illustrating an example of a specific movement according to the embodiment. FIG. 3 illustrates a movement in which the subject 99 is stretching as an example of the specific movement. The subject 99 to the left of the arrow in the figure is not stretching, and is not performing the specific movement. On the other hand, the subject 99 to the right of the arrow in the figure is stretching, and is performing the specific movement. When determining that the subject 99 is stretching, for example, the subject 99's skeletal model sensed as the subject's 99 posture shows an upward movement of the center of gravity, particularly when this movement is less than a predetermined speed, and the subject 99's gaze vector sensed as the subject's 99 gaze direction shows an upward change in angle (a relative angle with respect to a reference angle), particularly when this change is less than a predetermined speed, it is determined that the subject 99 is stretching. The predetermined speed for the movement of the center of gravity and the change in the gaze vector angle is a unique value set for each subject 99. The predetermined speed is set to exclude cases where the user is simply stretching without performing a specific action, or moving their eyes upward.

[0052] FIG. 4 is a diagram illustrating an example of a specific motion according to an embodiment. FIG. 4 illustrates a motion in which a subject 99 is leaning forward as an example of the specific motion. The subject 99 to the left of the arrow in the figure is not leaning forward, and is not performing the specific motion. On the other hand, the subject 99 to the right of the arrow in the figure is leaning forward, and is performing the specific motion. It is determined that the subject 99 is leaning forward, for example, when the angle of the hip joint in the skeletal model of the subject 99 sensed as the posture of the subject 99 decreases, particularly when the change in this angle is less than a predetermined speed, and when the facial direction vector of the subject 99 sensed as the facial direction of the subject 99 shows a downward angle change, particularly when the change is less than a predetermined speed. The predetermined speed is a unique value similarly set for each subject 99. The predetermined speed is set to eliminate cases where the user simply leans forward without performing a specific movement, or where the face moves downward.

[0053] The facial direction and gaze direction of the subject 99 are sensed by image analysis of the eyes and other facial features. For example, detailed methods of such analysis are described in Patent Document 2 and Non-Patent Document 1. However, the present invention is not limited to these, and the facial direction and gaze direction may be sensed by any existing sensing technology.

[0054] Furthermore, sensing of the position and posture of the subject 99 is performed by generating a skeletal model using an image of the subject 99 and calculating the spatial coordinates of each joint of the subject 99. However, without being limited to this, the posture of the subject 99 may be estimated by quantifying muscle contractions using an electromyography sensor and performing calculations from the numerical values, or the position and posture of the subject 99 may be estimated by sensing each attachment position of the subject 99 using a position sensor and an acceleration sensor attached to the subject 99, or the position and posture of the subject 99 may be sensed by any other existing sensing method.

[0055] 2 , the presentation image determination unit 43 determines the image to be presented to the subject 99 from images in a field of view range selected from the captureable range 20d of the camera 20. The presentation image determination unit 43 determines the presentation image when the analysis result of the subject 99's movement indicates that the subject 99 is determined to be performing a specific movement such as stretching or leaning forward, but does not determine the presentation image when the analysis result indicates that the subject 99 is not determined to be performing a specific movement. In other words, no presentation image is generated, and the subject 99 views an image in the normal field of view, or directly views the normal field of view without any particular image being presented.

[0056] When determining the image to be presented, the position of the subject 99 is used, but at least one of the facial orientation and gaze direction of the subject 99 may also be used. Specifically, when the subject 99 stretches up and performs a specific movement, an image with an upward angle of view from the position of the subject 99 (particularly the viewpoint position) is determined as the image to be presented. Alternatively, when the subject 99 leans forward and performs a specific movement, an image with a forward angle of view from the position of the subject 99 (particularly the viewpoint position) is determined as the image to be presented. In this way, for each specific movement, the direction in which the angle of view is moved from the position of the subject 99 is determined. Note that the image with a forward angle of view may be an image with an expanded angle of view in a narrow range in front, or may be an X-ray transmission image taken through a shield that blocks the view in front of the subject 99.

[0057] The degree to which the angle of view is desired to be moved from the position of the subject 99 often differs from one subject 99 to another, so the distance the angle of view is moved may be adjustable depending on the subject 99. Specifically, when the subject 99 performs a specific action and the direction in which the angle of view is to be moved is determined, an image with the angle of view closest to the subject 99 within the photographable range 20d is presented, and from there the angle of view is gradually moved along the determined direction of movement.

[0058] For example, in FIG. 1, eight angles of view, from angle of view 20d-1 to angle of view 20d-8, are shown within the imageable range 20d. The movement direction is assumed to be the up-down direction on the page. First, angle of view 20d-1, which is closest to the subject 99 within the imageable range 20d, is presented to the subject 99. Next, angle of view 20d-2 is presented, followed by angle of view 20d-3, followed by angle of view 20d-4, followed by angle of view 20d-5, followed by angle of view 20d-6, and followed by angle of view 20d-7. Finally, angle of view 20d-8, which is the farthest from the subject 99 in the movement direction within the imageable range 20d, is presented. When angle of view 20d-8 is presented, the subject 99 can also view the top surface of the uppermost load 98.

[0059] When the angle of view has moved to a desired position, the subject 99 may input a trigger to stop the angle of view movement, such as ceasing a specific action, thereby stopping the movement of the angle of view and allowing the subject 99 to adjust the distance of the movement of the angle of view. Note that, although the angle of view is divided into eight discontinuous angles in the figure, this is for the purpose of explanation, and the angle of view does not need to be divided discontinuously, and it is designed to move gradually while including overlapping areas.

[0060] The presentation image determination unit 43 transmits a control signal to the camera 20 so that the camera 20 captures an image at the determined angle of view (or the direction of movement of the determined angle of view). The camera 20 then controls the horizontal and vertical angles, and, if the camera 20 is capable of autonomous movement, the movement of the camera 20, so that the camera 20 can capture an image at the determined angle of view (or the direction of movement of the determined angle of view).

[0061] In addition, if there are multiple cameras 20 so as to configure a stereo camera or the like, it is possible to present an image as a stereoscopic video that follows the facial direction or the viewpoint direction of the subject 99. In such a case, the facial direction or the viewpoint direction of the sensed subject 99 is taken into consideration in determining the image to be presented.

[0062] The presentation unit 44 outputs the image captured by the camera 20 with the determined angle of view as a presentation image to the display device 60 for display and presentation to the subject 99 .

[0063] The display device 60 may be a display device 60a such as a smartphone, tablet terminal, smartwatch, television, or projector that has a display positioned around the subject 99. Note that the display in a projector refers to the projection surface, and the term projector is understood to include both a projection device and a projection surface. Alternatively, the display device 60 may be smart glasses 60b that are worn by the subject 99 and have a display placed in front of the subject 99's eyes. The display device 60 presents a presentation image output from the server 40 to the subject 99 by displaying it on the display.

[0064] [Operation] Next, the operation of the information presentation system 100 described above will be described, focusing on the operation of the server 40, with reference to Fig. 5. Fig. 5 is a flowchart showing the operation of the information presentation device according to the embodiment.

[0065] As shown in FIG. 5 , when the operation of the information presentation system 100 is initiated, the image capture range of the connected camera 20 is acquired (step S11). Next, the information collection unit 41 communicates with various sensors to collect information on the subject 99 (information collection step S12). Information collection continues thereafter. The motion analysis unit 42 analyzes the acquired motion of the subject 99 (motion analysis step S13) and determines whether the motion of the subject 99 corresponds to a specific motion. The motion analysis unit 42 outputs an analysis result indicating the result of the determination. Based on the analysis result, the presentation image determination unit 43 determines whether the subject 99 is performing a specific motion (step S14). If the subject 99 is not performing a specific motion (No in step S14), the process returns to the motion analysis step S13 and analyzes the subject's motion from the newly collected information on the subject 99.

[0066] If the subject 99 is performing a specific action (Yes in step S14), the angle of view is determined, and the image to be obtained as the presentation image is determined (presentation image determination step S15). The presentation image determination unit 43 transmits a control signal to the camera 20 to control the horizontal angle, vertical angle, and shooting position of the camera 20 so that the image is captured at the determined angle of view.

[0067] The camera 20 changes the horizontal angle, vertical angle, and shooting position in accordance with the control signal, and starts shooting so that the determined angle of view can be captured. The captured image is then transmitted to the server 40.

[0068] The presentation unit 44 receives the image transmitted from the camera 20. In this way, the camera 20 is controlled and the image after control is acquired (step S16). The acquired image is displayed as a presentation image by outputting it to the smart glasses 60b of the subject 99 or the display device 60a located around the subject 99. In this way, the presentation image is automatically presented when the subject 99 performs a specific action (presentation step S17). Since the subject 99 only needs to perform a specific action and the presentation image is presented when necessary, information is presented appropriately through visual stimulation while reducing the possibility of interfering with other tasks.

[0069] Other Embodiments Although the embodiments have been described above, the present disclosure is not limited to the above-described embodiments.

[0070] For example, the information presentation system described in the above embodiment may be realized as a single device including all of the components, or may be realized by allocating functions to multiple devices and coordinating these multiple devices. In the latter case, the device corresponding to the information presentation device may be an information processing device such as a smartphone, a tablet terminal, or a PC.

[0071] In the above-described embodiment, the processing performed by a specific processing unit may be performed by another processing unit. The order of multiple processing operations may be changed, or multiple processing operations may be performed in parallel.

[0072] In the above-described embodiments, each component may be realized by executing a software program suitable for that component, or by a program execution unit such as a CPU or processor reading and executing a software program recorded on a recording medium such as a hard disk or semiconductor memory.

[0073] Furthermore, each component may be realized by hardware. For example, each component may be a circuit (or integrated circuit). These circuits may form a single circuit as a whole, or each may be a separate circuit. Furthermore, each of these circuits may be a general-purpose circuit or a dedicated circuit.

[0074] Furthermore, the general or specific aspects of the present disclosure may be realized as a system, an apparatus, a method, an integrated circuit, a computer program, or a computer-readable recording medium such as a CD-ROM, etc. Furthermore, the general or specific aspects of the present disclosure may be realized as any combination of a system, an apparatus, a method, an integrated circuit, a computer program, and a recording medium.

[0075] For example, the present disclosure may be realized as an information presentation method executed by a computer, or as a program for causing a computer to execute the information presentation method. The present disclosure may also be realized as a computer-readable non-transitory recording medium on which such a program is recorded.

[0076] In addition, this disclosure also includes forms obtained by applying various modifications to each embodiment that a person skilled in the art would think of, or forms realized by arbitrarily combining the components and functions of each embodiment within the scope that does not deviate from the intent of this disclosure.

[0077] The present disclosure is useful for presenting information to a subject through visual cues.

[0078] 20 Camera 20a Fixed camera 20b Camera-mounted robot 20c Camera-mounted drone 20d Shooting range 40 Server (information presentation device) 41 Information collection unit 42 Motion analysis unit 43 Presentation image determination unit 44 Presentation unit 60, 60a Display device 60b Smart glasses 98 Loaded object 99 Target person 99a Field of view range 100 Information presentation system

Claims

1. A method for presenting information comprising: an information collecting step of collecting at least one piece of information on a subject's posture and at least one piece of information on the subject's facial direction and / or gaze direction; a movement analyzing step of analyzing the movement of the subject using the collected information; a presentation image determining step of determining an image for presentation to be presented to the subject based on the movement analysis results, wherein the image for presentation is an image obtained from a camera installed at a position different from the subject's viewpoint and within a range selected from within the camera's range of capture; and a presentation step of presenting the determined image for presentation to the subject using a display device.

2. The information presentation method according to claim 1, wherein the information collection step uses an image sensor to collect at least one of information on the subject's posture and information on the subject's facial direction and / or gaze direction.

3. The information presentation method according to claim 1, wherein the information collection step uses an ultrasonic sensor to collect at least one of information on the posture of the subject and information on at least one of information on the facial direction and gaze direction of the subject.

4. The information presentation method of claim 1, wherein in the presentation image determination step, when the analysis results indicate an upward shift in the subject's posture of the center of gravity, the presentation image is determined to be in a field of view above the field of view of the subject.

5. The information presentation method of claim 1, wherein in the presentation image determination step, when the analysis results indicate that the subject is in a forward-leaning posture, the presentation image is determined to be in a field of vision forward of the subject's field of vision.

6. The information presentation method described in claim 1, wherein in the presentation step, the presentation image is output to smart glasses that are worn by the subject and have a display placed in front of the subject's eyes, thereby causing the presentation image to be presented on the display.

7. The information presentation method according to claim 1, wherein the presentation step comprises outputting the image for presentation to a display device having a display positioned around the subject, thereby causing the image for presentation to be presented on the display.

8. The information presentation method of claim 1, wherein the information gathering step gathers information on at least one of the subject's facial direction and gaze direction, and the presentation image determination step determines an image to be presented to the subject based on the results of the movement analysis and information on at least one of the subject's facial direction and gaze direction.

9. The information presentation method according to any one of claims 1 to 8, wherein the camera is capable of controlling at least one of the horizontal angle and the vertical angle within a shooting range, and in the presentation step, a control signal is output to control at least one of the horizontal angle and the vertical angle of the camera in accordance with the determined image for presentation, and then an image obtained from the camera is presented to the subject.

10. A program for causing a computer to execute the information presentation method according to claim 1.

11. An information presentation device comprising: an information collecting unit that collects at least one piece of information among information on a subject's posture and at least one piece of information on the subject's facial direction and / or gaze direction; a motion analysis unit that analyzes the subject's movements using the collected information; a presentation image determination unit that determines a presentation image to be presented to the subject based on the results of the movement analysis, wherein the presentation image is an image obtained from a camera installed at a position different from the subject's viewpoint and selected from within the camera's range of capture; and a presentation unit that presents the determined presentation image to the subject.

12. An information presentation system comprising: the information presentation device according to claim 11; the camera; and a display device for presenting the presentation image to the subject.

Images