Information processing device and program

Abstract

This process handles image display and image-based action determination while minimizing the increase in processing load. [Solution] The information processing device comprises an acquisition unit, a display processing unit, and a determination processing unit. The acquisition unit acquires an image of an object captured by the shooting unit. The display processing unit causes the image of the object to be displayed on the display unit. The determination processing unit determines the operation of the object based on the image of the object. The display processing unit causes the image of the object to be displayed on the display unit until the determination of the operation of the object is initiated.

Description

Technical Field

[0006] , , , ,

[0005] , , , , ,

[0001] Embodiments of the present invention relate to an information processing apparatus and a program.

Background Art

[0002] A system for determining hand movements to monitor whether handwashing is being performed properly has been provided. Such a system determines hand movements based on a captured image.

[0003] When the system simultaneously processes the display of the captured image and the determination of hand movements based on the captured image, it causes an increase in the processing power required by the system. [[ID=1"]]

Prior Art Documents

Patent Documents

[0004] [[ID=2"]] Japanese Patent Application Laid-Open No. 2022-19356

Summary of the Invention

Problems to be Solved by the Invention

[0005] The problem to be solved by the embodiments of the present invention is to provide a technique for processing the display of an image and the determination of an action based on the image while suppressing an increase in processing load.

Means for Solving the Problems

[0006] In one embodiment, an information processing apparatus includes an acquisition unit, a display processing unit, and a determination processing unit. The acquisition unit acquires a captured image of an object captured by a capturing unit. The display processing unit causes the captured image of the object to be displayed on a display unit. The determination processing unit determines the action of the object based on the captured image of the object. The display processing unit causes the captured image of the object to be displayed on the display unit until the determination of the action of the object is started.

Brief Description of the Drawings

[0007] [Figure 1] Figure 1 is a schematic diagram showing an example of the configuration of the operation determination system according to the embodiment. [Figure 2] Figure 2 is a block diagram showing an example configuration of the control system of the operation determination system according to the embodiment. [Figure 3] Figure 3 is a diagram illustrating the various components implemented by the processor of the operation determination device according to this embodiment. [Figure 4] Figure 4 is a flowchart showing an example of processing by the operation determination device according to the embodiment. [Figure 5] Figure 5 shows a first display example in the display unit of the input / output device according to the embodiment. [Figure 6] Figure 6 shows a second display example in the display unit of the input / output device according to the embodiment. [Figure 7] Figure 7 shows a third display example in the display unit of the input / output device according to the embodiment. [Modes for carrying out the invention]

[0008] Several embodiments will be described below with reference to the drawings. Note that the scale of the parts in the drawings used in the following description of embodiments may have been changed as appropriate. Also, for illustrative purposes, some components may be omitted from the drawings used in the following description of embodiments.

[0009] <Embodiment> The action determination system according to this embodiment photographs the user's hands in a sink or the like in a washing area. The action determination system determines the user's hand movements during handwashing based on the image of the user's hands captured by the camera. The image of the user's hands is an image that includes the user's hands. Hereinafter, the term "image" refers to the image of the user's hands captured by the camera.

[0010] Handwashing shall consist of several designated actions. These designated actions are categorized by the area being washed and are specific hand movements performed during handwashing. Here, we will explain the multiple designated actions as six actions. These six actions are: lathering well, rubbing the backs of the hands, rubbing between the fingers, rubbing the thumbs, rubbing the fingertips, and rubbing the wrists. The number and content of designated actions are not limited to these.

[0011] Determining an action can include identifying the content of the action. Determining an action can also include determining whether the action is successful or unsuccessful. A successful action means that the action was performed correctly. An unsuccessful action means that the action was not performed correctly.

[0012] (Example configuration) Figure 1 is a schematic diagram showing an example configuration of the motion determination system 1. As shown in Figure 1, the motion determination system 1 consists of a camera 3, an input / output device 4, a sink 20, and the like.

[0013] Sink 20 is a basin for users to wash their hands. Sink 20 has a recessed structure. A drain is also formed at the bottom of sink 20. Additionally, a faucet 21 is installed in the sink 20. The faucet 21 dispenses water for the user to wash their hands. The dispensed water is then drained from the drain of the sink 20.

[0014] Camera 3 is mounted facing downwards above the sink 20. Camera 3 captures the shooting area. For example, Camera 3 obtains an image by capturing the user's hand from above. Camera 3 is an example of a shooting unit that captures the shooting area.

[0015] The input / output device 4 is installed at a position visible to the user. Here, the input / output device 4 is installed in front of the user washing hands at the sink 20. The input / output device 4 is an interface that receives input of instructions and displays various information. The input / output device 4 includes an operation unit that receives input of instructions and a display unit that displays information.

[0016] For example, the operation unit is composed of a touch panel. Note that the operation unit may include a keyboard or a numeric keypad. For example, the display unit is composed of a liquid crystal display or an EL (Electroluminescence) display, etc. The display unit may be integrally formed with the touch panel as the operation unit.

[0017] FIG. 2 is a block diagram showing a configuration example of the control system of the operation determination system 1. As shown in FIG. 2, the operation determination system 1 is a device including a camera 3, an input / output device 4, an operation determination device 10, etc. The operation determination device 10, the camera 3, and the input / output device 4 are communicably connected.

[0018] For example, the operation determination device 10 may be a dedicated device, or may be a desktop PC (Personal Computer), a notebook PC, a tablet PC, a smartphone, etc. The operation determination device 10 is an example of an information processing device that processes information for operation determination.

[0019] The operation determination device 10 includes a processor 11, a ROM (Read Only Memory) 12, a RAM (Random Access Memory) 13, an NVM (Non-Volatile Memory) 14, a communication interface 15, a camera interface 16, an input / output interface 17, etc.

[0020] The processor 11, the ROM 12, the RAM 13, the NVM 14, the communication interface 15, the camera interface 16, and the input / output interface 17 are communicably connected.

[0021] The camera interface 16 is connected to the camera 3 in a communicative manner. The input / output interface 17 is connected to the input / output device 4 in a communicative manner. The camera 3 and input / output device 4 are as described above.

[0022] The processor 11 is the central part of the operation determination device 10. The processor 11 is an element that constitutes the computer of the operation determination device 10. The processor 11 loads the program stored in the ROM 12 or NVM 14 into the RAM 13. By executing the program loaded into the RAM 13, the processor 11 makes various processes possible. For example, the processor 11 is a CPU (Central Processing Unit) or a GPU (Graphics Processing Unit), but is not limited to these.

[0023] The processor 11 is an example of a processing circuit that performs multiple processes by multiple functions. The processing circuit includes one or more circuits that perform multiple processes by multiple functions. For example, the circuit is a processor, an ASIC (Application Specific Integrated Circuit), or an FPGA (Field-Programmable Gate Array), but is not limited to these.

[0024] ROM12 is a non-volatile memory in which control programs and control data are pre-stored. The control programs and control data stored in ROM12 are pre-loaded according to the specifications of the operation determination device 10.

[0025] RAM13 is volatile memory. RAM13 temporarily stores data being processed by processor 11. RAM13 stores various application programs based on instructions from processor 11. RAM13 may also store data necessary for the execution of application programs and the execution results of application programs.

[0026] NVM14 is a non-volatile memory that can be written to and rewritten. NVM14 includes one or more storage devices. For example, the storage device may be an HDD (Hard Disk Drive) or a semiconductor storage medium such as an SSD (Solid State Drive), but is not limited to these. NVM14 stores the above-mentioned program, data used by the processor 11 in performing various processes, and data generated by the processing performed by the processor 11.

[0027] The communication interface 15 is an interface for sending and receiving data with an external device. The communication interface 15 connects to the external device via a network or the like. For example, the communication interface 15 supports wired or wireless LAN (Local Area Network) connections.

[0028] The camera interface 16 is an interface for sending and receiving data with the camera 3. For example, the camera interface 16 sends a signal to the camera 3 to take a picture based on the control of the processor 11. The camera interface 16 also acquires the captured image obtained from the camera 3. For example, the camera interface 16 may support a USB (Universal Serial Bus) connection or a Camera Link connection.

[0029] The input / output interface 17 is an interface for sending and receiving data with the input / output device 4. For example, the input / output interface 17 receives signals from the input / output device 4 indicating the operation of the input / output device 4. The input / output interface 17 transmits the received signals to the processor 11. The input / output interface 17 also transmits information for display to the input / output device 4 based on the control of the processor 11. For example, the input / output interface 17 may support a USB connection or a parallel interface connection.

[0030] In addition to the configuration shown in Figure 2, the operation determination device 10 may have other necessary configurations, or certain configurations may be excluded from the operation determination device 10.

[0031] Figure 3 is a diagram illustrating the various components implemented by the processor 11 of the operation determination device 10. The processor 11 implements the detection unit 111, the acquisition unit 112, the display processing unit 113, and the determination processing unit 114. Each part implemented by the processor 11 can also be described as a function.

[0032] The detection unit 111 detects a trigger to start processing. In one example, the trigger is a system start trigger. The system start trigger is a trigger to start the motion determination sequence. The motion determination sequence is a series of processes performed by the processor 11 of the motion determination device 10 to determine the user's hand movements.

[0033] The action determination sequence may include a process for displaying a list of actions in handwashing. The process for displaying a list of actions in handwashing is a process performed by the display processing unit 113 to display a list of actions in handwashing on the display unit of the input / output device 4. The list of actions in handwashing is a list showing information on multiple specified actions in handwashing. The information on the specified actions is information that allows recognition of the content of the specified actions. The information on the specified actions may consist of text, symbols, illustrations, or photographs, or it may consist of a combination of two or more of these. For example, the content of the specified actions is a guide to the specified actions.

[0034] The action determination sequence may include the processing of displaying the captured image. The processing of displaying the captured image is performed by the display processing unit 113, which displays the image of the user's hand captured by the camera 3 on the display unit of the input / output device 4.

[0035] The operation determination sequence may include a determination result display process. The determination result display process is performed by the display processing unit 113 to display the determination result on the display unit of the input / output device 4. The determination result is the result regarding the user's hand movements obtained by the determination processing by the determination processing unit 114. The determination result is information that allows recognition of whether the user's hand movements are acceptable or unacceptable. The determination result may consist of information such as characters, symbols, illustrations, or photographs, or information consisting of a combination of two or more of these.

[0036] The motion determination sequence may include a determination process. The determination process is performed by a determination processing unit 114 that determines the user's hand movements.

[0037] In another example, the trigger is a judgment start trigger. A judgment start trigger is a trigger that initiates the judgment process.

[0038] The acquisition unit 112 acquires the captured image.

[0039] The display processing unit 113 displays various information on the display unit of the input / output device 4. The display processing unit 113 can display a list of handwashing actions on the display unit of the input / output device 4 through a handwashing action list display process. The display processing unit 113 can display captured images on the display unit of the input / output device 4 through a captured image display process. The display processing unit 113 can display judgment results on the display unit of the input / output device 4 through a judgment result display process.

[0040] The judgment processing unit 114 determines the user's hand movements based on the captured image. For example, the judgment processing unit 114 determines the user's hand movements by classifying the shape of the user's hand based on the captured image. The judgment processing unit 114 may also classify the shape of the user's hand based on a classification model learned by deep learning.

[0041] (Example of processing) The processing in the operation determination device 10 will now be explained. The processing procedure described below is merely an example, and each process may be modified as much as possible. Furthermore, depending on the embodiment, steps in the processing procedure described below may be omitted, replaced, or added as appropriate. Figure 4 is a flowchart showing an example of processing by the motion determination device 10.

[0042] The processor 11 detects a system start trigger (ACT1). ACT1 may also be processed by the detection unit 111. In ACT1, for example, the processor 11 may detect a system start trigger based on user detection by a sensor. The processor 11 may also detect a system start trigger based on a start command input by the user at the operation unit of the input / output device 4.

[0043] Based on the detection of the system start trigger, the processor 11 starts processing the operation determination sequence (ACT2). In ACT2, for example, the processor 11 displays a list of operations in handwashing on the display unit of the input / output device 4, thereby displaying information for multiple specified operations on the display unit of the input / output device 4. The processor 11 displays information for each of the multiple specified operation display areas on the display unit of the input / output device 4. Multiple specified operation display areas are display areas that display information for multiple specified operations. One specified operation display area is an area that displays information for one specified operation.

[0044] Processor 11 acquires captured images (ACT3). ACT3 may also be processed by the acquisition unit 112. In ACT3, for example, processor 11 acquires a video. The video acquired by processor 11 is a video composed of a series of captured images obtained in time series by camera 3 based on the shooting.

[0045] The processor 11 displays the captured image on the display unit of the input / output device 4 until the detection of the user's hand movements begins (ACT4). ACT4 may also be processed by the display processing unit 113. In ACT4, for example, the processor 11 displays a video on the display unit of the input / output device 4. The video displayed on the display unit of the input / output device 4 by the processor 11 is a video composed of a series of captured images obtained in chronological order by the camera 3.

[0046] The frame rate of the video displayed on the display unit of the input / output device 4 by the processor 11 is less than or equal to the frame rate of the video acquired by the processor 11. The frame rate of the video displayed on the display unit of the input / output device 4 by the processor 11 may be the same as the frame rate of the video acquired by the processor 11. In this case, the video displayed on the display unit of the input / output device 4 by the processor 11 is the same as the video acquired by the processor 11. The frame rate of the video displayed on the display unit of the input / output device 4 by the processor 11 may be less than the frame rate of the video acquired by the processor 11. In this case, the video displayed on the display unit of the input / output device 4 by the processor 11 is a video composed of some of the captured images from the video acquired by the processor 11.

[0047] The frame rate of the video displayed on the display unit of the input / output device 4 by the processor 11 is less than or equal to the frame rate of the video used by the processor 11 to determine the user's hand movements in ACT7, which will be described later. The video used by the processor 11 to determine the user's hand movements is a video composed of a series of images captured by the camera 3 in chronological order. The frame rate of the video displayed on the display unit of the input / output device 4 by the processor 11 may be the same as the frame rate of the video used by the processor 11 to determine the user's hand movements. The frame rate of the video displayed on the display unit of the input / output device 4 by the processor 11 may be less than the frame rate of the video used by the processor 11 to determine the user's hand movements. In this case, the processor 11 can reduce the processing load for displaying the captured images by lowering the frame rate of the video.

[0048] The captured image displayed on the display unit of the input / output device 4 is a real-time image. A real-time image is an image that is displayed on the display unit of the input / output device 4 without delay. "Without delay" means that the processor 11 starts displaying the captured image on the display unit of the input / output device 4 before a predetermined time has elapsed after detecting the system start trigger. The predetermined time is less than or equal to half the time from when the processor 11 detects the system start trigger until the user's hand movement is detected. As a result, the processor 11 can display the captured image on the display unit of the input / output device 4 in real time, improving user convenience.

[0049] This section explains the display position of the captured image. The processor 11 may display the captured image in a position that does not overlap with any of the multiple designated operation display areas. In this example, the display position of the captured image is a predetermined position that does not overlap with any of the multiple designated operation display areas. The display position of the captured image can be set as appropriate. The information of the designated operation displayed in each designated operation display area is all visible. Therefore, the processor 11 can display both the information of each designated operation and the captured image on the display unit of the input / output device 4 in a manner that allows the user to see both.

[0050] The processor 11 may display the captured image at a position that overlaps with part or all of the multiple designated operation display areas. In this example, the processor 11 displays the captured image as an overlay on part or all of the multiple designated operation display areas. The display position of the captured image is at a position that overlaps with part or all of at least one of the multiple designated operation display areas. The display position of the captured image can be set as appropriate. Therefore, the processor 11 can display the captured image on the display unit of the input / output device 4 at a large size that is easy for the user to see.

[0051] The processor 11 may display the captured image in one of the multiple designated action display areas, specifically in the designated action display area that displays information about the designated action corresponding to the user's hand movement. The display position of the captured image is one of the multiple designated action display areas. In this example, the processor 11 may overlay the captured image on the designated action display area that displays information about the designated action corresponding to the user's hand movement. The captured image may be displayed in a manner in which some or all of the information about the designated action is not visible. The captured image may be displayed in a manner in which all of the information about the designated action is visible. The display position of the captured image can be set as appropriate. Therefore, the processor 11 can display the captured image on the display unit of the input / output device 4 in a manner that makes it easy for the user to recognize which designated action is being performed.

[0052] The processor 11 detects a judgment start trigger (ACT5). ACT5 may also be a process performed by the detection unit 111. In ACT5, for example, the processor 11 may detect a judgment start trigger based on the detection of a user by a sensor. The processor 11 may also detect a judgment start trigger based on the user's input of a start command at the operation unit of the input / output device 4. The processor 11 may detect a judgment start trigger a predetermined time after the detection of the system start trigger. In this example, the processor 11 may display the time until the judgment of the user's hand movements begins on the display unit of the input / output device 4. After the user has finished washing their hands, the processor 11 detects a judgment start trigger to determine the user's hand movements for each of several specified actions collectively.

[0053] Based on the detection of the judgment start trigger, the processor 11 erases the captured image on the display unit of the input / output device 4 (ACT6). ACT6 may also be processed by the display processing unit 113. In ACT6, for example, the processor 11 erases the captured image on the display unit of the input / output device 4 by ending the display of the video on the display unit of the input / output device 4.

[0054] The processor 11 determines the user's hand movements based on the captured image (ACT7). ACT7 may also be processed by the determination processing unit 114. In ACT7, for example, the processor 11 starts determining the user's hand movements after the display of the captured image on the display unit of the input / output device 4 has finished. The processor 11 determines the user's hand movements collectively for each of the multiple specified movements.

[0055] The video frame rate used by processor 11 to determine the user's hand movements is the same as the video frame rate acquired by processor 11. This allows processor 11 to improve the accuracy of determining the user's hand movements.

[0056] The processor 11 displays the determination result on the display unit of the input / output device 4 based on the determination of the user's hand movements (ACT8). ACT8 may also be processed by the display processing unit 113. In ACT8, for example, the processor 11 displays the determination result for a specified operation in each of the multiple specified operation display areas.

[0057] In the example above, the processor 11 determines the user's hand movements collectively for each of the multiple specified actions, but it is not limited to this. The processor 11 may repeat ACT5 to ACT8 for each specified action. In this example, the processor 11 may repeat ACT5 to ACT8 for each specified action in a predetermined order among the multiple specified actions. The processor 11 may also repeat ACT5 to ACT8 for each specified action in any order among the multiple specified actions.

[0058] (Example display) An example of how captured images are displayed on the display unit of the input / output device 4 will be described.

[0059] Figure 5 shows a first example of the display on the display unit of the input / output device 4. The display unit of the input / output device 4 displays a list of operations during hand washing. The display unit of the input / output device 4 includes a first designated operation display area 41, a second designated operation display area 42, a third designated operation display area 43, a fourth designated operation display area 44, a fifth designated operation display area 45, and a sixth designated operation display area 46.

[0060] The first designated action display area 41 is the area that displays information for the designated action "lather well". The second designated action display area 42 is the area that displays information for the designated action "wash the back of the hand". The third designated action display area 43 is the area that displays information for the designated action "wash between the fingers". The fourth designated action display area 44 is the area that displays information for the designated action "wash the thumb". The fifth designated action display area 45 is the area that displays information for the designated action "wash the fingertips". The sixth designated action display area 46 is the area that displays information for the designated action "wash the wrist".

[0061] The display unit of the input / output device 4 displays the captured image 51 in a position that does not overlap with the six designated operation display areas.

[0062] Figure 6 shows a second display example on the display unit of the input / output device 4. The display unit of the input / output device 4 displays a list of operations during handwashing, similar to Figure 5. The display unit of the input / output device 4 displays the captured image 52 at a position that overlaps with part or all of the six designated operation display areas. In this case, the display position of the captured image 52 is at a position that overlaps with part of the second designated operation display area 42, the third designated operation display area 43, and the sixth designated operation display area 46.

[0063] Figure 7 shows a third display example on the display unit of the input / output device 4. The display unit of the input / output device 4 displays a list of operations during handwashing, similar to Figure 5. The display unit of the input / output device 4 displays the captured image 53 in the designated action display area, which displays information about the designated action corresponding to the user's hand movement, among the six designated action display areas. Here, the display position of the captured image 53 is the first designated action display area 41. The captured image 53 is displayed in the first designated action display area 41 in a manner in which not all of the information about the designated action is visible.

[0064] In the above-described embodiment, the motion determination device 10 displays the captured image of the user's hand on the display unit of the input / output device 4 until the determination of the user's hand movement begins. This allows the motion detection device 10 to separate the display period of the captured image from the period for determining the user's hand movements. Therefore, the motion detection device 10 can process the display of the captured image and the determination of the user's hand movements while suppressing an increase in processing load.

[0065] <Other Embodiments> The embodiments described above focus on the user's hands during handwashing, but are not limited to this. The target may be a part of the user's body other than during handwashing. The target may also be a moving object other than a person.

[0066] Each component implemented by the processor 11 described in the above-described embodiment is not limited to being implemented in a single device such as the operation determination device 10. Each component may be implemented in an information processing system distributed across multiple devices.

[0067] The embodiments described above may be applied to a single device. The embodiments described above may be applied to a method performed by one or more devices. The embodiments described above may be applied to a program that can cause computers in one or more devices to perform each function. The embodiments described above may be applied to a recording medium that stores the program.

[0068] Each of the one or more circuits that make up a processing circuit performs one or more of the multiple processes. If the processing circuit consists of a single circuit, the single circuit performs all of the multiple processes. If the processing circuit consists of multiple circuits, each of the multiple circuits performs some of the multiple processes. Some of the multiple processes may be one of the multiple processes, or two or more of the multiple processes. If the processing circuit consists of multiple circuits, the multiple circuits may be contained in a single device, or they may be distributed across multiple devices.

[0069] The program may be transferred while stored in the device according to the embodiment, or it may be transferred without being stored in the device. In the latter case, the program may be transferred via a network, or it may be transferred while recorded on a recording medium. The recording medium is a non-temporary tangible medium. The recording medium is a computer-readable medium. The recording medium may be any medium that is capable of storing a program and is readable by a computer, such as a CD-ROM or memory card, and its form is not limited.

[0070] While several embodiments of the present invention have been described, these embodiments are presented as examples only and are not intended to limit the scope of the invention. These novel embodiments can be carried out in a variety of other forms, and various omissions, substitutions, and modifications can be made without departing from the spirit of the invention. These embodiments and their variations are included in the scope and spirit of the invention, as well as in the claims of the invention and its equivalents.

[0071] Some of the embodiments described above may be expressed as follows: (1) An acquisition unit that acquires images of the subject captured by the shooting unit, A display processing unit that displays the aforementioned captured image on a display unit, A determination processing unit that determines the operation of the target based on the captured image of the target, Equipped with, The display processing unit displays the captured image of the target on the display unit until the determination of the target's operation is initiated. Information processing device. (2) The frame rate of the video consisting of continuous images of the target that are displayed on the display unit by the display processing unit is less than or equal to the frame rate of the video consisting of continuous images of the target that are used by the determination processing unit. (1) The information processing device described above. (3) The display processing unit displays information on multiple operations on the display unit and displays the captured image of the target in a position that does not overlap with the display area on which the information on multiple operations is displayed. (1) The information processing device described above. (4) The display processing unit causes the display unit to display information on multiple operations, and displays the captured image of the target at a position that overlaps with part or all of the display area where the information on multiple operations is displayed. (1) The information processing device described above. (5) The display processing unit displays information of multiple operations on the display unit, and displays the captured image of the target in the display area that displays information of the operation corresponding to the target operation among the multiple operations. (1) The information processing device described above. (6) To the computer, A function to acquire images of the subject captured by the photography department, A function to display the aforementioned target image on the display unit, A function to determine the movement of the target based on the captured image of the target, Make it run, The aforementioned display function displays the captured image of the target on the display unit until the determination of the target's operation is initiated. A program that makes this possible. [Explanation of Symbols]

[0072] 1...Motion determination system, 3...Camera, 4...Input / output device, 11...Processor, 12...ROM, 13...RAM, 14...NVM, 15...Communication interface, 16...Camera interface, 17...Input / output interface, 20...Sink, 21...Faucet, 41...First designated operation display area, 42...Second designated operation display area, 43...Third designated operation display area, 44...Fourth designated operation display area, 45...Fifth designated operation display area, 46...Sixth designated operation display area, 51...Captured image, 52...Captured image, 53...Captured image, 111...Detection unit, 112...Acquisition unit, 113...Display processing unit, 114...Determination processing unit.

Claims

1. An acquisition unit that acquires images of the subject taken by the photography unit, A display processing unit that displays the aforementioned captured image on a display unit, A determination processing unit that determines the operation of the target based on the captured image of the target, Equipped with, The display processing unit displays the captured image of the target on the display unit until the determination of the target's operation is initiated. Information processing device.

2. The frame rate of the video consisting of continuous images of the target displayed on the display unit by the display processing unit is less than or equal to the frame rate of the video consisting of continuous images of the target used by the determination processing unit. The information processing apparatus according to claim 1.

3. The display processing unit displays information about multiple operations on the display unit, and displays the captured image of the target in a position that does not overlap with the display area where the information about the multiple operations is displayed. The information processing apparatus according to claim 1.

4. The display processing unit causes the display unit to display information on multiple operations, and displays the captured image of the target at a position that overlaps with part or all of the display area where the information on the multiple operations is displayed. The information processing apparatus according to claim 1.

5. The display processing unit displays information of multiple operations on the display unit, and displays the captured image of the target in the display area that displays information of the operation corresponding to the target operation among the multiple operations. The information processing apparatus according to claim 1.

6. On the computer, A function to acquire images of the subject captured by the photography department, A function to display the aforementioned captured image on the display unit, A function to determine the movement of the target based on the captured image of the target, Make it run, The aforementioned display function displays the captured image of the target on the display unit until the determination of the target's operation is initiated. A program that makes this possible.

Images