Information processing device, information processing method, and guidance method

Abstract

This technology provides a new way to convey instructions to performers. [Solution] The disclosed information processing device 10 acquires a guidance image projected onto the performance area 2 where the performer 3 performs, and causes the projection device 1 to project the guidance image onto the performance area 2. The guidance image includes a position guidance mark (guidance information 4). When the guidance image is projected onto the performance area 2, the position guidance mark (guidance information 4) is displayed at the position in the performance area 2 that the performer 3 is instructed to stand at.

Description

[Technical Field]

[0001] This disclosure relates to an information processing device, an information processing method, and a guidance method. [Background technology]

[0002] <000000> Information related to this disclosure is disclosed in Non-Patent Document 1. Non-Patent Document 1 discloses the use of tape to create cross marks (so-called "markings") and attaching them to the floor in order to clearly indicate the performer's position in the performance area where the performer is performing. [Prior art documents] [Non-patent literature]

[0003] [Non-Patent Document 1] Cover Corporation, “Motion Capture Technology Made Possible by the New Studio: The Inside Story of the Hoshimatic Project,” [online], December 27, 2023, [Retrieved September 10, 2024], Internet<URL: https: / / note.cover-corp.com / n / n10e1d<1123477> [Overview of the project] [Problems that the invention aims to solve]

[0004] In the current method of indicating instructions (such as standing positions) to performers using tape attached to the floor, a great deal of effort is required to apply and remove the tape. One example of the purpose of this disclosure is to provide a new technology for communicating instructions to performers. [Means for solving the problem]

[0005] According to one aspect of this disclosure, A means for acquiring guidance images that are projected onto the performance area where performers perform, The projection device includes projection control means for projecting the guide image onto the performance area, It has, The aforementioned guidance image includes location guidance marks, When the guidance image is projected onto the performance area, an information processing device is provided which displays the position guidance mark at the standing position within the performance area as instructed by the performer.

[0006] Furthermore, according to one aspect of this disclosure, One or more computers, The guide image projected onto the performance area where the performers perform is acquired, The projection device is used to project the guide image onto the performance area. The aforementioned guidance image includes location guidance marks, A method is provided for processing information in which, when the guidance image is projected onto the performance area, the position guidance mark is displayed at the standing position within the performance area as instructed by the performer.

[0007] Furthermore, according to one aspect of this disclosure, Using a projection device, guide images are projected onto the performance area where the performers act. The aforementioned guidance image includes location guidance marks, When the guidance image is projected onto the performance area, a guidance method is provided in which the position guidance mark is displayed at the standing position within the performance area as instructed by the performer. [Effects of the Invention]

[0008] According to one example of this disclosure, a new technology will be realized that will convey instructions given to performers back to them. [Brief explanation of the drawing]

[0009] [Figure 1] Figure 1 is a diagram illustrating an example of the overall structure of an information processing system. [Figure 2] Figure 2 shows an example of a performance area. [Figure 3] Figure 3 shows an example of a projected screen. [Figure 4]FIG. 4 is a diagram showing an example of the hardware configuration of the information processing apparatus. [Figure 5] FIG. 5 is a diagram showing an example of the functional block diagram of the information processing apparatus. [Figure 6] FIG. 6 is a diagram showing an example of the guidance information. [Figure 7] FIG. 7 is a diagram showing another example of the guidance information. [Figure 8] FIG. 8 is a diagram showing another example of the guidance information. [Figure 9] FIG. 9 is a flowchart showing an example of the processing flow of the information processing apparatus. [Figure 10] FIG. 10 is a diagram showing another example of the functional block diagram of the information processing apparatus. [Figure 11] FIG. 11 is a diagram showing an example of the guidance image with additional information. [Figure 12] FIG. 12 is a diagram for explaining another example of the overall image of the information processing system. [Figure 13] FIG. 13 is a diagram showing an example of the corrected guidance image.

Embodiments for Carrying Out the Invention

[0010] Hereinafter, embodiments of this disclosure will be described with reference to the drawings. In this disclosure, the drawings are associated with one or more embodiments. Also, in all the drawings, the same components are denoted by the same reference numerals, and the description will be omitted as appropriate.

[0011] <<First Embodiment>> <Overview> The information processing apparatus according to the first embodiment has a feature that a guidance image showing the content (the content of the instruction that the performer needs to follow) instructed to (directed at) the performer is projected onto the performance area (the floor surface) where the performer performs. Hereinafter, the configuration of the information processing apparatus will be described in detail.

[0012] <Overall Image of the Information Processing System> First, Figure 1 will be used to describe the overall structure of the information processing system, including the information processing device 10. The information processing system includes the information processing device 10 and the projection device 1. The information processing system may further include a performance area 2.

[0013] Acting Area 2 is the floor. Acting Area 2 may be a floor designed for an information processing system or an existing floor. Performer 3 stands on Acting Area 2 and performs. Examples of Acting Area 2 include, but are not limited to, a stage, a shooting area in a filming studio, or a practice floor.

[0014] A projection sheet may be spread out in the performance area 2. The composition of the projection sheet is not limited. For example, a sheet for projecting widely used images may be used as the projection sheet. Alternatively, a white sheet or carpet may be used as the projection sheet. By spreading the projection sheet over the performance area 2, the various information projected by the projection device 1 will be displayed more clearly in the performance area 2.

[0015] Furthermore, the performance area 2 may include scale marks (not shown in Figure 1) that serve as a guide for positioning within the performance area 2. Note that the performance area 2 does not necessarily have to include scale marks 5. For example, the performance area 2 may show a pattern of multiple scale marks 5 arranged regularly, as shown in Figure 2. The scale marks 5 in Figure 2 are cross marks, but the scale marks 5 are not limited to these marks. An example of the spacing between scale marks 5 is 1m, but this is not limited to this. Having such scale marks 5 in the performance area 2 is preferable because it facilitates the alignment of the projection screen 7 projected by the projection device 1. It is also preferable that these scale marks 5 can be used to indicate the performer's standing position, movement path, and as markers.

[0016] There are various ways to generate the performance area 2 that shows scale mark 5, and there are no particular restrictions. For example, the performance area 2 that shows scale mark 5 can be generated by spreading a sheet with scale mark 5 displayed on it (e.g., printed) over the performance area 2. Alternatively, a sticker of scale mark 5 can be attached to the projection sheet, or scale mark 5 can be drawn on the projection sheet with a pen or ink. The example shown here is merely one example and is not limited to this example.

[0017] The projection device 1 projects a projection screen 7 onto the performance area 2. The aspect ratio of the projection screen 7 is, for example, 16:10 (width:height), but is not limited to this. The projection size can be, for example, 514 inches to 617 inches, but is not limited to this. As shown in Figure 3, the projection device 1 can have a certain range of lens shift in the vertical and horizontal directions. Note that the width of the movable range shown is merely an example and is not limited to this.

[0018] The projection device 1 is installed in a position and orientation that allows the projected screen 7 to be displayed in the performance area 2. For example, the projection device 1 may be mounted on the ceiling or on other components located at a relatively high position.

[0019] When projecting the projection screen 7 onto the performance area 2 (floor) from a relatively high position such as the ceiling, sufficient brightness of the projection device 1 is necessary to clearly display the guidance information 4 on the performance area 2. For example, if the distance from the performance area 2 to the projection device 1 is between 6m and 7m, the brightness of the projection device 1 should be 18,000 lumens (lm) or more, more preferably 19,000 lumens or more.

[0020] The inventors have confirmed that when the distance from the performance area 2 to the projection device 1 is between 6m and 7m, the guidance information 4 can be clearly displayed in the performance area 2 by satisfying the brightness conditions of the projection device 1. Furthermore, the inventors have confirmed that when the distance from the performance area 2 to the projection device 1 is between 6m and 7m, if the brightness of the projection device 1 is less than 18,000 lumens, the guidance information 4 cannot be clearly displayed in the performance area 2.

[0021] Returning to Figure 1, the projection device 1 receives a guidance image from the information processing device 10 and can display the received guidance image on the projection screen 7 projected onto the performance area 2. The guidance image projected onto the performance area 2 includes guidance information 4 indicating the instructions given to the performer 3. In the example in Figure 1, the guidance information 4 is an "X" mark, and the position of this mark indicates the standing position within the performance area 2 as instructed for the performer 3. Note that the guidance information 4 is not limited to a mark indicating the standing position within the performance area 2. Variations of the guidance information 4 will be explained below.

[0022] The information processing device 10 is connected to the projection device 1 in a communication manner. The information processing device 10 inputs a guidance image showing guidance information 4 to the projection device 1 and projects the input guidance image. The information processing device 10 may be a general-purpose device such as a personal computer, tablet terminal, or smartphone, or it may be a dedicated device designed for an information processing system.

[0023] The information processing device 10 may be equipped with an input device and a display. The operator can operate the information processing device 10 to generate guidance images to be projected onto the projection device 1, or to read pre-stored guidance images and display them on the display of the information processing device 10. In addition, the guidance image projected by the projection device 1 onto the performance area 2 may be simultaneously displayed on the display of the information processing device 10. In this case, the operator can confirm the guidance image projected onto the performance area 2 by looking at the display of the information processing device 10. The detailed configuration of the information processing device 10 will be described later.

[0024] Although not shown in Figure 1, the information processing system may also include a motion capture system. The motion capture system is a system that digitizes (represents as digital data) the movements of performer 3. For example, an optical motion capture system can be used.

[0025] <Hardware configuration of information processing device 10> Next, an example of the hardware configuration of the information processing device 10 will be described. Each functional unit of the information processing device 10 is realized by any combination of hardware and software. It will be understood by those skilled in the art that there are various variations in the implementation method and the device. The software includes programs that are pre-installed at the time of shipment of the device, as well as programs downloaded from recording media such as CDs (Compact Discs) or from servers on the Internet.

[0026] Figure 4 is a block diagram illustrating the hardware configuration of the information processing device 10. As shown in Figure 4, the information processing device 10 includes a processor 1A, memory 2A, input / output interface 3A, peripheral circuitry 4A, and bus 5A. Peripheral circuitry 4A includes various modules. The information processing device 10 does not necessarily have peripheral circuitry 4A. The information processing device 10 may also be composed of multiple physically and / or logically separated devices. In this case, each of the multiple devices may have the above hardware configuration.

[0027] Bus 5A is a data transmission path for the processor 1A, memory 2A, peripheral circuits 4A, and input / output interface 3A to send and receive data to and from each other. Processor 1A is a processing unit such as a CPU (Central Processing Unit) or GPU (Graphics Processing Unit). Memory 2A is a memory such as RAM (Random Access Memory) or ROM (Read Only Memory). Input / output interface 3A includes interfaces for acquiring information from input devices, external devices, external servers, external sensors, cameras, etc., and interfaces for outputting information to output devices, external devices, external servers, etc. Input / output interface 3A also includes interfaces for connecting to communication networks such as the Internet. Input devices include, for example, keyboards, mice, microphones, physical buttons, touch panels, etc. Output devices include, for example, displays, projectors, speakers, printers, mailers, etc. Processor 1A can issue commands to each module and perform calculations based on their calculation results.

[0028] <Functional configuration of the information processing device 10> Next, the functional configuration of the information processing device 10 will be described in detail. Figure 5 is an example of a functional block diagram of the information processing device 10. As shown in the figure, the information processing device 10 has an acquisition unit 11 and a projection control unit 12.

[0029] The acquisition unit 11 acquires the guidance image projected onto the performance area 2 where the performer 3 performs.

[0030] The guidance image includes guidance information 4 that shows the instructions given to performer 3. Examples of instructions given to performer 3 include, but are not limited to, the standing position within the performance area 2, the route of movement within the performance area 2, the speed of movement, the movements to be performed at each position (jumping, crouching, falling, etc.), information about the performance, and information about the progress of the performance and filming. Guidance information 4 can show the instructions given to performer 3 using at least one of the following: marks, shapes, numbers, letters, symbols, pictures, still images, and moving images.

[0031] A single guide image may contain instructions for one presenter 3, or it may contain instructions for multiple presenters 3. The instructions for each of the multiple presenters 3 included in a single guide image may be displayed in a way that makes them identifiable to one another. There are various means for displaying the instructions for each of the multiple presenters 3 in an identifiable way, but examples include color coding.

[0032] The following is an example of information 4, but information 4 is not limited to the example below.

[0033] For example, guidance information 4 may include a location guidance mark. The location guidance mark indicates the performer's position within the performance area 2. As shown in Figure 6, when the guidance image is projected onto the performance area 2, the location guidance mark (guidance information 4) is displayed at the position within the performance area 2 that the performer 3 has been instructed to stand at.

[0034] In addition, the guidance information 4 may include motion guidance lines. The motion guidance lines indicate the movement of performer 3 within the performance area 2. As shown in Figure 7, when the guidance image is projected onto the performance area 2, the motion guidance lines (guidance information 4) are displayed along the movement line instructed to performer 3 within the performance area 2. The motion guidance lines (guidance information 4) shown in Figure 7 are arrow lines, and the direction of the arrows also indicates the direction in which performer 3 will move. Furthermore, the guidance information 4 shown in Figure 7 also indicates the starting position (the position where "Start" is displayed in the figure) where performer 3 will begin the movement instructed to them.

[0035] In addition, the guidance information 4 may include a motion guidance mark. The motion guidance mark indicates the movement of performer 3 within the performance area 2. As shown in Figure 8, when the guidance image is projected onto the performance area 2, the motion guidance mark M (guidance information 4) moves along the movement route indicated to performer 3 within the performance area 2. Through this movement, the motion guidance mark M can indicate the movement route indicated to performer 3 within the performance area 2.

[0036] Furthermore, the motion guidance mark M can move at the speed instructed to performer 3. By moving at this speed, the motion guidance mark M can indicate the speed instructed to performer 3.

[0037] Furthermore, the guidance information 4 shown in Figure 8 indicates the direction of movement instructed to performer 3, based on the direction of movement of the movement guidance mark M. The guidance information 4 shown in Figure 8 also shows a line along the movement path instructed to performer 3. The movement guidance mark M will move along this line. The guidance information 4 shown in Figure 8 also indicates the starting position (the position where "Start" is displayed in the figure) where performer 3 will begin the movement instructed to them.

[0038] Although not shown in the diagram, the guidance information 4 may also display a scale image indicating length (distance). The scale image includes, for example, a straight line of a predetermined length and text information indicating the length of that line. The predetermined length may be 1m, 3m, 5m, 10m, etc., or other lengths. By using such a scale image in combination with the scale mark 5 (see Figure 2) located in the performance area 2, the performer 3 can accurately grasp the distance.

[0039] Next, the means by which the acquisition unit 11 acquires the guidance image will be described. The acquisition unit 11 can acquire the guidance image by either of the following acquisition examples 1 and 2.

[0040] Example 1 of acquisition In acquisition example 1, the acquisition unit 11 acquires a guidance image by reading a guidance image that has been pre-stored in a predetermined storage device from the predetermined storage device. The predetermined storage device may be provided within the information processing device 10, or it may be provided in an external device that is communicatively connected to the information processing device 10. The same premise regarding the predetermined storage device applies below.

[0041] The acquisition unit 11 may, in accordance with the operator's operation, read out a guidance image specified by the operator from among the guidance images stored in a predetermined storage device.

[0042] Furthermore, attribute information may be associated with each guidance image stored in a predetermined storage device. The operator may then use this attribute information to perform an image search to find a predetermined guidance image from among multiple guidance images stored in the predetermined storage device, and designate the found guidance image as the guidance image to be projected onto the performance area 2. For example, the operator may input a certain attribute as a key for the image search into the information processing device 10. The acquisition unit 11 may then refer to the attribute information of each guidance image, identify the guidance image containing the input key (attribute information), and present the identified guidance image to the operator as a search result. The operator can then select one of the guidance images presented as a search result.

[0043] Attribute information may include, but is not limited to, the identification information (name, etc.) of the person (performer 3) giving instructions in each guidance image, the identification information of the scene in which each guidance image is displayed in acting area 2, the type of instructions indicated by each guidance image (standing position, movement path, etc.), and the timing of when each guidance image will be used as scheduled (e.g., September 11, 2024, 10:00-10:30).

[0044] In addition, the acquisition unit 11 may read a predetermined guidance image from a predetermined storage device according to a predetermined rule. Such rules can vary. For example, a schedule for using each guidance image may be determined in advance, and information indicating the contents of the schedule may be stored in the information processing device 10. The schedule indicates the guidance image to be used at each timing, for example, "September 11, 2024, 10:00-10:30: Guidance Image A". The acquisition unit 11 may refer to this schedule to identify the guidance image to be used at the present time and read the identified guidance image from the predetermined storage device.

[0045] Example 2 of acquisition In acquisition example 2, the acquisition unit 11 acquires a guidance image by generating a guidance image according to the operator's operations. For example, the acquisition unit 11 can generate a guidance image based on the operator's operations using image generation software (application) installed on the information processing device 10.

[0046] Returning to Figure 5, the projection control unit 12 causes the projection device 1, which projects the projection screen 7 onto the performance area 2, to project the guidance image acquired by the acquisition unit 11. In other words, the projection control unit 12 inputs the guidance image acquired by the acquisition unit 11 to the projection device 1 and causes it to project. The projection device 1 is installed to project the projection screen 7 onto the performance area 2. Through this control by the projection control unit 12, the guidance image is projected onto the performance area 2.

[0047] Next, an example of the processing flow of the information processing device 10 will be explained using the flowchart in Figure 9. Note that the purpose here is to explain the processing flow. Details of each process have been described above, so explanations will be omitted here as appropriate.

[0048] In S10, the information processing device 10 acquires the guidance image to be projected onto the performance area 2 where performer 3 performs. In S11, the information processing device 10 instructs the projection device 1 to project the guidance image onto the performance area 2.

[0049] In one example, the guidance image includes a location marker (guidance information 4). Then, as shown in Figure 6, when the guidance image is projected onto the performance area 2, the location marker (guidance information 4) is displayed at the position within the performance area 2 that the performer 3 is instructed to stand at.

[0050] In another example, the guidance image includes motion guidance lines (guidance information 4). Then, as shown in Figure 7, when the guidance image is projected onto the performance area 2, the motion guidance lines (guidance information 4) are displayed along the movement path within the performance area 2 instructed to the performer 3.

[0051] In another example, the guidance image includes a motion guidance mark M (guidance information 4). Then, as shown in Figure 8, when the guidance image is projected onto the performance area 2, the motion guidance mark M (guidance information 4) moves along the path within the performance area 2 instructed to the performer 3. The motion guidance mark M (guidance information 4) can move at the speed instructed to the performer 3.

[0052] <Effects and Effects> According to the information processing device 10 of the first embodiment, a guidance image showing the content instructed to the performer 3 can be projected onto the performance area 2 (floor) where the performer performs. In the case of using tape attached to the floor to show the performer 3 the content instructed (such as standing position), a lot of effort is required to apply and remove the tape. For example, the tape needs to be reapplied for each scene of the performance, which is very laborious. According to the information processing device 10 of the first embodiment, this effort can be reduced.

[0053] Furthermore, in the case of the information processing device 10 that projects guidance images, it can convey instructions to the performer 3 using various types of information. That is, in the case of the information processing device 10, it can convey instructions to the performer 3 using various types of information such as marks, shapes, numbers, letters, symbols, pictures, still images, and moving images. With such an information processing device 10, instructions can be accurately conveyed to the performer 3. Moreover, with such an information processing device 10, it becomes possible to accurately convey instructions that include a large amount of information, such as not only standing positions and movement routes, but also movements to be performed at each position, as well as complex instructions, to the performer 3.

[0054] Furthermore, in the case of an information processing device 10 that projects guidance images, instructions can be conveyed to the performer 3 using moving images. With such an information processing device 10, for example, the performer 3 can be informed of the instructed movement speed by actually moving a mark or the like. In this way, the information processing device 10 can convey information to the performer 3 that cannot be conveyed by means of indicating the instructed content (such as standing position) to the performer 3 using tape attached to the floor.

[0055] <<Second Embodiment>> The information processing device 10 of the second embodiment has the function of receiving input of additional information to be added to the guidance image projected on the performance area 2, and projecting the guidance image with the additional information onto the performance area 2. This will be described in detail below.

[0056] Figure 10 is an example of a functional block diagram of the information processing device 10. As shown in the figure, the information processing device 10 includes an acquisition unit 11, a projection control unit 12, a reception unit 13, and an image processing unit 14.

[0057] The reception unit 13 accepts input of additional information to be added to the guidance image being projected in the performance area 2.

[0058] The additional information is information added to the guidance image acquired by the acquisition unit 11. The additional information can include various types of information. The additional information can be at least one of the following: marks, figures, numbers, letters, symbols, pictures, still images, and moving images, and can indicate the content added to the guidance image.

[0059] The content of the additional information is not limited and examples include, but are not limited to, notes, records, comments, and messages directed to performer 3 while they are performing in performance area 2.

[0060] For example, during filming in a studio or during rehearsals on a practice floor, the instructions given to performer 3 (such as their position and movement) may be changed. In such cases, as shown in Figure 11, for example, the details of the change, the fact that a change has been made, and the date and time of the change may be added to the guidance image as additional information.

[0061] In addition, although not shown in the illustrations, the date and time when the photography or practice using each guide image was performed (practice record) may be added to the guide image as additional information. In addition, although not shown in the illustrations, the date and time when the photography or practice using each guide image was completed (completion record) may be added to the guide image as additional information.

[0062] In addition, notes indicating problems with the instructions shown in each guide image, which became apparent during filming or practice using each guide image, may be added to the guide images as supplementary information.

[0063] In addition, information regarding performer 3 during the actual performance, filming, or rehearsal using each instruction image may be added to the instruction image as supplementary information. Examples of such supplementary information include: "Performer 3 was following the instructions shown in the instruction image," "Performer 3 was not following the instructions shown in the instruction image," "Performer 3 was moving as instructed in the instruction image," and "Performer 3 was not moving as instructed in the instruction image." Another example of such supplementary information is information indicating the position of each performer 3 within the acting area 2 at the final timing of the scene using each instruction image during filming. According to this supplementary information, the actual position of each performer 3 at the final timing of each scene is shown, so by referring to this information when filming the next scene, the final position of each performer 3 in the previous scene can be easily determined. This determination result can then be used to avoid inconsistencies in the position of performer 3 at the boundary between scenes.

[0064] The reception unit 13 can receive input of additional information to be added to the guidance image being projected onto the performance area 2. The image processing unit 14, described later, can then add this additional information to the guidance image being projected onto the performance area 2. The projection control unit 12 can then cause the projection device 1 to project the guidance image with the additional information onto the performance area 2.

[0065] In the case of an information processing device 10 with this configuration, for example, additional information can be added in real time to the guidance image projected onto the performance area 2 during the actual performance, filming, or practice. That is, the guidance image projected onto the performance area 2 can be updated (changed) in real time based on the additional information. With such an information processing device 10, for example, an operator operating the information processing device 10 can send a message to the performer 3 who is performing in the performance area 2 by adding additional information to the guidance image and displaying that additional information on the performance area 2.

[0066] Next, the means by which the reception unit 13 acquires additional information will be described. The reception unit 13 can acquire additional information by either of the following reception examples 1 and 2.

[0067] Example of reception 1 In reception example 1, the operator can input additional information by operating the input device of the information processing device 10. The input device may include, but is not limited to, a touch panel, keyboard, physical buttons, mouse, joystick, microphone, etc. For example, the guidance image projected onto the performance area 2 is simultaneously displayed on the display of the information processing device 10. The operator can input the position on the projected image to which the additional information will be added, as well as the additional information to be added, on the guidance image displayed on the display of the information processing device 10. The reception unit 13 acquires the additional information input from the operator in this manner, for example.

[0068] Example of reception 2 In Reception Example 2, as shown in Figure 12, a camera 6 is installed to photograph the performance area 2. The information processing system may have the camera 6, or the camera 6 may be used as an external device of the information processing system.

[0069] Camera 6 may be mounted on the ceiling or on other components located at a relatively high position. Camera 6 is positioned to photograph the performance area 2 on which the guidance image is projected. Camera 6 may capture still images or moving images. Camera 6 detects visible light and creates images. In addition, camera 6 may detect other electromagnetic waves such as infrared rays and create images.

[0070] The reception unit 13 generates additional information by analyzing the image generated by the camera 6. For example, the reception unit 13 may generate information about the performer 3 located in the performance area 2 described above by analyzing the image.

[0071] For example, the reception unit 13 can detect each performer 3 from an image using pre-registered features of each performer 3's appearance (face information, costume information, body type information, etc.). The reception unit 13 can also detect the guidance information 4 from an image using pre-registered features of the guidance information 4's appearance (mark type, shape, line type, etc.). Then, by comparing the detected position of each performer 3 with the position of the guidance information 4, the reception unit 13 can determine whether each performer 3 is standing at the position indicated by the guidance information 4.

[0072] Alternatively, the reception unit 13 may detect each performer 3 from the image and then track each performer 3 within the video to determine the movement trajectory of each performer 3. The reception unit 13 can then determine whether each performer 3 is following the movement indicated in the guidance information 4 by comparing the detected movement trajectory of each performer 3 with the movement indicated in the guidance information 4. The reception unit 13 may also detect the aforementioned movement guidance mark M within the image and track this movement guidance mark within the video to determine the movement trajectory of the movement guidance mark M. The reception unit 13 can then determine whether each performer 3 is following the movement indicated in the guidance information 4 by comparing the detected movement trajectory of each performer 3 with the movement trajectory of the identified movement guidance mark M. Furthermore, the reception unit 13 may determine whether each performer 3 is following the movement speed indicated in the guidance information 4 by comparing the movement speed of each detected performer 3 with the movement speed of the identified movement guidance mark M.

[0073] The image processing unit 14 adds the additional information received by the reception unit 13 to the guidance image projected in the performance area 2. For example, the image processing unit 14 can add additional information entered by the operator to a predetermined position on the guidance image. The image processing unit 14 can also add additional information entered by the operator to a predetermined position on the guidance image specified by the operator. The image processing unit 14 may save the guidance image with the additional information to a predetermined storage device.

[0074] The projection control unit 12 causes the projection device 1 to project a guidance image with additional information onto the performance area 2. Figure 11 shows an example of the state in which the guidance image with additional information is projected onto the performance area 2. In the example shown, the additional information consists of the "X mark on the left," the text "Changed: September 10, 2024," and the "arrow between the two X marks."

[0075] Other configurations of the information processing device 10 can be the same as in the first embodiment. Furthermore, an example of the configuration of the information processing system is as described in the first embodiment.

[0076] The information processing device 10 of the second embodiment can achieve the same effects as the information processing device 10 of the first embodiment. Furthermore, the information processing device 10 can add various additional information, such as memos, records, comments, and messages directed to the performer 3 who is performing in the performance area 2, to the guidance image projected in the performance area 2. The information processing device 10 can also update the guidance image projected in the performance area 2 in real time and save the guidance image with the added information.

[0077] With this information processing device 10, the guidance image can be used as a memo. In addition, with the information processing device 10, if additional information is added to the guidance image being projected, the projected guidance image can be updated in real time. In this case, the operator operating the information processing device 10 can use the additional information added to the guidance image to send a message to the performer 3 who is performing in the performance area 2.

[0078] <<Third Embodiment>> The information processing device 10 of the third embodiment has the function of receiving input to correct the guidance information 4 being projected onto the performance area 2, and projecting the corrected guidance information 4 onto the performance area 2. This will be described in detail below.

[0079] Figure 10 is an example of a functional block diagram of the information processing device 10. As shown in the figure, the information processing device 10 includes an acquisition unit 11, a projection control unit 12, a reception unit 13, and an image processing unit 14.

[0080] The reception unit 13 receives input to correct the guidance information 4 contained in the guidance image being projected onto the performance area 2.

[0081] Modification of Information 4 includes at least one of the following: deletion of existing Information 4, modification of the content of existing Information 4, and addition of new Information 4.

[0082] Here, the means by which the reception unit 13 receives input to correct the guidance information 4 will be described. The operator can operate the input device of the information processing device 10 to input a correction to the guidance information 4 projected on the performance area 2. Examples of input devices include, but are not limited to, a touch panel, keyboard, physical buttons, mouse, joystick, microphone, etc.

[0083] For example, the guidance image projected onto the performance area 2 is simultaneously displayed on the display of the information processing device 10. The operator can input changes such as deleting existing guidance information 4, modifying the content of existing guidance information 4, or adding new guidance information 4 on the guidance image displayed on the display of the information processing device 10. The reception unit 13 receives input from the operator to modify the guidance information 4 in this manner, for example.

[0084] For example, during filming in a studio or during rehearsals on a practice floor, the instructions given to performer 3 (such as their position and movement) may change. In such cases, the operator can input a correction to the guidance information 4 projected onto acting area 2.

[0085] The image processing unit 14 modifies the guidance information 4 projected onto the performance area 2 based on the input for modification of the guidance information 4 received by the reception unit 13. For example, the image processing unit 14 can delete existing guidance information 4, change the content of existing guidance information 4, or add new guidance information 4 to the guidance image projected onto the performance area 2.

[0086] Figure 13 shows an example of the revised guidance image. The guidance image before revision is shown in Figure 6. In this example, a location guidance mark (guidance information 4) has been added.

[0087] The projection control unit 12 causes the projection device 1 to project the corrected guidance information 4 (guidance image) onto the performance area 2.

[0088] Other configurations of the information processing device 10 can be the same as those in the first and second embodiments. Furthermore, an example of the configuration of the information processing system is as described in the first and second embodiments.

[0089] The information processing device 10 of the third embodiment can achieve the same effects as the information processing device 10 of the first and second embodiments. Furthermore, the information processing device 10 can update the guidance information 4 projected onto the performance area 2 in real time. During filming in the filming studio or during practice on the practice floor, the content of instructions given to the performer 3 (standing position, movement route, etc.) may change. If the instructions given to the performer 3 (standing position, etc.) are indicated to the performer 3 by tape attached to the floor, it is troublesome to have to attach and remove the tape each time such a change occurs. With the information processing device 10, it is only necessary to operate the information processing device 10 to input a correction to the guidance information 4 included in the guidance image projected onto the performance area 2. With such an information processing device 10, the effort required when the content of instructions given to the performer 3 changes can be reduced compared to the method of indicating the instructions given to the performer 3 (standing position, etc.) by tape attached to the floor.

[0090] <<Variation>> Here, possible modifications applicable to the first to third embodiments will be described. In addition to the guidance information 4 that indicates the content instructed to the performer 3, the guidance image may also display other information. For example, the guidance image may further indicate the position of objects used in the performance (so-called props, etc.) within the performance area 2.

[0091] Although this disclosure has been described above with reference to embodiments, this disclosure is not limited to the embodiments described above. Various modifications to the structure and details of this disclosure are possible, which can be understood by those skilled in the art within the scope of this disclosure. Furthermore, each embodiment can be combined with other embodiments as appropriate.

[0092] Furthermore, the flowcharts used in the above description show multiple steps (processes) in sequence. However, the execution order of the steps performed in each embodiment is not limited to the order in which they are described. In each embodiment, the order of the illustrated steps can be changed to the extent that it does not impede the content.

[0093] Some or all of the above embodiments may also be described as follows, but are not limited to the following. 1. An acquisition means for acquiring guidance images projected onto the performance area where performers perform, The projection device includes projection control means for projecting the guide image onto the performance area, It has, The aforementioned guidance image includes location guidance marks, When the guidance image is projected onto the performance area, the position guidance mark is displayed on the information processing device at the standing position within the performance area as instructed by the performer. 2. The aforementioned guide image includes motion guide lines, The information processing device according to claim 1, in which the guidance image is projected onto the performance area, the motion guidance lines are displayed along the movement path within the performance area instructed to the performer. 3. The aforementioned guidance image includes a motion guidance mark, In a state in which the guidance image is projected onto the performance area, the motion guidance mark moves along the path of movement within the performance area as instructed by the performer, as described in 1 or 2 of the information processing device. 4. When the guidance image is projected onto the performance area, the motion guidance mark moves at the speed instructed by the performer, as described in 3. 5. A receiving means for receiving input of additional information to be added to the guidance image projected in the performance area, Image processing means for adding the aforementioned additional information to the guide image being projected onto the performance area, It has, The projection control means is an information processing device according to any one of 1 to 4 that causes the projection device to project the guidance image with the additional information onto the performance area. 6. The receiving means is, Based on the image generated by the camera that photographs the performance area on which the aforementioned guidance image is projected, information about the performer located in the performance area is generated. The information processing device according to 5, which receives information about the performer as additional information. 7. A receiving means for receiving input to modify guidance information that includes the guidance image projected onto the performance area and indicates the content instructed to the performer, Image processing means for modifying the guidance information projected onto the performance area based on the input, It has, The projection control means is an information processing device according to any one of 1 to 6 that causes the projection device to project the modified guidance information onto the performance area. 8. One or more computers, The guide image projected onto the performance area where the performers perform is acquired, The projection device is used to project the guide image onto the performance area. The aforementioned guidance image includes location guidance marks, An information processing method in which, when the guidance image is projected onto the performance area, the position guidance mark is displayed at the standing position within the performance area as instructed by the performer. 9. Using a projection device, guide images are projected onto the performance area where the performers will perform. The aforementioned guidance image includes location guidance marks, A guidance method in which, when the guidance image is projected onto the performance area, the position guidance mark is displayed at the standing position within the performance area as instructed by the performer.

[0094] Some or all of the appendices 2 through 7, which are dependent on the information processing device described in appendice 1 above, may also be dependent on the information processing method in appendice 8 and the guidance method in appendice 9, in the same dependent relationship as between appendice 1 and appendices 2 through 7. Furthermore, within the scope that does not depart from each of the embodiments described above, some or all of the configurations described as appendices can be realized in various hardware, software, various recording means for recording software, or systems. [Explanation of Symbols]

[0095] 1 Projection device 2. Performance Area 3 Performers 4. Information 5 Scale Marks 6 cameras 7 Projection screen 10 Information Processing Devices 11 Acquisition Department 12 Projection Control Unit 13 Reception Department 14 Image Processing Section 1A Processor 2A Memory 3A input / output I / F 4A Peripheral Circuits 5A bus

Claims

1. A means for acquiring guidance images that are projected onto the performance area where performers perform, The projection device includes projection control means for projecting the guide image onto the performance area, It has, The aforementioned guidance image includes location guidance marks, When the guidance image is projected onto the performance area, the position guidance mark is displayed on the information processing device at the standing position within the performance area as instructed by the performer.

2. The aforementioned guide image includes motion guide lines, The information processing device according to claim 1, wherein, when the guidance image is projected onto the performance area, the motion guidance lines are displayed along the movement path within the performance area instructed to the performer.

3. The aforementioned guidance image includes a motion guidance mark, The information processing device according to claim 1, wherein, with the guidance image projected onto the performance area, the motion guidance mark moves along the path of movement within the performance area as instructed by the performer.

4. The information processing device according to claim 3, wherein, with the guidance image projected onto the performance area, the motion guidance mark moves at a speed instructed by the performer.

5. A receiving means for receiving input of additional information to be added to the guidance image projected in the performance area, Image processing means for adding the aforementioned additional information to the guide image being projected onto the performance area, It has, The information processing apparatus according to claim 1, wherein the projection control means causes the projection device to project the guidance image with the additional information onto the performance area.

6. The aforementioned receiving means is Based on the image generated by the camera that photographs the performance area on which the aforementioned guidance image is projected, information about the performer located in the performance area is generated. The information processing apparatus according to claim 5, which receives information relating to the performer as the additional information.

7. A receiving means for receiving input to modify guidance information indicating the content instructed to the performer, which is included in the guidance image projected onto the performance area, Image processing means for modifying the guidance information projected onto the performance area based on the input, It has, The information processing device according to claim 1, wherein the projection control means causes the projection device to project the modified guidance information onto the performance area.

8. One or more computers, The guide image projected onto the performance area where the performers perform is acquired, The projection device is used to project the guide image onto the performance area. The aforementioned guidance image includes location guidance marks, An information processing method in which, when the guidance image is projected onto the performance area, the position guidance mark is displayed at the standing position within the performance area as instructed by the performer.

9. Using a projection device, guide images are projected onto the performance area where the performers act. The aforementioned guidance image includes location guidance marks, A guidance method in which, when the guidance image is projected onto the performance area, the position guidance mark is displayed at the standing position within the performance area as instructed by the performer.

Images