Information processing device, information processing method, and guidance method

Abstract

An information processing device (10) according to the present disclosure acquires a guidance image projected onto a performance area (2) in which a performer (3) performs, and causes a projection device (1) to project the guidance image onto the performance area (2). The guidance image includes a position guide mark (guidance information 4). In a state in which the guidance image is projected onto the performance area (2), the position guide mark (guidance information 4) is displayed at an instructed standing position in the performance area (2) for the performer (3).

Description

Information processing device, information processing method, and guidance method

[0001] This disclosure relates to an information processing device, an information processing method, and a guidance method.

[0002] Information related to this disclosure is disclosed in Non-Patent Document 1. Non-Patent Document 1 discloses the use of tape to create cross marks (so-called "markings") and attaching them to the floor in order to clearly indicate the performer's position in the performance area where the performer is performing.

[0003] Cover Corporation, “Motion Capture Technology Made Possible by the New Studio: The Inside Story of the Hoshimatic Project,” [online], December 27, 2023, [Accessed September 10, 2024], Internet <URL: https: / / note.cover-corp.com / n / n10e1d<1123477>

[0004] In the current method of indicating instructions (such as standing positions) to performers using tape attached to the floor, a great deal of effort is required to apply and remove the tape. One example of the purpose of this disclosure is to provide a new technology for communicating instructions to performers. <000000>

[0005] According to one aspect of this disclosure, an information processing device is provided which includes an acquisition means for acquiring a guidance image to be projected onto a performance area where a performer performs, and a projection control means for causing a projection device to project the guidance image onto the performance area, wherein the guidance image includes position guidance marks, and when the guidance image is projected onto the performance area, the position guidance marks are displayed at the standing position within the performance area instructed to the performer.

[0006] Furthermore, according to one aspect of this disclosure, an information processing method is provided in which one or more computers acquire a guidance image to be projected onto a performance area where an actor performs, and a projection device projects the guidance image onto the performance area, the guidance image includes position guidance marks, and when the guidance image is projected onto the performance area, the position guidance marks are displayed at the standing position within the performance area instructed to the actor.

[0007] Furthermore, according to one aspect of this disclosure, a guidance method is provided in which a guidance image is projected onto a performance area where a performer performs using a projection device, the guidance image includes a position guide mark, and when the guidance image is projected onto the performance area, the position guide mark is displayed at the standing position within the performance area as instructed by the performer.

[0008] According to one example of this disclosure, a new technology will be realized that will convey instructions given to performers back to them.

[0009] Figure 1 is a diagram illustrating an example of the overall structure of an information processing system. Figure 2 is a diagram illustrating an example of a performance area. Figure 3 is a diagram illustrating an example of a projection screen. Figure 4 is a diagram illustrating an example of the hardware configuration of an information processing device. Figure 5 is a diagram illustrating an example of a functional block diagram of an information processing device. Figure 6 is a diagram illustrating an example of guidance information. Figure 7 is a diagram illustrating another example of guidance information. Figure 8 is a diagram illustrating another example of guidance information. Figure 9 is a flowchart illustrating an example of the processing flow of an information processing device. Figure 10 is a diagram illustrating another example of a functional block diagram of an information processing device. Figure 11 is a diagram illustrating an example of a guidance image with additional information. Figure 12 is a diagram illustrating another example of the overall structure of an information processing system. Figure 13 is a diagram illustrating an example of a modified guidance image.

[0010] The embodiments of this disclosure will be described below with reference to the drawings. In this disclosure, the drawings are associated with one or more embodiments. In all drawings, similar components are denoted by the same reference numerals, and their descriptions are omitted where appropriate.

[0011] <<First Embodiment>> <Overview> The information processing device of the first embodiment has the characteristic of projecting a guidance image showing the content of instructions given to the performer (the content of the instructions that the performer must follow) onto the performance area (floor) where the performer performs. The configuration of the information processing device will be described in detail below.

[0012] <Overall Structure of the Information Processing System> First, the overall structure of the information processing system, including the information processing device 10, will be explained using Figure 1. The information processing system includes the information processing device 10 and the projection device 1. The information processing system may further have a performance area 2.

[0013] Acting area 2 is the floor. Acting area 2 may be a floor designed for an information processing system or an existing floor. Performer 3 stands on acting area 2 and performs. Examples of acting area 2 include, but are not limited to, a stage, a shooting area in a filming studio, or a practice floor.

[0014] A projection sheet may be spread out in the performance area 2. The composition of the projection sheet is not limited. For example, a sheet for projecting widely used images may be used as the projection sheet. Alternatively, a white sheet or carpet may be used as the projection sheet. By spreading the projection sheet over the performance area 2, the various information projected by the projection device 1 will be displayed more clearly in the performance area 2.

[0015] Furthermore, the performance area 2 may include scale marks (not shown in Figure 1) that serve as a guide for positioning within the performance area 2. Note that the performance area 2 does not necessarily have to include scale marks 5. For example, the performance area 2 may have a pattern of multiple scale marks 5 arranged regularly, as shown in Figure 2. The scale marks 5 in Figure 2 are cross marks, but the scale marks 5 are not limited to these marks. An example of the spacing between scale marks 5 is 1m, but this is not limited to this. Having such scale marks 5 in the performance area 2 is preferable because it facilitates the alignment of the projection screen 7 projected by the projection device 1. It is also preferable that these scale marks 5 can be used to indicate the performer's standing position, movement path, and as markers.

[0016] There are various ways to generate the performance area 2 that shows the scale mark 5, and there are no particular restrictions. For example, the performance area 2 that shows the scale mark 5 can be generated by spreading a sheet with the scale mark 5 displayed on it (for example, printed) over the performance area 2. Alternatively, a sticker of the scale mark 5 can be attached to the projection sheet, or the scale mark 5 can be drawn on the projection sheet with a pen or ink. The example shown here is merely one example and is not limited to this example.

[0017] The projection device 1 projects a projection screen 7 onto the performance area 2. The aspect ratio of the projection screen 7 is, for example, 16:10 (width:height), but is not limited to this. The projection size can be, for example, 514 inches to 617 inches, but is not limited to this. As shown in Figure 3, the projection device 1 can have a certain range of lens shift in the vertical and horizontal directions. Note that the width of the movable range shown is merely an example and is not limited to this.

[0018] The projection device 1 is installed in a position and orientation that allows the projected screen 7 to be displayed in the performance area 2. For example, the projection device 1 may be mounted on the ceiling or on other components located at a relatively high position.

[0019] When projecting the projection screen 7 onto the performance area 2 (floor) from a relatively high position such as the ceiling, sufficient brightness of the projection device 1 is necessary to clearly display the guidance information 4 on the performance area 2. For example, if the distance from the performance area 2 to the projection device 1 is 6 m or more and 7 m or less, the brightness of the projection device 1 should be 18,000 lumens (lm) or more, more preferably 19,000 lumens or more.

[0020] The inventors have confirmed that when the distance from the performance area 2 to the projection device 1 is 6 m or more and 7 m or less, the guidance information 4 can be clearly displayed in the performance area 2 by satisfying the brightness conditions of the projection device 1. Furthermore, the inventors have confirmed that when the distance from the performance area 2 to the projection device 1 is 6 m or more and 7 m or less, if the brightness of the projection device 1 is less than 18,000 lumens, the guidance information 4 cannot be clearly displayed in the performance area 2.

[0021] Returning to Figure 1, the projection device 1 receives a guidance image from the information processing device 10 and can display the received guidance image on the projection screen 7 projected onto the performance area 2. The guidance image projected onto the performance area 2 includes guidance information 4 indicating the instructions given to the performer 3. In the example of Figure 1, the guidance information 4 is an "X" mark, and the position of this mark indicates the standing position within the performance area 2 as instructed for the performer 3. Note that the guidance information 4 is not limited to a mark indicating the standing position within the performance area 2. Variations of the guidance information 4 will be explained below.

[0022] The information processing device 10 is connected to the projection device 1 in a communication manner. The information processing device 10 inputs a guidance image showing guidance information 4 to the projection device 1 and projects the input guidance image. The information processing device 10 may be a general-purpose device such as a personal computer, tablet terminal, or smartphone, or it may be a dedicated device designed for an information processing system.

[0023] The information processing device 10 may be equipped with an input device and a display. The operator can operate the information processing device 10 to generate guidance images to be projected onto the projection device 1, or to read pre-stored guidance images and display them on the display of the information processing device 10. In addition, the guidance image projected by the projection device 1 onto the performance area 2 may be simultaneously displayed on the display of the information processing device 10. In this case, the operator can confirm the guidance image projected onto the performance area 2 by looking at the display of the information processing device 10. The detailed configuration of the information processing device 10 will be described later.

[0024] Although not shown in Figure 1, the information processing system may also include a motion capture system. The motion capture system is a system that digitizes (represents as digital data) the movements of performer 3. For example, an optical motion capture system can be used.

[0025] <Hardware Configuration of Information Processing Device 10> Next, an example of the hardware configuration of the information processing device 10 will be described. Each functional unit of the information processing device 10 is realized by any combination of hardware and software. It will be understood by those skilled in the art that there are various modifications to the implementation method and the device. The software includes programs that are stored in the device from the time of shipment, as well as programs downloaded from recording media such as CDs (Compact Discs) or servers on the Internet.

[0026] Figure 4 is a block diagram illustrating the hardware configuration of the information processing device 10. As shown in Figure 4, the information processing device 10 includes a processor 1A, memory 2A, input / output interface 3A, peripheral circuitry 4A, and bus 5A. The peripheral circuitry 4A includes various modules. The information processing device 10 does not necessarily have peripheral circuitry 4A. The information processing device 10 may also be composed of multiple physically and / or logically separated devices. In this case, each of the multiple devices may have the above hardware configuration.

[0027] Bus 5A is a data transmission path for the processor 1A, memory 2A, peripheral circuit 4A, and input / output interface 3A to send and receive data to and from each other. The processor 1A is a processing unit such as a CPU (Central Processing Unit) or GPU (Graphics Processing Unit). Memory 2A is a memory such as RAM (Random Access Memory) or ROM (Read Only Memory). The input / output interface 3A includes interfaces for acquiring information from input devices, external devices, external servers, external sensors, cameras, etc., and interfaces for outputting information to output devices, external devices, external servers, etc. The input / output interface 3A also includes interfaces for connecting to a communication network such as the Internet. Input devices include, for example, a keyboard, mouse, microphone, physical buttons, touch panel, etc. Output devices include, for example, a display, projection device, speaker, printer, mailer, etc. The processor 1A can issue commands to each module and perform calculations based on their calculation results.

[0028] <Functional Configuration of Information Processing Device 10> Next, the functional configuration of the information processing device 10 will be described in detail. Figure 5 is an example of a functional block diagram of the information processing device 10. As shown in the figure, the information processing device 10 has an acquisition unit 11 and a projection control unit 12.

[0029] The acquisition unit 11 acquires the guidance image projected onto the performance area 2 where the performer 3 performs.

[0030] The guidance image includes guidance information 4 that indicates the instructions given to performer 3. Examples of instructions given to performer 3 include, but are not limited to, the standing position within the performance area 2, the route of movement within the performance area 2, the speed of movement, the movements to be performed at each position (jumping, crouching, falling, etc.), information about the performance, and information about the progress of the performance and filming. Guidance information 4 can indicate the instructions given to performer 3 using at least one of the following: marks, figures, numbers, letters, symbols, pictures, still images, and moving images.

[0031] A single guide image may contain instructions for one performer 3, or it may contain instructions for multiple performers 3. The instructions for each of the multiple performers 3 included in a single guide image may be displayed in a way that makes them identifiable to one another. There are various means for displaying the instructions for each of the multiple performers 3 in an identifiable way, but examples include color coding.

[0032] The following is an example of guidance information 4, but guidance information 4 is not limited to the example below.

[0033] For example, the guidance information 4 may include a location guidance mark. The location guidance mark indicates the performer's position within the performance area 2. As shown in Figure 6, when the guidance image is projected onto the performance area 2, the location guidance mark (guidance information 4) is displayed at the position within the performance area 2 that the performer 3 has been instructed to stand at.

[0034] In addition, the guidance information 4 may include motion guidance lines. The motion guidance lines indicate the movement of performer 3 within the performance area 2. As shown in Figure 7, when the guidance image is projected onto the performance area 2, the motion guidance lines (guidance information 4) are displayed along the movement line instructed to performer 3 within the performance area 2. The motion guidance lines (guidance information 4) shown in Figure 7 are arrow lines, and the direction of the arrows also indicates the direction in which performer 3 will move. Furthermore, the guidance information 4 shown in Figure 7 also indicates the starting position (the position where "Start" is displayed in the figure) where performer 3 will begin the movement instructed to them.

[0035] In addition, the guidance information 4 may include a motion guidance mark. The motion guidance mark indicates the movement of performer 3 within the performance area 2. As shown in Figure 8, when the guidance image is projected onto the performance area 2, the motion guidance mark M (guidance information 4) moves along the movement route indicated to performer 3 within the performance area 2. Through this movement, the motion guidance mark M can indicate the movement route indicated to performer 3 within the performance area 2.

[0036] Furthermore, the motion guidance mark M can move at the speed instructed to performer 3. By moving at this speed, the motion guidance mark M can indicate the speed instructed to performer 3.

[0037] Furthermore, the guidance information 4 shown in Figure 8 also indicates the direction of movement instructed to the performer 3, based on the direction of movement of the movement guidance mark M. The guidance information 4 shown in Figure 8 also shows a line along the movement path instructed to the performer 3. The movement guidance mark M will move along this line. The guidance information 4 shown in Figure 8 also indicates the starting position (the position where "Start" is displayed in the figure) where the movement instructed to the performer 3 begins.

[0038] Although not shown in the diagram, the guidance information 4 may also display a scale image indicating length (distance). The scale image includes, for example, a straight line of a predetermined length and text information indicating the length of that line. The predetermined length may be 1m, 3m, 5m, 10m, etc., or any other length. By using such a scale image in combination with the scale mark 5 (see Figure 2) located in the performance area 2, the performer 3 can accurately grasp the distance.

[0039] Next, the means by which the acquisition unit 11 acquires the guidance image will be described. The acquisition unit 11 can acquire the guidance image by either of the following acquisition examples 1 and 2.

[0040] ○Acquisition Example 1 In acquisition example 1, the acquisition unit 11 acquires a guidance image by reading a guidance image that has been pre-stored in a predetermined storage device from the predetermined storage device. The predetermined storage device may be provided inside the information processing device 10, or it may be provided in an external device that is communicably connected to the information processing device 10. The same premise regarding the predetermined storage device applies below.

[0041] The acquisition unit 11 may, in accordance with the operator's operation, read out a guidance image specified by the operator from among the guidance images stored in a predetermined storage device.

[0042] Incidentally, attribute information of each guidance image stored in a predetermined storage device may be associated with each guidance image. Then, the operator may search for a predetermined guidance image from a plurality of guidance images stored in the predetermined storage device by image search using the attribute information, and designate the searched guidance image as the guidance image to be projected onto the performance area 2. For example, the operator may input a certain attribute as a key for image search to the information processing device 10. Then, the acquisition unit 11 may refer to the attribute information of each guidance image, identify the guidance image including the input key (attribute information), and present the identified guidance image to the operator as a search result. The operator can specify a predetermined one from the guidance images presented as search results.

[0043] Examples of the attribute information include, but are not limited to, identification information (such as name) of the person (performer 3) to be instructed by each guidance image, identification information of the scene in which each guidance image is displayed in the performance area 2, the type of instruction indicated by each guidance image (standing position, movement route, etc.), the timing (such as from 10:00 to 10:30 on September 11, 2024) for using each guidance image scheduled in advance, and the like.

[0044] Alternatively, the acquisition unit 11 may read a predetermined guidance image from a predetermined storage device from among the guidance images stored in the predetermined storage device according to a predetermined rule. The rule is various. For example, in advance, a schedule for using each guidance image may be determined, and information indicating the content of the schedule may be stored in the information processing device 10. The schedule indicates the guidance image to be used at each timing, for example, "from 10:00 to 10:30 on September 11, 2024: Guidance Image A". The acquisition unit 11 may refer to this schedule to identify the guidance image to be used at the current time, and read the identified guidance image from the predetermined storage device.

[0045] 〇 Acquisition Example 2 In Acquisition Example 2, the acquisition unit 11 acquires a guidance image by generating a guidance image according to the operation of the operator. For example, the acquisition unit 11 can generate a guidance image based on the operation of the operator using software (application) for image generation installed in the information processing device 10.

[0046] Returning to FIG. 5, the projection control unit 12 causes the projection device 1 that projects the projection screen 7 onto the performance area 2 to project the guidance image acquired by the acquisition unit 11. That is, the projection control unit 12 inputs the guidance image acquired by the acquisition unit 11 to the projection device 1 and causes it to be projected. The projection device 1 is installed so as to project the projection screen 7 onto the performance area 2. By this control by the projection control unit 12, the guidance image is projected onto the performance area 2.

[0047] Next, an example of the processing flow of the information processing device 10 will be described using the flowchart of FIG. 9. Here, the purpose is to describe the processing flow. Since the details of each process have been described above, the description here will be omitted as appropriate.

[0048] In S10, the information processing device 10 acquires a guidance image projected onto the performance area 2 where the performer 3 performs. In S11, the information processing device 10 causes the projection device 1 to project the guidance image onto the performance area 2.

[0049] In one example, the guidance image includes a position guidance mark (guidance information 4). Then, as shown in FIG. 6, in the state where the guidance image is projected onto the performance area 2, the position guidance mark (guidance information 4) is displayed at the standing position within the performance area 2 indicated to the performer 3.

[0050] In another example, the guidance image includes a movement guidance line (guidance information 4). Then, as shown in FIG. 7, in the state where the guidance image is projected onto the performance area 2, the movement guidance line (guidance information 4) is displayed along the movement line within the performance area 2 indicated to the performer 3.

[0051] In another example, the guidance image includes a movement guidance mark M (guidance information 4). Then, as shown in FIG. 8, in the state where the guidance image is projected onto the performance area 2, the movement guidance mark M (guidance information 4) moves along the movement line within the performance area 2 indicated to the performer 3. The movement guidance mark M (guidance information 4) can move at the movement speed indicated to the performer 3.

[0052] <Effects> According to the information processing device 10 of the first embodiment, a guidance image showing the content instructed to the performer 3 can be projected onto the performance area 2 (floor) where the performer performs. In the case of using tape attached to the floor to show the performer 3 the content instructed (such as standing position), a lot of effort is required to apply and remove the tape. For example, the tape needs to be reapplied for each scene of the performance, which is a great deal of work. According to the information processing device 10 of the first embodiment, this effort can be reduced.

[0053] Furthermore, in the case of an information processing device 10 that projects guidance images, it can convey instructions to the performer 3 using various types of information. That is, in the case of an information processing device 10, it can convey instructions to the performer 3 using various types of information such as marks, shapes, numbers, letters, symbols, pictures, still images, and moving images. With such an information processing device 10, instructions can be accurately conveyed to the performer 3. Moreover, with such an information processing device 10, it becomes possible to accurately convey instructions that involve a large amount of information, such as not only standing positions and movement routes, but also movements to be performed at each position, as well as complex instructions, to the performer 3.

[0054] Furthermore, in the case of an information processing device 10 that projects guidance images, instructions can be conveyed to the performer 3 using moving images. With such an information processing device 10, for example, the performer 3 can be informed of the instructed movement speed by actually moving a mark or the like. In this way, the information processing device 10 can convey information to the performer 3 that cannot be conveyed by means of indicating the instructed content (such as standing position) to the performer 3 using tape attached to the floor.

[0055] <<Second Embodiment>> The information processing device 10 of the second embodiment has the function of receiving input of additional information to be added to the guidance image projected on the performance area 2, and projecting the guidance image with the additional information onto the performance area 2. This will be described in detail below.

[0056] Figure 10 is an example of a functional block diagram of the information processing device 10. As shown in the figure, the information processing device 10 includes an acquisition unit 11, a projection control unit 12, a reception unit 13, and an image processing unit 14.

[0057] The reception unit 13 receives input of additional information to be added to the guidance image being projected in the performance area 2.

[0058] The additional information is information added to the guidance image acquired by the acquisition unit 11. The additional information can include various types of information. The additional information can be at least one of the following: marks, figures, numbers, letters, symbols, pictures, still images, and moving images, and can indicate the content added to the guidance image.

[0059] The content of the additional information is not limited and examples include, but are not limited to, notes, records, comments, and messages directed to performer 3 who is performing in performance area 2.

[0060] For example, the instructions given to performer 3 (such as their position and movement) may change during filming in a studio or during rehearsals on a practice floor. In such cases, as shown in Figure 11, for example, the details of the change, the fact that a change has been made, and the date and time of the change may be added to the guidance image as additional information.

[0061] In addition, although not shown in the illustrations, the date and time when the photography or practice using each guide image was performed (practice record) may be added to the guide image as additional information. In addition, although not shown in the illustrations, the date and time when the photography or practice using each guide image was completed (completion record) may be added to the guide image as additional information.

[0062] In addition, notes indicating problems with the instructions shown in each guide image, which became apparent during filming or practice using each guide image, may be added to the guide images as supplementary information.

[0063] In addition, information regarding performer 3 during the actual performance, filming, or rehearsal using each instruction image may be added to the instruction image as supplementary information. Examples of such supplementary information include: "Performer 3 was following the instructions shown in the instruction image," "Performer 3 was not following the instructions shown in the instruction image," "Performer 3 was moving as instructed in the instruction image," and "Performer 3 was not moving as instructed in the instruction image." Another example of such supplementary information is information indicating the position of each performer 3 within the acting area 2 at the final timing of the scene using each instruction image during filming. According to this supplementary information, the actual position of each performer 3 at the final timing of each scene is shown, so by referring to this information when filming the next scene, the final position of each performer 3 in the previous scene can be easily determined. Then, using this determination result, inconsistencies in the position of performer 3 at the boundary between scenes can be avoided.

[0064] The reception unit 13 can receive input of additional information to be added to the guidance image being projected onto the performance area 2. The image processing unit 14, described later, can then add this additional information to the guidance image being projected onto the performance area 2. The projection control unit 12 can then cause the projection device 1 to project the guidance image with the additional information onto the performance area 2.

[0065] In the case of an information processing device 10 with this configuration, for example, additional information can be added in real time to the guidance image projected onto the performance area 2 during the actual performance, filming, or practice. That is, the guidance image projected onto the performance area 2 can be updated (changed) in real time based on the additional information. With such an information processing device 10, for example, an operator operating the information processing device 10 can send a message to the performer 3 who is performing in the performance area 2 by adding additional information to the guidance image and displaying that additional information on the performance area 2.

[0066] Next, the means by which the reception unit 13 acquires additional information will be described. The reception unit 13 can acquire additional information by either of the following reception examples 1 and 2.

[0067] 〇 Reception Example 1 In reception example 1, the operator can input additional information by operating the input device of the information processing device 10. The input device is exemplified by, but is not limited to, a touch panel, keyboard, physical buttons, mouse, joystick, microphone, etc. For example, the guidance image projected onto the performance area 2 is simultaneously displayed on the display of the information processing device 10. The operator can input the position on the projected image to which the additional information will be added, and the additional information to be added, on the guidance image displayed on the display of the information processing device 10. The reception unit 13 acquires the additional information input from the operator in this manner, for example.

[0068] ○ Reception Example 2 In Reception Example 2, as shown in Figure 12, a camera 6 is installed to photograph the performance area 2. The information processing system may have the camera 6, or the camera 6 may be used as an external device of the information processing system.

[0069] Camera 6 may be mounted on the ceiling or on other components located at a relatively high position. Camera 6 is positioned to photograph the performance area 2 on which the guidance image is projected. Camera 6 may capture still images or moving images. Camera 6 detects visible light and creates images. In addition, camera 6 may detect other electromagnetic waves such as infrared rays and create images.

[0070] The reception unit 13 generates additional information by analyzing the image generated by the camera 6. For example, the reception unit 13 may generate information about the performer 3 located in the performance area 2 described above by analyzing the image.

[0071] For example, the reception unit 13 can detect each performer 3 from an image using pre-registered features of each performer 3's appearance (face information, costume information, body type information, etc.). The reception unit 13 can also detect the guidance information 4 from an image using pre-registered features of the guidance information 4's appearance (mark type, shape, line type, etc.). Then, by comparing the position of each detected performer 3 with the position of the guidance information 4, the reception unit 13 can determine whether each performer 3 is standing at the position indicated by the guidance information 4.

[0072] Alternatively, the reception unit 13 may detect each performer 3 from the image and then track each performer 3 within the video to determine the movement trajectory of each performer 3. The reception unit 13 can then determine whether each performer 3 is following the movement indicated in the guidance information 4 by comparing the detected movement trajectory of each performer 3 with the movement path indicated in the guidance information 4. The reception unit 13 may also detect the aforementioned movement guidance mark M within the image and track this movement guidance mark within the video to determine the movement trajectory of the movement guidance mark M. The reception unit 13 can then determine whether each performer 3 is following the movement path indicated in the guidance information 4 by comparing the detected movement trajectory of each performer 3 with the movement trajectory of the identified movement guidance mark M. Furthermore, the reception unit 13 may determine whether each performer 3 is following the movement speed indicated in the guidance information 4 by comparing the detected movement speed of each performer 3 with the movement speed of the identified movement guidance mark M.

[0073] The image processing unit 14 adds the additional information received by the reception unit 13 to the guidance image projected onto the performance area 2. For example, the image processing unit 14 can add additional information entered by the operator to a predetermined position on the guidance image. The image processing unit 14 can also add additional information entered by the operator to a predetermined position on the guidance image specified by the operator. The image processing unit 14 may save the guidance image with the additional information to a predetermined storage device.

[0074] The projection control unit 12 causes the projection device 1 to project a guidance image with additional information onto the performance area 2. Figure 11 shows an example of the state in which the guidance image with additional information is projected onto the performance area 2. In the illustrated example, the additional information consists of the "X mark on the left," the text "Changed: September 10, 2024," and the "arrow between the two X marks."

[0075] Other configurations of the information processing device 10 can be the same as in the first embodiment. Furthermore, an example of the configuration of the information processing system is as described in the first embodiment.

[0076] The information processing device 10 of the second embodiment can achieve the same effects as the information processing device 10 of the first embodiment. Furthermore, the information processing device 10 can add various additional information, such as memos, records, comments, and messages directed to the performer 3 who is performing in the performance area 2, to the guidance image projected in the performance area 2. The information processing device 10 can also update the guidance image projected in the performance area 2 in real time and save the guidance image with the added information.

[0077] With this information processing device 10, the guidance image can be used as a memo. In addition, with the information processing device 10, if additional information is added to the guidance image being projected, the projected guidance image can be updated in real time. In this case, the operator operating the information processing device 10 can use the additional information added to the guidance image to send a message to the performer 3 who is performing in the performance area 2.

[0078] <<Third Embodiment>> The information processing device 10 of the third embodiment has the function of receiving input to correct the guidance information 4 being projected onto the performance area 2, and projecting the corrected guidance information 4 onto the performance area 2. This will be described in detail below.

[0079] Figure 10 is an example of a functional block diagram of the information processing device 10. As shown in the figure, the information processing device 10 includes an acquisition unit 11, a projection control unit 12, a reception unit 13, and an image processing unit 14.

[0080] The reception unit 13 receives input to correct the guidance information 4 contained in the guidance image being projected onto the performance area 2.

[0081] The modification of the guidance information 4 includes at least one of the following: deleting the existing guidance information 4, changing the content of the existing guidance information 4, and adding new guidance information 4.

[0082] Here, the means by which the reception unit 13 receives input to correct the guidance information 4 will be described. The operator can operate the input device of the information processing device 10 to input a correction to the guidance information 4 projected on the performance area 2. Examples of input devices include, but are not limited to, a touch panel, keyboard, physical buttons, mouse, joystick, microphone, etc.

[0083] For example, the guidance image projected onto the performance area 2 is simultaneously displayed on the display of the information processing device 10. The operator can input changes such as deleting existing guidance information 4, modifying the content of existing guidance information 4, or adding new guidance information 4 on the guidance image displayed on the display of the information processing device 10. The reception unit 13 receives input from the operator to modify the guidance information 4 in this manner, for example.

[0084] For example, during filming in a studio or during practice on a practice floor, the instructions given to performer 3 (such as their position and movement) may change. In such cases, the operator can input a correction to the guidance information 4 projected onto acting area 2.

[0085] The image processing unit 14 modifies the guidance information 4 projected onto the performance area 2 based on the input for modification of the guidance information 4 received by the reception unit 13. For example, the image processing unit 14 can delete existing guidance information 4, change the content of existing guidance information 4, or add new guidance information 4 to the guidance image projected onto the performance area 2.

[0086] Figure 13 shows an example of the revised guidance image. The guidance image before revision is shown in Figure 6. In this example, a location guidance mark (guidance information 4) has been added.

[0087] The projection control unit 12 causes the projection device 1 to project the corrected guidance information 4 (guidance image) onto the performance area 2.

[0088] Other configurations of the information processing device 10 can be the same as those in the first and second embodiments. Furthermore, an example of the configuration of the information processing system is as described in the first and second embodiments.

[0089] The information processing device 10 of the third embodiment can achieve the same effects as the information processing device 10 of the first and second embodiments. Furthermore, the information processing device 10 can update the guidance information 4 projected onto the performance area 2 in real time. During filming in the filming studio or during practice on the practice floor, the content of instructions given to the performer 3 (standing position, movement route, etc.) may change. If the instructions given to the performer 3 (standing position, etc.) are shown to the performer 3 by tape attached to the floor, it is troublesome to have to attach and remove the tape each time such a change occurs. With the information processing device 10, it is only necessary to operate the information processing device 10 to input a correction to the guidance information 4 included in the guidance image projected onto the performance area 2. With such an information processing device 10, the effort required when the content of instructions given to the performer 3 changes can be reduced compared to the method of showing the instructions given to the performer 3 (standing position, etc.) to the performer 3 by tape attached to the floor.

[0090] <<Modifications>> Here, possible modifications applicable to the first to third embodiments are described. In addition to the guidance information 4 that indicates the content instructed to the performer 3, the guidance image may also display other information. For example, the guidance image may further indicate the position of objects used in the performance (so-called props, etc.) within the performance area 2.

[0091] Although this disclosure has been described above with reference to embodiments, this disclosure is not limited to the embodiments described above. Various modifications to the structure and details of this disclosure are possible, which can be understood by those skilled in the art within the scope of this disclosure. Furthermore, each embodiment can be combined with other embodiments as appropriate.

[0092] Furthermore, the flowcharts used in the above description show multiple steps (processes) in sequence. However, the execution order of the steps performed in each embodiment is not limited to the order in which they are described. In each embodiment, the order of the illustrated steps can be changed to the extent that it does not impede the content.

[0093] Some or all of the above embodiments may also be described as follows, but are not limited to the following: 1. An information processing device comprising: an acquisition means for acquiring a guidance image to be projected onto a performance area where a performer performs; and a projection control means for causing a projection device to project the guidance image onto the performance area, wherein the guidance image includes position guidance marks, and when the guidance image is projected onto the performance area, the position guidance marks are displayed at the standing position within the performance area as instructed by the performer. 2. The information processing device according to 1, wherein the guidance image includes motion guidance lines, and when the guidance image is projected onto the performance area, the motion guidance lines are displayed along the movement path within the performance area as instructed by the performer. 3. The information processing device according to 1 or 2, wherein the guidance image includes motion guidance marks, and when the guidance image is projected onto the performance area, the motion guidance marks move along the movement path within the performance area as instructed by the performer. 4. The information processing device according to 3, wherein when the guidance image is projected onto the performance area, the motion guidance marks move at a movement speed instructed by the performer. 5. 7. An information processing apparatus according to any one of 1 to 4, comprising: a receiving means for receiving input of additional information to be added to the guidance image projected onto the performance area; and an image processing means for adding the additional information to the guidance image projected onto the performance area, wherein the projection control means causes the projection device to project the guidance image with the additional information onto the performance area. 6. An information processing apparatus according to 5, wherein the receiving means generates information about the performer located in the performance area based on an image generated by a camera that photographs the performance area on which the guidance image is being projected, and receives the information about the performer as the additional information. 7. An information processing apparatus according to any one of 1 to 6, comprising: a receiving means for receiving input to modify guidance information indicating content instructed to the performer, which is included in the guidance image projected onto the performance area; and an image processing means for modifying the guidance information projected onto the performance area based on the input, wherein the projection control means causes the projection device to project the modified guidance information onto the performance area.8. An information processing method comprising: one or more computers acquiring a guidance image to be projected onto a performance area where an actor performs; a projection device projecting the guidance image onto the performance area; the guidance image including position guide marks; and, when the guidance image is projected onto the performance area, the position guide marks being displayed at the standing position within the performance area as instructed by the actor. 9. A guidance method comprising: using a projection device to project a guidance image onto a performance area where an actor performs; the guidance image including position guide marks; and, when the guidance image is projected onto the performance area, the position guide marks being displayed at the standing position within the performance area as instructed by the actor.

[0094] Some or all of the appendices 2 to 7, which are dependent on the information processing device described in appendice 1 above, may also be dependent on the information processing method in appendice 8 and the guidance method in appendice 9 in the same dependent relationship as between appendice 1 and appendices 2 to 7. Furthermore, within the scope of not departing from each of the embodiments described above, some or all of the configurations described as appendices can be realized in various hardware, software, various recording means for recording software, or systems.

[0095] This application claims priority based on Japanese Patent Application No. 2024-170067, filed on 30 September 2024, and incorporates all of its disclosures herein.

Claims

1. An information processing device comprising: an acquisition means for acquiring a guidance image to be projected onto a performance area where a performer performs; and a projection control means for causing a projection device to project the guidance image onto the performance area, wherein the guidance image includes position guidance marks, and when the guidance image is projected onto the performance area, the position guidance marks are displayed at the standing position within the performance area as instructed by the performer.

2. The information processing device according to claim 1, wherein the guidance image includes motion guide lines, and when the guidance image is projected onto the performance area, the motion guide lines are displayed along the movement path within the performance area instructed to the performer.

3. The information processing device according to claim 1 or 2, wherein the guidance image includes a motion guidance mark, and when the guidance image is projected onto the performance area, the motion guidance mark moves along the path of movement within the performance area as instructed to the performer.

4. The information processing device according to claim 3, wherein, when the guidance image is projected onto the performance area, the motion guidance mark moves at a speed instructed by the performer.

5. Information processing apparatus according to any one of claims 1 to 4, comprising: a receiving means for receiving input of additional information to be added to the guidance image being projected onto the performance area; and an image processing means for adding the additional information to the guidance image being projected onto the performance area, wherein the projection control means causes the projection device to project the guidance image with the additional information onto the performance area.

6. The information processing apparatus according to claim 5, wherein the receiving means generates information about the performer located in the performance area based on an image generated by a camera that photographs the performance area on which the guidance image is projected, and receives the information about the performer as the additional information.

7. Information processing apparatus according to any one of claims 1 to 6, comprising: a receiving means for receiving input to modify guidance information indicating content instructed to the performer, which is included in the guidance image projected onto the performance area; and an image processing means for modifying the guidance information projected onto the performance area based on the input, wherein the projection control means causes the projection device to project the modified guidance information onto the performance area.

8. An information processing method comprising: one or more computers acquiring a guidance image to be projected onto a performance area where an actor performs; causing a projection device to project the guidance image onto the performance area; the guidance image including positional markers; and, with the guidance image projected onto the performance area, the positional markers being displayed at the standing position within the performance area as instructed by the actor.

9. A guidance method comprising projecting a guidance image onto a performance area where a performer performs using a projection device, wherein the guidance image includes positional markers, and when the guidance image is projected onto the performance area, the positional markers are displayed at the standing position within the performance area as instructed by the performer.

Images