Information processing system, image projection method, information processing method and program

Abstract

To provide an image that looks differently depending on whether or not an image provision target person is moving.SOLUTION: According to an aspect of the present invention, there is provided an information processing system comprising: an acquisition unit for acquiring consecutive frames including, at least as frames, a first image generated on the basis of a target image and a second image different from the first image; and an output control unit for repeatedly and continuously outputting the consecutive frames at a frame rate equal to and more than a prescribed value such that an observer who is doing exercise and an observer who remains still visibly recognize different images, respectively.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to an information processing system, an image projection method, an information processing method, and a program. [Background technology]

[0002] Patent Document 1 discloses a technology that aims to provide a technology for creating chance encounters between users and products, providing users with the fun and excitement of shopping, and creating new demand. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2022-122787 A Summary of the Invention [Problem to be solved by the invention]

[0004] There is a demand for providing images that look different when the intended subject is moving and when he / she is stationary. The technology of Patent Document 1 cannot satisfy such a demand. [Means for solving the problem]

[0005] According to one aspect of the present invention, there is provided an information processing system comprising: an acquisition unit that acquires successive frames including at least a first image generated based on a target image and a second image different from the first image; and an output control unit that repeatedly and continuously outputs the successive frames at a frame rate equal to or greater than a predetermined value so that different images are visible to a moving observer and a stationary observer.

[0006] According to this embodiment, it is possible to provide an image in which the subject of the image looks different when the subject is moving and when the subject is stationary. [Brief description of the drawings]

[0007] [Figure 1] 1 is a configuration diagram illustrating an information processing system 1. [Diagram 2] 1 is a block diagram showing a hardware configuration of an information processing device 10. FIG. [Diagram 3] FIG. 2 is a block diagram showing the hardware configuration of the user terminal 20. [Figure 4] FIG. 2 is a block diagram showing functions realized by a user terminal 20 (control unit 21). [Diagram 5] FIG. 2 is a diagram showing an overview of processing in the first embodiment. [Figure 6] 13 is a flowchart showing an example of information processing executed by the user terminal 20. [Figure 7] FIG. 13 is a diagram showing an example of a diagram in which a mosaic technique is applied to an area in which it is desired to increase the saliency, so that the mosaic is observed when the observer is in motion. [Figure 8] FIG. 13 is a diagram showing an example of high-speed sequential display of mosaics with different phases. [Figure 9] FIG. 1 is a diagram showing an example of decomposing an image into RGB components. [Figure 10] 11A and 11B are diagrams for explaining an example of a change in an image projected onto a target area. [Figure 11] 11A and 11B are diagrams for explaining an example of a change in an image projected outside a target area. [Figure 12] FIG. 13 is a diagram showing an example of an observation result by a stationary observer. [Figure 13] FIG. 13 is a diagram showing an example of an observation result by an observer during exercise. [Figure 14] FIG. 2 is a diagram for explaining an outline of processing in the information processing system 1. [Figure 15] FIG. 2 shows an example of a projection image of a landscape image and its saliency map. [Figure 16] FIG. 2 shows an example of a projected image of a streetscape image and its saliency map. [Figure 17] FIG. 13 is a diagram illustrating an example of a projected image of a product image and its saliency map. [Figure 18] FIG. 1 shows an example of a projected image of a poster image including text and its saliency map. [Figure 19] FIG. 2 shows an example of a projection observation result of a landscape image and its saliency map. [Figure 20] FIG. 13 is a diagram showing an example of a projection observation result of a streetscape image and its saliency map. [Figure 21] FIG. 13 shows an example of a projection observation result of a product image and its saliency map. [Figure 22] FIG. 1 shows an example of a projection observation of a poster image containing text and its saliency map. [Figure 23] FIG. 11 is a diagram showing an outline of a process in a second embodiment. [Figure 24] 1 is a schematic diagram illustrating sequential additive color mixing of RGB light. [Diagram 25] FIG. 1 is a schematic diagram illustrating color breaking. [Figure 26] 3A and 3B are schematic diagrams illustrating the perception mechanism of a first target image and a second target image. [Figure 27] 1A and 1B are schematic diagrams illustrating the configuration of successive frames and a procedure for projecting the frames. [Figure 28] 13 is a flowchart showing an example of information processing executed by the user terminal 20. [Figure 29] FIG. 13 is a diagram showing the procedure of an image projection experiment using the information processing system 1. [Diagram 30] 1A to 1C are diagrams showing observation results of an image projected by the information processing system 1. [Diagram 31] 2 is a schematic diagram showing a specific example of an application of the information processing system 1. FIG. [Diagram 32] 2 is a schematic diagram showing an example of capturing a projected image by the information processing system 1. FIG. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0008] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, embodiments of the present invention will be described with reference to the drawings. Various characteristic features shown in the following embodiments can be combined with each other.

[0009] Incidentally, a program for realizing the software appearing in one embodiment may be provided as a non-transitory computer-readable recording medium, or may be provided so as to be downloadable from an external server, or may be provided so that the program is launched on an external computer and its functions are realized on a client terminal (so-called cloud computing).

[0010] In addition, in various information processing according to an embodiment, an input and an output according to the input can be realized. Here, as long as an output is obtained as a result of the input, the form of information referenced in such information processing (hereinafter referred to as reference information) is not limited. The reference information may be, for example, rule-based information such as a database, a lookup table, or a predetermined function (including a judgment formula such as a regression formula constructed by a statistical method), or may be a trained model that has previously trained the correlation between the input and the output, or may be a large-scale language model that can output a desired result by inputting a prompt.

[0011] In one embodiment, the term "unit" may include, for example, a combination of hardware resources implemented by a circuit in the broad sense and software information processing that can be specifically realized by these hardware resources. In one embodiment, various information is handled, and this information is represented by, for example, physical values ​​of signal values ​​representing voltage and current, high and low signal values ​​as a binary bit collection consisting of 0 or 1, or quantum superposition (so-called quantum bits), and communication and calculation can be performed on the circuit in the broad sense.

[0012] Furthermore, a circuit in the broad sense is a circuit realized by at least appropriately combining a circuit, circuitry, a processor, and a memory. The processor may be a general-purpose processor or a dedicated circuit. In other words, it includes an application specific integrated circuit (ASIC), a programmable logic device (e.g., a simple programmable logic device (SPLD), a complex programmable logic device (CPLD), and a field programmable gate array (FPGA)), etc.

[0013] 1. Hardware Configuration This section describes the hardware configuration.

[0014] <Information Processing System 1> 1 is a configuration diagram illustrating an information processing system 1. The information processing system 1 includes an information processing device 10, a user terminal 20, a projector 110, and a projector screen 120.

[0015] The information processing device 10 and the user terminal 20 are configured to be able to communicate with each other through a telecommunication line. The information processing device 10 and the user terminal 20 are each an example of an information processing device. In one embodiment, the information processing system 1 is made up of one or more devices or components. For example, if the information processing system 1 is made up of only the information processing device 10 or the user terminal 20, the information processing system 1 can be the information processing device 10 or the user terminal 20. These components will be described below. <Information processing device 10> Fig. 2 is a block diagram showing a hardware configuration of the information processing device 10. As shown in Fig. 2, the information processing device 10 includes a control unit 11, a storage unit 12, a communication unit 13, and a communication bus 14. The control unit 11, the storage unit 12, and the communication unit 13 are electrically connected to each other inside the information processing device 10 via the communication bus 14.

[0016] <Control unit 11> The control unit 11 processes and controls the overall operation related to the information processing device 10. The control unit 11 is, for example, a central processing unit (CPU). The control unit 11 realizes various functions related to the information processing device 10 by reading out a predetermined program stored in the storage unit 12. That is, information processing by software stored in the storage unit 12 can be specifically realized by the control unit 11, which is an example of hardware, and executed as each functional unit included in the control unit 11. These will be described in more detail in the next section. Note that the control unit 11 is not limited to being a single unit, and the information processing device 10 may have multiple control units 11 for each function. Furthermore, the information processing device 10 may have a configuration that combines these.

[0017] <Storage section 12> The storage unit 12 stores various pieces of information defined by the above description. This can be implemented, for example, as a storage device such as a solid state drive (SSD) that stores various programs and the like related to the information processing device 10 executed by the control unit 11, or as a memory such as a random access memory (RAM) that stores temporarily required information (arguments, arrays, etc.) related to the program calculations. The storage unit 12 stores various programs, variables, etc. related to the information processing device 10 executed by the control unit 11.

[0018] <Communications Division 13> The communication unit 13 is preferably a wired communication means such as USB, IEEE1394, Thunderbolt (registered trademark), wired LAN network communication, etc., but may also include wireless LAN network communication, mobile communication such as LTE / 5G, BLUETOOTH (registered trademark) communication, etc. as necessary. In other words, it is more preferable to implement it as a collection of multiple communication means. In other words, the information processing device 10 may communicate various information from the outside via the communication unit 13 and the network.

[0019] The information processing device 10 may be in an on-premise form or in a cloud form. As the information processing device 10 in a cloud form, the above-mentioned functions and processes may be provided in the form of, for example, SaaS (Software as a Service) or cloud computing.

[0020] <User terminal 20> The user terminal 20 is an information processing terminal used by a user who utilizes the information processing function provided by the information processing device 10. Fig. 3 is a block diagram showing a hardware configuration of the user terminal 20. As shown in Fig. 3, the user terminal 20 includes a control unit 21, a storage unit 22, a communication unit 23, an input unit 24, an output unit 25, and a communication bus 26. The control unit 21, the storage unit 22, the communication unit 23, the input unit 24, and the output unit 25 are electrically connected via the communication bus 26 inside the user terminal 20. The explanation of the control unit 21, the storage unit 22, and the communication unit 23 will be omitted because they are similar to the explanation of each unit in the information processing device 10.

[0021] <Input section 24> The input unit 24 accepts an action input made by a user. The action input is transferred as a command signal to the control unit 21 via the communication bus 26. The control unit 21 may execute a predetermined control or calculation based on the transferred command signal as necessary. The input unit 24 may be included in the housing of the user terminal 20, or may be externally attached. For example, the input unit 24 may be implemented as a touch panel integrated with the output unit 25. When the input unit 24 is implemented as a touch panel, the user can input a tap action, a swipe action, or the like to the input unit 24. As the input unit 24, a switch button, a mouse, a track pad, a QWERTY keyboard, or the like can be adopted instead of a touch panel.

[0022] <Output section 25> The output unit 25 displays a screen of a graphical user interface (GUI) on which the user can perform actions. The output unit 25 may be included in the housing of the user terminal 20, or may be attached externally. Specifically, the output unit 25 may be implemented as a display device such as a CRT display, a liquid crystal display, an organic EL display, or a plasma display. It is preferable that these display devices are implemented by selectively using them according to the type of the user terminal 20.

[0023] 2. Functional configuration In this section, the functional configuration of the present embodiment will be described. Information processing by software stored in the storage unit 12 of the information processing device 10 or the storage unit 22 of the user terminal 20 can be specifically realized by the control unit 11 of the information processing device 10 or the control unit 21 of the user terminal 20, which are examples of hardware, and can be executed as each functional unit included in the control unit 11 or the control unit 21 (a processor included in the information processing system 1).

[0024] Fig. 4 is a block diagram showing functions realized by the user terminal 20 (control unit 21). As shown in Fig. 4, the user terminal 20 (control unit 21) includes a reception unit 211, a generation unit 212, an acquisition unit 213, and an output control unit 214. Note that in this embodiment, "projection" includes displaying an image or the like on an external object by a projection device, as well as displaying an image or the like by a display device.

[0025] First Embodiment (1) Overview of the process In the first embodiment, the control unit 21 breaks down the part of the image where the gaze should be guided into a mosaic and superimposes it at high speed. This realizes gaze guidance that works only on moving observers (those to whom the image is provided) and does not affect stationary observers. This makes it possible to manipulate the saliency within the image and effectively control gaze guidance when stationary and when moving. The proposed method shown below can be applied not only to gaze guidance in advertisements for pedestrians, but also to advertisements for vehicles and gaze guidance to real objects.

[0026] When presenting an advertisement for pedestrians, it is desirable to guide the pedestrian's gaze in the brief moment when the pedestrian passes in front of the advertisement. Also, when the pedestrian stops and stares at the advertisement, it is desirable to make the gaze guidance effect disappear and the content recognized. Therefore, a system is desired in which the gaze is guided to an intended location when the pedestrian sees the advertisement while walking, while the guidance effect disappears when the pedestrian stops. Therefore, in the first embodiment, a gaze guidance method is proposed that works only for moving observers and does not work for stationary observers. The control unit 21 breaks down the image using a special mosaic that manipulates saliency, and projects it at high speed. FIG. 5 is a diagram showing an overview of the processing in the first embodiment.

[0027] <Reception Department 211> The reception unit 211 is configured to receive from the user the designation of a target image and the selection of a designated area in the target image based on the user's operation via the screen. This allows the provider of the target image to arbitrarily designate a designated area in the target image that is to be changed depending on the presence or absence of movement of the person to whom the image is to be provided. Here, the "target image" is an image to be viewed by the person to whom the image is to be provided.

[0028] The receiving unit 211 may receive a selection of a designated area based on a target image, which makes it easier for the provider of the target image to specify the designated area.

[0029] The designated area may be a part of the target image. In other words, the receiving unit 211 may receive a part of the target image as the designated area. This allows only a part of the target image to be changed depending on the presence or absence of movement of the person to whom the image is to be provided.

[0030] The designated area may be the entire target image. In other words, the receiving unit 211 may receive the entire target image as the designated area. This allows the entire target image to be changed depending on the presence or absence of movement of the person to whom the image is to be provided.

[0031] <Generation unit 212> The generator 212 is configured to generate successive frames based on image information of a designated area designated in a destination image.

[0032] The consecutive frames include at least a first image generated based on the target image and a second image different from the first image as frames. In other words, the consecutive frames include at least two types of frames that are different from each other, and may include three or more types of frames.

[0033] In the first embodiment, the consecutive frames include, as frames, a plurality of mosaic images each composed of a predetermined number of periodically arranged rectangular elements of a color, which are generated based on a target image. In each frame (mosaic image) of the consecutive frames, the phases of the rectangular elements are different from each other. The mosaic images having different phases from each other correspond to the first image and the second image in the consecutive frames. That is, both the first image and the second image in the consecutive frames are generated based on the target image.

[0034] "Different phases" in a mosaic image means that the periodic arrangement of a certain number of colors is shifted; for example, the order of the colors is the same, but the colors at the start (end) points of the cycle are different.

[0035] The number of rectangular features in the mosaic image is preferably 4. This makes it possible to project a relatively clear image while suppressing the processing load for generating successive frames.

[0036] Furthermore, the rectangular elements in the mosaic image are preferably square elements, which can increase the accuracy of the projected image (the degree of reproduction of the target image).

[0037] The generating unit 212 may determine the area of ​​the rectangular element according to the area of ​​the specified region accepted by the accepting unit 211. This makes it possible to increase the accuracy of the projected image (the degree of reproduction of the target image) while suppressing the load of the process of generating consecutive frames.

[0038] <Acquisition part 213> The acquisition unit 213 acquires consecutive frames. Specifically, the acquisition unit 213 is configured to acquire consecutive frames (consecutive frames generated by the generation unit 212) generated based on image information of a designated area designated in a target image.

[0039] <Output control unit 214> The output control unit 214 is configured to repeatedly and continuously output the consecutive frames acquired by the acquisition unit 213 at a frame rate equal to or higher than a predetermined value so that a moving observer and a stationary observer can view different images.

[0040] In the first embodiment, the output control unit 214 causes the projector 110 to output the continuous frames at a frame rate equal to or higher than a predetermined value, while superimposing the continuous frames on the position of the designated area of ​​the target image. For example, the output control unit 214 causes the projector 110 to output the target image toward the projector screen 120 (project it onto the projector screen 120), and causes the projector 110 to repeatedly and continuously output a plurality of mosaic images generated based on the designated area of ​​the target image toward the projector screen 120 in phase order so that the images are superimposed on the designated area of ​​the target image on the projector screen 120.

[0041] (2) Details of the processing 6 is a flowchart showing an example of information processing executed by user terminal 20. In this information processing, in step S110, control unit 21 acquires an image based on an operation of a user (provider of a target image). For example, control unit 21 may acquire an image from storage unit 22 or the like, or may acquire an image from a server or the like with which control unit 21 can communicate via a network. Hereinafter, for the sake of simplicity, the image acquired in step S110 is also referred to as a target image.

[0042] In step S120, control unit 21 selects an area of ​​the target image for which the saliency is to be changed (i.e., the area to which the viewer's gaze is to be guided). For example, control unit 21 outputs a screen including the target image to a projection device (projector 110) and accepts a selection of an area included in the target image from a user based on a selection operation via the screen. Note that control unit 21 may display a screen including the target image on output unit 25 (display, etc.) of user terminal 20 and accept the selection of an area. These processes are an example of a process of selecting an area based on a user operation via the screen.

[0043] Furthermore, the control unit 21 may automatically select a region based on image information included in the target image. The image information may be, for example, color information and / or edge information. The control unit 21 may select a characteristic region based on the image information as a region for which the saliency is to be changed, or may input the target image to a trained model and select a region output from the trained model as a region for which the saliency is to be changed. The trained model is a model trained using an image as input data and a region included in the image for which the saliency is to be changed as output data.

[0044] The region selected in step S120 may be a part of the target image, or may be the whole of the target image. However, in the following description, for the sake of simplicity, the region is assumed to be a part of the target image. The region selected in step S120 is hereinafter referred to as the selected region, or the region whose salience is desired to be increased, etc.

[0045] In step S130, the control unit 21 generates a mosaic image by converting the region selected in step S120 into a mosaic shape based on the image information of the region. Here, the mosaic image is composed of rectangular elements of a predetermined number of colors arranged periodically. In the example of the first embodiment, as described later, the predetermined number is four, that is, four colors are used as an example. However, the constituent colors of the mosaic image are not limited to four colors, and may be three colors or five or more colors. In the example of the first embodiment, as described later, the rectangular elements are used as an example. However, the rectangles constituting the mosaic image are not limited to squares, and may be diamonds, rectangles, etc.

[0046] The control unit 21 generates a number of mosaic images equal to a predetermined number (the number of colors constituting the mosaic image) for one selected region. These mosaic images are obtained by shifting the periodic arrangement of the rectangles in the first mosaic image by one. By generating a plurality of mosaic images, the control unit 21 generates a continuous frame composed of these mosaic images.

[0047] In step S140, control unit 21 controls so that each of the consecutive frames is output in the order included in the consecutive frames (i.e., in the order in which the phases are shifted by one) and at a frame rate equal to or higher than a predetermined value, superimposed on the position of the region selected in step S120 of the target image. For example, control unit 21 transmits a control signal to projector 110, and controls so as to project an image onto projector screen 120.

[0048] The frame rate of the consecutive frames is, for example, 240 fps. This value is obtained by multiplying 60 fps by a predetermined number, 4, based on data that the frame rate that humans can recognize is 60 fps. However, the frame rate is not limited to this, and may be, for example, 480 fps, which is obtained by doubling the frame rate that humans can recognize (60 fps) to 120 fps, and then multiplying it by four. Note that, as a result of experiments, it has been found that a frame rate of 360 fps or more is easily recognized as a mosaic, so the predetermined frame rate may be 360 ​​fps.

[0049] FIG. 7 is a diagram showing an example of an image in which a mosaic technique is applied to an area in which saliency is desired to be increased, and the mosaic is observed when the observer is moving. FIG. 7(a) shows a state in which an area in which saliency is desired to be increased in a moving state is selected in the target image. FIG. 7(b) shows a state of the image observed when the observer is stationary. FIG. 7(c) shows a state of the image observed when the observer is moving. As shown in FIG. 7(b), an image identical to the target image is observed for a stationary observer, whereas as shown in FIG. 7(c), an image in which the saliency of the selected area is increased is observed for a moving observer.

[0050] More specifically, the control unit 21 breaks down an area in the projected image in which it is desired to enhance the salience into a plurality of mosaic images. Each mosaic image is composed of square elements of four colors (e.g., red, green, blue, and black) arranged periodically to draw a circle (e.g., two columns and two rows), and four frames are generated with a temporal and spatial phase shift (i.e., the color scheme is shifted clockwise or counterclockwise) as time t=4n, 4n+1, 4n+2, 4n+3 (n∈N) elapses, as shown in FIG. 8. FIG. 8 is a diagram showing an example of high-speed sequential display of mosaics with different phases. The square elements have a large color change from each other, so the salience of the selected area is increased.

[0051] When consecutive frames include an area (non-selected area) other than the selected area that does not require improvement in saliency, the pixel values ​​(RGB values) of the non-selected area in the mosaic image (individual frames) may be set to values ​​obtained by dividing the pixel values ​​of the target image by a predetermined number (4 in the case of four colors) so as not to change the saliency of the non-selected area in the projected image. The control unit 21 repeatedly projects the four frames of images generated by these operations at high speed.

[0052] The control unit 21 determines the size of the square elements in the mosaic according to the size of the area in the projected image where the salience is to be increased. This process is an example of a process for determining the area of ​​the rectangular elements according to the area of ​​the area. As the number of colors (number of frames) of the superimposed square elements increases, a high projection frequency is required to perceive the original image, so it is preferable to configure the mosaic image with square elements of four colors (red, green, blue, and black). Note that the characters black, red, green, blue, etc. in the mosaic in FIG. 8 are for explanation purposes and are not actually included in the image.

[0053] An image before application of the proposed method of the first embodiment is called a target image Ig=(Rg, Gg, Bg). Rg, Gg, and Bg are the RGB components of the target image Ig. The target image Ig is expressed by additive color mixing of Rg, Gg, and Bg, and the target image Ig can be reproduced by overlapping the elements of Rg, Gg, and Bg. Fig. 9 is a diagram showing an example of decomposing an image into each RGB component.

[0054] In order to reproduce the target image Ig by time integration, the square elements in the projected mosaic are assigned colors such that Rg, Gg, and Bg all overlap when superimposed in the time direction. For example, in a selected region where it is desired to increase the saliency, the projected image Ip=(Rp, Gp, Bp) changes as shown in Fig. 10 for the target image Ig=(Rg, Gg, Bg). Fig. 10 is a diagram for explaining an example of the change in the image projected onto the target region.

[0055] On the other hand, outside the region of the target for saliency manipulation, the projection image Ip changes as shown in Fig. 11. Fig. 11 is a diagram for explaining an example of the change in the image projected outside the region of the target. The reason why processing is also performed outside the region of the target for saliency manipulation is to make the brightness uniform with the region of the target for saliency manipulation.

[0056] As a result, the projected image Ip is integrated in the time direction in the visual system for a stationary observer, and the image perceived by the stationary observer generally coincides with the target image Ig, regardless of whether the image is inside or outside the mosaic selection area. Figure 12 shows an example of the observation result by a stationary observer. On the other hand, a moving observer perceives the square elements in the mosaic as being shifted. Figure 13 shows an example of the observation result by a moving observer.

[0057] Since a large gradient of pixel values ​​in a region in an image tends to be salient, the shift in the mosaic increases the salience of the selected region in the projection image Ip.

[0058] FIG. 14 is a diagram for explaining the outline of the processing of the information processing system 1. The control unit 21 may calculate a saliency map of the target image Ig to be shown to a stationary person and display the saliency map of the target image Ig by superimposing it on the saliency map of the target image Ig, or may compare the target image Ig with the saliency map of the target image Ig, and select the selected area to which the viewer's eye is to be attracted as an application part of the proposed method shown in the first embodiment if the saliency of the selected area is lower than a predetermined value (step 1 in FIG. 14). In the example of FIG. 14, a rectangular range surrounding a can with low saliency indicates the selected area. Next, the control unit 21 applies the proposed method of the first embodiment to the target image Ig, and generates four projection images so that the area to which the viewer is to be attracted is decomposed in a mosaic shape (step 2 in FIG. 14). The control unit 21 projects the four projection images thus generated onto the projector screen 120 using the projector 110 (step 3 in FIG. 14). The saliency map indicates the distribution of the saliency level in an image, and is obtained by a known method.

[0059] <Verification results> The saliency of the target image Ig before the application of the proposed method and the four projected images generated by the proposed method for four types of images was compared and evaluated. As shown in Figs. 15, 16, 17, and 18, it is shown that the saliency (lower row) of the four projected images (upper row) is improved compared to the target image Ig. This result shows that the saliency of the mosaic application portion is improved in the projected image. Fig. 15 is a diagram showing an example of a projected image of a landscape image and its saliency map. Fig. 16 is a diagram showing an example of a projected image of a streetscape image and its saliency map. Fig. 17 is a diagram showing an example of a projected image of a product image and its saliency map. Fig. 18 is a diagram showing an example of a projected image of a poster image including text and its saliency map.

[0060] Next, the proposed method was applied to four types of images, and the observation results were compared between still and moving images by capturing images at high speed. The observation results (upper row) and the respective saliency maps (lower row) in still and moving states when an image was projected using the proposed method are shown in Figs. 19, 20, 21, and 22. Fig. 19 is a diagram showing an example of the projection observation result of a landscape image and its saliency map. Fig. 20 is a diagram showing an example of the projection observation result of a streetscape image and its saliency map. Fig. 21 is a diagram showing an example of the projection observation result of a product image and its saliency map. Fig. 22 is a diagram showing an example of the projection observation result of a poster image including text and its saliency map.

[0061] From each of Figures 19, 20, 21, and 22, the target image Ig is observed as it is as a projected image when the subject is stationary, whereas a mosaic is observed in the observation results when the subject is moving. From these results, it can be seen that a portion of the projection result is observed as a mosaic when the subject is moving. In addition, the saliency map at the bottom of each figure shows that saliency is improved in areas where a mosaic is observed when the subject is moving compared to when the subject is stationary. From this, it can be said that saliency is improved in areas where a mosaic is observed when the subject is moving compared to when the subject is stationary.

[0062] <Application> When the proposed method of the first embodiment is applied to advertising videos or posters, the intended part of the advertisement can be made conspicuous to people who are moving, such as pedestrians and train passengers. Moreover, the observation results are not impaired when the advertisement is perceived while stationary. Furthermore, the proposed method of the first embodiment can be applied even when the advertisement itself is moving. For example, by applying the proposed method of the first embodiment to advertisements on vehicles such as trucks and buses, it becomes possible to apply the method to attract the observer's attention while the vehicle is moving, and to allow the observer to observe a normal advertisement when the vehicle stops at a traffic light or the like.

[0063] In addition, by applying the method proposed in the first embodiment to a white target image, it becomes possible to manipulate the saliency of a real object. This makes it possible to guide the gaze even in cases where it is difficult to control the appearance of a real object, such as product displays or museum exhibits. This makes it possible to guide the gaze to an advertisement or to a real object using white light projection.

[0064] In the first embodiment, the control unit 21 has been described using the projector 110 capable of high-speed projection. However, the control unit 21 of the second modification may output an image or the like to a display having a refresh rate higher than a predetermined value. For example, the control unit of the vehicle may display an image on a display or the like of the vehicle.

[0065] <Image projection method> The image projection method of the present embodiment includes the steps of acquiring a target image, selecting an area of ​​the target image, creating successive frames based on image information of a specified area specified in the target image, and outputting the successive frames at a frame rate equal to or higher than a predetermined value, superimposed on the position of the area of ​​the target image. The successive frames include a plurality of mosaic images as frames, each of which is composed of a predetermined number of periodically arranged rectangular elements of different colors. The successive frames have mutually different phases of the rectangular elements.

[0066] The image projection method of the present embodiment may be implemented by the information processing system 1, or may be implemented using an information processing device other than the information processing system 1.

[0067] As described above, according to the first embodiment, it is possible to provide images that look different when a subject to whom the images are to be provided is moving and when the subject is stationary.

[0068] <Second embodiment> (1) Overview of the process In the second embodiment, high-speed projection technology and the afterimage effect are utilized to realize the presentation of a desired color of an afterimage according to the movement of an object within the visual field of an observer (a person to whom the image is to be provided).

[0069] According to the information processing system 1 of the second embodiment, it is possible to present a specific color in the afterimage of a moving object blocking the projection frame while minimizing the constraints on the direction of movement of the observer. Fig. 23 is a diagram showing an overview of the processing in the second embodiment. This processing utilizes a phenomenon called sequential additive color mixing, in which when multiple colors are displayed at high speed, the human eye perceives the displayed colors as one color.

[0070] FIG. 24 is a schematic diagram explaining the time-sequential additive color mixing of RGB light. As shown in FIG. 24(a), white is perceived by overlapping three colors, red (R), green (G), and blue (B), at high speed. Also, as shown in FIG. 24(b), various colors can be expressed by changing the ratio of RGB light. By decomposing the projected frame so that the total pixel values ​​of R, G, and B are the same, it is also possible to perceive the same color by changing the color of the overlapping frames, such as overlapping yellow and blue as shown in FIG. 24(c), or overlapping yellow and two dark blues as shown in FIG. 24(d).

[0071] Furthermore, when performing continuous color mixing display by high-speed image display, if the display surface is blocked by a dynamic object or if the observer or the display surface moves, frame dropping occurs, resulting in a phenomenon called color breaking, in which an unintended image is observed. Figure 25 is a schematic diagram explaining color breaking. As shown in Figure 25(a), when there is no frame dropping, the observer perceives the intended image. On the other hand, as shown in Figure 25(b), when there is a frame dropping, the observer does not perceive the intended image. In this process, the image seen when a frame dropping occurs is controlled by adjusting the speed of image display and the color mixing combination of the displayed image.

[0072] <Reception Department 211> The reception unit 211 is configured to receive designation of a first destination image and a second destination image from a user. The first destination image is an image that is perceived when the successive frames output by the output control unit 214 are projected onto a moving object. The second destination image is an image that is perceived when the successive frames output by the output control unit 214 are projected onto a stationary object. This allows the target person to visually recognize different images when the object is moving and when the object is not moving.

[0073] Here, "moving object" means "an object moving relative to an observer." In other words, "moving object" includes an object moving relative to a stationary observer, a stationary object observed by a moving observer, a moving object observed by a moving observer, etc.

[0074] The first destination image and the second destination image may each be part of a moving image, i.e. successive frames may give the observer the perception of a moving image.

[0075] From the viewpoint of a generation algorithm for the first and second images, which will be described later, the luminance of each pixel in the first destination image is set to be smaller than the luminance of the corresponding pixel in the second destination image.

[0076] <Generation unit 212> The generating unit 212 is configured to generate consecutive frames based on the image information of the first and second target images received by the receiving unit 211. The consecutive frames include at least a first image generated based on the target image and a second image different from the first image as frames. In other words, the consecutive frames include at least two types of frames that are different from each other, and may include three or more types of frames.

[0077] In the second embodiment, each pixel of the first image has an RGB value obtained by dividing the RGB value of each pixel of the first destination image (for example, in the case of 8 bits, a value from 0 to 255 for each of red (R), green (G), and blue (B)) by the number of first images included in consecutive frames. Each pixel of the second image has an RGB value obtained by subtracting the value obtained by multiplying the RGB value of each pixel of the first image by the number of first images included in consecutive frames from the RGB value of each pixel of the second destination image.

[0078] The RGB value Fd of each pixel of the first image is calculated by the following formula (1), and the RGB value Fc of each pixel of the second image is calculated by the following formula (2). Fd = It / (Tk) (1) Fc = Is - (Tk)Fd (2)

[0079] In formula (1), It is the RGB value of the pixel in the first destination image whose coordinates correspond to the coordinates of the pixel for which Fd is obtained. T is the frames (total number of first images and second images) included in the consecutive frames. k is the number of second images included in the consecutive frames. Therefore, (Tk) represents the number of first images included in the consecutive frames. In formula (2), Is is the RGB value of the pixel in the second destination image whose coordinates correspond to the coordinates of the pixel for which Fc is obtained. In addition, (Tk)Fd represents the number of first images multiplied by the RGB value of the pixel in the first image whose coordinates correspond to the coordinates of the pixel for which Fc is obtained.

[0080] Fig. 26 is a schematic diagram for explaining the perception mechanism of the first and second target images. In the example of Fig. 26, as shown in Fig. 26(a), the consecutive frames are composed of five first images P1 and one second image P2. When the consecutive frames are continuously projected at high speed by the projector 110 in the order shown in Fig. 26(a), the multiple images included in the consecutive frames are superimposed, and the observer perceives the second target image OP2 (in the example of Fig. 26, a completely white image).

[0081] On the other hand, as shown in Fig. 26(b), when a rod-shaped object 130 is moved up and down with its longitudinal direction horizontal in front of the projector screen 120 onto which the successive frames are projected by the projector 110, a part of the successive frames projected onto the object 130 is perceived by the observer. In other words, when the object 130 moves slightly, the first image or the second image included in the successive frames is sequentially perceived by the observer on the motion trajectory of the object 130. As a result, as shown on the right of Fig. 26(b), the observer can perceive a first destination image OP1 into which an afterimage caused by the object 130 is synthesized.

[0082] The number of second images included in the consecutive frames is preferably smaller than the number of first images included in the consecutive frames. Specifically, in the above formulas (1) and (2), k<(Tk) is preferably set. This can increase the reproducibility of the first target image as viewed by the image provider.

[0083] Furthermore, it is preferable that the number of second images included in the consecutive frames is 1, and the number of first images included in the consecutive frames is 10 or more and 20 or less. Specifically, in the above formulas (1) and (2), it is preferable that k=1 and 10≦(Tk)≦20. This can reduce the processing load for creating consecutive frames while increasing the reproducibility of the first target image visually recognized by the image provider.

[0084] Also, the total number of frames included in the consecutive frames (the total number of first images and the number of second images) may be, for example, 10 or more and 20 or less. The larger the total number of frames (the number of frame divisions), the closer the image perceived by the observer is to the first target image when projected onto a moving object, but as the number of frame divisions increases, it is necessary to increase the projection frequency as described below. As a result, the brightness of the image perceived by the observer decreases, and the color reproducibility of the perceived first target image decreases. Therefore, for example, a total number of frames of 16 is appropriate.

[0085] Fig. 27 is a schematic diagram for explaining the configuration of successive frames and the projection procedure thereof. When the stationary target image (second target image) is a white image as in the example of Fig. 27, each pixel of the complementary color frame (second image) becomes close to the complementary color (opposite color image in the hue circle) of each pixel of the target color frame (first image).

[0086] The order (projection order) of the first image and the second image in the consecutive frames is not particularly limited. In addition, the consecutive frames may include only the first image and the second image. In other words, the consecutive frames may not include images other than the first image and the second image. In other words, the consecutive frames may include only two types of images as frames.

[0087] <Acquisition part 213> The acquisition unit 213 acquires consecutive frames. Specifically, the acquisition unit 213 is configured to acquire consecutive frames including at least the first image and the second image (consecutive frames generated by the generation unit 212).

[0088] <Output control unit 214> The output control unit 214 is configured to repeatedly and continuously output the consecutive frames acquired by the acquisition unit 213 at a frame rate equal to or higher than a predetermined value so that a moving observer and a stationary observer can view different images.

[0089] In the second embodiment, the output control unit 214 outputs successive frames at any position at a frame rate equal to or higher than a predetermined value. For example, the output control unit 214 causes the projector 110 to repeatedly and continuously output the first image and the second image to the projector screen 120 in a specified order.

[0090] The output control unit 214 may project successive frames onto a stationary object. This allows an observer to view the second image on a stationary first object (e.g., projector screen 120), while allowing the same observer to view the first target image by the successive frames projected onto the second object when another second object moves in front of the first object or passes in front of the first object. Also, an observer moving relative to the first object can view the first target image.

[0091] The frame rate of the successive frames, that is, the projection frequency of the successive frames (frame switching frequency), is set to, for example, equal to or greater than the critical flicker fusion frequency (CFFF) of the observer multiplied by the number of frames included in the successive frames (T in the above formula (1)). For example, when the number of frames is T=16, by setting the frame rate to 960 fps, the image (first destination image or second destination image) in which the successive frames are superimposed is observed at a frequency of 960 / 16=60 fps. Since this 60 fps exceeds the CFFF, the observer can perceive the first destination image or the second destination image without perceiving flickering.

[0092] (2) Details of the processing 28 is a flowchart showing an example of information processing executed by user terminal 20. In this information processing, first, a user (a provider of a target image) prepares images to be a first target image and a second target image, and selects the first target image and the second target image to be projected by successive frames in user terminal 20 (step S210).

[0093] Next, the user causes user terminal 20 to create consecutive frames (step S220). Here, the user inputs setting values ​​such as the number of frame divisions of the consecutive frames, the number of first images, and the number of second images. User terminal 20 generates consecutive frames based on the input setting values ​​and the selected first and second target images. Note that the setting values ​​may be automatically set by control unit 21.

[0094] After the successive frames are created, the created successive frames are output to a projection device such as the projector 110 (step S230). For example, the user terminal 20 accepts an output instruction from a user, and causes the projector 110 to repeatedly and continuously project the successive frames based on the output instruction.

[0095] <Verification results> Fig. 29 is a diagram showing the procedure of an image projection experiment using the information processing system 1. As shown in Fig. 29, a black rod was moved vertically in front of the screen while a high-speed projector was used to project consecutive frames onto the screen, causing it to move up and down. The image projected onto the screen was recorded by a camera at a fixed position. The shutter speed of the camera was set to 60 fps, which is close to human perception.

[0096] The projected image was designed to include a variety of colors both when still (when the black stick is not swung) and when moving (when the black stick is swung). As the target image for stillness (second target image), an image was prepared in which the left half of the image was white and the right half was colored with cyan (C), magenta (M), and yellow (Y) from left to right. As the target image for moving (first target image), an image was prepared in which the left half was colored with B, G, R, Y, C, M, G, B, R, B, R, and G from left to right.

[0097] A series of frames was created based on the first and second target images. The total number of frames (frame division number) included in the series of frames to be projected was 16, and multiple series of frames were prepared by varying the number of first images and second images.

[0098] Specifically, four consecutive frames were created: a first pattern of eight first images and eight second images; a second pattern of 12 first images and four second images; a third pattern of 14 first images and two second images; and a fourth pattern of 15 first images and one second image.

[0099] The continuous frames were projected onto a screen at a frequency of 960 fps, and the projection results at rest and in motion were photographed with a camera, and the color reproducibility was evaluated by comparing the color of the projection target with the photographed image to obtain the color difference. CIEDE2000 was used to evaluate the color difference, and a color map was created by calculating the color difference at corresponding pixels between the projection target and the projection result.

[0100] 30 is a diagram showing the observation results of the image projected by the information processing system 1. From the observation results when stationary and the color map of the color difference (the color difference between the second target image and the captured image), it was found that the projection results were close to the projection target in consecutive frames of any pattern.

[0101] In addition, the results of the observations during motion confirmed that in consecutive frames of any pattern, an image different from that when still is perceived due to afterimages. In particular, the color of the superimposed frame is presented around the black bar, and the range in which the image different from that when still changes depending on the ratio of the first image to the second image.

[0102] Furthermore, regarding the color of the afterimage during movement, in the first pattern (a), the color of the afterimage is expressed randomly, and control of the color of the afterimage is weak, whereas as the proportion of the first image increases in the order of the second pattern (b), the third pattern (c), and the fourth pattern (d), the color of the afterimage becomes clearer and the color difference with the first target image also decreases.

[0103] <Application> For example, by setting the second target image to a projected image in white ambient light, it is possible to change the image that is perceived only when an object is moving in an everyday situation. Fig. 31 is a schematic diagram showing a specific example of an application of the information processing system 1.

[0104] Fig. 31(a) is an example of projection onto a smartphone. In this example, when a user is using the smartphone while standing still, the projected image is perceived as white ambient light, whereas when the user is walking, the smartphone becomes a moving projection target object, and an image warning against using a smartphone while walking is displayed on the smartphone in response to the movement of the smartphone. This is expected to effectively prevent people from using their smartphone while walking in train stations, commercial facilities, etc.

[0105] Figure 31(b) shows an example of presenting an afterimage according to the direction of a person's movement. In this example, spatial presentation according to the movement of the person becomes possible, and the atmosphere of the space can be dynamically changed.

[0106] Figure 31(c) shows an example where the observer waves their hand at the image of a character, causing the character to change perception as if it were smiling. When the observer is still, a normal character is displayed, but when the observer makes an action such as waving their hand, an effect prepared for movement can be displayed on the character as an image. This allows the observer to have an interactive experience with the character through their own actions.

[0107] Figure 31(d) shows an example of displaying a water effect (effect line) as an afterimage when swinging a sword. By displaying an effect line in the afterimage when swinging a sword, bat, etc. in this way, the action in the real world is visually enhanced, providing a more immersive experience.

[0108] The information processing system 1 can also be used for applications that allow a photographing device (camera) to perceive (take) different images. In image projection by the information processing system 1, the photographing device can acquire (take) a target image without synchronizing the projection process of the projection device with the photographing process of the photographing device.

[0109] Fig. 32 is a schematic diagram showing an example of capturing a projected image by the information processing system 1. For example, when capturing an image with a shutter speed slower than the human perception speed, a target image (second target image) at rest is captured (Fig. 32(a)), and when the shutter speed is high, a target image (first target image) during exercise can be captured (Fig. 32(b)). In particular, since the shutter speed of a smartphone is often high to prevent camera shake, there is a high possibility that a target image during exercise will be captured.

[0110] A specific application of the camera is, for example, suppression or promotion of photography of advertisements at train stations. Many attractive advertisements are posted at train stations, and some of them are photographed by many people. Taking a photograph of an advertisement may increase the effectiveness of the advertisement by spreading it thereafter, but there is a concern that the photographer may disturb passersby during rush hour when there is a lot of traffic. In response to this, photography can be suppressed during rush hour by projecting successive frames that make the viewer perceive a first destination image in which the original advertisement image is accompanied by a warning not to take photographs, and a second destination image that is the original advertisement image, as shown in FIG. 32(c). Furthermore, during quiet times, photography can be promoted by projecting successive frames in which an image in which the original advertisement image has been changed (an image in which the person's clothes have been changed) is used as the first destination image, as shown in FIG. 32(d). This makes it possible to control the spread of advertisements at the appropriate time, and maximize the advertising effectiveness.

[0111] In the second embodiment, the consecutive frames do not necessarily need to be projected by a projection device, but may be displayed on a display. For example, the output control unit 214 may cause the output unit 25 of the user terminal 20 to output the consecutive frames.

[0112] <Image projection method> The image projection method of this embodiment includes the steps of: creating consecutive frames including at least a first image and a second image different from the first image as frames; and projecting the consecutive frames at a frame rate equal to or higher than a predetermined value. Each pixel of the first image has an RGB value obtained by dividing the RGB value of each pixel of the first destination image by the number of first images included in the consecutive frames. Each pixel of the second image has an RGB value obtained by subtracting from the RGB value of each pixel of the second destination image a value obtained by multiplying the RGB value of each pixel of the first image by the number of first images included in the consecutive frames.

[0113] The image projection method of the present embodiment may be implemented by the information processing system 1, or may be implemented using an information processing device other than the information processing system 1.

[0114] As described above, according to the second embodiment, it is possible to provide images that look different when a subject to whom the images are to be provided is moving and when the subject is stationary.

[0115] In particular, in this embodiment, a sensor (camera, etc.) for changing an image according to the movement of an observer or an object is used. Since no additional imaging is required, there is no limit to the number of observers. In addition, there is no limit to the speed of observer movement. Furthermore, when a moving object enters between the projected image and the observer, an afterimage is easily observed on the object or near the edge of the object, so that not only a geometric pattern but also a more detailed first target image can be observed.

[0116] 3.Other In the above embodiment, the information processing device 10 performs various storage and control, but multiple external devices may be used instead of the information processing device 10. That is, various information and programs may be distributed and stored in multiple external devices using block chain technology or the like.

[0117] The aspect of the present embodiment is not limited to the information processing system 1, and may be an information processing method or a program. The information processing method includes each step executed by the information processing system 1. The program causes a computer to execute each step of the information processing system 1.

[0118] At least one of the devices included in the information processing system 1 may be installed outside the country in which the functions of the information processing system 1 are performed.

[0119] The processing of the information processing system 1 may be executed by the information processing device 10. In other words, a part of or the whole of the processing executed by the control unit 21 of the user terminal 20 may be executed by the control unit 11 of the information processing device 10.

[0120] For example, the above-mentioned program may be stored in a non-transitory computer-readable storage medium. Also, the above-mentioned embodiments may be combined in any desired manner.

[0121] It may be provided in any of the following ways:

[0122] (1) An information processing system comprising: an acquisition unit that acquires consecutive frames including at least a first image generated based on a target image and a second image different from the first image; and an output control unit that repeatedly and continuously outputs the consecutive frames at a frame rate equal to or higher than a predetermined value so that different images are visible to a moving observer and a stationary observer.

[0123] (2) In the information processing system described in (1) above, each pixel of the first image has an RGB value obtained by dividing the RGB value of each pixel of the first destination image by the number of the first images included in the consecutive frames, and each pixel of the second image has an RGB value obtained by subtracting from the RGB value of each pixel of the second destination image the value obtained by multiplying the RGB value of each pixel of the first image by the number of the first images included in the consecutive frames.

[0124] (3) In the information processing system described in (2) above, the first target image is an image perceived when the successive frames are projected onto a moving object, and the second target image is an image perceived when the successive frames are projected onto a stationary object.

[0125] (4) The information processing system according to (2) above, wherein the number of the second images included in the consecutive frames is smaller than the number of the first images included in the consecutive frames.

[0126] (5) In the information processing system described in (4) above, the number of the second images included in the consecutive frames is 1, and the number of the first images included in the consecutive frames is 10 or more and 20 or less.

[0127] (6) In the information processing system described above in (2), the output control unit projects the successive frames onto a stationary object.

[0128] (7) A method for projecting an image, comprising: a step of creating consecutive frames including at least a first image and a second image different from the first image as frames; and a step of projecting the consecutive frames at a frame rate equal to or higher than a predetermined value, wherein each pixel of the first image has an RGB value obtained by dividing the RGB value of each pixel of a first destination image by the number of the first images included in the consecutive frames, and each pixel of the second image has an RGB value obtained by subtracting from the RGB value of each pixel of the second destination image a value obtained by multiplying the RGB value of each pixel of the first image by the number of the first images included in the consecutive frames.

[0129] (8) An information processing system as described in (1) above, wherein the acquisition unit acquires the consecutive frames generated based on image information of a designated area specified in the target image, the output control unit outputs the consecutive frames superimposed on the position of the designated area of ​​the target image at a frame rate equal to or higher than a predetermined value, the consecutive frames include a plurality of mosaic images as frames, each of which is composed of rectangular elements of a predetermined number of colors arranged periodically, and the phases of the rectangular elements in each of the consecutive frames are different from each other.

[0130] (9) In the information processing system described above in (8), the designated area is a part of the target image.

[0131] (10) In the information processing system described above in (8), the specified area is the entire target image.

[0132] (11) The information processing system according to (8) above, further comprising a reception unit that receives a selection of the designated area based on a user operation via a screen.

[0133] (12) In the information processing system described above in (11), the reception unit receives a selection of the designated area based on the target image.

[0134] (13) In the information processing system described above in (8), the number of rectangular features in the mosaic image is four.

[0135] (14) In the information processing system described above in (8), the rectangular elements are square elements.

[0136] (15) The information processing system according to (8) above, further comprising a generation unit that generates the successive frames, wherein the generation unit determines an area of ​​the rectangular element according to an area of ​​the designated region.

[0137] (16) A method for projecting an image, comprising the steps of: acquiring a target image; selecting an area of ​​the target image; creating successive frames based on image information of a specified area specified in the target image; and outputting the successive frames at a frame rate equal to or higher than a predetermined value and superimposed on the position of the area of ​​the target image, wherein the successive frames include a plurality of mosaic images as frames, each of which is composed of rectangular elements of a predetermined number of colors arranged periodically, and the phases of the rectangular elements in each of the successive frames are different from each other.

[0138] (17) An information processing method comprising the step of executing processing of each part of the information processing system described in any one of (1) to (6) and (8) to (15) above.

[0139] (18) A program for causing a computer to execute processing of each part of the information processing system described in any one of (1) to (6) and (8) to (15) above. Of course, this is not the case.

[0140] Finally, although various embodiments of the present invention have been described, these are presented as examples and are not intended to limit the scope of the invention. The new embodiments can be implemented in various other forms, and various omissions, substitutions, and modifications can be made without departing from the spirit of the invention. The embodiments and their modifications are within the scope and spirit of the invention, and are included in the scope of the invention and its equivalents described in the claims. [Explanation of symbols]

[0141] 1: Information processing system 10: Information processing device 11: Control section 12: Storage section 13: Communications Department 14: Communication bus 20: User terminal 21: Control section 22: Storage section 23: Communications Department 24: Input section 25: Output section 26: Communication bus 110: Projector 120: Projector screen 130: Object 211: Reception 212 :Generation part 213: Acquisition Department 214: Output control section OP1: First target image OP2: Second target image P1: First image P2: Second image

Claims

1. An information processing system, an acquisition unit that acquires consecutive frames including at least a first image generated based on a target image and a second image different from the first image as frames; an output control unit that repeatedly and continuously outputs the successive frames at a frame rate equal to or greater than a predetermined value so that a moving observer and a stationary observer can view different images; An information processing system comprising:

2. 2. The information processing system according to claim 1, Each pixel of the first image has an RGB value obtained by dividing the RGB value of each pixel of the first destination image by the number of the first images included in the consecutive frames; An information processing system, wherein each pixel of the second image has an RGB value obtained by subtracting the RGB value of each pixel of the first image multiplied by the number of the first images included in the consecutive frames from the RGB value of each pixel of the second target image.

3. 3. The information processing system according to claim 2, the first destination image is an image that is perceived when the successive frames are projected onto a moving object; An information processing system, wherein the second destination image is an image that is perceived when the successive frames are projected onto a stationary object.

4. 3. The information processing system according to claim 2, An information processing system, wherein the number of the second images included in the consecutive frames is smaller than the number of the first images included in the consecutive frames.

5. 5. The information processing system according to claim 4, An information processing system, wherein the number of the second images included in the consecutive frames is 1, and the number of the first images included in the consecutive frames is 10 or more and 20 or less.

6. 3. The information processing system according to claim 2, The output control unit projects the successive frames onto a stationary object.

7. A method for projecting an image, comprising the steps of: creating a sequence of frames including at least a first image and a second image, the second image being different from the first image; projecting the successive frames at a frame rate equal to or greater than a predetermined value; Equipped with Each pixel of the first image has an RGB value obtained by dividing the RGB value of each pixel of the first destination image by the number of the first images included in the consecutive frames; A method for projecting an image, wherein each pixel of the second image has an RGB value obtained by subtracting the RGB value of each pixel of the first image multiplied by the number of the first images included in the consecutive frames from the RGB value of each pixel of the second target image.

8. 2. The information processing system according to claim 1, The acquisition unit acquires the consecutive frames generated based on image information of a designated area designated in the target image, the output control unit causes the continuous frames to be output at a frame rate equal to or higher than a predetermined value and superimposed on a position of the designated area of ​​the target image; The continuous frames include a plurality of mosaic images as frames, each of which is composed of rectangular elements of a predetermined number of colors arranged periodically; An information processing system, wherein the phases of the rectangular elements are different from each other in each of the successive frames.

9. 9. The information processing system according to claim 8, An information processing system, wherein the designated area is a portion of the target image.

10. 9. The information processing system according to claim 8, An information processing system, wherein the specified area is the entire target image.

11. 9. The information processing system according to claim 8, The information processing system further includes a reception unit that receives a selection of the designated area based on a user operation via a screen.

12. 12. The information processing system according to claim 11, The reception unit receives a selection of the designated area based on the target image.

13. 9. The information processing system according to claim 8, The number of rectangular features in the mosaic image is four.

14. 9. The information processing system according to claim 8, An information processing system, wherein the rectangular elements are square elements.

15. 9. The information processing system according to claim 8, A generating unit for generating the consecutive frames is further provided, The generation unit determines an area of ​​the rectangular element according to an area of ​​the designated region.

16. A method for projecting an image, comprising the steps of: acquiring a target image; selecting a region of the target image; creating successive frames based on image information of a designated area designated in the target image; outputting the successive frames at a frame rate equal to or greater than a predetermined value and superimposing the successive frames on the position of the region of the target image; Equipped with The continuous frames include a plurality of mosaic images as frames, each of which is composed of rectangular elements of a predetermined number of colors arranged periodically; A method for projecting an image, wherein the phase of the rectangular elements is different from each other in each of the successive frames.

17. 1. An information processing method, comprising:

16. An information processing method comprising the step of executing processing of each unit of the information processing system according to claim 1.

18. A program, A program for causing a computer to execute processing of each unit of the information processing system according to any one of claims 1 to 6 and claims 8 to 15.

Images