Multi-image adjustment program and multi-image adjustment device

Abstract

To enable an image to be projected in a suitable manner on a ceiling surface or a wall surface.SOLUTION: A multiple face image adjustment device 1 comprises: a multiple face image acquisition part 10 that acquires multiple face images G; a wall surface size reception part 11 that receives an input of a wall surface size including a height and a width of a wall surface W; a wall surface image trim part 12 capable of carrying out trimming that deletes a trim area T from a wall surface image GW; a trim candidate area reception part 13 that receives the input of a specification of a trim candidate area; a ceiling surface image parameter setting part 17 that sets a ceiling surface image parameter including a first magnification of a ceiling surface image GC, based on the specification of the trim candidate area; and a wall surface image parameter setting part 18 that sets a wall surface image parameter including the specification of the trim area T to which trimming is carried out by the wall face image trim part 12, based on a relationship between the height and the width of the wall surface W in a wall surface size, and the specification of the trim candidate area.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present disclosure relates to a multi-surface image adjustment program and a multi-surface image adjustment device. [Background technology]

[0002] There is known a technique for projecting an image in a suitable manner onto each of a plurality of surfaces, such as walls. For example, Patent Document 1 discloses a technique for appropriately enlarging or reducing the size of an image displayed on each wall in a multi-screen theater having a plurality of walls arranged side by side. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Special Publication No. 2017-504990 Summary of the Invention [Problem to be solved by the invention]

[0004] The above-described technology assumes that the multiple surfaces onto which an image is projected are multiple wall surfaces arranged side by side. However, it is also possible to project an image not only onto the wall surfaces but also onto the ceiling surface. In particular, when projecting an image onto the ceiling surface, the sense of realism and immersion imparted to users can be further enhanced by making the ceiling surface image projected onto the ceiling surface and the wall surface image projected onto the wall surfaces into a continuous image. Here, since the visual impression of the same part of an image differs when projected onto the ceiling surface and when projected onto the wall surface, it is desirable to appropriately set the parts of the entire image to be displayed on the ceiling surface and the wall surface, respectively.

[0005] Therefore, an object of the multi-surface image adjustment program and multi-surface image adjustment device according to the present disclosure is to make it possible to project images onto ceiling surfaces and wall surfaces in a suitable manner. [Means for solving the problem]

[0006] A multi-screen image adjustment program (P) according to one embodiment of the present disclosure is a multi-screen image adjustment program (P) that causes a computer (E) to function as a multi-screen image adjustment device (1) that sets ceiling image parameters relating to the manner in which the ceiling image (GC) is projected onto the ceiling surface (C, CA, CB, CC) and wall image parameters relating to the manner in which the wall image (GW) is projected onto the wall surface (W, WA, WB, WC) for a multi-screen image (G) including a substantially square ceiling image (GC) projected onto the ceiling surface (C, CA, CB, CC) and a substantially square wall image (GW) projected onto the wall surface (W, WA, WB, WC) adjacent to the ceiling surface (C, CA, CB, CC), and the computer (E) includes a multi-screen image acquisition unit (10) that acquires the multi-screen image (G), a wall size reception unit (11) that receives input of wall sizes including the height and width of the wall surface (W, WA, WB, WC), and a trim area that is part of the wall surface image (GW). a trim candidate area receiving unit (13) that receives an input of designation of a trim candidate area which is a candidate for an area to be set as a trim area (T) in the wall image (GW); a ceiling image parameter setting unit (17) that sets ceiling image parameters including a first magnification ratio of the ceiling image (GC) based on the designation of the trim candidate area received as an input by the trim candidate area receiving unit (13); and a wall image parameter setting unit (18) that sets wall image parameters including the designation of the trim area (T) for which the trim process is executed by the wall image trimming unit (12) based on the relationship between the height and width of the wall surfaces (W, WA, WB, WC) in the wall size received as an input by the wall size receiving unit (11) and the designation of the trim candidate area received as an input by the trim candidate area receiving unit (13).

[0007] A multi-screen image adjustment device (1) according to one aspect of the present disclosure is a multi-screen image adjustment device (1) that sets ceiling surface image parameters relating to the manner in which the ceiling surface image (GC) is projected onto the ceiling surface (C, CA, CB, CC) and wall surface image parameters relating to the manner in which the wall surface image (GW) is projected onto the wall surfaces (W, WA, WB, WC) for a multi-screen image (G) including a substantially square ceiling surface image (GC) projected onto a ceiling surface (C, CA, CB, CC) and a substantially square wall surface image (GW) projected onto a wall surface (W, WA, WB, WC) adjacent to the ceiling surface (C, CA, CB, CC), and includes a multi-screen image acquisition unit (10) that acquires the multi-screen image (G), a wall surface size reception unit (11) that receives input of wall surface sizes including heights and widths of the wall surfaces (W, WA, WB, WC), and a trimming unit (12) that removes a trimming area (T) that is a part of the wall surface image (GW) from the wall surface image (GW). The image processing system includes a wall surface image trimming unit (12) capable of executing processing, a trim candidate area receiving unit (13) receiving input of designation of a trim candidate area which is a candidate for an area in the wall surface image (GW) to be set as a trim area (T), a ceiling surface image parameter setting unit (17) setting ceiling surface image parameters including a first magnification ratio of the ceiling surface image (GC) based on the designation of the trim candidate area received as input by the trim candidate area receiving unit (13), and a wall surface image parameter setting unit (18) setting wall surface image parameters including designation of the trim area (T) for which trim processing is executed by the wall surface image trimming unit (12) based on the relationship between the height and width of the wall surfaces (W, WA, WB, WC) in the wall surface size received as input by the wall surface size receiving unit (11) and the designation of the trim candidate area received as input by the trim candidate area receiving unit (13).

[0008] According to at least one of the multi-surface image adjustment program (P) and the multi-surface image adjustment device (1), a trimming process is performed on a multi-surface image (G) including a ceiling surface image (GC) and a wall surface image (GW), thereby removing a trimming area (T), which is a part of the wall surface image (GW), from the wall surface image (GW). At this time, a first magnification ratio of the ceiling surface image (GC) is set based on the designation of the trimming candidate area, so that the ceiling surface image (GC) can be projected in a suitable manner onto the ceiling surface (C). In addition, the trimming area (T) is designated based on the input designation of the trimming candidate area and the wall surface size of the wall surface (W) onto which the wall surface image (GW) is projected. Therefore, the wall surface image (GW) can be projected in a suitable manner onto the wall surface (W). Moreover, the manner in which the ceiling surface image (GC) is projected and the manner in which the wall surface image (GW) is projected can be linked to each other. For example, even if the multi-surface image (G) is a continuous image of the ceiling surface image (GC) and the wall surface image (GW), the trimming process can be performed while maintaining the continuity. As a result, it is possible to project images onto the ceiling surface (C) and the wall surface (W) in a suitable manner.

[0009] In the multi-surface image adjustment program (P) according to one aspect of the present disclosure, the multi-surface image (G) may be an image based on a cubic image, which facilitates setting of ceiling surface image parameters and wall surface image parameters for projecting the multi-surface image (G) onto the ceiling surface (C) and wall surface (W).

[0010] In the multi-plane image adjustment program (P) according to an embodiment of the present disclosure, the cubic image may be an image generated based on a 360-degree image. This makes it possible to acquire and project an image in all directions centered on the viewpoint position, allowing the user to have an experience closer to the real space.

[0011] A multi-screen image adjustment program (P) according to one embodiment of the present disclosure causes a computer (E) to function as: a ceiling image size setting unit (15) that sets a ceiling image size, which is the size of a ceiling image (GC), based on the relationship between the heights and widths of the wall surfaces (W, WA, WB, WC) in the wall surface size input received by the wall surface size receiving unit (11); and a wall image size setting unit (16) that sets a wall image size, which is the size of a wall image (GW), based on the relationship between the heights and widths of the wall surfaces (W, WA, WB, WC) in the wall surface size input received by the wall surface size receiving unit (11). A ceiling image parameter setting unit (17) may set ceiling image parameters including the ceiling image size set by the ceiling image size setting unit (15), and a wall image parameter setting unit (18) may set wall image parameters including the wall image size set by the wall image size setting unit (16). This enables images to be projected at suitable sizes onto the ceiling surface (C) and the wall surface (W).

[0012] In a multi-surface image adjustment program (P) according to one aspect of the present disclosure, a multi-surface image acquisition unit (10) acquires a plurality of multi-surface images (G), a ceiling image parameter setting unit (17) sets, for each of the plurality of multi-surface images (G), ceiling image parameters including a first magnification ratio of the ceiling image (GC), and a wall image parameter setting unit (18) sets, for each of the plurality of multi-surface images (G), wall image parameters including designation of a trim region (T) in which trimming processing is performed by a wall image trimming unit (12). This makes it possible to project, for example, a plurality of multi-surface images (G) of different scenes onto a ceiling surface (C) and a wall surface (W), and to project an image in a preferred manner for each of the multi-surface images (G).

[0013] A multiple surface image adjustment program (P) according to one embodiment of the present disclosure causes a computer (E) to function as a trim correction area acquisition unit (14) that acquires a designation of a trim correction area obtained by correcting a trim candidate area based on the relationship between the height and width of the wall surfaces (W, WA, WB, WC) in the wall surface size input received by the wall surface size receiving unit (11) and the designation of the trim candidate area input received by the trim candidate area receiving unit (13). A ceiling surface image parameter setting unit (17) sets ceiling surface image parameters including a first magnification ratio of the ceiling surface image (GC) based on the designation of the trim correction area acquired by the trim correction area acquisition unit (14). A wall surface image parameter setting unit (18) may set wall surface image parameters including a designation of the trim area (T) in which trimming processing is performed by the wall surface image trimming unit (12), using the designation of the trim correction area acquired by the trim correction area acquisition unit (14) as the designation of the trim area (T). This makes it possible to project an image in a more suitable manner even if the trimming candidate area specified by the user is inappropriate, thereby improving convenience for the user.

[0014] A multi-surface image adjustment program (P) according to one embodiment of the present disclosure may cause a computer (E) to function as a floor image parameter setting unit (19) that sets floor image parameters including a second magnification ratio of the floor image (GF) based on the designation of a trim candidate area input received by a trim candidate area receiving unit (13) or the first magnification ratio of the ceiling image (GC) set by a ceiling image parameter setting unit (17). This makes it possible to project an image onto the floor (F) in a suitable manner.

[0015] Note that the reference numerals in the parentheses above indicate the reference numerals of components in the embodiments described below as an example of the present disclosure, and do not limit the present disclosure to the aspects of the embodiments. [Effects of the Invention]

[0016] In this way, the multi-surface image adjustment program and the multi-surface image adjustment device according to the present disclosure make it possible to project images onto ceiling surfaces and wall surfaces in a suitable manner. [Brief explanation of the drawings]

[0017] [Figure 1] FIG. 1 is a block diagram showing a multi-plane image adjustment device according to this embodiment. [Figure 2] FIG. 2 is a diagram showing an example of a projection room. [Figure 3] FIG. 3 is a diagram showing an example of a multi-plane image. [Figure 4] FIG. 4 shows a multi-plane image from which redundant areas have been removed. [Figure 5] FIG. 5 is a diagram showing ceiling surface images and wall surface images according to the size of the trim area. [Figure 6] FIG. 6 is a flowchart showing the multi-plane image adjustment process. [Figure 7] FIG. 7 is a block diagram showing the module configuration of the multi-plane image adjustment program. [Figure 8] FIG. 8 is a diagram showing another example of a projection room. [Figure 9] FIG. 9 is a diagram showing another example of a projection room. [Figure 10] FIG. 10 is a diagram showing another example of a projection room. [Figure 11] FIG. 11 is a diagram for explaining the display modes of the ceiling surface image, wall surface image, and floor surface image. DETAILED DESCRIPTION OF THE INVENTION

[0018] Hereinafter, exemplary embodiments will be described with reference to the drawings. Note that the same or corresponding parts in each drawing are designated by the same reference numerals, and redundant explanations will be omitted.

[0019] [Overall configuration] FIG. 1 is a block diagram showing a multi-screen image adjustment device 1 according to this embodiment. FIG. 2 is a diagram showing an example of a projection room R. FIG. 3 is a diagram showing an example of a multi-screen image G. The multi-screen image adjustment device 1 shown in FIGS. 1 to 3 is a device that enables an image included in a multi-screen image G to be projected in a suitable manner onto each projection surface in a projection room R equipped with a plurality of projection surfaces (surfaces onto which images are projected). The multi-screen image adjustment device 1 transmits, for example, information to an image projection device 4 for projecting an image in a suitable manner onto each projection surface. The multi-screen image adjustment device 1 is realized when a multi-screen image adjustment program P is executed by a computer E to perform a multi-screen image adjustment process.

[0020] A "projection room" is a space having a ceiling C and at least one wall W, and may be, for example, a typical box-shaped room. Here, the projection room R is assumed to be a room having a floor F, a ceiling C, and four walls W. In FIG. 2, a portion of the ceiling C of the projection room R is shown as being virtually cut away. More specifically, the projection room R has a flat rectangular parallelepiped shape, including a rectangular floor F, a ceiling C that is the same shape as the floor F and parallel to the floor F, and four rectangular walls W connected to corresponding sides of the floor F and the ceiling C. In other words, each wall W is adjacent to the floor F and the ceiling C, respectively (in other words, they share one side). Furthermore, the opposing walls W are the same shape and parallel to each other. In the following description, the longitudinal direction of the floor F and the ceiling C will be referred to as the vertical direction of the projection room R, the lateral direction of the floor F and the ceiling C will be referred to as the horizontal direction of the projection room R, and the vertical direction of the walls W will be referred to as the height direction of the projection room R.

[0021] Of the four wall surfaces W of the projection room R, two are a first wall surface W1 and a fourth wall surface W4 which constitute both vertical end surfaces of the projection room R. In FIG. 3, the first wall surface W1 is the wall surface W on the front side in the vertical direction of the projection room R, and the fourth wall surface W4 is the wall surface W on the back side in the vertical direction of the projection room R. The remaining two of the four wall surfaces W of the projection room R are a second wall surface W2 and a third wall surface W3 which constitute both horizontal end surfaces of the projection room R. In FIG. 2, the second wall surface W2 is the wall surface W on the right side in the horizontal direction of the projection room R, and the third wall surface W3 is the wall surface W on the left side in the horizontal direction of the projection room R.

[0022] The multiple projection surfaces onto which images are projected by the multi-screen image adjustment device 1 include the floor F, ceiling C, and each wall W, and at least the ceiling C and one wall W. Here, the projection surfaces are the floor F, the first wall W1, the second wall W2, and the third wall W3. Because the floor F and the ceiling C of the projection room R are rectangular parallelepipeds, the fourth wall W4 is not used as a projection surface, as will be described later. Furthermore, the wall size (height and width of wall W) of wall W, which serves as the basis for each process by the multi-screen image adjustment device 1, is calculated based on the wall size (height and width of first wall W1) of the first wall W1.

[0023] A "multiple-surface image" is an image projected onto a projection surface. A multi-surface image G is a set of images obtained by extracting at least a ceiling image GC and one wall image GW from a cube image. A "cube image" is a collective term for six images that represent the field of view included in each face of a cube when the viewpoint is placed inside the cube (for example, at the center). In other words, a cube image includes one floor image GF that represents the field of view included in the face corresponding to the floor, one ceiling image GC that represents the field of view included in the face corresponding to the ceiling, and four wall images GW (a first wall image GW1, a second wall image GW2, a third wall image GW3, and a fourth wall image GW4) that represent the field of view included in the face corresponding to the wall.

[0024] Each image included in the cubic image corresponds to a projection surface of the projection room R, with the floor image GF corresponding to the floor F, the ceiling image GC corresponding to the ceiling C, the first wall image GW1 corresponding to the first wall W1, the second wall image GW2 corresponding to the second wall W2, the third wall image GW3 corresponding to the third wall W3, and the fourth wall image GW4 corresponding to the fourth wall W4. In other words, the floor image GF is projected onto the floor F, the ceiling image GC is projected onto the ceiling C, the first wall image GW1 is projected onto the first wall W1, the second wall image GW2 is projected onto the second wall W2, the third wall image GW3 is projected onto the third wall W3, and the fourth wall image GW4 is projected onto the fourth wall W4 (although in practice, not all of these images are necessarily projected).

[0025] The multi-surface image G is obtained by selecting and extracting predetermined images from these images that make up the cubic image. In other words, the multi-surface image G is an image based on the cubic image. Here, the multi-surface image G includes a ceiling surface image GC, a first wall surface image GW1, a second wall surface image GW2, and a third wall surface image GW3.

[0026] Each image included in the multi-plane image G is configured in an approximately square shape. Note that "approximately square" is not limited to a strict square, but also includes a quadrangle that is close to a strict square (for example, a rectangle in which the difference in the lengths of the long and short sides is within 5%). Furthermore, while the term "approximately" clearly indicates that it is not limited to a strict square, even when simply referred to as "square," the "square" is not limited to a strict square, but also includes a quadrangle that is close to a strict square (for example, a rectangle in which the difference in the lengths of the long and short sides is within 5%). In other words, in the present disclosure, "approximately square" and "square" are synonymous, and neither is limited to a strict square.

[0027] The cubic image may be an image generated based on a 360-degree image. A "360-degree image" is an image in all directions centered on the viewpoint position. A 360-degree image may have a range of directions that is not included in the 360-degree image within the scope of common technical knowledge. There are no particular limitations on the method for converting a 360-degree image into a cubic image, and general software may be used. The cubic image does not have to be generated based on a 360-degree image, and may be generated, for example, by combining rectangular (specifically, square) images into a cube.

[0028] The multi-screen image adjustment device 1 sets each parameter. Here, the multi-screen image G is adjusted by each parameter regarding the manner in which it is projected onto the projection surface. Specifically, for the multi-screen image G, the ceiling surface image parameters specify the manner in which the ceiling surface image GC is projected onto the ceiling surface C, and the wall surface image parameters specify the manner in which the wall surface image GW is projected onto the wall surface W. Furthermore, although not used here, if the multi-screen image G includes a floor surface image GF, the floor surface image parameters specify the manner in which the floor surface image GF is projected onto the floor surface F.

[0029] The physical configuration of the multi-image image adjustment device 1 will be described. The multi-image image adjustment device 1 is physically configured as a computer E (server) equipped with a control and arithmetic device, a storage device, and an input / output device. The multi-image image adjustment device 1 can communicate with each of the administrator terminal 2, the user terminal 3, and the image projection device 4 via wired or wireless communication. The control and arithmetic device is configured as, for example, a CPU (Central Processing Unit) or the like, and executes arithmetic processing and controls the storage device and the input / output device. The storage device includes, for example, a main storage device and an auxiliary storage device. The main storage device is configured, for example, by RAM (Random Access Memory). The auxiliary storage device is configured, for example, by ROM (Read Only Memory). The input / output device includes, for example, an input device that receives data from the outside and transmits it to the storage device, and an output device that outputs, to the outside, the results of calculations performed by the control and arithmetic device and stored in the storage device.

[0030] The multi-surface image adjustment device 1 performs predetermined processing by, for example, loading a program stored in ROM into RAM and executing the program loaded into RAM with a CPU. Here, the multi-surface image adjustment device 1 loads a multi-surface image adjustment program P stored in ROM into RAM and executes the multi-surface image adjustment program P loaded into RAM with a CPU, thereby performing the multi-surface image adjustment processing described below. Note that the multi-surface image adjustment device 1 may have a physical configuration different from the configuration described above.

[0031] The administrator terminal 2 is a terminal used by the administrator of the multi-surface image adjustment device 1. The administrator terminal 2 is configured to be able to communicate with at least the multi-surface image adjustment device 1. For example, the administrator terminal 2 transmits information required for the multi-surface image adjustment process to the multi-surface image adjustment device 1, and receives information generated by the multi-surface image adjustment process from the multi-surface image adjustment device 1. The administrator terminal 2 may be a smartphone, tablet, laptop, desktop computer, etc., and here a laptop is used as an example of the administrator terminal 2.

[0032] The user terminal 3 is a terminal used by a user of the multi-surface image adjustment device 1. Like the administrator terminal 2, the user terminal 3 is configured to be able to communicate with at least the multi-surface image adjustment device 1. For example, the user terminal 3 transmits information required for the multi-surface image adjustment process to the multi-surface image adjustment device 1, and receives information generated by the multi-surface image adjustment process from the multi-surface image adjustment device 1. The user terminal 3 may be a smartphone, tablet, laptop, desktop computer, etc., and a smartphone is exemplified as the user terminal 3 here.

[0033] The image projection device 4 is placed in the projection room R and projects a multi-screen image G onto each projection surface in the projection room R. The image projection device 4 is configured to be able to communicate with at least the multi-screen image adjustment device 1, and projects the multi-screen image G onto each projection surface based on information received from the multi-screen image adjustment device 1 (for example, information relating to the multi-screen image G and each parameter). The image projection device 4 may be, for example, a projector, and more specifically, may be a projector group consisting of projectors in a number corresponding to the number of projection surfaces.

[0034] Next, we will explain the functional configuration of the multi-screen image adjustment device 1. Functionally, the multi-screen image adjustment device 1 includes a multi-screen image acquisition unit 10, a wall surface size acceptance unit 11, a wall surface image trimming unit 12, a trim candidate area acceptance unit 13, a trim correction area acquisition unit 14, a ceiling surface image size setting unit 15, a wall surface image size setting unit 16, a ceiling surface image parameter setting unit 17, and a wall surface image parameter setting unit 18.

[0035] The multi-plane image acquisition unit 10 acquires a multi-plane image G. The multi-plane image acquisition unit 10 may acquire multiple multi-plane images G, and in this case, each multi-plane image G may be an image of a different scene. Here, since the ceiling surface image GC of the multi-plane image G is approximately square, even if the ceiling surface C is rectangular, the ceiling surface image GC projected onto the ceiling surface C will be approximately square. In other words, the approximately square ceiling surface image GC is projected onto a portion of the rectangular ceiling surface C (here, the front side in the longitudinal direction), and the ceiling surface image GC is not projected onto the remaining portion of the rectangular ceiling surface C (here, the back side in the longitudinal direction). Then, the wall surface image GW is projected onto the wall surfaces W (here, the first wall surface W1, the second wall surface W2, and the third wall surface W3) adjacent to the portion of the ceiling surface C onto which the ceiling surface image GC is projected. In this way, by not projecting the wall surface image GW (fourth wall surface image GW4) onto the fourth wall surface W4, it is possible to prevent a portion of the multi-plane image G from being separated. The multi-plane image acquisition unit 10 may acquire the multi-plane image G by receiving the multi-plane image G from the administrator terminal 2 or the user terminal 3, for example.

[0036] The wall size receiving unit 11 receives an input of the wall size of the wall W. The wall size receiving unit 11 may receive an input of the wall size of the wall W from, for example, the administrator terminal 2 or the user terminal 3. The wall size of the wall W includes the height and width of the wall W. The wall size receiving unit 11 may receive an input of the wall size of any one of the multiple wall surfaces W, or may receive an input of the wall sizes of multiple wall surfaces W. The wall size of the wall W received as an input by the wall size receiving unit 11 may be a numerical value determined in any way, for example, a known numerical value, or a numerical value measured by a general method (for example, a method using a measuring instrument such as a tape measure).

[0037] The wall surface image trimming unit 12 processes the multi-screen image G. FIG. 4 is a diagram showing the multi-screen image G from which the excess area N has been removed. As shown in FIG. 4, the wall surface image trimming unit 12 processes the multi-screen image G by removing the excess area N from the multi-screen image G. The "excess area" is a lower area of ​​the wall surface image GW that is located below a lower limit line of projection of the wall surface W when the wall surface image GW is projected onto the wall surface W. The "lower limit line of projection" is a virtual line corresponding to the lowermost part of the area on the wall surface W where the wall surface image GW should be projected, and may be a line extending horizontally. Here, the lower limit line of projection is the boundary between the wall surface W and the floor surface F. In other words, the wall surface image trimming unit 12 removes, as the excess area N, an area of ​​the multi-screen image G that extends below the wall surface W (toward the floor surface F) when projected onto the wall surface W.

[0038] FIG. 5 is a diagram showing the ceiling surface image GC and the wall surface image GW according to the width of the trim area T. In FIG. 5, only the first wall surface image GW1 is shown as the wall surface image GW, but the same applies to the second wall surface image GW2 and the third wall surface image GW3. As shown in FIG. 5, the wall surface image trimming unit 12 can perform trimming processing on the multi-surface image G as processing of the multi-surface image G. The "trim processing" is a process of removing the trim area T, which is part of the wall surface image GW, from the wall surface image GW. The ceiling surface image GC is then reduced in accordance with the removed portion (so that a wider image is included in the ceiling surface image GC). The "trim area" is the upper region of the multi-surface image G that is included in the wall surface image GW and projected onto the wall surface W before the trim processing is performed, and that is included in the ceiling surface image GC and projected onto the ceiling surface C after the trim processing is performed.

[0039] The trim area T is located around the boundary between the wall surface image GW and the ceiling surface image GC. In other words, when the trimming process is performed, the trim area T, which is the upper area of ​​the wall surface image GW, moves across the boundary line H between the wall surface W and the ceiling surface C and onto the ceiling surface image GC (integrated into the ceiling surface image GC), and the wall surface image GW rises as a whole to fill the blank space above the wall surface W from which the trim area T was removed. At this time, as will be described later, a first magnification ratio, which is the magnification ratio of the ceiling surface image GC, decreases (i.e., is reduced), and an image including the trim area T in addition to the ceiling surface image GC before the trimming process is performed becomes a new ceiling surface image GC. Here, the trim area T (designation of the trim area T) and the first magnification ratio of the ceiling surface image GC may be set in advance in a manner that corresponds to each other. The "designation of the trim area" is information that designates the area of ​​the wall surface image GW that will become the trim area T, and may be information that includes, for example, a numerical value indicating what percentage of the upper part of the wall surface image GW will become the trim area T. The designation of the trim area T may be the designation of a trim candidate area or the designation of a trim correction area, which will be described later, depending on the situation. Specifically, when the designation of the trim area T is "0 (i.e., 0%)," the first magnification ratio of the ceiling surface image GC may be set to 200%, and when the designation of the trim area T is "30 (i.e., 30%)," the first magnification ratio of the ceiling surface image GC may be set to 100%. Note that, when a plurality of multi-plane images G are acquired by the multi-plane image acquisition unit 10, the wall surface image trimming unit 12 may perform trimming processing on the trim area T set for each of the plurality of multi-plane images G.

[0040] The trim candidate area receiving unit 13 receives input of designation of a trim candidate area, which is a candidate for an area in the wall image GW that should be set as the trim area T. The trim candidate area receiving unit 13 may receive input of designation of a trim candidate area from, for example, the administrator terminal 2 or the user terminal 3. A "trim candidate area" is, for example, an area that an administrator or a user desires to set as the trim area T. "Designation of a trim candidate area" is information that designates an area in the wall image GW that should be set as the trim area T, and may include, for example, information that includes a numerical value indicating what percentage of the top of the wall image GW should be set as the trim area T. In this case, if the designation of the trim candidate area is "10", it means that it is desired that the top 10% of the wall image GW be set as the trim area T.

[0041] The trim correction area acquisition unit 14 acquires a designation of a trim correction area obtained by correcting a trim candidate area based on the relationship between the height and width of the wall surface W in the wall surface size of the wall surface W input by the wall surface size receiving unit 11 and the designation of a trim candidate area input by the trim candidate area receiving unit 13. The "trim correction area" is an area that is desired by an administrator or user to be the trim area T. However, since the trim candidate area is not necessarily a suitable area in reality, the trim correction area is an area that has been corrected to bring the trim candidate area closer to the recommended area. The "designation of the trim correction area" is information that designates an area of ​​the wall surface image GW that should be the trim area T, similar to the designation of the trim candidate area. For example, the "designation of the trim correction area" may include a numerical value indicating what percentage of the upper part of the wall surface image GW should be the trim area T. The "relationship between the height and width of the wall surface" may be a quantitative relationship calculated by a predetermined arithmetic expression based on the height and width of the wall surface W, and specifically, may be the ratio between the height and width of the wall surface W. When the trim correction area acquisition unit 14 corrects the designation of the trim candidate area to become the trim correction area, the ceiling surface image parameters and wall surface image parameters may also be set based on the relationship between the height and width of the wall surface W.

[0042] The trim correction area acquisition unit 14 may acquire the designation of the trim correction area by correcting the designation of the trim candidate area according to the following correction logic. For example, the correction logic may calculate a trim correction coefficient by dividing the width of the wall W by the height of the wall W, and then multiplying the value of the designation of the trim candidate area by the correction coefficient. In this case, when the designation of the trim candidate area is "10," if the width of the wall W is 6 m and the height is 5 m, the correction coefficient is 0.4, and therefore the designation of the trim correction area is "4." In this way, even if the designation of the trim candidate area is too large (or too small), it is possible to designate an appropriate trim correction area. Note that in the above logic, the calculation method of the correction coefficient may be changed; for example, instead of dividing by 3, division may be performed by another value (any number). Furthermore, the correction coefficient may be set so that no correction is performed when the ratio of the height to the width of the wall W is 1:1 (i.e., the trim correction area becomes equal to the trim candidate area).

[0043] The ceiling surface image size setting unit 15 sets the ceiling surface image size. The "ceiling surface image size" is the size of the ceiling surface image GC when it is projected onto the ceiling surface C, and is the actual size of the ceiling surface image GC reflected on the ceiling surface C. The ceiling surface image size setting unit 15 sets the ceiling surface image size based on the relationship between the height and width of the wall surface W in the wall surface size input accepted by the wall surface size accepting unit 11. Note that the ceiling surface image size setting unit 15 may also set the ceiling surface image size based on the width of the wall surface W in the wall surface size input accepted by the wall surface size accepting unit 11. The setting of the ceiling surface image size by the ceiling surface image size setting unit 15 differs from the trimming process and the process of removing excess area N performed by the wall surface image trimming unit 12, and is merely an adjustment of the display size of the image.

[0044] It is preferable that the ceiling surface image size is such that the width of the ceiling surface image GC corresponds to (is the same as) the width of the wall surface W. This makes it possible to set the size of the ceiling surface image GC based on the height and width of the wall surface W. In this case, if the wall surface W is wide (width is greater than height) or if the wall surface W is approximately square, the ceiling surface image GC may be approximately square.

[0045] The wall image size setting unit 16 sets the wall image size. The "wall image size" is the size of the wall image GW when it is projected onto the wall W, and is the actual size of the wall image GW projected on the wall W. The wall image size setting unit 16 sets the wall image size based on the relationship between the height and width of the wall W in the wall size input accepted by the wall size accepting unit 11. Note that the wall image size setting unit 16 may set the wall image size based on the height and width of the wall W in the wall size input accepted by the wall size accepting unit 11. The setting of the wall image size by the wall image size setting unit 16 is different from the trimming process and the process of removing the excess area N performed by the wall image trimming unit 12, and is merely an adjustment of the display size of the image.

[0046] The ceiling surface image parameter setting unit 17 sets ceiling surface image parameters based on the designation of the trim candidate area received as input by the trim candidate area receiving unit 13. As described above, the "ceiling surface image parameters" are parameters that designate the manner in which the ceiling surface image GC is projected onto the ceiling surface C. The ceiling surface image parameters include at least a first magnification ratio of the ceiling surface image GC. The ceiling surface image parameters may also include the field of view (FOV), image size (vertical and horizontal lengths), area, and trim area T (position, ratio, area, etc.) of the ceiling surface image GC. Furthermore, the ceiling surface image parameters may also include the ceiling surface image size set by the ceiling surface image size setting unit 15.

[0047] The ceiling surface image parameter setting unit 17 may set the ceiling surface image parameters based on the designation of the trim correction area acquired by the trim correction area acquisition unit 14. When a plurality of multi-plane images G are acquired by the multi-plane image acquisition unit 10, the ceiling surface image parameter setting unit 17 may set the ceiling surface image parameters for each of the plurality of multi-plane images G, or may set common ceiling surface image parameters for the plurality of multi-plane images G.

[0048] The wall surface image parameter setting unit 18 sets wall surface image parameters based on the relationship between the height and width of the wall surface W in the wall surface size input received by the wall surface size receiving unit 11 and the designation of the trim candidate area input received by the trim candidate area receiving unit 13. As described above, the "wall surface image parameters" are parameters that designate the manner in which the wall surface image GW is projected onto the wall surface W. The wall surface image parameters include at least the designation of the trim area T in which the trimming process is executed by the wall surface image trimming unit 12. The wall surface image GW parameters may also include the field of view (FOV), image size (length and width), area, and trim area T (position, ratio, area, etc.) of the wall surface image GW. Furthermore, the wall surface image parameters may also include the wall surface image size set by the wall surface image size setting unit 16.

[0049] The wall surface image parameter setting unit 18 may set wall surface image parameters including the designation of the trim region T in which the wall surface image trimming unit 12 executes trimming processing, using the designation of the trim correction region acquired by the trim correction region acquisition unit 14 as the designation of the trim region T. In this case, the wall surface image parameter setting unit 18 may set the wall surface image parameters based on the relationship between the height and width of the wall surface W and the designation of the trim correction region. Note that, when a plurality of multi-surface images G are acquired by the multi-surface image acquisition unit 10, the wall surface image parameter setting unit 18 may set wall surface image parameters including the designation of the trim region T in which the wall surface image trimming unit 12 executes trimming processing for each of the plurality of multi-surface images G, or may set the common ceiling surface image parameters for the plurality of multi-surface images G.

[0050] Therefore, when the wall size receiving unit 11 has received input of the wall size in advance, and the trim candidate area receiving unit 13 receives input specifying the trim candidate area, the wall image parameter setting unit 18 sets the wall image parameters (i.e., the trim area T is set) and (simultaneously) the ceiling image parameter setting unit 17 sets the ceiling image parameters (i.e., the first magnification ratio of the ceiling image GC is set).

[0051] The viewing angle of the ceiling surface image GC in the ceiling surface image parameters (ceiling surface image viewing angle) and the viewing angle of the wall surface image GW in the wall surface image parameters (wall surface image viewing angle) are not limited, but may be set to the following values, for example. That is, the ceiling surface image viewing angle may have a default value of 135 degrees and may be variable within a range from 135 degrees to 90 degrees according to the first magnification ratio (135 degrees is the first magnification ratio of 1, and 90 degrees is the first magnification ratio of 2.4). When the ceiling surface image viewing angle is changed, the range of the scenery, etc. displayed in the ceiling surface image GC is enlarged or reduced. By making the ceiling surface image viewing angle variable, it is possible to prevent areas in the four corners of the ceiling surface C where the ceiling surface image GC is not projected when a trimming process is performed. The wall surface image viewing angle may also be fixed at 90 degrees, which improves the appearance of the wall surface image GW. In particular, when the wall image GW is an image based on a cubic image converted from a 360-degree image, the effect of improving the appearance is likely to be significant.

[0052] [Multi-image adjustment processing] First, an example of the outline of the multi-surface image adjustment process will be described. In the multi-surface image adjustment process, first, the height and width of the wall W and the horizon position set for each multi-surface image G (the position corresponding to the boundary line H between the ceiling surface image GC and the wall surface image GW) are input. Next, the wall surface image size, excess area N, trim area T, and the first magnification ratio of the ceiling surface image GC when the wall surface image GW is projected to match the height of the wall surface W are simultaneously determined. Next, trimming processing is performed on the upper region of the wall surface image GW to match the first magnification ratio of the ceiling surface image GC, and the final horizon position is determined. Next, if the lower region of the wall surface image GW protrudes downward from the wall surface W even after trimming processing is performed on the upper region of the wall surface W, the lower region of the wall surface image GW is removed as the final excess area N to match the height of the wall surface W.

[0053] Next, the multi-image adjustment process will be described with reference to Fig. 6. Fig. 6 is a flowchart showing the multi-image adjustment process. The multi-image adjustment process shown in Fig. 6 is realized by the computer E of the multi-image adjustment device 1 executing the multi-image adjustment program P.

[0054] In step S10, multi-plane image acquisition unit 10 of multi-plane image adjustment device 1 acquires multi-plane image G. Multi-plane image acquisition unit 10 may acquire multiple multi-plane images G. Thereafter, the multi-plane image adjustment process proceeds to step S12.

[0055] In step S12, the wall surface size receiving unit 11 of the multi-screen image adjustment device 1 receives an input of the wall surface size of the wall surface W. The wall surface size of the wall surface W includes the height and width of the wall surface W. Thereafter, the multi-screen image adjustment process proceeds to step S14.

[0056] In step S14, the trimming candidate area receiving unit 13 of the multi-screen image adjustment device 1 receives an input specifying a trimming candidate area that is a candidate for an area in the wall image GW that should be set as the trimming area T. Thereafter, the multi-screen image adjustment process proceeds to step S16.

[0057] In step S16, the trim correction area acquisition unit 14 of the multi-surface image adjustment device 1 acquires the designation of the trim correction area. Specifically, the trim correction area acquisition unit 14 acquires the designation of the trim correction area obtained by correcting the trim candidate area based on the relationship between the height and width of the wall surface W in the wall surface size of the wall surface W accepted as input by the wall surface size acceptance unit 11 and the designation of the trim candidate area accepted as input by the trim candidate area acceptance unit 13. The trim correction area acquisition unit 14 corrects the designation of the trim candidate area in accordance with predetermined correction logic and acquires the designation of the trim correction area. Thereafter, the multi-surface image adjustment process proceeds to step S18.

[0058] In step S18, the ceiling surface image size setting unit 15 of the multi-screen image adjustment device 1 sets the ceiling surface image size. Specifically, the ceiling surface image size setting unit 15 sets the ceiling surface image size based on the relationship between the height and width of the wall surface W in the wall surface size input accepted by the wall surface size accepting unit 11. Thereafter, the multi-screen image adjustment process proceeds to step S20.

[0059] In step S20, the wall image size setting unit 16 of the multi-screen image adjustment device 1 sets the wall image size. Specifically, the wall image size setting unit 16 sets the wall image size based on the relationship between the height and width of the wall W in the wall size input accepted by the wall size accepting unit 11. Note that the wall image size setting unit 16 may set the wall image size simultaneously with the ceiling image size being set by the ceiling image size setting unit 15. In other words, step S20 may be executed simultaneously with step S18. Thereafter, the multi-screen image adjustment process proceeds to step S22.

[0060] In step S22, the ceiling surface image parameter setting unit 17 of the multi-screen image adjustment device 1 sets ceiling surface image parameters. Specifically, the ceiling surface image parameter setting unit 17 sets ceiling surface image parameters including at least the first magnification ratio of the ceiling surface image GC based on the designation of the trim candidate area accepted as input by the trim candidate area accepting unit 13. Thereafter, the multi-screen image adjustment process proceeds to step S24.

[0061] In step S24, the wall surface image parameter setting unit 18 of the multi-screen image adjustment device 1 sets wall surface image parameters. Specifically, the wall surface image parameter setting unit 18 sets wall surface image parameters including at least the designation of the trim area T based on the relationship between the height and width of the wall surface W in the wall surface size input accepted by the wall surface size receiving unit 11 and the designation of the trim candidate area input accepted by the trim candidate area receiving unit 13. Note that the wall surface image parameter setting unit 18 may set the wall surface image parameters simultaneously with the setting of the ceiling surface image parameters by the ceiling surface image parameter setting unit 17. In other words, step S24 may be executed simultaneously with step S22. Thereafter, the multi-screen image adjustment process proceeds to step S26.

[0062] In step S26, the wall surface image trimming unit 12 of the multi-surface image adjustment device 1 performs trimming processing on the multi-surface image G as processing of the multi-surface image G. Specifically, the wall surface image trimming unit 12 performs trimming processing based on at least one of the ceiling surface image parameters and the wall surface image parameters. At this time, in addition to the trimming processing, the wall surface image trimming unit 12 removes excess area N from the multi-surface image G as processing of the multi-surface image G. This completes the multi-surface image adjustment processing.

[0063] The multi-plane image G that has been subjected to the trimming process in step S26 is transmitted from the multi-plane image adjustment device 1 to the image projection device 4, and is projected by the image projection device 4 onto the projection surface.

[0064] [Multi-plane image adjustment program] This section describes the multi-surface image adjustment program P that causes the computer E to function as the multi-surface image adjustment device 1. Fig. 7 is a block diagram showing the module configuration of the multi-surface image adjustment program P. The multi-surface image adjustment program P includes a main module MM, a multi-surface image acquisition module M10, a wall surface size reception module M11, a wall surface image trim module M12, a trim candidate area reception module M13, a trim correction area acquisition module M14, a ceiling surface image size setting module M15, a wall surface image size setting module M16, a ceiling surface image parameter setting module M17, and a wall surface image parameter setting module M18.

[0065] The main module MM is a part that performs overall control of the computer E. Functions realized by executing each of the multiple surface image acquisition module M10, the wall surface size reception module M11, the wall surface image trim module M12, the trim candidate area reception module M13, the trim correction area acquisition module M14, the ceiling surface image size setting module M15, the wall surface image size setting module M16, the ceiling surface image parameter setting module M17, and the wall surface image parameter setting module M18 are similar to the functions of the multiple surface image acquisition unit 10, the wall surface size reception unit 11, the wall surface image trim unit 12, the trim candidate area reception unit 13, the trim correction area acquisition unit 14, the ceiling surface image size setting unit 15, the wall surface image size setting unit 16, the ceiling surface image parameter setting unit 17, and the wall surface image parameter setting unit 18, respectively. In addition, the multi-surface image adjustment program P may not include some or all of the modules mentioned above other than the main module MM, the multi-surface image acquisition unit 10, the wall size reception unit 11, the wall image trimming unit 12, the trim candidate area reception unit 13, the ceiling surface image parameter setting unit 17, and the wall surface image parameter setting unit 18.

[0066] [Action and effect] As explained above, the multi-screen image adjustment program P is a multi-screen image adjustment device 1 that sets ceiling image parameters relating to the manner in which the ceiling image GC is projected onto the ceiling surface C and wall image parameters relating to the manner in which the wall image GW is projected onto the wall surface W, for a multi-screen image G including a substantially square ceiling image GC projected onto the ceiling surface C and a substantially square wall image GW projected onto the wall surface W adjacent to the ceiling surface C, and the computer E comprises a multi-screen image acquisition unit 10 that acquires the multi-screen image G, a wall size reception unit 11 that receives input of the wall size including the height and width of the wall surface W, and a wall size adjustment unit 12 that can execute trimming processing to remove a trim region T that is a part of the wall surface image GW from the wall surface image GW. The unit functions as an image trimming unit 12, a trim candidate area receiving unit 13 that receives input of designation of a trim candidate area which is a candidate for an area in the wall image GW to be set as a trim area T, a ceiling surface image parameter setting unit 17 that sets ceiling surface image parameters including a first magnification ratio of the ceiling surface image GC based on the designation of the trim candidate area received as input by the trim candidate area receiving unit 13, and a wall surface image parameter setting unit 18 that sets wall surface image parameters including designation of a trim area T for which trim processing is performed by the wall surface image trimming unit 12 based on the relationship between the height and width of the wall surface W in the wall surface size received as input by the wall surface size receiving unit 11 and the designation of the trim candidate area received as input by the trim candidate area receiving unit 13.

[0067] The multi-screen image adjustment device 1 is a multi-screen image adjustment device 1 that sets ceiling surface image parameters relating to the manner in which the ceiling surface image GC is projected onto the ceiling surface C and wall surface image parameters relating to the manner in which the wall surface image GW is projected onto the wall surface W, for a multi-screen image G including a substantially square ceiling surface image GC projected onto the ceiling surface C and a substantially square wall surface image GW projected onto a wall surface W adjacent to the ceiling surface C, and includes a multi-screen image acquisition unit 10 that acquires the multi-screen image G, a wall surface size reception unit 11 that receives input of the wall surface size including the height and width of the wall surface W, a wall surface image trimming unit 12 that can perform trimming processing to remove a trim area T that is part of the wall surface image GW from the wall surface image GW, and a trim area T of the wall surface image GW. The image processing apparatus includes a trim candidate area receiving unit 13 that receives input specifying a trim candidate area that is a candidate for the area to be set as T; a ceiling surface image parameter setting unit 17 that sets ceiling surface image parameters including a first magnification ratio of the ceiling surface image GC based on the specification of the trim candidate area received as input by the trim candidate area receiving unit 13; and a wall surface image parameter setting unit 18 that sets wall surface image parameters including specification of a trim area T for which trim processing is performed by the wall surface image trimming unit 12 based on the relationship between the height and width of the wall surface W in the wall surface size received as input by the wall surface size receiving unit 11 and the specification of the trim candidate area received as input by the trim candidate area receiving unit 13.

[0068] According to at least one of the multi-screen image adjustment program P and the multi-screen image adjustment device 1, a trimming process is performed on the multi-screen image G, which includes the ceiling surface image GC and the wall surface image GW. This causes a trimming region T, which is a part of the wall surface image GW, to be removed from the wall surface image GW and integrated into the ceiling surface image GC. In other words, the trimming region T, which is the region to be projected onto the wall surface W, is projected onto the ceiling surface C instead of onto the wall surface W. At this time, the first magnification ratio of the ceiling surface image GC is set based on the designation of the trimming candidate region, so that the ceiling surface image GC can be projected onto the ceiling surface C in a suitable manner. Additionally, the trimming region T is designated based on the input designation of the trimming candidate region and the wall surface size of the wall surface W onto which the wall surface image GW is projected. Therefore, the wall surface image GW can be projected onto the wall surface W in a suitable manner. Moreover, the manner in which the ceiling surface image GC is projected and the manner in which the wall surface image GW is projected can be linked to each other. For example, even in the case of a multi-surface image G in which the ceiling surface image GC and the wall surface image GW are continuous images, it is possible to perform trimming processing while maintaining the continuity. As a result, it is possible to project images onto the ceiling surface C and the wall surface W in a suitable manner.

[0069] In the multi-surface image adjustment program P, the multi-surface image G is an image based on a cubic image. This makes it easy to set ceiling surface image parameters and wall surface image parameters for projecting the multi-surface image G onto the ceiling surface C and wall surface W.

[0070] In the multi-plane image adjustment program P, the cubic image is generated based on a 360-degree image. This makes it possible to acquire and project images in all directions centered on the viewpoint position, allowing the user to have an experience closer to the real world.

[0071] The multi-surface image adjustment program P causes the computer E to function as a ceiling surface image size setting unit 15 that sets the ceiling surface image size, which is the size of the ceiling surface image GC, based on the relationship between the height and width of the wall surface W in the wall surface size input accepted by the wall surface size accepting unit 11, and a wall surface image size setting unit 16 that sets the wall surface image size, which is the size of the wall surface image GW, based on the relationship between the height and width of the wall surface W in the wall surface size input accepted by the wall surface size accepting unit 11, the ceiling surface image parameter setting unit 17 sets ceiling surface image parameters including the ceiling surface image size set by the ceiling surface image size setting unit 15, and the wall surface image parameter setting unit 18 sets wall surface image parameters including the wall surface image size set by the wall surface image size setting unit 16. This makes it possible to project images at suitable sizes onto the ceiling surface C and the wall surfaces W.

[0072] In the multi-surface image adjustment program P, the multi-surface image acquisition unit 10 acquires a plurality of multi-surface images G, the ceiling surface image parameter setting unit 17 sets, for each of the plurality of multi-surface images G, ceiling surface image parameters including a first magnification ratio of the ceiling surface image GC, and the wall surface image parameter setting unit 18 sets, for each of the plurality of multi-surface images G, wall surface image parameters including designation of a trim area T in which trimming processing is executed by the wall surface image trimming unit 12. This makes it possible to project, for example, a plurality of multi-surface images G of different scenes onto the ceiling surface C and the wall surface W, and to project an image in a suitable manner for each of the multi-surface images G.

[0073] The multi-surface image adjustment program P causes the computer E to function as a trim correction area acquisition unit 14 that acquires a designation of a trim correction area obtained by correcting a trim candidate area based on the relationship between the height and width of the wall surface W in the wall surface size input by the wall surface size receiving unit 11 and the designation of a trim candidate area input by the trim candidate area receiving unit 13. The ceiling surface image parameter setting unit 17 sets ceiling surface image parameters including a first magnification ratio of the ceiling surface image GC based on the designation of the trim correction area acquired by the trim correction area acquisition unit 14. The wall surface image parameter setting unit 18 sets wall surface image parameters including a designation of the trim area T for which trimming processing is performed by the wall surface image trimming unit 12, using the designation of the trim correction area acquired by the trim correction area acquisition unit 14 as the designation of the trim area T. This allows images to be projected in a more suitable manner even if the designation of the trim candidate area input by the user or the like is inappropriate. This improves convenience for users or the like.

[0074] [Transformation] The above-described embodiment can be implemented in various forms with modifications or improvements made based on the knowledge of those skilled in the art.

[0075] For example, the ceiling surface image GC may be a rectangle with such a large difference in length between its longer and shorter sides that it cannot be classified as a substantially square.

[0076] Furthermore, each of the floor surface F, ceiling surface C, and wall surface W does not necessarily have to be configured as a strictly flat surface. For example, each of the floor surface F, ceiling surface C, and wall surface W may have an uneven surface, may have openings or openings such as windows or doors, or may have curtains or decorations.

[0077] Furthermore, the projection surfaces onto which the multi-surface image G is projected are not limited to the four surfaces of the ceiling surface C, the first wall surface W1, the second wall surface W2, and the third wall surface W3. The projection surfaces onto which the multi-surface image G is projected need only include at least two surfaces, the ceiling surface C and one wall surface W, and may further include one or more surfaces of the floor surface F, the other walls W, and the fourth wall surface W4 in addition to these two surfaces.

[0078] Furthermore, the trimming area T does not have to be the upper area of ​​the wall surface image GW, but may be, for example, the lower area, right area, or left area of ​​the wall surface image GW, or a combination of a plurality of these areas. For example, when the wall surface image GW is wide (its width is greater than its height), and the wall surface image GW cannot fit on the wall surface W by only trimming the upper area of ​​the wall surface image GW, the trimming may also be performed on the lower area of ​​the wall surface image GW.

[0079] Furthermore, in the above embodiment, the projection room R has a flat rectangular parallelepiped shape and includes a rectangular floor F, a ceiling C that is the same shape as the floor F and parallel to the floor F, and four rectangular wall surfaces W (first wall surface W1, second wall surface W2, third wall surface W3, and fourth wall surface W4) that are connected to corresponding sides of the floor F and the ceiling surface C. However, the multi-screen image adjustment device 1 can be applied to rooms other than this projection room R.

[0080] For example, as shown in FIG. 8 , the multi-screen image adjustment device 1 may be applied to a projection room RA instead of a projection room R. The projection room RA has a flat rectangular parallelepiped shape and includes a square floor surface FA, a ceiling surface CA that is the same shape as the floor surface FA and parallel to the floor surface FA, and four rectangular walls WA (first wall surface WA1, second wall surface WA2, third wall surface WA3, and fourth wall surface WA4) connected to corresponding sides of the floor surface FA and the ceiling surface CA. In this case, the ceiling image GC of the multi-screen image G is projected onto the entire surface of the square ceiling surface CA. Then, the first wall image GW1, the second wall image GW2, the third wall image GW3, and the fourth wall image GW4 of the multi-screen image G are projected onto the first wall surface WA1, the second wall surface WA2, the third wall surface WA3, and the fourth wall surface WA4, respectively.

[0081] Alternatively, as shown in FIG. 9 , the multi-screen image adjustment device 1 may be applied to a projection room RB instead of a projection room R. The projection room RB has a cubic shape and includes a square floor surface FB, a ceiling surface CB that is the same shape as and parallel to the floor surface FB, and four square walls WB (a first wall surface WB1, a second wall surface WB2, a third wall surface WB3, and a fourth wall surface WB4) connected to corresponding sides of the floor surface FB and the ceiling surface CB. In this case, the ceiling image GC of the multi-screen image G is projected onto the entire surface of the square ceiling surface CB. Then, the first wall image GW1, the second wall image GW2, the third wall image GW3, and the fourth wall image GW4 of the multi-screen image G are projected onto the first wall surface WB1, the second wall surface WB2, the third wall surface WB3, and the fourth wall surface WB4, respectively. In this case, the multi-plane image G does not need to be substantially changed (it does not need to be processed) before and after the trimming process is performed.

[0082] Alternatively, as shown in FIG. 10, the multi-screen image adjustment device 1 may be applied to a projection room RC instead of the projection room R. The projection room RC has a narrow rectangular parallelepiped shape and includes a rectangular floor surface FC, a ceiling surface CC that is the same shape as the floor surface FC and parallel to the floor surface FC, and four rectangular walls WC (first wall surface WC1, second wall surface WC2, third wall surface WC3, and fourth wall surface WC4) connected to corresponding sides of the floor surface FC and the ceiling surface CC. Here, at least the first wall surface W1 is vertically long (its height is greater than its width). In this case, the trimming process for the wall surface image GW may be performed on a side region (at least one of the right and left regions) of the wall surface image GW rather than on an upper region. Furthermore, the trimming process for the ceiling surface image GC may be performed on a side region (at least one of the right and left regions).

[0083] The multi-plane image adjustment device 1 may also include a floor image parameter setting unit 19. The floor image parameter setting unit 19 sets floor image parameters including a second magnification ratio of the floor image GF based on the designation of a trim candidate area received as input by the trim candidate area receiving unit 13 or the first magnification ratio of the ceiling image GC set by the ceiling image parameter setting unit 17. In other words, when the multi-plane image G includes a floor image GF, the second magnification ratio, which is the magnification ratio of the floor image GF, may be set by the floor image parameter setting unit 19 based on the designation of a trim candidate area or the first magnification ratio of the ceiling image GC set by the ceiling image parameter setting unit 17. For example, the second magnification ratio of the floor image GF may be set to be opposite to the first magnification ratio of the ceiling image GC. As an example, when the designation of the trim area T is "30 (i.e., 30%)" and the first magnification ratio of the ceiling image GC is set to 100%, the second magnification ratio of the floor image GF may be set to 200%. In other words, when the ceiling surface image GC is enlarged (reduced), the floor surface image GF may be set to be reduced (enlarged). Alternatively, when the lower area of ​​the wall surface image GW is removed as the excess area N based on the designation of the trimming candidate area, the second enlargement ratio of the floor surface image GF may be set according to the proportion of the excess area N or the like.

[0084] FIG. 11 is a diagram for explaining the display modes of the ceiling surface image GC, the wall surface image GW, and the floor surface image GF. Here, the first wall surface image GW1 is exemplified as the wall surface image GW, but the same applies to the second wall surface image GW2, the third wall surface image GW3, and the fourth wall surface image GW4. As shown in FIG. 11, when the horizontal line positions (designation of the trim candidate area) are the same in multiple multi-plane images G but the heights of the wall surfaces W are different, the first and second magnification rates of the ceiling surface image GC and the floor surface image GF may be set to match the heights of the wall surfaces W. In this case, the upper and lower areas of the wall surface image GW in each multi-plane image G may be trimmed to have equal areas. Note that the second magnification rate of the floor surface image GF may be set so as not to contradict the first magnification rate of the ceiling surface image GC. For example, the second magnification rate of the floor surface image GF may be set to the same value as the first magnification rate of the ceiling surface image GC. Specifically, in the left diagram of Fig. 11, the height of the wall W is higher than usual with respect to the standard horizon position, and the viewing angle of the ceiling image GC is 90 degrees, the viewing angle of the wall image GW is 90 degrees, and the viewing angle of the floor image GF is 90 degrees. Also, in the center diagram of Fig. 11, the height of the wall W is normal with respect to the standard horizon position, and the viewing angle of the ceiling image GC is 110 degrees, the viewing angle of the wall image GW is 90 degrees, and the viewing angle of the floor image GF is 110 degrees. Also, in the right diagram of Fig. 11, the height of the wall W is lower than usual with respect to the standard horizon position, and the viewing angle of the ceiling image GC is 135 degrees, the viewing angle of the wall image GW is 90 degrees, and the viewing angle of the floor image GF is 135 degrees. 11, when the height of the wall W is changed without changing the position of the horizon, the ceiling image GC and the floor image GF are enlarged or reduced to match the height of the wall W, and more specifically, the upper and lower parts of the wall image GW are trimmed by the same area. When the position of the horizon rises, the upper part of the wall image GW may be trimmed more than the lower part, and conversely, when the position of the horizon falls, the lower part of the wall image GW may be trimmed more than the upper part.

[0085] The multi-surface image adjustment program P may cause the computer E to function as a floor image parameter setting unit 19 that sets floor image parameters including a second magnification ratio of the floor image GF based on the designation of a trim candidate area accepted as input by the trim candidate area accepting unit 13 or the first magnification ratio of the ceiling image GC set by the ceiling image parameter setting unit 17. This makes it possible to project an image onto the floor F in a suitable manner.

[0086] The multi-screen image adjustment device 1 may cooperate with the image projection device 4 to form a multi-screen image adjustment system. In other words, a multi-screen image adjustment system capable of executing multi-screen image adjustment processing includes the multi-screen image adjustment device 1 and the image projection device 4, and can achieve the same functions and effects as the multi-screen image adjustment device 1. [Explanation of symbols]

[0087] 1. Multi-plane image adjustment device 2. Administrator terminal 3. User terminal 4. Image projection device 10 Multi-plane image acquisition unit 11 Wall-sized reception area 12 Wall image trim section 13 Trim candidate area reception section 14 Trim correction area acquisition section 15 Ceiling image size setting section 16 Wall image size setting section 17 Ceiling surface image parameter setting section 18 Wall image parameter setting section 19 Floor image parameter setting section C,CA,CB,CC Ceiling surface E Computer F,FA,FB,FC Floor surface G Multi-plane image GC ceiling image GF floor image Golden Week wall image GW1 1st wall image GW2 2nd wall image GW3 3rd wall image GW4 4th wall image H border N surplus area P Multi-plane image adjustment program R,RA,RB,RC Projection room T Trim Area W,WA,WB,WC wall W1, WA1, WB1, WC1 1st wall W2, WA2, WB2, WC2 2nd wall W3, WA3, WB3, WC3 3rd wall W4, WA4, WB4, WC4 4th wall

Claims

1. A multi-screen image adjustment program that causes a computer to function as a multi-screen image adjustment device that sets ceiling surface image parameters relating to how the ceiling surface image is projected onto the ceiling surface and wall surface image parameters relating to how the wall surface image is projected onto the wall surface, for a multi-screen image including a substantially square ceiling surface image projected onto a ceiling surface and a substantially square wall surface image projected onto a wall surface adjacent to the ceiling surface, The computer a multi-plane image acquisition unit for acquiring the multi-plane images; a wall size receiving unit that receives an input of a wall size including a height and a width of the wall; a wall surface image trimming unit capable of performing a trimming process to remove a trim area that is a part of the wall surface image from the wall surface image; a trim candidate area receiving unit that receives input of designation of a trim candidate area, which is a candidate for an area to be set as the trim area in the wall surface image, by the administrator or the user via an administrator terminal used by the administrator or a user terminal used by the user; a ceiling surface image parameter setting unit that sets the ceiling surface image parameters including a first magnification ratio of the ceiling surface image based on the designation of the trim candidate area that is an upper area of ​​the wall surface image, the input of which is accepted by the trim candidate area accepting unit; a wall surface image parameter setting unit that sets wall surface image parameters including designation of the trimming area in which the trimming process is executed by the wall surface image trimming unit, based on the relationship between the height and the width of the wall surface in the wall surface size input received by the wall surface size receiving unit and the designation of the trimming candidate area input received by the trimming candidate area receiving unit; a trim candidate area which is the upper region of the wall surface image moves across the boundary line between the wall surface and the ceiling surface to the ceiling surface image, the trim candidate area which is the upper region is removed from the wall surface image, the wall surface image rises to fill the trim candidate area which is the removed upper region, and the first magnification ratio of the ceiling surface image is set based on the size of the area of ​​the trim candidate area which is the upper region of the wall surface image.

2. The multi-plane image adjusting program according to claim 1 , wherein the multi-plane image is an image based on a cubic image.

3. The multi-plane image adjustment program according to claim 2 , wherein the cubic image is an image generated based on a 360-degree image.

4. The computer a ceiling surface image size setting unit that sets a ceiling surface image size, which is the size of the ceiling surface image, based on the relationship between the height and the width of the wall surface in each of two adjacent different wall surface sizes that are input and accepted by the wall surface size accepting unit; a wall surface image size setting unit that sets a wall surface image size, which is the size of the wall surface image, based on the relationship between the height and the width of the wall surface in the wall surface size input received by the wall surface size receiving unit, the ceiling surface image parameter setting unit sets the ceiling surface image parameters including the ceiling surface image size set by the ceiling surface image size setting unit; 4. The multi-screen image adjustment program according to claim 1, wherein the wall surface image parameter setting unit sets the wall surface image parameters including the wall surface image size set by the wall surface image size setting unit.

5. the multi-plane image acquisition unit acquires a plurality of the multi-plane images; the ceiling surface image parameter setting unit sets the ceiling surface image parameters including the first magnification ratio of the ceiling surface image for each of the plurality of multi-plane images; The wall image parameter setting unit sets the wall image parameters for each of the multiple multi-surface images, including a specification of the trim area in which the trimming process is performed by the wall image trimming unit. A multi-surface image adjustment program as described in any one of claims 1 to 4.

6. The computer a trim correction area acquisition unit that acquires a designation of a trim correction area obtained by correcting the trim candidate area based on the relationship between the height and the width of the wall surface in the wall surface size input received by the wall surface size receiving unit and the designation of the trim candidate area input received by the trim candidate area receiving unit; the ceiling surface image parameter setting unit sets the ceiling surface image parameters including the first magnification ratio of the ceiling surface image based on the designation of the trim correction area acquired by the trim correction area acquisition unit; The wall surface image parameter setting unit sets the wall surface image parameters including a designation of the trim area in which the trim processing is performed by the wall surface image trimming unit, using the designation of the trim correction area acquired by the trim correction area acquisition unit as the designation of the trim area. A multi-surface image adjustment program described in any one of claims 1 to 5.

7. The multi-surface image includes a substantially square floor image projected onto a floor surface adjacent to the wall surface opposite the ceiling surface, The computer functioning as a floor image parameter setting unit that sets floor image parameters including a second magnification ratio of the floor image based on the designation of the trim candidate area that is the lower area of ​​the wall image received as input by the trim candidate area receiving unit; A multi-surface image adjustment program according to any one of claims 1 to 6, wherein a trim candidate area, which is the lower region of the wall image, crosses the boundary line between the wall and the floor and moves to the floor image, the trim candidate area, which is the lower region, is removed from the wall image, the wall image descends to fill in the trim candidate area, which is the removed lower region, and the second magnification ratio of the floor image is set based on the area size of the trim candidate area, which is the lower region of the wall image.

8. 1. A multi-screen image adjustment device that sets a ceiling surface image parameter relating to a manner in which the ceiling surface image is projected onto the ceiling surface and a wall surface image parameter relating to a manner in which the wall surface image is projected onto the wall surface, for a multi-screen image including a substantially square ceiling surface image projected onto a ceiling surface and a substantially square wall surface image projected onto a wall surface adjacent to the ceiling surface, a multi-plane image acquisition unit for acquiring the multi-plane images; a wall size receiving unit that receives an input of a wall size including a height and a width of the wall; a wall surface image trimming unit capable of performing a trimming process to remove a trim area that is a part of the wall surface image from the wall surface image; a trim candidate area receiving unit that receives input of designation of a trim candidate area, which is a candidate for an area to be set as the trim area in the wall surface image, by the administrator or the user via an administrator terminal used by the administrator or a user terminal used by the user; a ceiling surface image parameter setting unit that sets the ceiling surface image parameters including a first magnification ratio of the ceiling surface image based on the designation of the trim candidate area that is an upper area of ​​the wall surface image, the input of which is accepted by the trim candidate area accepting unit; a wall surface image parameter setting unit that sets wall surface image parameters including designation of the trimming area in which the trimming process is performed by the wall surface image trimming unit, based on the relationship between the height and the width of the wall surface in the wall surface size input received by the wall surface size receiving unit and the designation of the trimming candidate area input received by the trimming candidate area receiving unit, a trim candidate area which is the upper region of the wall surface image moves across the boundary line between the wall surface and the ceiling surface to the ceiling surface image, the trim candidate area which is the upper region is removed from the wall surface image, the wall surface image rises to fill the trim candidate area which is the removed upper region, and the first magnification ratio of the ceiling surface image is set based on the size of the area of ​​the trim candidate area which is the upper region of the wall surface image.

Images