Providing device, providing method, and providing program

Abstract

To easily provide 3D content. [Solution] The providing device 10 has a generating unit 153 and a providing unit 154. The generating unit 153 generates a panoramic image of the surroundings viewed from a point in a virtual space in which an object is placed. The providing unit 154 provides data in which the point and the panoramic image are associated with each other. For example, the generating unit 153 generates a 360-degree image centered on the point as the panoramic image.

Description

[Technical field]

[0001] The present invention relates to a providing device, a providing method, and a providing program. [Background technology]

[0002] The use of 3D data has become widespread in recent years, and attempts are being made to use 3D data created for design purposes for construction, maintenance, sales, education, and so on.

[0003] For example, images rendered based on 3D data are provided as 3D content via display devices such as flat displays and VR (Virtual Reality) goggles. For example, a type of 3D content called "walk-through" is known. Walk-through is content that displays images that allow the viewer to see the surroundings while actually walking through a virtual space in which objects are placed. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2004-227074 A [Non-patent literature]

[0005] [Non-Patent Document 1] Google, “Street View”, [online], [searched July 31, 2023], Internet (https: / / www.google.com / intl / ja / streetview / ) Summary of the Invention [Problem to be solved by the invention]

[0006] However, there is a problem with the conventional technology in that it may not be possible to easily provide 3D content.

[0007] For example, as an example of industrial 3D content using 3D CAD (Computer Aided Design) or the like, there is a walk-through of a virtual space that reproduces a plant equipped with various facilities.

[0008] The 3D models in industrial 3D content are created with sufficient detail to withstand business use such as manufacturing, structural calculations, maintenance, and testing, but if these 3D models were used directly for walkthroughs, the processing load would be too great and they would not be of practical use.

[0009] In order to use a 3D model for a walkthrough, data reduction is necessary, but automating data reduction is difficult, and performing data reduction manually requires a huge amount of labor. [Means for solving the problem]

[0010] The providing device of the embodiment is characterized by having a generation unit that generates a panoramic image of the surroundings viewed from a point in a virtual space where an object is placed, and a providing unit that provides data that associates the point with the panoramic image. [Brief description of the drawings]

[0011] [Figure 1] FIG. 1 is a diagram illustrating an example of the configuration of a provision system according to the first embodiment. [Diagram 2] FIG. 2 is a diagram illustrating an example of the configuration of a providing device according to the first embodiment. [Diagram 3] FIG. 3 is a diagram illustrating an example of the configuration of a terminal device according to the first embodiment. [Figure 4] FIG. 4 is a diagram illustrating an example of the history data. [Diagram 5] FIG. 5 is a diagram showing an example of the arrangement of viewpoints. [Figure 6] FIG. 6 is a diagram showing an example of the arrangement of a 360-degree image sphere. [Figure 7] FIG. 7 is a diagram illustrating the 360 ​​degree image sphere. [Figure 8]FIG. 8 is a diagram illustrating the 360 ​​degree image sphere. [Figure 9] FIG. 9 is a diagram showing an example of a displayed image. [Figure 10] FIG. 10 is a diagram for explaining the display control of TO. [Figure 11] FIG. 11 is a diagram for explaining the display control of TO. [Figure 12] FIG. 12 is a diagram for explaining the display control of TO. [Figure 13] FIG. 13 is a diagram for explaining automatic arrangement of viewpoints. [Figure 14] FIG. 14 is a diagram for explaining automatic arrangement of viewpoints. [Figure 15] FIG. 15 is a diagram for explaining automatic arrangement of viewpoints. [Figure 16] FIG. 16 is a flowchart showing the flow of the process of generating content. [Figure 17] FIG. 17 is a flowchart showing the process flow for defining a viewpoint. [Figure 18] FIG. 18 is a flowchart showing the flow of processing for defining a TO. [Figure 19] FIG. 19 is a flowchart showing the flow of the display control process. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0012] Hereinafter, embodiments of a providing device, a providing method, and a providing program according to the present application will be described in detail with reference to the accompanying drawings. Note that the present invention is not limited to the embodiments described below.

[0013] [First embodiment] First, an overview of the providing system according to the present embodiment will be described with reference to Fig. 1. Fig. 1 is a diagram for explaining an overview of the providing system according to the first embodiment. The providing system 1 creates 3D content. Furthermore, the providing system 1 provides the created 3D content to a user.

[0014] 1, the providing system 1 includes a providing device 10 and a terminal device 20. The providing device 10 and the terminal device 20 are connected to a network N (for example, the Internet). A user is provided with 3D content via the terminal device 20.

[0015] A display device 30 and an input device 40 are connected to the terminal device 20. For example, the terminal device 20 is a personal computer, a smartphone, or the like. For example, the display device 30 is a VR goggle. The input device 40 is a VR controller. The input device 40 may be a sensor (such as a camera) for hand tracking.

[0016] The configuration of the providing system 1 is not limited to that described here. The providing system 1 may have any configuration as long as it can provide 3D content to a user. For example, the terminal device 20 may be a home game machine. Also, for example, the terminal device 20, the display device 30, and the input device 40 may be replaced with standalone VR goggles.

[0017] 1, the providing device 10 and the terminal device 20 are in a server-client relationship. On the other hand, the providing system 1 does not necessarily have to include the providing device 10. In this case, the terminal device 20 includes a function equivalent to that of the providing device 10.

[0018] The providing system 1 significantly compresses 3D data required for providing 3D content by using a panoramic image, and reduces the processing load required for rendering. The panoramic image is, for example, a 360-degree image (a spherical image).

[0019] As described in Non-Patent Document 1, Google (registered trademark) Street View is a walk-through that displays 360-degree images taken at various locations in the real world. However, since 360-degree images are simply still images, objects captured in the 360-degree images cannot be manipulated.

[0020] On the other hand, in a virtual space constructed based on a 3D model, the manipulation of objects is realized by changing the conditions and re-rendering, etc. Here, manipulation means, for example, moving, rotating, or transforming an object.

[0021] For this reason, a walkthrough using a 3D model can be said to offer greater freedom in terms of being able to manipulate objects compared to a walkthrough using a 360-degree image.

[0022] However, as described above, a walkthrough using a 3D model has the problem of an increase in data size and processing load. In response to this problem, the provision system 1 of the present embodiment provides a walkthrough using a 3D model while suppressing the increase in data size and processing load.

[0023] The configuration of the providing device 10 will be described with reference to Fig. 2. Fig. 2 is a diagram showing an example of the configuration of the providing device according to the first embodiment. As shown in Fig. 2, the providing device 10 includes a communication unit 11, a storage unit 14, and a control unit 15.

[0024] The communication unit 11 performs wired or wireless data communication with the terminal device 20 via the network N. For example, the communication unit 11 is a network interface card (NIC).

[0025] The storage unit 14 is a storage device such as a hard disk drive (HDD), a solid state drive (SSD), an optical disk, a random access memory (RAM), a flash memory, or a non-volatile static random access memory (NVSRAM). The storage unit 14 stores an operating system (OS) and programs executed by the providing device 10. Furthermore, the storage unit 14 stores various information used in the execution of the programs. For example, the storage unit 14 stores 3D model data 141 and content data 142.

[0026] The 3D model data 141 is data of 3D CAD etc. The 3D model data 141 may be a file in a format such as ".FBX" or ".OBJ" supported by a development platform such as Unity (registered trademark).

[0027] The content data 142 is data for providing content to the user. For example, the content data 142 includes the positions of viewpoints in the virtual space and panoramic images for each viewpoint. Details of the viewpoints and the panoramic images will be described later.

[0028] The control unit 15 controls the providing device 10. The control unit 15 is a central processing unit (CPU), a micro processing unit (MPU), an application specific integrated circuit (ASIC), a field programmable gate array (FPGA), etc. For example, the control unit 15 has a construction unit 151, a placement unit 152, a generation unit 153, and a providing unit 154.

[0029] The construction unit 151 constructs a virtual space based on the 3D model data 141. By referring to the data of the virtual space constructed by the construction unit 151, it becomes possible to specify the position of an object in the virtual space.

[0030] For example, the virtual space may be a representation of a plant, and objects that represent the equipment of the plant, such as piping, valves, control panels, and supports, may be placed in the virtual space.

[0031] The arrangement unit 152 arranges one or more points (hereinafter referred to as viewpoints) in the virtual space. The viewpoint is a virtual viewpoint when generating a panoramic image.

[0032] The generating unit 153 generates a panoramic image of the surroundings viewed from a viewpoint in the virtual space in which the object is placed. In this embodiment, the panoramic image is a 360-degree image (spherical image). However, the panoramic image may be an image that represents only a part of the direction (spherical zone) rather than an image that represents all directions (global) around the viewpoint. That is, the 360-degree image in the following description may be replaced with a panoramic image as appropriate.

[0033] The providing unit 154 provides content in which viewpoints are associated with 360-degree images. In this embodiment, the providing unit 154 provides images based on the content data 142 to the terminal device 20 by streaming. However, the providing unit 154 may provide the content data 142 to the terminal device 20 as a package.

[0034] The configuration of the terminal device 20 will be described with reference to Fig. 3. Fig. 3 is a diagram showing an example of the configuration of the terminal device according to the first embodiment. As shown in Fig. 3, the terminal device 20 includes a communication unit 21, an input unit 22, an output unit 23, a storage unit 24, and a control unit 25.

[0035] The communication unit 21 performs wired or wireless data communication with the providing device 10 via the network N. For example, the communication unit 21 is a NIC.

[0036] The input unit 22 is an interface for receiving input of data and is connected to an input device 40, for example.

[0037] The output unit 23 is an interface for outputting data and is connected to a display device 30, for example.

[0038] The storage unit 24 is a storage device such as an HDD, an SSD, an optical disk, a RAM, a flash memory, or an NVSRAM. The storage unit 24 stores an OS and a program executed by the providing device 10. Furthermore, the storage unit 24 stores various information used in the execution of the program. For example, the storage unit 24 stores history data 241.

[0039] The history data 241 is data indicating a history of a user's actions in a space of the real world. For example, the history data 241 is the user's position at each time and a travel route.

[0040] The control unit 25 controls the terminal device 20. The control unit 25 is a CPU, an MPU, an ASIC, an FPGA, etc. For example, the control unit 25 includes a display control unit 251 and a transmission control unit 252.

[0041] The display control unit 251 causes the display device 30 to display the image provided from the providing device 10 .

[0042] The transmission control unit 252 transmits the history data 241 to the providing device 10. The transmission control unit 252 transmits the user's behavior data to the providing device 10 in real time. In addition, the transmission control unit 252 transmits the content of an operation by the user via the input device 40 to the providing device 10.

[0043] The processing contents of the provision system 1 will be described in detail below.

[0044] First, the arrangement unit 152 acquires the history data 241 from the terminal device 20. The history data 241 indicates a movement route of the user in the real space.

[0045] Here, the construction unit 151 constructs a virtual field for shooting, which is a virtual space for creating content, based on the 3D model data 141.

[0046] When the movement route indicated in the history data 241 is superimposed on the virtual field for imaging constructed by the construction unit 151, it becomes as shown in Fig. 4. Fig. 4 is a diagram showing an example of history data.

[0047] 4, an object 511, an object 512, and an object 521 are arranged in the virtual field for shooting. Objects such as facilities corresponding to the objects 511, 512, and 521 exist in the real space. In other words, the virtual field for shooting imitates the real space.

[0048] As shown in Fig. 4, the directions in the virtual space are expressed by x-axis, y-axis, and z-axis, which are perpendicular to each other. The positive direction of the z-axis corresponds to the vertically upward direction in the real space. That is, Fig. 4 is a bird's-eye view of the virtual shooting field.

[0049] The arrangement unit 152 arranges viewpoints in a virtual field for imaging that imitates the real space, based on the user's movement route in the real space.

[0050] The placement unit 152 places viewpoints at positions on the movement path. The placement unit 152 may place the viewpoints automatically, or may place them in response to a user operation (manual placement).

[0051] The placement unit 152 may place a viewpoint at a position on the movement route where the user has stayed (stopped) for a time equal to or longer than a threshold value. The placement unit 152 may also place a viewpoint at a position where the user has passed a certain number of times (e.g., twice) or more.

[0052] Fig. 5 is a diagram showing an example of the arrangement of viewpoints. In the example of Fig. 5, the arrangement unit 152 arranges viewpoints 61_1, 61_2, 61_3, 61_4, 61_5, 61_6, 61_7, 61_8, 61_9, 61_10, 61_11, 61_12, 61_13, and 61_14 in the imaging virtual field.

[0053] Next, the generation unit 153 generates 360-degree images centered on each of the viewpoints as a panoramic image. The generation unit 153 defines a virtual sphere centered on each viewpoint, as shown in FIG.

[0054] Fig. 6 is a diagram showing an example of the arrangement of 360-degree image spheres. In the example of Fig. 6, the generation unit 153 defines spheres 62_1, 62_2, 62_3, 62_4, 62_5, 62_6, 62_7, 62_8, 62_9, 62_10, 62_11, 62_12, 62_13, and 62_14. However, the center of the sphere 62_N is the viewpoint 61_N.

[0055] The generation unit 153 generates data in which a 360-degree image captured of the virtual field for shooting is pasted on the inside of the sphere with the center of the sphere as the viewpoint. The generation unit 153 can generate the 360-degree image using existing technology (for example, Unity's Skybox, a spherical mesh, etc.). The generation unit 153 associates the position of the viewpoint with the 360-degree image and adds them to the content data 142. Furthermore, a 2D map of the sky above the virtual field for shooting, that is, a bird's-eye view map as shown in FIG. 5, is added to the content data 142.

[0056] When the sphere defined in Fig. 6 is viewed in the direction from the base to the tip of the arrow 71, it appears as shown in Fig. 7 and Fig. 8. Fig. 7 and Fig. 8 are diagrams for explaining a 360-degree image sphere. Note that although a sphere is drawn here, it is not necessary for the sphere to be drawn on the screen during content creation.

[0057] 7, the sphere 62_3 is hidden by the object 511 and becomes invisible. On the other hand, as shown in FIG 8, when objects other than the sphere (including the object 511) are made invisible, the sphere 62_3 appears.

[0058] As the movement of the player, which is the user's avatar, within the content, only walking, which does not change the height difference, may be defined, or in addition to walking, flying, crouching, etc., which change the height difference, may be defined. As shown in Figures 7 and 8, when only walking is defined, the height (position on the z-axis) of each sphere (or viewpoint) is constant, but when flying or crouching is defined, the height of each sphere may differ from each other.

[0059] Furthermore, the generation unit 153 adds information on an object to be operated (hereinafter referred to as a TO (Touchable Object)) based on the 3D model data 141 to the content data 142. Here, it is assumed that the object 521 is a TO. In this case, the generation unit 153 adds the position (coordinates) of the object 521 in the shooting virtual field and data on the 3D model of the object 521 to the content data 142.

[0060] Furthermore, the generation unit 153 sets a collider (a component for collision detection) to the TO. Furthermore, the generation unit 153 sets the initial state of the TO to transparent.

[0061] Furthermore, the generation unit 153 may arrange viewpoints based not only on the history data 241 but also on the player's action history (including movement history) within the content.

[0062] The providing unit 154 provides the 360-degree image corresponding to the selected viewpoint to the terminal device 20. Here, the construction unit 151 constructs a virtual field for provision. The construction unit 151 places a TO in the virtual field for provision with reference to the content data 142. On the other hand, the construction unit 151 does not place any object other than the TO in the virtual field for provision.

[0063] The providing unit 154 displays a 2D map on the terminal device 20. The map is a diagram in which viewpoints are arranged on an image overlooking the virtual space, as shown in FIG.

[0064] The providing unit 154 provides an image as shown in Fig. 9 to the terminal device 20. Fig. 9 is a diagram showing an example of a displayed image.

[0065] Fig. 9 is a 360-degree image corresponding to viewpoint 61_1. The viewpoint of the 360-degree image rotates in response to a user operation. In the initial state, the TO is transparent. Therefore, the object 521 in Fig. 9 is merely a part of the 360-degree image. At this time, the TO is transparent, although it is superimposed on the 360-degree image.

[0066] The content of the user's operation is transmitted to the providing device 10 via the transmission control unit 252 of the terminal device 20.

[0067] When the viewpoint is changed, the providing unit 154 provides a 360-degree image corresponding to the viewpoint after the change.

[0068] For example, the providing unit 154 causes the display device 30 to display a 360-degree image corresponding to a selected viewpoint from among viewpoints displayed on a map overlooking the virtual space.

[0069] Also, for example, when an operation instructing movement within the provided virtual field (e.g., pressing the arrow object 72) is performed while a 360-degree image is being displayed on the display device 30, the providing unit 154 causes the display device 30 to display a 360-degree image corresponding to the viewpoint to which the movement is to be made based on the operation.

[0070] The providing unit 154 displays the object 521 when a condition regarding the relationship between the position in the providing virtual field specified by the user and the position where the object 521 (object to be operated) is placed is satisfied, and does not display the object 521 when the condition is not satisfied.

[0071] The display control of TO will be described with reference to Fig. 10, Fig. 11, and Fig. 12. Fig. 10, Fig. 12, and Fig. 12 are diagrams for explaining the display control of TO.

[0072] For example, as shown in Fig. 10, an object 521 exists as a TO at a position that has been arranged in advance in the presentation virtual field. However, as shown in Fig. 11, the object 521 is made transparent. A figure 73 in Fig. 11 represents the user's field of view in the presentation virtual field.

[0073] 12 is an object that indicates a position in the provided virtual field designated by the user. The pointer 74 may be an object that resembles a hand or an object that resembles an arrow.

[0074] When the position of the pointer 74 enters a certain range centered on the object 521 (approach determination), or when the pointer 74 comes into contact with the object 521 (contact determination), the providing unit 154 determines that the condition is satisfied and displays (makes the object non-transparent, cancels transparency) the object 521. The user can perform operations (moves, rotates, transforms, etc.) on the displayed object 521.

[0075] In addition, the providing unit 154 may make the object 521 non-transparent when the pointer 74 approaches the object 521, and may execute a predetermined process (e.g., changing the color of the object 521, opening an opening such as a door associated with the object 521) when the pointer 74 comes into contact with the object 521.

[0076] (Example 1: Automatic placement of viewpoints and automatic designation of TOs) For example, as shown in Fig. 13, the generation unit 153 may arrange viewpoints based on the user's action history and specify a TO. Fig. 13 is a diagram for explaining automatic arrangement of viewpoints. Here, it is assumed that an object 521 is not initially specified as a TO.

[0077] First, the generation unit 153 determines, as TO, an object located at a position on the content where the user extends his / her hand and operates (a position where the pointer 74 is moved). The generation unit 153 may also place an extended viewpoint at a position where the user stops or at a position where an operation is performed. Furthermore, the generation unit 153 may place an extended viewpoint at a position estimated from the user's behavior history using a machine learning model.

[0078] 13 is a viewpoint arranged at a position where the user stops. Moreover, a viewpoint 61_16 is a viewpoint arranged at a position when the user operates the object 521. Moreover, a viewpoint 61_17 is a viewpoint arranged at a position estimated by the machine learning model.

[0079] In this way, the placement unit 152 can place a point in the virtual space based on the position where the object to be operated is placed.

[0080] (Example 2: Adding 360-degree images) The generation unit 153 may generate additional 360-degree images in response to a user's instruction even during the provision of content. For example, it is assumed that the viewpoint 61_21 in Fig. 14 is placed before the provision of content, and the corresponding 360-degree image has already been generated.

[0081] The viewpoint 61_22 is a viewpoint additionally specified by the user via the terminal device 20 after the provision of the content has started. The generation unit 153 additionally generates a 360-degree image corresponding to the specified viewpoint 61_22. Thereafter, the 360-degree image corresponding to the viewpoint 61_22 can be provided to the user.

[0082] Furthermore, the generation unit 153 adds not only the specified viewpoint, but also viewpoints at positions near the specified viewpoint to which it is estimated that the user would like to move.

[0083] For example, when a viewpoint 61_22 is additionally specified as shown in Fig. 15, the generation unit 153 adds a plurality of viewpoints (61_23, 61_24, 61_25, 61_26, 61_27) in the vicinity (within a certain distance) of the viewpoint 61_22. The generation unit 153 may also add viewpoints that are four or eight positions away from the specified viewpoint.

[0084] (Example 3: Automatic designation of TO) The generating unit 153 may determine whether or not to designate an object as a TO based on information indicated by character strings such as a name, label, and tag that are predetermined for the object.

[0085] For example, if the name of an object includes a specific keyword such as "switch," "operation," or "valve," the generating unit 153 treats the object as a TO.

[0086] In this way, the placement section 152 can specify an object to be operated on, based on a character string related to the object.

[0087] [Processing of the first embodiment] The flow of processing for generating content will be described with reference to Fig. 16. Fig. 16 is a flowchart showing the flow of processing for generating content.

[0088] 16, the providing device 10 constructs a virtual field for shooting (step S101). Next, the providing device 10 defines a TO (step S102). Then, the providing device 10 defines a viewpoint (step S103).

[0089] Here, the providing device 10 captures a 360-degree image at the viewpoint (step S104), and saves the 2D map of the sky and information about the viewpoint (including the 360-degree image) (step S105).

[0090] Furthermore, the providing device 10 takes in the TO (step S106) and automatically generates content (content data 142) (step S107).

[0091] The flow of the process of defining a viewpoint (step S103 in FIG. 16) will be described with reference to FIG 17. FIG 17 is a flowchart showing the flow of the process of defining a viewpoint.

[0092] 17, the providing device 10 determines whether or not to automatically define a viewpoint (step S10301). Whether the viewpoint is defined automatically or manually may be changeable by settings.

[0093] If the viewpoint is not automatically defined (step S10301, No), the providing device 10 performs manual placement of the viewpoint based on a user operation (step S10302).

[0094] When the viewpoint is automatically defined (step S10301, Yes), the providing device 10 reads the history data 241 (step S10304). Then, the providing device 10 defines the player's motion (step S10305). For example, the providing device 10 defines whether the player's motion is only walking or includes flying and crouching.

[0095] Then, the providing device 10 defines area priority (step S10306). More viewpoints are defined in areas with higher priority in the virtual space.

[0096] Here, the providing device 10 acquires the action record of the user (player) in the content (step S10307).

[0097] Then, the providing device 10 performs automatic arrangement of the viewpoints (step S10308).

[0098] The providing device 10 determines the viewpoint that has been manually or automatically placed (step S10303).

[0099] The process of defining a TO will be described with reference to Fig. 18. Fig. 18 is a flowchart showing the flow of the process of defining a TO.

[0100] 18, first, the providing device 10 specifies a TO in the shooting virtual field (step S201). At this time, the providing device 10 stores the coordinates and model data of the TO as the content data 142 (step S202).

[0101] Next, the providing device 10 places the TO at the stored coordinates of the providing virtual field (step S203). Then, the providing device 10 sets a collider (collision determination) for the TO (step S204). In addition, the providing device 10 makes the TO transparent (step S205).

[0102] Furthermore, the providing device 10 adds a determination process for making the TO non-transparent (step S206). For example, the determination process is a process for performing approach determination and contact determination. The providing device 10 completes the definition and placement of the TO (step S207).

[0103] The display control process will be described with reference to Fig. 19. Fig. 19 is a flowchart showing the flow of the display control process.

[0104] 19, first, the providing device 10 displays a 360-degree image corresponding to the viewpoint (step S301). When the providing device 10 ends the content provision (step S302, Yes), the providing device 10 ends the process. For example, the content provision ends in response to a user operation.

[0105] If the provision of the content has not ended (No at step S302), the providing device 10 determines whether the viewpoint has been changed (step S303).

[0106] If the viewpoint has been changed (Yes at step S303), the providing device 10 returns to step S301 and displays the 360-degree image corresponding to the changed viewpoint.

[0107] If the viewpoint has not been changed (step S303, No), the providing device 10 acquires the position of the pointer in the providing virtual field (step S304).

[0108] Then, the providing device 10 judges whether or not the positional relationship between the pointer and the TO satisfies the condition (step S305). If the positional relationship between the pointer and the TO satisfies the condition (step S306, Yes), the providing device 10 makes the TO non-transparent (step S307). On the other hand, if the positional relationship between the pointer and the TO does not satisfy the condition (step S306, No), the providing device 10 makes the TO transparent (step S308).

[0109] For example, when the pointer and the TO are close to each other, the providing device 10 makes the TO non-transparent (visible), and when the pointer and the TO are not close to each other, the providing device 10 makes the TO transparent (invisible).

[0110] [Advantages of the First Embodiment] As described above, the generation unit 153 generates a panoramic image of the surroundings viewed from a point in the virtual space where the object is placed. The provision unit 154 provides data associating the point with the panoramic image. For example, the generation unit 153 generates a 360-degree image centered on the point as the panoramic image.

[0111] In this manner, in the present embodiment, an area in which a 3D object is arranged in 3D content can be replaced with a panoramic image. Therefore, according to the present embodiment, it is possible to reduce the data size and the processing load, and it becomes possible to easily provide 3D content.

[0112] Furthermore, in a VR walk-through, VR sickness and the like occurs if the FPS (Frames Per Second) falls below 60. According to this embodiment, the FPS of the walk-through can be improved in conjunction with a reduction in the processing load.

[0113] In particular, in design models, the division units such as assemblies and groups for creating LOD are often not suitable for VR. Designers must take this into consideration when designing, which increases the design load and has traditionally created a barrier to converting design models into VR. This embodiment solves this problem.

[0114] Furthermore, when automatic mesh reduction is performed on a 3D model for design, small models may disappear or break, and specific objects such as parts and components tend to be more likely to be missing than 3D models in video games, etc. For example, parts that one wishes to operate or show, such as valves and switches, tend to be small in volume relative to the entire model. For this reason, this embodiment is effective as an alternative to conventional automatic mesh reduction methods.

[0115] In addition, in this embodiment, content of a discrete walkthrough between viewpoints is provided. Particularly in industrial applications, unlike video games, a continuous walkthrough is not required, and a discrete walkthrough is often sufficient.

[0116] The providing unit 154 causes the display device 30 to display a panoramic image corresponding to a selected point among the points displayed on the map overlooking the virtual space. This makes it possible to select a viewpoint by an intuitive operation.

[0117] When an operation instructing movement in a virtual space is performed while a panoramic image is being displayed on the display device 30, the providing unit 154 causes the display device 30 to display a panoramic image corresponding to a point of a movement destination based on the operation. This allows the user to get a sense of actually moving in a virtual space.

[0118] The placement unit 152 places points in a virtual space that mimics the real space, based on the user's movement route in the real space. This makes it possible to place viewpoints in necessary locations efficiently.

[0119] The providing unit 154 adds information about the object to be operated that is placed in the virtual space to the data, and causes the display device 30 to display an image in which the object to be operated is superimposed on the panoramic image. Furthermore, the providing unit 154 displays the object to be operated when a condition regarding the relationship between the position in the virtual space specified by the user and the position where the object to be operated is placed is satisfied, and hides the object to be operated when the condition is not satisfied. In this way, by providing the minimum necessary objects in an operable manner, it is possible to reduce data and processing load while meeting the needs of the user.

[0120] The placement unit 152 places a point in the virtual space based on the position where the object to be operated is to be placed. The placement unit 152 also specifies the object to be operated based on a character string related to the object. This makes it possible to automate the placement of the viewpoint and the specification of the TO.

[0121] The programs executed by the providing device 10 and the terminal device 20 of the present embodiment are provided by being pre-installed in a ROM or the like. The programs executed by the providing device 10 and the terminal device 20 of the present embodiment may be configured to be provided by being recorded in a computer-readable recording medium as a file in an installable or executable format.

[0122] Furthermore, the programs executed by the providing device 10 and the terminal device 20 of the present embodiment may be configured to be stored on a computer connected to a network such as the Internet and provided by being downloaded via the network. Also, the programs executed by the providing device 10 and the terminal device 20 of the present embodiment may be configured to be provided or distributed via a network such as the Internet.

[0123] The program executed by the providing device 10 and the terminal device 20 of this embodiment has a modular structure including each of the above-mentioned units (construction unit 151, placement unit 152, generation unit 153, providing unit 154, display control unit 251, and transmission control unit 252), and in terms of actual hardware, the CPU reads and executes the program from the ROM, thereby loading each of the above-mentioned units onto the main memory device, and each unit is generated on the main memory device.

[0124] Although the embodiment of the present invention has been described, the embodiment is presented as an example and is not intended to limit the scope of the invention. The embodiment can be implemented in various other forms, and various omissions, substitutions, and modifications can be made without departing from the gist of the invention. The embodiment and its modifications are included in the scope of the invention and its equivalents described in the claims, as well as in the scope and gist of the invention. [Explanation of symbols]

[0125] 1. Provision system 10 Providing device 11, 21 Communications Department 14, 24 Storage section 15, 25 Control section 22 Input section 23 Output section 30 Display device 40 Input Devices 141 3D model data 142 Content Data 151 Construction Department 152 Placement section 153 Generation part 154 Provision Department 241 Historical Data 251 Display control unit 252 Transmission control section

Claims

1. a generating unit for generating a panoramic image of the surroundings viewed from a point in the virtual space in which the object is placed; a providing unit that provides data in which the points are associated with the panoramic image; a placement unit that places the points in the virtual space that imitates the real space based on a movement path of a user in the real space; A providing device comprising:

2. The providing device according to claim 1 , wherein the generating unit generates a 360-degree image centered on the point as the panoramic image.

3. The providing device according to claim 1 , characterized in that the providing unit causes a display device to display the panoramic image corresponding to a selected point among the points displayed on a map overlooking the virtual space.

4. The providing device according to claim 1, characterized in that when an operation instructing movement within the virtual space is performed while the panoramic image is displayed on a display device, the providing unit causes the display device to display the panoramic image corresponding to a destination point based on the operation.

5. A generation unit that generates a panoramic image of the surroundings viewed from a point in a virtual space in which an object is placed; a providing unit that provides data in which the points are associated with the panoramic image, adds information about an object to be operated that is to be placed in the virtual space to the data, and causes a display device to display an image in which the object to be operated is superimposed on the panoramic image; a placement unit that places the point in the virtual space based on a position where the operation target object is to be placed; A providing device comprising:

6. The providing device according to claim 5, characterized in that the providing unit displays the object to be operated when a condition regarding a relationship between a position in the virtual space specified by the user and a position at which the object to be operated is to be placed is satisfied, and hides the object to be operated when the condition is not satisfied.

7. A generation unit that generates a panoramic image of the surroundings viewed from a point in a virtual space in which an object is placed; a providing unit that provides data in which the points are associated with the panoramic image; having the providing unit adds information about an operation target object to be placed in the virtual space to the data, and causes a display device to display an image in which the operation target object is superimposed on the panoramic image; The providing device, wherein the generating unit specifies the object to be operated on the basis of a character string related to the object.

8. A generating step of generating a panoramic image of the surroundings viewed from a point in the virtual space where the object is placed; providing data associating the points with the panoramic image; a placement step of placing the points in the virtual space simulating the real space based on a movement route of a user in the real space; The method is characterized in that the method is executed by a computer.

9. A generating step of generating a panoramic image of the surroundings viewed from a point in the virtual space where the object is placed; providing data associating the points with the panoramic image; a placement step of placing the point in the virtual space simulating the real space based on a movement route of a user in the real space; A provided program characterized by causing a computer to execute the above.

Images