3D tour additional information display system and method

Abstract

The present invention relates to a technology relating to a system and method for displaying additional 3D tour information. [Solution] In this case, the 3D tour additional information display method is executed by a 3D tour service providing server linked to a user terminal, and includes the steps of providing a 3D tour including 3D information of a specific space to the user terminal, receiving coordinate information for the start point and end point of an additional information marker to be newly created on the 3D tour displayed on the user terminal, creating an additional information marker connecting the start point and the end point, and overlapping and displaying the created additional information marker on the 3D tour.

Description

[Technical field]

[0001] The present invention relates to a system and method for displaying additional information on a 3D tour. Specifically, the present invention relates to a system and method for providing an interface capable of expressing additional information of a 3D tour configured in three dimensions in a 3D form. The present invention also relates to a system and method for providing an interface capable of tagging and displaying additional information by linking 2D and 3D screens. [Background technology]

[0002] The best way to record a 3D space is to take 360-degree photos of a specific location, save them as panoramic images, and then combine the panoramic images of multiple locations to create a 3D tour.

[0003] Here, the 3D tour can be composed of a combination of panoramic images (e.g., 360-degree images) that are taken at multiple locations and stored. In this case, the 3D tour can include location information where each image was taken, and each location information can be mapped on a floor plan and provided to the user.

[0004] At this time, users of 3D tours have a need to include additional information such as notes, images, and videos in the 3D tour.

[0005] However, the existing interface for displaying additional information only provided the function to display additional information such as notes and images recorded by the user in 2D on the floor plan. Since the additional information was only displayed on the floor plan, it was difficult for the user to clearly indicate the additional information for the specific position where they wanted to make a note in the 3D tour space.

[0006] In addition, because the location was not clearly expressed, it was difficult for others to clearly understand the meaning of the additional information that had been added.

[0007] In addition, with the conventional additional information display interface, the recorded additional information could only be viewed at a specific position, and if the angle at which the image in the 3D tour was viewed was changed, the set additional information could not be viewed.

[0008] In addition, the conventional additional information recording interface separates the 3D shooting interface and the additional information input interface, which means that users have to enter additional information separately into the plan view after shooting the 3D tour, which is a hassle.

[0009] In addition, with the conventional additional information recording interface, the information entered on the floor plan was not linked to the 3D tour, which meant that users had to inconveniently enter the location corresponding to the additional information entered on the floor plan separately on the 3D tour or check it separately.

[0010] There was also a problem that it was difficult for other people to clearly understand the meaning of the additional information displayed on the floor plan. Summary of the Invention [Problem to be solved by the invention]

[0011] An object of the present invention is to provide a 3D tour additional information display system and method that displays additional information related to a specific point specified by a user in 3D form for various types of additional information that a user wishes to record while using a 3D tour.

[0012] Another object of the present invention is to provide a 3D tour additional information display system and method that allows a user to specify 360-degree images on which additional information is to be displayed, thereby enabling the user to view the set additional information at a desired position.

[0013] Another object of the present invention is to provide a system and method for displaying additional information on a 3D tour, which allows the location of additional information added within a 3D tour to be confirmed at a glance by displaying the location of the additional information signpost together on a plan view.

[0014] Another object of the present invention is to provide a 3D tour additional information display system and method that can simultaneously perform 3D shooting of a space and insert various types of additional information into a floor plan when shooting to create a 3D tour.

[0015] Another object of the present invention is to provide a 3D tour additional information display system and method which, when additional information is inserted at a specific position in a first screen (e.g., a 2D plan view screen), automatically calculates the position of the additional information and automatically displays the additional information at a corresponding position in a second screen (e.g., a 3D tour screen).

[0016] The objects of the present invention are not limited to the objects mentioned above, and other objects and advantages of the present invention not mentioned can be understood from the following description and will be more clearly understood by the embodiments of the present invention. Also, it will be easily understood that the objects and advantages of the present invention can be realized by the means and combinations thereof as set forth in the claims. [Means for solving the problem]

[0017] To achieve the above technical objectives, a 3D tour additional information display method according to an embodiment of the present invention is executed by a 3D tour service providing server linked to a user terminal, and includes the steps of providing a 3D tour including 3D information of a specific space to the user terminal, receiving coordinate information for a start point and an end point of an additional information signpost to be newly created on the 3D tour displayed on the user terminal, creating an additional information signpost connecting the start point and the end point, and overlapping and displaying the created additional information signpost on the 3D tour.

[0018] In addition, the step of receiving coordinate information for the start point and the end point may include, when receiving input of a line connecting two points on the 3D tour from the user terminal, setting one end of the input line as the start point and setting the other end of the line as the end point.

[0019] In addition, the step of receiving coordinate information of the start point and the end point may include, when only one point on the 3D tour is input from the user terminal, setting the input point as the end point, and setting a point on the floor or wall located at the shortest distance from the input point as the start point.

[0020] Furthermore, the coordinate information for the start point and the end point can be configured as three-dimensional coordinates.

[0021] Additionally, the additional information signposts can be displayed in different shapes at different locations within the 3D tour.

[0022] The method further includes providing an interface for selecting a shooting location at which the additional information signpost is to be displayed from among a plurality of image shooting locations included in the 3D tour, so that the additional information signpost can be displayed only at the selected shooting location within the 3D tour.

[0023] The 3D tour may also include a floor plan of the specific space, and additional information icons corresponding to the positions of the additional information signposts may be displayed on the floor plan.

[0024] The method further includes providing an interface for setting a color, title, content, or additional information of the additional information signpost to the user terminal, and the additional information signpost can be created based on the color, title, content, or additional information inputted through the interface.

[0025] Also, the additional information may be displayed on one side of the additional information signpost, or may be displayed in a separate message window when the user selects the additional information signpost.

[0026] The additional information may include a photograph, a video, or a URL link.

[0027] In order to achieve the above technical objectives, a 3D tour additional information display system according to an embodiment of the present invention includes a processor and a memory in which a program executed by the processor is stored, and the program includes an operation of providing a 3D tour including 3D information of a specific space to the user terminal, an operation of receiving coordinate information for a start point and an end point of an additional information signpost to be newly created via the user terminal within the 3D tour, an operation of creating the additional information signpost connecting the start point and the end point, and an operation of overlapping and displaying the created additional information signpost on the 3D tour.

[0028] Meanwhile, a 3D tour additional information display method according to an embodiment of the present invention for achieving the above technical objectives, in a 3D tour additional information display method performed by a 3D tour management server linked to a user terminal, includes the steps of simultaneously displaying a floor plan and a 3D tour shooting interface for a specific space on the user terminal, receiving shot images of the 3D tour for the specific space from the user terminal, receiving input of additional information via the user terminal during the process of shooting the 3D tour, combining the 3D tour with the input additional information, and displaying the additional information on the 3D tour or the floor plan.

[0029] In addition, the step of synthesizing the 3D tour with the input additional information may include a step of extracting position coordinates of the additional information to be added to the floor plan based on changes in the captured image of the 3D tour, and a step of mapping the input additional information to the extracted position coordinates.

[0030] In addition, the step of extracting the position of the additional information may include the steps of extracting a plurality of feature points on the captured image of the 3D tour, calculating the movement direction and distance of the feature points due to changes in the captured image, and extracting the position coordinates of the additional information based on the calculated movement direction and distance.

[0031] In addition, the position coordinates of the extracted additional information may be composed of two-dimensional coordinates, and the step of mapping the additional information to the extracted position coordinates may include the steps of converting the position coordinates of the extracted additional information into three-dimensional coordinates on the 3D tour, mapping the additional information on the floor plan using the two-dimensional coordinates, and mapping the additional information on the 3D tour using the three-dimensional coordinates.

[0032] In addition, the step of receiving the input of the additional information may include the steps of receiving an input of a specific position on the plan view of the 3D shooting where the additional information is to be inserted, and receiving an input of the additional information to be inserted at the specific position via an additional information insertion interface.

[0033] In addition, the shooting process of the 3D tour is displayed on one side of the screen of the user terminal, and the floor plan is displayed on the other side of the screen of the user terminal, and the step of receiving the input of the specific position may include receiving position information selected by the user on the floor plan.

[0034] The additional information insertion interface can also receive input of additional information corresponding to a selected information type, such as a memo, a photo, a video, or an internet link.

[0035] In addition, the step of displaying the additional information may include the steps of displaying an additional information icon at an insertion position of the additional information on the floor plan, and displaying a 3D additional information signpost corresponding to the additional information icon on the 3D tour.

[0036] In addition, the 3D additional information signpost may be composed of a start point located on the floor or wall of the 3D tour, an end point corresponding to the position of the additional information icon, and a body portion connecting the start point and the end point.

[0037] Meanwhile, a 3D tour additional information tagging system according to an embodiment of the present invention for achieving the above technical objectives includes a processor and a memory in which a program executed by the processor is stored, and the program includes an operation of simultaneously displaying a floor plan and a 3D tour shooting interface for a specific space on the user terminal, an operation of receiving images of a 3D tour of the specific space from the user terminal, an operation of receiving input of additional information via the user terminal during the process of shooting the 3D tour, an operation of combining the 3D tour with the input additional information, and an operation of displaying the additional information on the 3D tour or the floor plan. Effect of the Invention

[0038] The 3D tour additional information display system and method according to the present invention can display additional information at the exact location that the user desires by setting an additional information signpost in 3D form at the user's desired location, thereby allowing other users using the same 3D tour to clearly explain and convey the meaning of a specific location.

[0039] In addition, the 3D tour additional information display system and method according to the present invention provides an interface for selecting a specific 360-degree image for which a 3D additional information signpost is to be displayed, and displays the 3D additional information signpost only on the selected image, allowing the additional information to be viewed from various positions within the 3D tour. This improves user convenience and clearly conveys the intention of displaying additional information to multiple users.

[0040] In addition, the system and method for displaying 3D tour additional information according to the present invention can provide a user with an intuitive interface that allows the user to grasp the location of inserted additional information at a glance by automatically displaying the location where the additional information is displayed on a floor plan within the 3D tour.

[0041] In addition, the 3D tour additional information display system and method according to the present invention enables 3D tour shooting and insertion of additional information into a floor plan simultaneously, thereby reducing the inconvenience that a user has to perform a separate task of inserting additional information after shooting a 3D tour.

[0042] In addition, the 3D tour additional information display system and method of the present invention can improve user convenience by automatically displaying additional information inserted on a floor plan in the form of an additional information signpost at a corresponding position in the 3D tour.

[0043] In addition, the 3D tour additional information display system and method according to the present invention can clearly communicate the meaning of the additional information to other users who are using the same 3D tour.

[0044] The effects of the present invention are not limited to those described above, and a person skilled in the art of the present invention can easily derive various effects of the present invention using the configuration of the present invention. [Brief description of the drawings]

[0045] [Figure 1] 1 is a block diagram illustrating a schematic configuration of a 3D tour additional information display system according to some embodiments of the present invention. [Diagram 2] 1 is a block diagram illustrating a schematic configuration of a 3D tour additional information display system according to some embodiments of the present invention. [Diagram 3] 1 is a flow diagram illustrating a method for adding and displaying additional information within a 3D tour according to an embodiment of the present invention. [Figure 4]11 is a diagram illustrating a setting interface for additional information provided by a 3D tour additional information display system according to an embodiment of the present invention. [Diagram 5] 11 is a diagram illustrating a setting interface for additional information provided by a 3D tour additional information display system according to an embodiment of the present invention. [Figure 6] 1 is a diagram illustrating an example of how additional information added to a 3D tour is displayed in a 3D tour additional information display system according to an embodiment of the present invention. [Figure 7] 11 is a diagram illustrating a function of displaying added additional information only at a specific image shooting location in a 3D tour additional information display system according to an embodiment of the present invention. [Figure 8] 11 is a diagram illustrating another example of how additional information added to a 3D tour is displayed in a 3D tour additional information display system according to an embodiment of the present invention. [Figure 9] 1 is a diagram showing a plan view in which icons for additional information added in a 3D tour additional information display system according to an embodiment of the present invention are displayed. FIG. [Figure 10] 11 is a flow chart illustrating a method for displaying 3D tour additional information according to another embodiment of the present invention. [Figure 11] 11 is a diagram illustrating a method of photographing a space in a 3D tour additional information display system according to another embodiment of the present invention. [Figure 12] 11 is a diagram illustrating an example of an interface for inserting additional information according to another embodiment of the present invention; [Figure 13] 13 is a plan view showing an icon of additional information inserted through the additional information insertion interface of FIG. 12; [Figure 14] 13 is a diagram illustrating a 3D tour additional information display system according to another embodiment of the present invention, in which a plan view and a 3D tour are combined to display additional information. [Figure 15]13 is a diagram illustrating a 3D tour additional information display system according to another embodiment of the present invention, in which a plan view and a 3D tour are combined to display additional information. [Figure 16] 11 is a diagram illustrating a tracking method performed in a 3D tour additional information display system according to another embodiment of the present invention. [Figure 17] 11 is a diagram illustrating a tracking method performed in a 3D tour additional information display system according to another embodiment of the present invention. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0046] The advantages and features of the present invention, and the method of achieving them, will become clear from the following detailed description of the embodiments, etc., in conjunction with the accompanying drawings. However, the present invention is not limited to the embodiments disclosed below, but may be implemented in various different forms, and the embodiments are provided merely to ensure that the disclosure of the present invention is complete and to fully inform those skilled in the art of the present invention of the scope of the invention, and the present invention is only defined by the scope of the claims. The same reference numerals refer to the same elements throughout the specification.

[0047] The terms used herein are for the purpose of describing the embodiments and are not intended to limit the present invention. In the present specification, the singular form includes the plural form unless otherwise stated in the phrase. As used in the specification, "comprises" and / or "comprising" means that the recited components, steps, operations, and / or elements do not exclude the presence or addition of one or more other components, steps, operations, and / or elements.

[0048] Unless otherwise defined, all terms (including technical and scientific terms) used herein may be used in a manner commonly understood by those having ordinary skill in the art to which the present invention belongs. Furthermore, commonly used predefined terms are not to be interpreted ideally or excessively unless expressly and specifically defined.

[0049] In the present invention, a "3D tour" can be composed of a combination of multiple images (e.g., panoramic images) that are taken and stored in 360 degrees at multiple locations. In this case, the "3D tour" can include location information where each image was taken, and each location information can be mapped on a plan view and provided to the user.

[0050] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, a 3D tour additional information display system and method according to an embodiment of the present invention will be described in detail with reference to the accompanying drawings.

[0051] 1 and 2 are block diagrams illustrating a schematic configuration of a 3D tour additional information display system according to some embodiments of the present invention.

[0052] 1, a 3D tour additional information display system according to an embodiment of the present invention includes a server (100) (hereinafter, referred to as server) that displays 3D tour additional information, and a user terminal (200). The server (100) and the user terminal (200) can be implemented as a server-client system.

[0053] At this time, the server (100) can select an image corresponding to a specific location selected by the user from among the shooting locations of a plurality of images included in the 3D tour, and provide it to the user terminal (200). The server (100) can transmit and receive data to and from the user terminal (200) via a wired or wireless network.

[0054] Although only one user terminal (200) is illustrated in FIG. 1, the present invention is not limited thereto, and the server (100) can operate in conjunction with a plurality of user terminals (200).

[0055] The server (100) can store and manage a plurality of different 3D tours. In this case, the server (100) can receive coordinate values ​​for creating additional information signposts from the user terminal (200) and display additional information on the 3D tour using the received coordinate values ​​and additional information signposts. The method for displaying additional information on a 3D tour will be described in detail below.

[0056] In addition, the server (100) can insert additional information into a specific location selected by the user and display an icon for the additional information on a floor plan and a 3D tour in the user terminal (200). The server (100) can transmit and receive data to and from the user terminal (200) via a wired or wireless network.

[0057] The server (100) can store and manage 360-degree images captured via the user terminal (200), floor plans for 3D tours, 3D additional information signposts, and additional information display icons.

[0058] The server (100) can then provide the 360-degree image, the 3D tour, a floor plan of the 3D tour, a 3D additional information signpost, and an additional information display icon to the user terminal (200).

[0059] The server 100 can simultaneously display the 3D tour and the additional information inserted into the plan view of the 3D tour on the screen of the user terminal 200. In this case, the shooting process of the 3D tour can be displayed on one side of the screen of the user terminal 200, and the plan view of the 3D tour can be displayed on the other side.

[0060] Furthermore, the server (100) can input and display additional information on the plan view of the 3D tour, and can also input and display additional information of the same content within the 3D tour.

[0061] Specifically, the server (100) can automatically create and display an additional information signpost at a corresponding position within the 3D tour based on the position coordinates of the additional information input via the floor plan during 3D tour shooting.

[0062] That is, the server (100) can display an additional information icon at a position where the additional information is input on the floor plan, and display a 3D additional information signpost at a corresponding position in the 3D tour. A detailed description of a method for inputting and displaying additional information in the floor plan and inserting and displaying the additional information in the 3D tour will be provided below. The configuration of the server (100) will be provided below in detail.

[0063] Meanwhile, referring to FIG. 2, the server (100) includes a memory (120) in which a program for implementing the technical idea of ​​the present invention is stored, and a processor (110) for executing the program stored in the memory (120).

[0064] At this time, the memory 120 can store data related to the 3D tour and additional information of the 3D tour. For example, the 3D tour can include 360-degree captured images, coordinates of the capture positions of the captured images, data related to the floor plan to which the coordinates are mapped, data related to additional information signposts added to the 3D tour, and data related to the settings of the additional information.

[0065] Here, the data related to the additional information signpost may include the content of the additional information, the color of the additional information signpost, the coordinates of the additional information signpost, and the position of the floor plan where the coordinates are mapped, etc. Furthermore, the data related to the setting of the additional information may include the content of the additional information, an icon expressing the additional information, the coordinates of the additional information signpost, and data related to the floor plan where the coordinates are mapped.

[0066] The memory 120 can store an algorithm for a 3D tour additional information display method. Here, the 3D tour additional information display method refers to a method of providing an interface for setting additional information in a 3D form on a 3D tour configured in three dimensions. In this case, the processor 110 can be the entity that executes the algorithm.

[0067] Specifically, the server 100 can provide a 3D additional information setting interface that enables a user to create a 3D additional information signpost on the 3D tour.

[0068] At this time, the server (100) can receive coordinate values ​​for the start and end points of the additional information signpost, create the additional information signpost, and map the additional information input by the user to the created additional information signpost.

[0069] In addition, the server (100) can provide an interface that allows the user to specify the location where the image at which the additional information signpost is to be displayed was taken, so that the input additional information is displayed only at a specific location.

[0070] In addition, the server 100 can display the location of additional information set in the 3D tour on the plan view, which will be described in detail with reference to the following drawings.

[0071] Additionally, the processor (110) may be designated by various names, such as a CPU, a mobile processor, etc., depending on the implementation of the server (100).

[0072] The memory (120) may be implemented in any form of storage device in which a program can be stored and which can be accessed by a processor to run the program. Depending on the hardware implementation, the memory (120) may be implemented in more than one storage device. The memory (120) may also include not only a primary storage device but also a temporary storage device. The memory (120) may also be implemented in a volatile memory or a non-volatile memory, and may be defined to include all forms of information storage means implemented in which a program can be stored and run by a processor.

[0073] Additionally, the server (100) may be implemented in a variety of ways, such as a web server, a computer, a mobile phone, a tablet, a TV, a set-top box, etc., depending on the embodiment, and may be defined to include any type of data processing device capable of performing the functions defined in this specification.

[0074] Depending on the embodiment, the server 100 may further include various peripheral devices (e.g., peripheral device-1 131 through peripheral device-N 139). For example, the server 100 may further include peripheral devices such as a 360-degree camera, a keyboard, a monitor, a graphics card, a communication device, etc.

[0075] The 3D tour additional information display method executed by the server (100) will be specifically described below.

[0076] FIG. 3 is a flow chart illustrating a method for adding and displaying additional information in a 3D tour according to an embodiment of the present invention.

[0077] Referring to FIG. 3, in a 3D tour additional information display method for expressing additional information in 3D within a 3D tour according to an embodiment of the present invention, first, a server (100) provides a 3D tour of a specific space to a user terminal (200) (S110).

[0078] Next, the server (100) receives coordinate information for the start point and end point of the additional information signpost (S120). At this time, the user can specify a specific point on the 3D tour displayed on the user terminal (200) as the start point or end point.

[0079] For example, the server 100 may provide a menu for adding additional information through mouse click or touch input within the 3D tour. The user may input the start and end points of the additional information signpost by selecting the Add Additional Information menu. In this case, the Add Additional Information menu may be provided in various modified forms, such as being replaced with an Add Additional Information button in the list view window of the tool.

[0080] In addition, the start point and end point of the additional information signpost can be derived by the server (100) using a line connecting two points on the 3D tour input from the user terminal (200). At this time, one end of the line input by the user can be set as the start point, and the other end of the line can be set as the end point.

[0081] On the other hand, when only one point is input from the user terminal (200), the server (100) can set the input point as the end point and set a point on the floor or wall surface located at the shortest distance from the input point as the start point.

[0082] At this time, the coordinate information of the start point and end point of the additional information signpost can be stored in the form of three-dimensional spatial coordinates.

[0083] Additionally, the end points of the additional information signposts can be displayed in various shapes within the 3D tour, for example, the end points of the additional information signposts can include various variations such as circles, triangles, squares, and the like.

[0084] Next, the user sets the additional information to be inserted through an additional information setting interface (S130). At this time, the user can set the color, title, content, etc. of the additional information signpost through the additional information setting interface, and can insert various types of additional information (e.g., photo, video, URL, etc.). At this time, a pop-up window for setting the additional information can be automatically displayed after the start point and end point of the additional information signpost are specified, or can be displayed when the created additional information signpost is clicked. However, this is merely an example, and the present invention is not limited thereto.

[0085] Next, the server (100) creates an additional information signpost using the coordinate values ​​of the start point and the end point, and displays the created additional information signpost on the 3D tour (S140). At this time, the input start point and end point can be connected to each other and expressed as a 3D-shaped additional information signpost on the 3D tour. In addition, the additional information set on the additional information signpost can be separately displayed near the additional information signpost.

[0086] Next, the server (100) displays an additional information icon on the floor plan corresponding to the position where the additional information signpost was added on the 3D tour (S150). At this time, the server (100) can display an additional information icon for the additional information signpost added on the floor plan by converting the three-dimensional coordinates of the added additional information signpost into two-dimensional coordinates. The additional information icon can be displayed as a different icon (e.g., a photo icon or a video icon, etc.) depending on the form of the additional information.

[0087] The following describes in detail the setting interface for additional information provided by the server (100).

[0088] 4 and 5 are diagrams illustrating an additional information setting interface provided in a system for displaying additional information of a 3D tour according to an embodiment of the present invention.

[0089] Referring to FIG. 4, a user can set a start point (SP) and an end point (EP) through an additional information setting interface.

[0090] For example, when a user selects a specific position within a 3D tour, the start point (SP) of an additional information signpost is set within the 3D tour.

[0091] Subsequently, when the user selects another specific position, the end point (EP) of the additional information signpost is set within the 3D tour. At this time, the start point (SP) and end point (EP) of the additional information signpost (M1) can be stored in the server (100) in the form of 3D coordinates.

[0092] Next, when the start point (SP) and end point (EP) of the additional information signpost are set, a body part (BD) connecting the two points is created, thereby allowing the additional information signpost (M1) to be represented in 3D format on a 3D tour.

[0093] In addition, a first mark (MS) is displayed on the floor surface corresponding to the start point (SP) of the created additional information signpost (M1), and a second mark (ME) is displayed on the floor surface corresponding to the end point (EP). The first mark (MS) and the second mark (ME) are additional displays to clarify the position of the additional information signpost on the 3D tour, and can be omitted by a predetermined setting value.

[0094] However, the above method of inputting the start point (SP) and end point (EP) is merely one example, and the selection of the start point (SP) and end point (EP) can be set through various modifications, such as mouse click or drag, continuous touch input, additional menu input of additional information, etc.

[0095] Referring to Fig. 5, after the user sets the start point (SP) and end point (EP), the additional information setting popup (SB) can be executed. However, this is only one example of a method of displaying the additional information setting popup (SB), and the additional information setting popup (SB) can be implemented in various ways, such as being displayed by right-clicking the mouse or by clicking the additional information signpost.

[0096] The additional information setting popup (SB) may include a signpost color box (CB), a character input box (TB) and an additional information addition box (IB).

[0097] Specifically, the color box (CB) of the signpost can specify the color of the end point (EP) of the additional information signpost. When the user clicks on the color he or she wants to specify, the color of the end point (EP) of the additional information signpost can change to the color specified by the user. In this case, the color box (CB) of the signpost contains a variety of colors (e.g., red, yellow, green, sky, blue, purple, etc.), and the colors contained in the color box (CB) of the signpost can be arranged in various ways.

[0098] The title and description of the additional information signpost can be entered in the text input box (TB). When the user enters the title and description, the entered title and description are inserted into the additional information signpost and can be displayed in a separate message window on one side of the additional information signpost.

[0099] The additional information box (IB) can specify various types of additional information to be added. For example, a user can add a photo, video, URL link, etc. through the additional information box (IB).

[0100] That is, the user can add specific additional information to the additional information signpost and display it through the additional information setting popup (SB).

[0101] As a result, the 3D tour additional information display system according to the present invention allows the user to set additional information signposts at arbitrary positions, and can display various additional information as intended by the user.

[0102] FIG. 6 is a diagram illustrating an example in which additional information added to a 3D tour is displayed in a system for displaying 3D tour additional information according to an embodiment of the present invention.

[0103] Referring to FIG. 6, the additional information signpost set by the user can be seen at various positions within the 3D tour.

[0104] for example, <a1>indicates the additional information signpost seen from the first point, <a2>indicates the additional information signpost seen from the second point, <a3>indicates the additional information signpost as seen from the third point. Here, the first to third points indicate different image capture points.

[0105] <a1> 、 <a2> 、 <a3>By referring to this, users can check the location and content of pre-entered additional information signposts at multiple locations within the 3D tour, and the shape of the additional information signpost can be displayed differently depending on the angle.

[0106] In other words, the additional information signpost can be set to three-dimensional coordinates within a 360-degree image specified by the user and displayed in 3D format. Therefore, the additional information signpost can be displayed with its size and angle changed according to the user's position and field of view.

[0107] The method for setting an image that allows the server (100) to confirm additional information signposts will be described in detail below.

[0108] FIG. 7 is a diagram illustrating a function of displaying added additional information only at a specific image shooting location in a 3D tour additional information display system according to an embodiment of the present invention.

[0109] Referring to Fig. 7, a user can input various additional information through the additional information setting interface described with reference to Fig. 5. In addition, the user can select a 360-degree image on which the input additional information signpost is to be displayed from among a plurality of image shooting points included in the 3D tour through the additional information setting interface.

[0110] Specifically, when a user selects an image selection button (SV) provided in the additional information setting interface, a pop-up window (PB) is started in which multiple 360-degree images included in the 3D tour are arranged.

[0111] The graphic box (GB) in the pop-up window (PB) can display multiple 360-degree images included in the 3D tour. The user can select a specific 360-degree image to be displayed on the selected additional information signpost from the multiple 360-degree images displayed in the graphic box (GB). This allows the user to set the set additional information signpost to be displayed only at a specific image shooting location. Thereafter, the additional information signpost can express various intentions of the user by displaying only the shooting location of the selected image.

[0112] As a result, the 3D tour additional information display system according to the present invention can improve user convenience by selecting a specific 360-degree image for which a 3D additional information signpost is to be displayed and displaying the 3D additional information signpost only in the specific image, thereby enabling the user to check additional information at various positions within the 3D tour. Also, the present invention can clearly convey the user's intention for displaying additional information.

[0113] FIG. 8 is a diagram illustrating another example of how additional information added to a 3D tour is displayed in the 3D tour additional information display system according to an embodiment of the present invention.

[0114] Referring to FIG. 8, when a user inputs only one point on a 3D tour, the 3D tour additional information display system can create an additional information signpost by setting the input point as the end point and setting the point on the floor or wall that is the shortest distance from the input point as the start point.

[0115] for example, <b1>Referring to the above, an additional information signpost created by inputting one point can be set in a direction extending upward from the floor. That is, the additional information signpost can be formed to extend vertically from the floor. In this case, the floor can be set as the starting point of the additional information signpost by default, or can be positioned closer to the input point than the surrounding walls.

[0116] Then, the user can select the created additional information signpost to enter an additional information setting interface and input specific additional information.

[0117] After the input of additional information is completed, when another user clicks on the additional information signpost (M2), the additional information window (IM2) (e.g., a photo) set by the person who input the additional information can be displayed on one side of the additional information signpost.

[0118] As another example, <b2>Referring to the above, the 3D additional information signpost can be set to extend vertically from the wall. In other words, the additional information signpost can be formed to extend horizontally from the wall. In this case, the wall can be set as the starting point of the additional information signpost, or it can be positioned closer to the input point than the surrounding floor.

[0119] Similarly, the user can select the created additional information signpost to enter the additional information setting interface and input specific additional information.

[0120] In addition, when another user clicks on the additional information signpost (M3) after inputting additional information, the additional information window (IM3) (e.g., memo) set by the user who inputted the additional information can be displayed on one side of the additional information signpost.

[0121] Also, <b1>and <b2>can correspond to the preset basic shape of the additional information signpost. If the user inputs additional information on the floor plan, the additional information signpost will be <b1>or <b2>It can be expressed as:

[0122] A method for displaying additional information on a plan view in a 3D tour additional information display system will be described below.

[0123] FIG. 9 is a plan view showing an icon for added additional information displayed in a 3D tour additional information display system according to an embodiment of the present invention.

[0124] Referring to FIG. 9, an icon of an additional information signpost set by the user can be displayed on a floor plan (FP) included in the 3D tour.

[0125] When a user places an additional information signpost within a 3D tour, the server (100) can convert the 3D coordinates into 2D coordinates.

[0126] The server (100) can then display an icon (e.g., a photo icon, a video icon, a text icon) according to the type of additional information at a point (e.g., MC1, MC2, MC3) on the floor plan (FP) corresponding to the position where the additional information signpost in the 3D tour is set. The user can check the previously input additional information on the floor plan (FP) by clicking on the icon.

[0127] In addition, when a user sets additional information in the floor plan (FP), an additional information marker can be created on the 3D tour to correspond to the position where the additional information is set in the floor plan (FP).

[0128] Additional information added in the floor plan (FP) can be formed into a corresponding additional information signpost in the 3D tour. In this case, the start point (SP) and end point (EP) of the additional information signpost can be set automatically. The additional information signpost can be created with the start point (SP) set to a specific plane (e.g. wall, floor, etc.) that is closest to the position set in the floor plan (FP). In addition, the end point (EP) of the additional information signpost can be set to a preset height that is perpendicular to the specific plane and has the shortest distance from the start point (SP).

[0129] At this time, the created additional information signpost is, as described above with reference to FIG. 8, classified according to the degree of adjacency with the floor or wall. <b1>or <b2>It can be formed in the form of:

[0130] In summary, the 3D tour additional information display system of the present invention can improve user convenience by automatically creating additional information markers within the 3D tour that correspond to the positions where additional information is displayed on the floor plan within the 3D tour.

[0131] FIG. 10 is a flow chart illustrating a method for displaying additional information of a 3D tour according to another embodiment of the present invention.

[0132] 10, in the method for displaying additional information on a 3D tour according to an embodiment of the present invention, the server (100) first creates a project (S210). Within the created project, the user can perform operations of shooting a 3D tour and inserting additional information on a floor plan.

[0133] In this case, the work of shooting the 3D tour and the work of inserting additional information into the floor plan can be performed sequentially by one user in the same project, or simultaneously by two or more users.

[0134] For example, the 3D photography work can be performed by a first user and the additional information insertion work can be performed by a second user different from the first user, and then the 3D photography work and the additional information insertion work performed by the different users can be integrated into the same project after the work is completed.

[0135] Next, the server (100) shoots a 3D tour (S220). At this time, a 3D tour shooting screen for a specific space and a floor plan of the specific space can be simultaneously displayed on a divided screen. Since the 3D tour shooting screen and the floor plan screen are displayed on the divided screen, the user can insert various types of additional information on the floor plan while shooting the 3D tour.

[0136] In addition, the server (100) provides the user terminal (200) with an interface having a button for adding additional information in the photographed image or plan view. When the user touches the button, an interface for inserting additional information can be provided to the user terminal (200). That is, the user can enter the step of inserting additional information by clicking or touching the button for inserting additional information.

[0137] Next, when the user specifies a position on the floor plan, the server (100) inserts the additional information at the selected position (S230). At this time, the user can specify the insertion position of the additional information by clicking or touching the floor plan.

[0138] Next, when the insertion position of the additional information is specified, the server (100) displays an interface for inserting the additional information on the screen. The user can input various types of additional information (e.g., memos, photos, etc.) through the interface for inserting the additional information.

[0139] Next, the server (100) combines the input additional information with the 3D tour and the floor plan (S240). At this time, the server (100) can extract the two-dimensional position coordinates of the additional information inserted into the floor plan through tracking. Then, the extracted two-dimensional coordinates are converted into three-dimensional coordinates, so that the position of the additional information signpost displayed in the 3D tour can be automatically set.

[0140] Next, the server 100 displays the 3D tour and the input additional information on the plan view together (S250). At this time, the server 100 can display the additional information inserted in the 3D tour as a 3D-type additional information signpost within the 3D tour.

[0141] The following describes in detail how to capture and tag additional information in the additional information tagging interface in the server 100.

[0142] FIG. 11 is a diagram illustrating a method of photographing a space in a system for displaying additional 3D tour information according to another embodiment of the present invention.

[0143] Referring to FIG. 11, the server (100) can proceed with the shooting of a 3D tour of a space and the insertion of additional information in a floor plan within the same project.

[0144] The server (100) can provide a floor plan (GP) on a first screen (D1) and a 3D tour of the space on a second screen (D2) via a split screen.

[0145] At this time, the user can check his / her current location via the position setting point (AP) on the plan view (GP) in the first screen (D1).

[0146] In addition, the user can take pictures of the space through the second screen (D2). The user can start taking pictures to create a 3D tour by selecting the record button (B1) at the bottom of the 3D tour shooting screen (TP) on the second screen (D2).

[0147] Specifically, when a user selects the record button (B1), a 360-degree camera module (not shown) connected to the server (100) can perform a 360-degree shooting operation at the corresponding position to create a 3D tour. At this time, the 360-degree camera module (not shown) can continuously create 360-degree images at a certain distance or time interval. Then, the server (100) can create a 3D tour by mapping the multiple captured 360-degree images and the moving path. However, this is merely an example, and the method of creating a 3D tour of the 360-degree camera module (not shown) during 3D shooting can be implemented in various modified forms.

[0148] The 360-degree image created by the 360-degree camera module (not shown) is temporarily stored in the 360-degree camera module (not shown) and can be transmitted to the server (100) when the user ends the shooting. For example, the user can end the shooting by selecting the record button (B1) again while shooting. When the shooting ends, the 360-degree image stored in the 360-degree camera module (not shown) can be transmitted to the server (100).

[0149] In addition, the server (100) can extract the user's movement route through tracking technology. When the 3D tour shooting process in the second screen (D2) is viewed, a plurality of feature points (PM) can be displayed in the 3D tour shooting screen (TP).

[0150] After extracting a plurality of feature points (PM), the server (100) can calculate the movement direction and distance of the feature points (PM) due to changes in the captured image of the user. The server (100) can then use the extracted information to calculate the movement path of the user terminal (200). The calculated movement path can be displayed on the plan view (GP) in the first screen (D1).

[0151] For example, the server (100) can set the location of the 3D tour photographed the second time by the user as the second shooting location (P2), the location of the 3D tour photographed the third time as the third shooting location (P3), and the location of the 3D tour photographed the fourth time as the fourth shooting location (P4) via the feature point (PM).

[0152] Next, the server (100) can display the second photographing point (P2), the third photographing point (P3), and the fourth photographing point (P4) on the plan view (GP) and express the movement route of the user terminal (200) with a line. At this time, the server (100) can extract the photographing ranges of the first photographing point, the second photographing point, the third photographing point, and the fourth photographing point and display them on the plan view (GP).

[0153] Furthermore, the 3D tour shooting distance (TD) can be displayed on the 3D tour shooting screen (TP) in the second screen (D2). Here, the 3D tour shooting distance (TD) can indicate the movement distance of the user terminal (200) extracted via the feature points (PM).

[0154] When additional information to be inserted occurs while the user is shooting a 3D tour, the user can switch the screen to an additional information insertion interface by selecting a specific point in the floor plan in the first screen (D1). The additional information insertion interface will be described in detail with reference to Figures 12 and 13. In addition, the tracking system will be described in detail with reference to Figures 16 and 17.

[0155] A method for inserting additional information through an interface for inserting additional information provided by the server 100 will now be described in detail.

[0156] FIG. 12 is a diagram illustrating an example of an interface for inserting additional information according to another embodiment of the present invention.

[0157] 12, a user can select a specific point (TP) on the floor plan displayed on the screen, where the specific point (TP) indicates a location where additional information is to be added.

[0158] Next, the server (100) displays an additional information insertion interface (IP) on the screen of the user terminal (200).

[0159] Next, the user can specify the type of additional information (eg, photo, video, writing, etc.) via the additional information insertion interface (IP).

[0160] For example, the additional information insertion interface (IP) may include a video capture button (RB), a picture capture button (CB) and a media upload button (UB).

[0161] When the user selects the video capture button (RB), the additional information insertion interface (IP) switches to a video capture mode, which allows the captured video to be inserted into the floor plan as additional information.

[0162] The user can also select the image capture button (CB) to capture an image and insert the captured image into the floor plan as additional information. The user can also select the media upload button (UB) to insert various types of additional information that have been input and saved in a device including the user's terminal (200) or an Internet server (not shown) into the floor plan. The user can also insert related notes into the floor plan as additional information by inputting text into a memo input box (TB) included in the additional information insertion interface (IP).

[0163] Next, the user can select the insert button (SB) to complete the insertion of the additional information. The inserted additional information can be displayed in the form of an icon (TI) on the plan view. Here, the shape of the icon (TI) can be displayed in different forms depending on the type of additional information.

[0164] The additional information insertion interface (IP) shown in the drawing is merely an example, and the interface for inputting additional information can be implemented in various modified forms.

[0165] As a result, the server 100 of the present invention enables the user to simultaneously shoot a 3D tour and insert additional information into a plan view, eliminating the inconvenience of having to separately input related additional information after shooting a 3D tour.

[0166] FIG. 13 is a plan view showing an icon of additional information inserted through the additional information insertion interface of FIG.

[0167] Referring to Fig. 13, the server (100) can display an icon of additional information inserted by the user in the floor plan. The user can specify any position in the floor plan and insert various types of additional information (e.g., photos, videos, notes, etc.) to store a lot of additional information in the floor plan. An icon indicating the position of the additional information inserted on the floor plan can be displayed.

[0168] At this time, the icon pattern displayed on the floor plan can be displayed in various forms depending on the type of information. For example, if a user takes a picture or inserts a saved image through the additional information insertion interface, a photo icon (T1) can be displayed on the floor plan. Also, if a user inserts additional information in the form of a video, a video icon (T2) can be displayed on the floor plan, and if additional information in the form of text is inserted, a text icon (T3) can be displayed.

[0169] However, the present invention is not limited to this, and the icon of the additional information can be displayed in various shapes and images, and various modifications can be made, such as the user directly specifying or creating the shape of the icon.

[0170] The method of displaying 3D tour additional information according to the present invention allows the user to grasp the location of the inserted additional information at a glance by displaying the location of the inserted additional information as an icon on a floor plan within the 3D tour.

[0171] 14 and 15 are diagrams for explaining how a plan view and a 3D tour are combined to display additional information in a 3D tour additional information display system according to another embodiment of the present invention.

[0172] The server (100) can express the additional information inserted in the plan view together with the 3D tour by compositing the additional information with the 3D tour. The user can check the content of the additional information set by the user on the plan view within the 3D tour.

[0173] 14, the server 100 can express various types of additional information in the plan view, and can display the position of the additional information inserted by the user on the plan view of the 3D tour.

[0174] for example, <c1>2, a plurality of additional information icons, such as a first additional information icon (IP11) and a second additional information icon (IP12), can be displayed on the first plan view (GP1) of the first tour (T1) at the positions where the respective additional information is inserted. When the user selects the first additional information icon (IP11) on the first plan view (GP1), an additional information display window (GI1) including an additional information image can be displayed.

[0175] <c2>2, on the second floor plan (GP2) of the second tour (T2), a plurality of additional information icons such as a third additional information icon (IP21) and a fourth additional information icon (IP22) can be displayed at the position where the user inserted the additional information. When the user selects the third additional information icon (IP21) on the floor plan (GP2), an additional information display window (GI2) including a video inserted as additional information can be displayed.

[0176] <c3>2, a plurality of additional information icons including a fifth additional information icon (IP31) and a sixth additional information icon (IP32) can be displayed on the third floor plan (GP3) of the third tour (T3). When the user selects the first part information icon (IP31) on the floor plan (GP3), an additional information display window (GI3) including text inserted by the user can be displayed.

[0177] Referring to FIG. 15, the server (100) can display additional information inserted in the floor plan in the form of additional information signposts in the 3D tour.

[0178] At this time, the server (100) can extract the position of the additional information inserted in the plan view using tracking, and then create and insert an additional information signpost at the corresponding position.

[0179] Specifically, the server (100) can extract a plurality of feature points from images captured during the 3D tour shooting process. The server (100) can then calculate the movement direction and distance of the feature points due to changes in the captured image through the feature points, and extract position coordinates of the additional information based on the calculated movement direction and distance. At this time, the position coordinates of the extracted additional information can be configured as two-dimensional coordinates.

[0180] The server (100) can then convert the two-dimensional coordinates of the extracted additional information into three-dimensional coordinates on the 3D tour.

[0181] The server (100) can then use the converted three-dimensional coordinates to map the additional information entered onto the 3D tour.

[0182] The server (100) can then display the 3D additional information signpost at the mapped location within the 3D tour.

[0183] In this case, the starting point of the 3D additional information signpost may be located on an adjacent plane (e.g., a floor or a wall). Also, the end point of the additional information signpost may be set at a predetermined height from the starting point. The 3D additional information signpost may be displayed in the 3D tour in the form of a straight line connecting the starting point and the end point. However, the present invention is not limited thereto, and the shape of the additional information signpost may include various modifications such as a curve, a circle, etc.

[0184] For example, multiple additional information icons including a first additional information icon (IP1), a second additional information icon (IP2), a third additional information icon (IP3) and a fourth additional information icon (IP4) can be displayed on the floor plan (GP1) in the 3D tour screen (TD).

[0185] Next, the server (100) can extract the position coordinates of the additional information in the plan view through feature point extraction, and convert the extracted two-dimensional coordinates into three-dimensional coordinates to select the insertion position of the additional information in the 3D tour.

[0186] The server (100) can then create and display additional information signposts corresponding to the additional information inserted into the 3D tour.

[0187] At this time, the additional information signposts on the 3D tour screen (TD) can correspond to the positions of the additional information icons on the floor plan.

[0188] For example, when looking at the first information signpost (IS1), the plane of the desk, which is the plane closest to the selected position, can be set as the starting point. Also, the point corresponding to the first additional information icon (IP1) is set as the end point, and the additional information signpost can be displayed by connecting the starting point and the end point.

[0189] Also, the second additional information signpost (IS2) can be displayed with the top surface of the partition, which is the plane closest to the position where the second additional information signpost (IS2) is selected, as the starting point. Also, the second additional information signpost (IS2) can be set by connecting the starting point and the ending point, with the point corresponding to the position coordinates of the second additional information icon (IS2) set as the ending point.

[0190] Also, the third additional information signpost (IS3) can be set as starting point to the side of the box on the bookshelf, which is the plane closest to the position of the third additional information icon (IS3) on the floor plan (GP1).Then, the third additional information signpost (IS3) can be displayed by setting the point corresponding to the position coordinates of the third additional information icon (IS3) as the end point and connecting the start point and the end point.

[0191] Also, the fourth additional information signpost (IS4) can be displayed with the floor surface, which is the flat surface closest to the selected position, as the starting point.The fourth additional information signpost (IS4) can then be displayed with the point corresponding to the position coordinates of the fourth additional information icon (IP4) as the ending point, and can be displayed by connecting the starting point and the ending point.

[0192] The tracking method for extracting the position coordinates of the additional information executed by the server 100 will be described in detail below.

[0193] 16 and 17 are diagrams illustrating a tracking method performed in a system for displaying additional 3D tour information according to another embodiment of the present invention.

[0194] 16, the server (100) can extract the position coordinates of the additional information in the floor plan using a tracking function. Here, the tracking function is a function for extracting the movement of the user terminal (200) when the user shoots a video.

[0195] When the tracking function is implemented, feature points (PM) can be extracted from the video being captured while the video is being captured.

[0196] Next, the server (100) can calculate the movement direction and distance of the feature points (PM) due to changes in the captured image via the extracted feature points (PM). This allows the server (100) to calculate the positional change and directional change of the additional information. The server (100) can also calculate the movement distance (TD) and display it on the 3D tour capture screen.

[0197] The server (100) can then refer to the extracted location change information to calculate the current location coordinates.

[0198] The server (100) can then use the calculated position coordinates to display the additional information inserted on the floor plan in the form of a 3D additional information signpost at the corresponding position in the 3D tour.

[0199] Referring to FIG. 17, the server (100) can divide the screen of the user terminal (200) and display a plan view (GP) on one side and a 3D shooting screen (TP) on the other side.

[0200] Specifically, a first area (D1) of the user terminal (200) may be provided with a floor plan (GP), and a second area (D2) may be provided with a 3D shooting screen (TP) for shooting a 3D tour of a specific space. In this case, the floor plan (GP) may correspond to a floor plan of the specific space in which the 3D tour is shot.

[0201] When the user takes a photograph through the second area (D2), feature points (PM) can be extracted from the photographed image. The server (100) can extract the coordinates of the current location of the user terminal (200) using the extracted feature points (PM).

[0202] Next, when the coordinates of the current position of the user terminal (200) are extracted, the server (100) can display the position (AP) of the user terminal (200) currently being photographed on the floor plan (GP) of the first screen (D1). In addition, the first photographing point (P1) and the second photographing point (P2) can be displayed on the floor plan (GP) using the position coordinates of the photographing viewpoint, and the movement direction can be indicated by linking multiple photographing points. In addition, the movement path (MP) traveled by the user terminal (200) can be displayed on the floor plan (GP).

[0203] As a result, the 3D tour additional information display system of the present invention automatically displays additional information inserted on the floor plan in the form of an additional information signpost at a corresponding position in the 3D tour, allowing the additional information inserted by the user to be displayed together in the floor plan and the 3D tour, thereby improving user convenience.

[0204] Although the present invention has been described above with reference to the limited embodiments and drawings, the present invention is not limited to the above embodiments, and various modifications and variations are possible from such descriptions by those skilled in the art to which the present invention pertains. Therefore, the concept of the present invention should be understood only by the claims set forth below, and all equivalent or similar modifications are considered to fall within the scope of the concept of the present invention. [Explanation of symbols]

[0205] 100 Servers 110 Processor 120 Memory < / a2> < / a1>

Claims

1. A 3D tour additional information display method performed by a 3D tour management server linked to a user terminal, comprising: simultaneously displaying a floor plan and a 3D tour photography interface for a specific space on the user terminal; receiving a photographed image of a 3D tour of the specific space from the user terminal; receiving additional information through the user terminal during the 3D tour shooting process; synthesizing the 3D tour and the input additional information; displaying the additional information on the 3D tour or the floor plan; The step of synthesizing the 3D tour and the input additional information includes: extracting position coordinates of the additional information to be added to the plan view using feature points extracted in the 3D tour based on changes in the captured images of the 3D tour; The method further comprises the step of mapping the input additional information to the extracted position coordinates.

2. The step of extracting the position of the additional information includes: Extracting a plurality of the feature points on the captured image of the 3D tour; and calculating a moving direction and distance of the feature point due to a change in the photographed image and extracting position coordinates of the additional information based on the calculated moving direction and distance. The 3D tour additional information display method according to claim 1.

3. The position coordinates of the extracted additional information are configured as two-dimensional coordinates, The step of mapping the additional information to the extracted position coordinates includes: converting the position coordinates of the extracted additional information into three-dimensional coordinates on the 3D tour; mapping the additional information onto the floor plan using the two-dimensional coordinates, and mapping the additional information onto the 3D tour using the three-dimensional coordinates. The 3D tour additional information display method according to claim 1.

4. The step of receiving the additional information includes: receiving an input of a specific position on the plan view where the additional information is to be inserted during shooting of the 3D tour; receiving an input of additional information to be inserted at the specific position via an additional information insertion interface; The 3D tour additional information display method according to claim 1.

5. The 3D tour shooting process is displayed on one side of the screen of the user terminal, The floor plan is displayed on the other side of the screen of the user terminal; The step of receiving the input of the specific location includes receiving location information selected by a user on the floor plan.

5. The 3D tour additional information display method according to claim 4.

6. The additional information insertion interface includes: Select one of the information types, namely, memo, photo, video, and internet link, and receive input of additional information corresponding to the selected information type; 5. The 3D tour additional information display method according to claim 4.

7. The step of displaying the additional information includes: displaying an additional information icon at an insertion position of the additional information on the plan view; displaying a 3D additional information signpost corresponding to the additional information icon on the 3D tour. The 3D tour additional information display method according to claim 1.

8. The 3D additional information signpost is: a starting point located on a floor or wall of the 3D tour; an end point corresponding to the position of the additional information icon; A body portion that connects the start point and the end point. The 3D tour additional information display method according to claim 7.

9. A processor; A memory in which a program executed by the processor is stored; The program is An operation of simultaneously displaying a floor plan and a 3D tour photography interface for a specific space on a user terminal; receiving from the user terminal images of a 3D tour of the particular space; an operation of receiving additional information simultaneously with the 3D tour shooting through the user terminal during the 3D tour shooting; an operation of combining the 3D tour with the input additional information; displaying the additional information on the 3D tour or the floor plan; The operation of synthesizing the 3D tour and the input additional information includes: an operation of extracting position coordinates of the additional information to be added to the plan view by using feature points extracted within the 3D tour based on changes in the captured images of the 3D tour; A 3D tour additional information display system including an operation of mapping the input additional information to the extracted position coordinates.

Images