Augmented reality display device, server device, augmented reality display system, augmented reality display method, and program

Abstract

An augmented reality display device according to the present invention includes a display unit, an image analyzing unit that detects shooting-object features in which a feature point of a shooting object included in image data is quantified, and a control unit. The control unit transmits, to a server device, posting download instruction information that includes shooting position information relating to a position at which the image data was shot and the shooting-object features, and on the basis of information relating to posting data related to the shooting position information and the shooting-object features transmitted from the server device, displays the posting data overlaid on the display unit, at a position relative to the shooting-object features in the image data displayed on the display unit. The position relative to the shooting-object features is a position based on positing position information that is included in the information related to the posting data (FIG. 13).

Description

Technical Field

[0001] [Description of Related Applications] This invention is based on the claim of priority of Japanese Patent Application: Japanese Patent Application No. 2021-189898 (filed on November 24, 2021), and the entire description of the application is incorporated herein by reference. The present invention relates to an augmented reality display device, a server device, an augmented reality display system, an augmented reality display method, and a program.

Background Art

[0002] There is an information sharing service using augmented reality (AR: Augmented Reality) technology that overlays related posted data (photos, text, etc.) on a predetermined position in a real image captured by a camera of a mobile terminal (e.g., a smartphone). In an information sharing service using AR technology, the mobile terminal transmits current position information by GPS (Global Positioning System) or the like and orientation information by an orientation sensor or the like to a server device, and acquires posted data posted around the current position information and the orientation information from the server device, and overlays and displays the posted data at a designated position (the designated position set for the posted data) in the image captured by the camera (for example, see Patent Documents 1 to 3).

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Patent Document 2

Patent Document 3

Summary of the Invention

Problems to be Solved by the Invention

[0004] Furthermore, the disclosures in the above-mentioned prior art documents are incorporated herein by reference. The following analysis was conducted by the inventors.

[0005] In the information sharing services using AR technology described in Patent Documents 1 to 3, the accuracy of the location measured by the GPS of the mobile device made it difficult to display posted data at the precise location of a specific object (for example, a server in a room) in an image captured by the mobile device's camera. For example, if there are two adjacent rooms in an office building, each containing the same type of server A and server B, an image showing only the servers would not allow for identification of whether the server in the image is server A or server B, and posted data intended for server A might be displayed around server B. In other words, the information sharing services using AR technology described in Patent Documents 1 to 3 may not be able to display posted data at the precise location, potentially preventing users from obtaining the information they want.

[0006] The main objective of the present invention is to provide an augmented reality display device, a server device, an augmented reality display system, an augmented reality display method, and a program that can contribute to displaying posted data at the precise location in a captured image. [Means for solving the problem]

[0007] The augmented reality display device relating to the first viewpoint comprises a display unit configured to display information, an image analysis unit configured to analyze image data and detect object feature quantities that quantify the feature points of the object being photographed included in the image data, and a control unit configured to control the display unit and the image analysis unit and to perform predetermined information processing. The control unit is configured to perform the following processes: transmit to a server device post download instruction information including shooting location information relating to the location where the image data was photographed and the object feature quantities; and, based on information about post data related to the shooting location information and the object feature quantities transmitted from the server device, display the post data on the display unit superimposed on the image data displayed on the display unit at a position relative to the object feature quantities, wherein the position relative to the object feature quantities is a position based on the post location information included in the information about the post data.

[0008] The server device relating to the second viewpoint includes a storage unit configured to store in association information the following: shooting location information relating to the location where the image data was taken; shooting object feature quantities, which are numerical representations of the feature points of the object being photographed included in the image data; and posting location information relating to the relative position to the shooting object feature quantities. The control unit is configured to control the storage unit and perform predetermined information processing. The control unit is configured to read the information relating to the posting data, which includes the shooting location information and the shooting object feature quantities included in the posting download instruction information, from the storage unit and transmit it to the augmented reality display device when it receives posting download instruction information from the augmented reality display device.

[0009] The augmented reality display system relating to the third viewpoint comprises an augmented reality display device relating to the first viewpoint and a server device relating to the second viewpoint.

[0010] The augmented reality display method relating to the fourth viewpoint includes the steps of: transmitting post download instruction information from an augmented reality display device to a server device, which includes shooting location information relating to the location where the image data was taken, and shooting object feature quantities obtained by analyzing the image data and quantifying the feature points of the shooting object included in the image data; when the server device obtains the post download instruction information, it reads from the storage unit of the server device information relating to the post data included in the post download instruction information and transmits it to the augmented reality display device; and when the augmented reality display device obtains the post download instruction information, it displays the post data based on the information about the post data transmitted from the server device, superimposed on the displayed image data at a position relative to the shooting object feature quantities, wherein the position relative to the shooting object feature quantities is a position based on the post location information included in the information about the post data.

[0011] The program relating to the fifth perspective involves causing the augmented reality display device to perform the following processes: sending post download instruction information to a server device, which includes shooting location information relating to the location where the image data was taken, and shooting object feature quantities obtained by analyzing the image data and quantifying the feature points of the object being photographed included in the image data; and displaying the posted data overlaid on the displayed image data at a position relative to the shooting object feature quantities, based on the information about the posted data transmitted from the server device, wherein the position relative to the shooting object feature quantities is the position based on the post location information included in the information about the posted data.

[0012] The program relating to the sixth perspective causes the server device to execute a process in which, upon obtaining post download instruction information from the augmented reality display device, it reads from the storage unit information related to the shooting location information and the features of the object being photographed included in the post download instruction information and transmits it to the augmented reality display device. [Effects of the Invention]

[0013] According to the perspectives described in points 1 to 6 above, it is possible to contribute to displaying the posted data at the precise location in the captured image. [Brief explanation of the drawing]

[0014] [Figure 1] This is a schematic block diagram showing the configuration of the augmented reality display system according to Embodiment 1. [Figure 2] This is a schematic diagram illustrating an example of augmented reality displayed by an augmented reality display device in the augmented reality display system according to Embodiment 1. [Figure 3] This is a schematic diagram illustrating the relationship between the shooting location information and the feature quantities of the object being photographed in the augmented reality display system according to Embodiment 1. [Figure 4] This flowchart schematically illustrates the operation related to the registration of posted data in the augmented reality display system according to Embodiment 1. [Figure 5] This is a schematic transition diagram showing an example of the display screen of the augmented reality display device when registering posted data in the augmented reality display system according to Embodiment 1. [Figure 6] This is a transition diagram following Figure 5, which schematically shows an example of the display screen of the augmented reality display device when registering posted data in the augmented reality display system according to Embodiment 1. [Figure 7] This is a transition diagram following Figure 6, schematically showing an example of the display screen of the augmented reality display device when registering posted data in the augmented reality display system according to Embodiment 1. [Figure 8] This flowchart schematically illustrates the operation related to the display of posted data in the augmented reality display system according to Embodiment 1. [Figure 9] This is a schematic transition diagram showing an example of the display screen of the augmented reality display device when displaying posted data in the augmented reality display system according to Embodiment 1. [Figure 10]It is a transition diagram schematically showing an example of a display screen of a management device when deleting posted data in an augmented reality display system according to Embodiment 1. [Figure 11] It is a block diagram schematically showing the configuration of an augmented reality display system according to Embodiment 2. [Figure 12] It is a transition diagram schematically showing an example of a display screen of an augmented reality display device when linking posted data to an SNS in an augmented reality display system according to Embodiment 2. [Figure 13] It is a block diagram schematically showing the configuration of an augmented reality display device according to Embodiment 3. [Figure 14] It is a block diagram schematically showing the configuration of hardware resources.

Modes for Carrying Out the Invention

[0015] Hereinafter, embodiments will be described with reference to the drawings. In the present application, when reference numerals are attached to the drawings, they are for assisting understanding only and are not intended to be limited to the illustrated embodiments. Further, the following embodiments are merely examples and do not limit the present invention. In addition, the connection lines between blocks in the drawings and the like referred to in the following description include both bidirectional and unidirectional ones. The one-way arrow schematically shows the flow of the main signal (data) and does not exclude bidirectionality. Furthermore, in the circuit diagrams, block diagrams, internal configuration diagrams, connection diagrams, etc. shown in the present application disclosure, although not explicitly shown, input ports and output ports exist at the input ends and output ends of each connection line, respectively. The same applies to input / output interfaces. The program is executed via a computer device, and the computer device includes, for example, a processor, a storage device, an input device, a communication interface, and a display device as necessary. The computer device is configured to be able to communicate with devices inside or outside the device (including computers) via the communication interface, whether wired or wireless.

[0016] [Embodiment 1] The augmented reality display system according to Embodiment 1 will be described with reference to the drawings. Figure 1 is a schematic block diagram showing the configuration of the augmented reality display system according to Embodiment 1. Figure 2 is a schematic image diagram showing an example of augmented reality displayed by the augmented reality display device in the augmented reality display system according to Embodiment 1. Figure 3 is a schematic image diagram showing the relationship between the shooting position information and the feature quantity of the object being photographed in the augmented reality display system according to Embodiment 1.

[0017] The Augmented Reality Display System 1 is a system that displays an augmented reality image (AR image) in which relevant posted data is superimposed on a predetermined position in real-world image data (for example, image data of an object 2) displayed on augmented reality display devices 10A and 10B (see Figures 1 and 2). The Augmented Reality Display System 1 has the function of displaying posted data superimposed on an image in the image displayed on augmented reality display devices 10A and 10B at a position relative to the object features (a position based on the posted location information associated with the posted data) based on the shooting location information associated with the image data and the object features, which are numerical representations of the feature points of the object 2 in the image data (see Figure 3).

[0018] Here, the characteristic points of the object being photographed 2 include, for example, the plane, edges, and corners of the object being photographed 2. Furthermore, the numerical representation of the characteristic points includes, for example, the assignment of coordinate information such as 3D coordinate information and polar coordinate information.

[0019] The Augmented Reality Display System 1 can be used in information sharing services that allow multiple users to share AR images in real space, and can be used for purposes such as SNS (Social Networking Service), facility management, maintenance, inventory management, road information provision, and navigation. The Augmented Reality Display System 1 comprises Augmented Reality Display Devices 10A and 10B, a server device 30, a management device 40, and a network 60.

[0020] The augmented reality display devices 10A and 10B are devices that display augmented reality images (see Figure 1). The augmented reality display devices 10A and 10B are connected to the network 60 in a way that allows communication (wireless or wired communication). In Figure 1, there are two augmented reality display devices 10A and 10B, but there may be one or three or more. The augmented reality display devices 10A and 10B can be devices (computer devices) equipped with functional parts that constitute a computer (e.g., a processor, a storage device, an input device, a communication interface, and a display device) that are capable of acquiring image data associated with shooting location information. For example, smartphones, tablets, personal computers, glasses-type devices, etc., can be used. The image data can be image data captured by the imaging unit 13 of the augmented reality display devices 10A and 10B themselves, image data stored in the storage unit of the augmented reality display devices 10A and 10B themselves, or image data acquired from an external source (e.g., a remote surveillance camera, a location image provision site, etc.) via the network 60, and may also be image data associated with directional information. The shooting location information associated with the image data may be shooting location information detected by the position detection unit 15 of the augmented reality display devices 10A and 10B themselves, or shooting location information associated with the image data by another device. The augmented reality display devices 10A and 10B have a time function. By executing a predetermined program, the augmented reality display devices 10A and 10B realize a configuration comprising a communication unit 11, a display unit 12, an imaging unit 13, an image analysis unit 14, a position detection unit 15, an input unit 16, a storage unit 17, and a control unit 18.

[0021] The communication unit 11 is a functional unit that performs information communication (wired or wireless communication) (see Figure 1). The communication unit 11 is connected to the network 60 in a communicative manner. The communication unit 11 performs communication under the control of the control unit 18. The communication unit 11 may use, for example, a wireless communication interface or a wired communication interface.

[0022] The display unit 12 is a functional unit that displays information (see Figure 1). The display unit 12 displays information under the control of the control unit 18. The display unit 12 can be a display device such as a liquid crystal display or an organic EL (ElectroLuminescence) display, or a glasses-type display that is connected to the communication unit 11 in a communicative manner.

[0023] The imaging unit 13 is a functional unit that photographs the object to be photographed 2 (see Figures 1 and 2). The imaging unit 13 generates image data by photographing the object to be photographed 2. The imaging unit 13 photographs the object to be photographed 2 under the control of the control unit 18. Note that if the augmented reality display devices 10A and 10B acquire image data from an external source, the augmented reality display device 10 may be configured without the imaging unit 13. The imaging unit 13 can use image sensors such as a CCD (Charge Coupled Device) sensor and a CMOS (Complementary Metal Oxide Semiconductor) sensor, and may also incorporate a 3D sensor for feature detection (e.g., a ToF (Time of Flight) camera, stereo camera, 3D-LIDAR (Laser Imaging Detection And Ranging), depth sensor, distance sensor, distance camera, etc.). The imaging unit 13 may have a zoom lens that can take telephoto or wide-angle shots.

[0024] The image analysis unit 14 is a functional unit that analyzes image data (see Figure 1). The image analysis unit 14 acquires image data from the imaging unit 13, storage unit 17, communication unit 11 (externally connected communication unit 11), etc. The image analysis unit 14 analyzes the acquired image data and detects object feature quantities (3D coordinate information, polar coordinate information, etc.) which are numerical representations of the feature points of the object 2 included in the image data. As a method for detecting feature quantities, the image analysis unit 14 can extract feature points of the object 2 based on the image data, determine the spatial coordinates related to the image data based on the extracted feature points, and detect object feature quantities which are numerical representations of the feature points based on the determined coordinates. For example, SIFT (Scale-Invariant Feature Transform) or HOG (Histograms of Oriented Gradients) can be used.

[0025] The position detection unit 15 is a functional unit that detects information related to the current position of the augmented reality display devices 10A and 10B (imaging unit 13) (corresponding to shooting position information; for example, longitude and latitude) (see Figure 1). The position detection unit 15 may detect the shooting position information of the augmented reality display devices 10A and 10B by using, for example, GPS (Global Positioning System), radio wave strength from multiple wireless base stations with pre-set position information, or QR (Quick Response) codes with pre-set position information. In addition to detecting the shooting position, the position detection unit 15 may also detect angular information related to the direction and elevation angle of the optical axis of the imaging unit 13 using an orientation sensor, geomagnetic sensor, acceleration sensor, etc. Note that if the augmented reality display devices 10A and 10B acquire image data associated with the shooting position information from an external source, the augmented reality display devices 10A and 10B may be configured without the position detection unit 15.

[0026] The input unit 16 is a functional unit for inputting information (see Figure 1). The input unit 16 receives information entered by the user through user operation, under the control of the control unit 18. The input unit 16 can use, for example, a touch panel, keyboard, mouse, contactless UI (User Interface), gesture sensor, microphone, headset, etc. The input unit 16 receives information about posted data, information about filtering conditions, etc., through user operation (selection and specification are also possible).

[0027] Here, information related to the posted data includes, for example, user ID, visibility (group ID, etc.), posting date and time, display format (speech bubble, icon display, color, shape, etc.), text (font, font size, font color, etc.), emojis, stamps, images, video files, audio files, hashtags, and posting location information. Regarding posting location information, minor adjustments to the location are possible (for example, by operating the arrow buttons in Figure 7 (1-10)).

[0028] Furthermore, information regarding filtering conditions can include, for example, time period (e.g., posts within the last week from today), keywords (e.g., "cafe"), hashtags (e.g., "#cafedining"), distance (e.g., within 10m of the current location), user ID, age, gender, group ID, number of likes (e.g., 10 or more likes), number of comments, number of questions, etc.

[0029] The memory unit 17 is a functional unit that stores various types of information (data, programs, etc.) (see Figure 1). For example, the memory unit 17 can use storage devices such as RAM (Random Access Memory), SSD (Solid State Drive), or HDD (Hard Disk Drive). The memory unit 17 performs information writing and reading under the control of the control unit 18.

[0030] The control unit 18 is a functional unit that controls the communication unit 11, display unit 12, imaging unit 13, image analysis unit 14, position detection unit 15, input unit 16, and storage unit 17 (see Figure 1). The control unit 18 can use a processor such as a CPU (Central Processing Unit) or MPU (Micro Processor Unit). The control unit 18 can perform predetermined processing described in a program by executing a predetermined program stored in the storage unit 17.

[0031] When submitting data (registering it with the server device 30), the control unit 18 performs the following processing: The control unit 18 acquires image data from the imaging unit 13, storage unit 17, communication unit 11 (externally connected communication unit 11), etc., and displays it on the display unit 12. The control unit 18 acquires shooting location information (angle information may also be included if available) from the position detection unit 15 or the acquired image data (including shooting location information). The control unit 18 uses the image analysis unit 14 to detect the feature quantities of the object being photographed, which are numerical representations of the feature points of the object being photographed 2 based on the acquired image data, and acquires the detected feature quantities of the object being photographed. The control unit 18 acquires information related to the submitted data from the input unit 16. The control unit 18 transmits submission upload instruction information, which associates the acquired shooting location information, the feature quantities of the object being photographed, and the information related to the submitted data, to the server device 30 via the communication unit 11 and the network 60.

[0032] When displaying submitted data (including filtered display), the control unit 18 performs the following processing: The control unit 18 acquires image data from the imaging unit 13, storage unit 17, communication unit 11 (externally connected communication unit 11), etc., and displays it on the display unit 12. The control unit 18 acquires shooting location information from the position detection unit 15 or from the acquired image data (including shooting location information). The control unit 18 uses the image analysis unit 14 to detect the feature quantities of the object being photographed, which are numerical representations of the feature points of the object being photographed 2 based on the acquired image data, and acquires the detected feature quantities of the object being photographed. When filtering, the control unit 18 acquires information regarding the filtering conditions from the input unit 16. The control unit 18 transmits the submitted download instruction information (including information regarding filtering conditions if filtering is performed) containing the acquired shooting location information and feature quantities of the object being photographed to the server device 30 via the communication unit 11 and the network 60. The control unit 18 receives information about the posted data related to the shooting location information and the features of the object being photographed, which are included in the posted download instruction information transmitted from the server device 30 that received the posted download instruction information, via the network 60 and the communication unit 11. Based on the information about the posted data that it has received, the control unit 18 displays the posted data on the display unit 12, overlaid on the relative position of the features of the object being photographed in the image data displayed on the display unit 12 (the position based on the posted location information in the information about the posted data). If the control unit 18 filters the posted data after displaying it, it may also receive information about the filtering conditions from the input unit 16 and filter the displayed posted data based on the information about the filtering conditions that it has received. If the control unit 18 displays multiple posted data, it may also display the posted data offset so that they do not overlap, display the icons of the posted data in a list, or aggregate and organize the information on how many posts there were at each location and display it.

[0033] The server device 30 is a device that provides a service that provides information about posted data to be displayed overlaid on a predetermined position in the image data displayed on the augmented reality display devices 10A and 10B (see Figure 1). The server device 30 stores information about the shooting location, the features of the object being photographed, and the posted data in association with each other. The server device 30 is connected to the network 60 in a way that allows communication (wireless or wired communication). As the server device 30, a device (computer device) equipped with functional parts that constitute a server (e.g., a processor, a storage device, and a communication interface) can be used, for example, a physical server, a virtual server, a cloud server, etc. By executing a predetermined program, the server device 30 realizes a configuration comprising a communication unit 31, a storage unit 32, and a control unit 33.

[0034] The communication unit 31 is a functional unit that performs information communication (wired or wireless communication) (see Figure 1). The communication unit 31 is connected to the network 60 in a communicative manner. The communication unit 31 performs communication under the control of the control unit 33. The communication unit 31 may use, for example, a wired communication interface or a wireless communication interface. The communication unit 31 can receive upload instruction information, download instruction information, etc., from the augmented reality display devices 10A and 10B. The communication unit 31 can transmit information regarding the posted data corresponding to the download instruction information to the augmented reality display devices 10A and 10B.

[0035] The memory unit 32 is a functional unit that stores various types of information (data, programs, etc.) (see Figure 1). For example, the memory unit 32 can use storage devices such as RAM, SSD, HDD, or RAID (Redundant Arrays of Inexpensive Disks). The memory unit 32 performs information writing and reading under the control of the control unit 33. The memory unit 32 can store data from the augmented reality display devices 10A and 10B. The memory unit 32 can store data processed by the control unit 33. Data stored in the memory unit 32 can be transmitted to the augmented reality display devices 10A and 10B. The memory unit 32 can store information related to shooting location, features of the object being photographed, and posted data in association with each other.

[0036] The control unit 33 is a functional unit that controls the communication unit 31 and the storage unit 32 (see Figure 1). For example, a processor such as a CPU or MPU can be used for the control unit 33. The control unit 33 can perform predetermined information processing described in a program by executing a predetermined program stored in the storage unit 32.

[0037] When registering posted data, the control unit 33 acquires post upload instruction information from the augmented reality display devices 10A and 10B via the network 60 and the communication unit 31. The control unit 33 associates the shooting location information, the features of the object being photographed, and the information related to the posted data included in the acquired post upload instruction information and stores them in the storage unit 32. When the control unit 33 registers posted data, it may also send a notification to the augmented reality display devices 10A and 10B of followers who are following the poster (follower) of the posted data to inform them of the registration of the posted data.

[0038] When providing submitted data (including when filtered), the control unit 33 performs the following processing: The control unit 33 acquires submitted data download instruction information (including information on filtering conditions if filtering is performed) from the augmented reality display devices 10A and 10B via the network 60 and the communication unit 31. The control unit 33 acquires from the storage unit 32 information regarding submitted data that is located within a predetermined range of the location related to the shooting location information included in the acquired submitted data download instruction information and that corresponds to the feature quantities of the object being photographed included in the submitted data download instruction information. If the acquired submitted data download instruction information includes information on filtering conditions, the control unit 33 acquires from the storage unit 32 information regarding submitted data that corresponds to the filtering conditions among the information on submitted data that corresponds to the shooting location information and feature quantities of the object being photographed included in the acquired submitted data download instruction information. The control unit 33 transmits the acquired information regarding submitted data to the augmented reality display devices 10A and 10B that sent the submitted data download instruction information via the communication unit 31 and the network 60.

[0039] The management device 40 is a device used to manage information related to posted data stored in the server device 30 (see Figure 1). The management device 40 is connected to the network 60 in a way that allows communication (wireless or wired communication). The management device 40 can be a device (computer device) equipped with functional parts that constitute a computer (e.g., a processor, storage device, input device, communication interface, and display device), such as a personal computer, tablet, or smartphone. The management device 40 is used by the administrator of the server device 30. The administrator can delete user IDs, information related to posted data, etc., on an administrator-only page through the management device 40.

[0040] Network 60 is a wired or wireless communication network that enables communication between the augmented reality display devices 10A and 10B, the server device 30, and the management device 40 (see Figure 1). Network 60 can utilize communication networks such as PAN (Personal Area Network), LAN (Local Area Network), MAN (Metropolitan Area Network), WAN (Wide Area Network), and GAN (Global Area Network).

[0041] The operation of registering posted data in the augmented reality display system according to Embodiment 1 will be explained with reference to the drawings. Figure 4 is a schematic flowchart showing the operation of registering posted data in the augmented reality display system according to Embodiment 1. Figures 5 to 7 are schematic transition diagrams showing an example of the display screen of the augmented reality display device when registering posted data in the augmented reality display system according to Embodiment 1. For the configuration of the augmented reality display system, please refer to Figure 1.

[0042] First, the control unit 18 of the augmented reality display device 10A acquires image data from the imaging unit 13 and displays it on the display unit 12 in response to user operation (step A1). The image data may also be acquired from the storage unit 17, the communication unit 11 (an externally connected communication unit 11), etc.

[0043] Next, the control unit 18 of the augmented reality display device 10A acquires shooting location information from the position detection unit 15 in response to user operation (step A2). If shooting location information cannot be acquired from the position detection unit 15, the process ends. If the image data is image data acquired from the storage unit 17, communication unit 11, etc., the shooting location information contained in the image data is acquired. If the image data acquired from the storage unit 17, communication unit 11, etc. does not contain shooting location information, the process ends. In step A2, for example, if the display screen of the augmented reality display device is a display screen like that shown in Figure 5(1-1), the user taps the "Register Post" button to acquire shooting location information, and once the acquisition of shooting location information is complete, the display screen transitions to a display screen like that shown in Figure 5(1-2).

[0044] Next, the control unit 18 of the augmented reality display device 10A, in response to user operation, causes the image analysis unit 14 to detect object feature quantities, which are numerical representations of the feature points of the object 2 based on the acquired image data, and acquires the detected object feature quantities (step A3). If object feature quantities cannot be acquired, the process ends. In step A3, for example, if the display screen of the augmented reality display device is a display screen like that shown in Figure 5(1-2), tapping the screen will transition to a display screen like that shown in Figure 5(1-3), and the augmented reality display device 10A (imaging unit 13) will be moved to rotate around the side of the object 2 to acquire object feature quantities. Once the acquisition of object feature quantities is complete, the display screen will transition to a display screen like that shown in Figure 5(1-4). In acquiring object feature quantities, feature points (planes such as walls and floors, edges, corners, etc.) in the image data are detected, the coordinates of the space related to the image data are determined based on the extracted feature points, and object feature quantities, which are numerical representations of the feature points based on the determined coordinates, can be detected.

[0045] Next, the control unit 18 of the augmented reality display device 10A acquires information about the posted data from the input unit 16 in response to user operation (step A4). Examples of information about the posted data include text, photos, and posting location information (see above for details). In step A4, for example, if the display screen of the augmented reality display device is a display screen like that shown in Figure 6(1-5), tapping the "+" button transitions to a display screen like that shown in Figure 6(1-6), tapping the location where the user wants to post to set the location transitions to a display screen like that shown in Figure 6(1-7), selecting the posting screen transitions to a display screen like that shown in Figure 7(1-8), entering the posting text and tapping the "Post" button transitions to a display screen like that shown in Figure 7(1-9), tapping the "Adjust posting location" button to adjust the posting location results in a display screen like that shown in Figure 7(1-10), and tapping the "Post to this location" button allows the user to acquire information about the posted data.

[0046] Next, the control unit 18 of the augmented reality display device 10A transmits upload instruction information, which associates the acquired shooting location information, the characteristics of the object being photographed, and information about the posted data, to the server device 30 via the communication unit 11 and the network 60 in response to user operation (step A5).

[0047] Next, the control unit 33 of the server device 30 acquires the post upload instruction information from the augmented reality display device 10A via the network 60 and the communication unit 31 (step A6).

[0048] Next, the control unit 33 of the server device 30 associates the shooting location information, the characteristics of the object being photographed, and the information related to the posted data included in the acquired post upload instruction information and stores (registers) them in the storage unit 32 (step A7), and then terminates.

[0049] The operation of displaying posted data in the augmented reality display system according to Embodiment 1 will be explained with reference to the drawings. Figure 8 is a schematic flowchart showing the operation of displaying posted data in the augmented reality display system according to Embodiment 1. Figure 9 is a schematic transition diagram showing an example of the display screen of the augmented reality display device when displaying posted data in the augmented reality display system according to Embodiment 1. For the configuration of the augmented reality display system, please refer to Figure 1.

[0050] First, the control unit 18 of the augmented reality display device 10A acquires image data from the imaging unit 13 and displays it on the display unit 12 in response to user operation (step B1). The image data may also be acquired from the storage unit 17, the communication unit 11 (an externally connected communication unit 11), etc.

[0051] Next, the control unit 18 of the augmented reality display device 10A acquires shooting location information from the position detection unit 15 in response to user operation (step B2). If it is not possible to acquire shooting location information from the position detection unit 15, the process is terminated. If the image data is image data acquired from the storage unit 17, communication unit 11, etc., the shooting location information contained in the image data is acquired. If the image data acquired from the storage unit 17, communication unit 11, etc. does not contain shooting location information, the process is terminated.

[0052] Next, the control unit 18 of the augmented reality display device 10A, in response to user operation, causes the image analysis unit 14 to detect object feature quantities, which are numerical representations of the feature points of the object 2 based on the acquired image data, and obtains the detected object feature quantities (step B3). If object feature quantities cannot be obtained, the process is terminated.

[0053] Next, the control unit 18 of the augmented reality display device 10A transmits post download instruction information, which associates the acquired shooting location information and the features of the object being photographed, to the server device 30 via the communication unit 11 and the network 60 in response to user operation (step B4).

[0054] Next, the control unit 33 of the server device 30 obtains post download instruction information from the augmented reality display devices 10A and 10B (step B5).

[0055] Next, the control unit 33 of the server device 30 obtains information from the storage unit 32 regarding the post data that is located within a predetermined range of the location related to the shooting location information included in the acquired post download instruction information, and that corresponds to the feature quantity of the object being photographed included in the said post download instruction information (step B6).

[0056] Next, the control unit 33 of the server device 30 transmits information regarding the acquired post data to the augmented reality display devices 10A and 10B that sent the post download instruction information via the communication unit 31 and the network 60 (step B7).

[0057] Next, the control unit 18 of the augmented reality display device 10A acquires information regarding the posted data transmitted from the server device 30 that received the post download instruction information, via the network 60 and the communication unit 11 (step B8).

[0058] Next, the control unit 18 of the augmented reality display device 10A displays the posted data on the display unit 12, overlaid on its relative position to the feature quantities of the captured object in the image displayed on the display unit 12 (the position based on the posting location information in the information regarding the posted data) (step B9).

[0059] Subsequently, when filtering and displaying the posted data, the control unit 18 of the augmented reality display device 10A acquires information regarding the filtering conditions from the input unit 16 in response to user operation (step B10). Examples of information regarding the filtering conditions include the poster, posting date, hashtags, etc. (see above for details). In step B10, for example, if the display screen of the augmented reality display device is a display screen like Figure 9 (2-1) where multiple posted data are displayed in a reduced size, the user can acquire information regarding the filtering conditions by tapping the button for inputting the filtering conditions and entering the information regarding the filtering conditions.

[0060] Next, the control unit 18 filters and displays the displayed post data based on the acquired information regarding the filtering conditions (step B11), and then terminates. In step B11, for example, based on the acquired information regarding the filtering conditions, the system can transition from a display screen like Figure 9(2-1), where multiple post data are displayed in a reduced size, to a display screen like Figure 9(2-3), where the filtered post data is displayed in an enlarged size. Alternatively, instead of filtering, the system can transition to a display screen like Figure 9(2-3), where the tapped post data is displayed in an enlarged size, by tapping the post data that the user wants to view on a display screen like Figure 9(2-2), where multiple post data are displayed in a reduced size.

[0061] The operation of deleting posted data in the augmented reality display system according to Embodiment 1 will be explained with reference to the drawings. Figure 10 is a schematic transition diagram showing an example of the display screen of the management device when deleting posted data in the augmented reality display system according to Embodiment 1. For the configuration of the augmented reality display system, please refer to Figure 1.

[0062] When an administrator deletes posted data, the management device 40 allows the administrator to open an administrator-only page and delete the user ID, information related to the posted data, etc. For example, when the administrator-only page displays a screen like Figure 10(3-1) showing a list of icons for multiple posted data for a given user ID (JNS JNFR), the administrator can tap the icon of the posted data they want to delete, which will take them to a screen like Figure 10(3-2), then to a screen like Figure 10(3-3) where they can check the contents of the posted data, and finally, by tapping the delete button, they will be taken to a screen like Figure 10(3-4) where they can delete the posted data.

[0063] According to Embodiment 1, since the posted data is displayed overlaid on the image data using not only the shooting location information but also the features of the object being photographed, it is possible to display the posted data at the precise location in the captured image data.

[0064] Furthermore, according to Embodiment 1, by performing matching based on the shooting location information and the features of the object being photographed, the search range is limited, making it possible to quickly find the posted data that should be displayed in the displayed image data.

[0065] Furthermore, according to Embodiment 1, even when a large amount of posted data is displayed in the image data, it becomes easier to find the desired information from among the miscellaneous information by displaying it in a list or by aggregating and organizing it based on the input of information regarding filtering conditions, thereby contributing to increased customer satisfaction.

[0066] [Embodiment 2] The augmented reality display system according to Embodiment 2 will be described with reference to the drawings. Figure 11 is a schematic block diagram showing the configuration of the augmented reality display system according to Embodiment 2. Figure 12 is a schematic transition diagram showing an example of the display screen of the augmented reality display device when linked posted data with SNS in the augmented reality display system according to Embodiment 2.

[0067] Embodiment 2 is a modification of Embodiment 1, and enables the sharing of posted data between the server device 30 and the SNS device 50 by linking the posted data with an SNS (see Figure 11). In the augmented reality display system 1 according to Embodiment 2, an SNS information posting unit 34, an SNS information collection unit 35, and a posting location estimation unit 36 ​​are added to the server device 30 compared to the augmented reality display system according to Embodiment 1 (Figure 1, 1), and an SNS device 50 is also added.

[0068] There are two ways in which posted data is shared between the server device 30 and the SNS device 50: one in which posted data registered in the server device 30 is shared with the SNS device 50, and another in which posted data (including image data and shooting location information) registered in the SNS device 50 is shared with the server device 30.

[0069] In a configuration where posted data registered in the server device 30 is shared with the SNS device 50, when acquiring information about the posted data in step A4 of Figure 4, the augmented reality display devices 10A and 10B acquire shared SNS selection information, which is the SNS to which the data will be shared. The augmented reality display devices 10A and 10B include the acquired shared SNS selection information in the information about the posted data and send it to the server device 30. For example, when acquiring information about the posted data with the augmented reality display devices 10A and 10B, a display screen like the one in Figure 12(4-1) displays buttons related to the sharing method for sharing with SNS, and by tapping these buttons, the user transitions to a display screen like the one in Figure 12(4-2) for selecting the SNS to share with, and by selecting the SNS to share with, the shared SNS selection information can be included in the information about the posted data. The SNS information posting unit 34 of the server device 30 acquires information about the posted data included in the post upload instruction information from the augmented reality display devices 10A and 10B, generates SNS information posting information for posting SNS information to the SNS device 50 based on the acquired information about the posted data, and sends the generated SNS information posting information to the SNS device 50 related to the SNS selected in the shared SNS selection information. Furthermore, even if the information regarding the posted data does not include shared SNS selection information, the SNS information posting unit 34 may generate SNS information posting information based on the information regarding the posted data obtained from the augmented reality display devices 10A and 10B, and transmit the generated SNS information posting information to the SNS device 50 related to any SNS. The SNS device 50 obtains the SNS information posting information from the server device 30 and registers SNS information based on the obtained SNS information posting information. As a result, the SNS related to the SNS device 50 can refer to the SNS information regarding the posted data posted by the augmented reality display devices 10A and 10B, and can access and refer to the posted data (posted data posted by the augmented reality display devices 10A and 10B) registered in the server device 30.

[0070] In a configuration where posted data (including image data and shooting location information) registered in the SNS device 50 is shared with the server device 30, the SNS information collection unit 35 of the server device 30 collects SNS information registered in the SNS device 50 from the SNS device 50 and selects SNS information from the collected SNS information that includes at least image data and shooting location information. The posting location estimation unit 36 ​​of the server device 30 detects photographic object features (3D coordinate information, polar coordinate information, etc.) which are numerical representations of the feature points of the photographic object 2 based on the image data included in the selected SNS information. The posting location estimation unit 36 ​​obtains information from the storage unit 32 regarding posted data that is located within a predetermined range of the location related to the shooting location information included in the selected SNS information and corresponds to the detected photographic object features. The posting location estimation unit 36 ​​compares the hashtags or text included in the information regarding the acquired posted data with the hashtags or text included in the selected SNS information and extracts information regarding matching posted data. The posting location estimation unit 36 ​​extracts posting location information contained in the extracted posting data information and generates posting location information relating to locations near the location of the extracted posting location information. The posting location estimation unit 36 ​​generates posting data for the server device 30 based on the extracted SNS information, associates the generated posting location information with the generated posting data, and generates information relating to the posting data related to the SNS information. The posting location estimation unit 36 ​​associates the information relating to the generated posting data, the shooting location information related to the extracted SNS information, and the detected shooting object features (shooting object features related to the extracted SNS information) and stores (registers) them in the storage unit 32. This makes it possible to access and refer to the posting data (posting data related to SNS information) registered in the server device 30.

[0071] The configuration and operation of the augmented reality display system 1 according to the other embodiment 2 are the same as those of the augmented reality display system according to embodiment 1.

[0072] According to Embodiment 2, similar to Embodiment 1, the posted data is displayed overlaid on the image data using not only the shooting location information but also the features of the object being photographed. This contributes to displaying the posted data at the precise location in the captured image data.

[0073] Furthermore, according to Embodiment 2, the augmented reality image posting data registered in the server device 30 can be converted into SNS information and registered in the SNS device 50, thereby increasing the opportunities for people to see the posting data registered in the server device 30.

[0074] Furthermore, according to Embodiment 2, since the posting data for augmented reality images is registered in the server device 30 based on the SNS information registered in the SNS device 50, the amount of information registered in the server device 30 can be increased, making it easier for users to obtain the information they need.

[0075] [Embodiment 3] The augmented reality display device according to Embodiment 3 will be described with reference to the drawings. Figure 13 is a schematic block diagram showing the configuration of the augmented reality display device according to Embodiment 3.

[0076] The augmented reality display device 10 is a device that displays augmented reality images (see Figure 13). The augmented reality display device 10 is communicatively connected to the server device 30. The augmented reality display device 10 comprises a display unit 12, an image analysis unit 14, and a control unit 18.

[0077] The display unit 12 is configured to display information. The image analysis unit 14 is configured to analyze image data and detect object feature quantities, which are numerical representations of the feature points of the object being photographed that are included in the image data. The control unit 18 is configured to control the display unit 12 and the image analysis unit 14, and to perform predetermined information processing.

[0078] The control unit 18 processes to transmit to the server device 30 post download instruction information, which includes shooting location information regarding the location where the image data was taken and the feature quantities of the object being photographed. Based on the information about the post data related to the shooting location information and the feature quantities of the object being photographed, transmitted from the server device 30, the control unit 18 processes to display the post data on the display unit 12, superimposed on the image data displayed on the display unit 12 at a position relative to the feature quantities of the object being photographed. Here, the position relative to the feature quantities of the object being photographed is the position based on the post location information included in the information about the post data.

[0079] According to Embodiment 3, since the posted data is displayed overlaid on the image data using not only the shooting location information but also the features of the object being photographed, it is possible to display the posted data at the precise location in the captured image data.

[0080] The augmented reality display device and server device according to Embodiments 1 to 3 can be composed of so-called hardware resources (information processing device, computer), and a configuration as illustrated in Figure 14 can be used. For example, the hardware resource 100 includes a processor 101, memory 102, network interface 103, etc., which are interconnected by an internal bus 104.

[0081] The configuration shown in Figure 14 is not intended to limit the hardware configuration of the hardware resource 100. The hardware resource 100 may include hardware not shown (e.g., input / output interfaces). Similarly, the number of units such as processors 101 included in the device is not limited to the example in Figure 14; for example, multiple processors 101 may be included in the hardware resource 100. For example, a CPU (Central Processing Unit), MPU (Micro Processor Unit), GPU (Graphics Processing Unit), etc., can be used for the processor 101.

[0082] Memory 102 can be, for example, RAM (Random Access Memory), HDD (Hard Disk Drive), SSD (Solid State Drive), etc.

[0083] The network interface 103 can use, for example, a LAN (Local Area Network) card, a network adapter, a network interface card, etc.

[0084] The functions of the hardware resource 100 are realized by the processing module described above. This processing module is realized, for example, by the processor 101 executing a program stored in memory 102. Furthermore, this program can be downloaded via a network or updated using a storage medium containing the program. Moreover, the processing module may be implemented by a semiconductor chip. In other words, the functions performed by the processing module can be realized by the execution of software on some hardware.

[0085] Some or all of the above embodiments may also be described as follows, but are not limited to the following.

[0086] [Note 1] A display unit configured to display information, An image analysis unit configured to analyze image data and detect object feature quantities, which are numerical representations of the characteristic points of the object being photographed that are included in the image data, A control unit configured to control the display unit and the image analysis unit and to perform predetermined information processing, Equipped with, The control unit, The process involves sending a post download instruction information to a server device, which includes shooting location information relating to the location where the image data was taken and the feature quantities of the object being photographed. Based on the information transmitted from the server device regarding the shooting location information and the features of the object being photographed, the process of displaying the posted data on the display unit, superimposed on the image data displayed on the display unit at a relative position to the features of the object being photographed; It is configured to do the following: The relative position of the aforementioned object feature is the position based on the posting location information included in the information regarding the posted data. Augmented reality display device. [Note 2] It further includes an input section configured to allow information to be entered through user operation, The control unit is further configured to transmit to the server device a post upload instruction information that includes the shooting location information, the feature quantities of the object being photographed, and information regarding the post data input from the input unit. The augmented reality display device described in Appendix 1. [Note 3] The information regarding the aforementioned posted data includes information on which social media platforms to share the data on, The augmented reality display device described in Appendix 2. [Note 4] When the control unit displays the posted data on the display unit, it filters the posted data based on the information regarding the filtering conditions input from the input unit and displays it on the display unit. An augmented reality display device as described in Appendix 2 or 3. [Note 5] An imaging unit configured to generate image data by photographing the object to be photographed, A position detection unit configured to detect the aforementioned shooting position information, Furthermore, An augmented reality display device as described in any one of the appendices 1 to 4. [Note 6] The system further includes a communication unit configured to acquire the image data associated with the shooting location information from an external source. An augmented reality display device as described in any one of the appendices 1 to 5. [Note 7] The system further includes a storage unit that stores the image data associated with the aforementioned shooting location information. An augmented reality display device as described in any one of the appendices 1 to 6. [Note 8] A storage unit configured to store, in association with, shooting location information relating to the location where the image data was taken, shooting object feature quantities that quantify the feature points of the object included in the image data, and information about posted data including posting location information relating to the relative position of the shooting object feature quantities, A control unit configured to control the storage unit and perform predetermined information processing, Equipped with, The control unit is configured to read information related to the shooting location information and the features of the shooting target object included in the posting data from the storage unit when it obtains posting download instruction information from the augmented reality display device, and to transmit this information to the augmented reality display device. Server device. [Note 9] The control unit is configured to further perform a process in which, upon acquiring post upload instruction information from the augmented reality display device, it associates and stores in the storage unit the shooting location information, the feature quantities of the object being photographed, and the information related to the posted data included in the post upload instruction information. The server device described in Appendix 8. [Note 10] The system further includes an SNS information posting unit that generates SNS information posting information for posting SNS information to an SNS device based on information about the posting data included in the posting upload instruction information, and transmits the SNS information posting information to the SNS device. The server device described in Appendix 9. [Note 11] The SNS information collection unit collects SNS information from SNS devices, A posting location estimation unit that estimates the posting location information of the SNS information based on the image data and shooting location information contained in the SNS information, Furthermore, The aforementioned posting location estimation unit, A process for detecting object features, which are numerical representations of the object's characteristic points, based on the image data contained in the aforementioned SNS information. The process involves obtaining from the storage unit information information about posted data that is located within a predetermined range from the location of the shooting location information included in the SNS information and is related to the detected feature quantity of the object being photographed. The process involves comparing the hashtags or text contained in the information of the acquired post data with the hashtags or text contained in the SNS information to extract information of matching post data. A process to generate post location information relating to a location near the location of the post location information included in the extracted post data information, A process for generating posting data for the server device based on the aforementioned SNS information, A process to generate information relating to the post data on the SNS information by associating the generated post location information with the generated post data, A process of associating the generated post data information, the shooting location information included in the SNS information, and the detected feature quantities of the object being photographed, and storing them in the storage unit, It is configured to do, A server device as described in any one of the appendices 8 to 10. [Note 12] An augmented reality display device as described in any one of Appendix 1 to 7, A server device described in any one of the appendices 8 to 11, Equipped with, Augmented reality display system. [Note 13] The system further comprises an SNS device configured to be communicatively connected to the aforementioned server device. The augmented reality display system described in Appendix 12. [Note 14] The steps include: transmitting a post download instruction information from an augmented reality display device to a server device, which includes shooting location information regarding the location where the image data was captured, and a feature quantity of the object being photographed, obtained by analyzing the image data and quantifying the feature points of the object being photographed that are included in the image data; The server device, upon acquiring the post download instruction information, reads from the storage unit of the server device information regarding the post data related to the shooting location information and the features of the object being photographed, and transmits this information to the augmented reality display device. The augmented reality display device includes the step of displaying the posted data superimposed on the displayed image data at a relative position to the feature quantities of the object being photographed, based on the information about the posted data transmitted from the server device. Includes, The relative position of the aforementioned object feature is the position based on the posting location information included in the information regarding the posted data. Augmented reality display method. [Note 15] The process involves sending a post download instruction to a server device, which includes shooting location information regarding the location where the image data was taken, and a feature quantity of the object being photographed, obtained by analyzing the image data and quantifying the feature points of the object being photographed that are included in the image data. Based on the information transmitted from the server device regarding the shooting location information and the features of the object being photographed, the process of displaying the posted data superimposed on the displayed image data at a relative position to the features of the object being photographed; To have the augmented reality display device execute this, The relative position of the aforementioned object feature is the position based on the posting location information included in the information regarding the posted data. program. [Note 16] When post download instruction information is obtained from the augmented reality display device, the server device is instructed to read information from the storage unit regarding the post data related to the shooting location information and the features of the object being photographed, as contained in the post download instruction information, and to transmit this information to the augmented reality display device. program.

[0087] Furthermore, each disclosure in the above-mentioned patent documents is incorporated into this document by reference and may be used as the basis or part of the present invention as necessary. Within the framework of the full disclosure of the present invention (including the claims and drawings), further modifications and adjustments to the embodiments or examples are possible based on the basic technical concept. Also, within the framework of the full disclosure of the present invention, various combinations or selections (or non-selection as necessary) of various disclosure elements (including each element of each claim, each element of each embodiment or example, each element of each drawing, etc.) are possible. In other words, the present invention naturally includes the full disclosure, including the claims and drawings, and various modifications and alterations that a person skilled in the art could make in accordance with the technical concept. Furthermore, regarding the numerical values ​​and numerical ranges described in this application, any intermediate values, lower values, and smaller ranges are deemed to be described even if not explicitly stated. Moreover, each disclosure in the above-mentioned cited documents may, as necessary, be used in part or in whole as part of the disclosure of the present invention, in accordance with the spirit of the present invention, in combination with the matters described in this document, and these may also be considered to be included in (belong to) the disclosures of this application. [Explanation of symbols]

[0088] 1. Augmented Reality Display System 2. Object to be photographed 10, 10A, 10B Augmented Reality Display Device 11 Communications Department 12 Display section 13 Imaging Unit 14 Image Analysis Department 15 Position detection unit 16 Input section 17 Memory section 18 Control Unit 30 Server Devices 31 Communications Department 32 Storage section 33 Control Unit 34 SNS Information Posting Department 35 SNS Information Gathering Department 36 Post location estimation unit 40 Management device 50 SNS device 60 Networks 100 hardware resources 101 Processors 102 memory 103 Network Interface 104 Internal Bus

Claims

1. An augmented reality display device used in a service for sharing augmented reality images in real space among multiple users, A display unit configured to display information, An image analysis unit configured to analyze image data and detect object feature quantities, which are numerical representations of the characteristic points of the object being photographed that are included in the image data, A control unit configured to control the display unit and the image analysis unit and to perform predetermined information processing, Equipped with, The control unit, The process involves sending a post download instruction to the server device to select post data from among the post data stored in the server device that is related to the shooting location information regarding the location where the image data was taken and the feature quantity of the object being photographed, and then sending post download instruction information to the server device, Based on the information regarding the selected posted data transmitted from the server device, the process of displaying the posted data on the display unit by superimposing it on the image data displayed on the display unit at a relative position to the feature quantity of the object being photographed; It is configured to do the following: The relative position of the aforementioned object feature is the position based on the posting location information included in the information regarding the posted data. Augmented reality display device.

2. It further includes an input section configured to allow information to be entered through user operation, The control unit is further configured to transmit to the server device a post upload instruction information that includes the shooting location information, the feature quantities of the object being photographed, and information regarding the post data input from the input unit. The augmented reality display device according to claim 1.

3. The information regarding the aforementioned posted data includes the selected social media platform to share the data on, The augmented reality display device according to claim 2.

4. When the control unit displays the posted data on the display unit, it filters the posted data based on the information regarding the filtering conditions input from the input unit and displays it on the display unit. The augmented reality display device according to claim 2.

5. An imaging unit configured to generate image data by photographing the object to be photographed, A position detection unit configured to detect the aforementioned shooting position information, Furthermore, The augmented reality display device according to claim 1.

6. The system further includes a communication unit configured to acquire the image data associated with the shooting location information from an external source. The augmented reality display device according to claim 1.

7. The system further includes a storage unit that stores the image data associated with the aforementioned shooting location information. The augmented reality display device according to claim 1.

8. A server device used in a service for sharing augmented reality images in real space among multiple users using an augmented reality display device, A storage unit configured to store, in association with, shooting location information relating to the location where the image data was taken, shooting object feature quantities that quantify the feature points of the object included in the image data, and information about posted data including posting location information relating to the relative position of the shooting object feature quantities, A control unit configured to control the storage unit and perform predetermined information processing, Equipped with, When the control unit obtains post download instruction information from the augmented reality display device, it performs the process of selecting from the post data stored in the storage unit the post data that is related to the shooting location information and the feature quantities of the object being photographed included in the post download instruction information, and that is displayed superimposed on the image data displayed on the augmented reality display device at a relative position to the object being photographed. The process of sending the selected post data to the augmented reality display device, It is configured to do, Server device.

9. An augmented reality display device according to any one of claims 1 to 7, The server device according to claim 8, Equipped with, Augmented reality display system.

10. An augmented reality display method used in a service for sharing augmented reality images in real space among multiple users, The augmented reality display device sends a post download instruction to the server device to select post data from the post data stored in the server device that is related to the shooting location information regarding the location where the image data was taken, and the shooting object feature quantity obtained by analyzing the image data and quantifying the feature points of the shooting object included in the image data. The server device, upon acquiring the post download instruction information, reads from the storage unit of the server device information regarding the post data related to the shooting location information and the features of the object being photographed, and transmits this information to the augmented reality display device. The augmented reality display device includes the step of displaying the selected post data superimposed on the displayed image data at a relative position to the feature quantities of the object being photographed, based on the information about the selected post data transmitted from the server device. Includes, The relative position of the aforementioned object feature is the position based on the posting location information included in the information regarding the posted data. Augmented reality display method.

Images