Interaction method through event area in virtual space, server device, and cooperation system between event-related commodity and virtual space

Abstract

To provide a system for easy communication through an event area in a virtual space.SOLUTION: A system through an event area and a cooperation system between an event-related commodity and a virtual space are provided. An interaction method to be executed by a server device 2 and a user terminal 3 through an event area in a virtual space composed of two-dimensional or three-dimensional spatial data of an imaging space formed by imaging an event area 54 including an event site or a pseudo space formed by simulating the imaging includes the steps of: transmitting a viewpoint image moving in the event area in the virtual space based on an operation made by a virtual visitor 23 who visits the event area in the virtual space, to a user terminal of the virtual visitor; acquiring positional information of a visitor 21 who visits the event area; and displaying an avatar element of a visitor set in advance at a coordinate position in the event site in the virtual space corresponding to the positional information.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to a method of communication through a virtual space. [Background technology]

[0002] In recent years, technologies using virtual spaces have been developed, which provide users with new experiences through the virtual world.

[0003] There have also traditionally been farms set up in care farms (welfare facilities with farms attached, hereafter the same) which are welfare facilities, community gardens which allow users to use plots of land, and tourist farms. For example, care farms' farms give elderly people a sense of purpose in life and provide employment for people with disabilities, and working on these farms is also said to be effective in alleviating dementia and mental disorders. For example, community gardens are places where users who live in urban areas regularly visit to grow agricultural products, and are effective in building community cooperation in times of disaster.

[0004] Patent Document 1 discloses a method for linking the real world and the virtual world, which includes acquiring location information indicating a current location of a user in the real world, determining whether the current location indicated by the location information is in a first area in the real world, and enabling the user to access a second area in the virtual world when the current location indicated by the location information is in the first area, wherein the first area and the second area have the same level for at least one parameter.

[0005] Patent Document 2 also discloses an agricultural produce cultivation information utilization system. This agricultural produce cultivation information utilization system is a system that supports agricultural produce cultivation plans of users who cultivate agricultural produce in adjacent plots in community gardens and the like by allowing them to share and mutually utilize cultivation information on the agricultural produce they are cultivating.

[0006] Furthermore, Patent Document 3 discloses an agricultural product growing game, in which a person who does not have means of production such as farmland can experience the joy of agricultural production by growing agricultural products together with a player and a manager while simulating the experience of farm work through a computer screen. [Prior art documents] [Patent documents]

[0007] [Patent Document 1] Patent No. 7158789 [Patent Document 2] JP 2014-035700 A [Patent Document 3] JP 2002-78975 A Summary of the Invention [Problem to be solved by the invention]

[0008] It is cumbersome to actually visit the event area and talk to visitors, or to go to the event area to get information about the products (including free products / goods) available in the event area and related products.

[0009] Therefore, an objective of the present invention is to provide a method of interaction via an event area in a virtual space, a server device, and a system for linking event-related products with a virtual space in order to reduce complexity by using the event area in a virtual space. [Means for solving the problem]

[0010] (1) A method of communication through an event area of ​​a virtual space of the present invention is executed by a server device and a user terminal, and is a method of communication through an event area of ​​a virtual space consisting of two-dimensional or three-dimensional spatial data of an imaged space formed from an image of an event area including an event venue, or a pseudo space formed to imitate the imaged space, and is characterized by comprising the steps of: transmitting to the user terminal of a virtual visitor a viewpoint image moving through the event area of ​​the virtual space based on an operation of the virtual visitor visiting the event area of ​​the virtual space; acquiring position information of the visitor visiting the event area; and displaying a preset avatar element of the visitor at a coordinate position in the event area of ​​the virtual space corresponding to the position information.

[0011] (2) Such a method of interaction via an event area in a virtual space preferably includes the steps of acquiring coordinate position information regarding the coordinate position of the virtual visitor in the event area of ​​the virtual space, and superimposing and displaying a preset avatar element of the virtual visitor at a position in the field of view through the user terminal of the visitor that corresponds to the coordinate position information.

[0012] (3) A predetermined position range including the products in the event area and a coordinate position range of the event area in the virtual space corresponding to the predetermined position range are set, It is preferable that the method further includes a step of displaying product display elements related to the product in the position range in the field of view through the visitor's user terminal and in the coordinate position range displayed on the user terminal of the virtual visitor.

[0013] (4) It is also preferable to have a step of communicating between the virtual visitor and the visitor using voice information / text information.

[0014] (5) It is also preferable that an information medium including event-related products, including products available in the event area and products related to the products, or a website on which the event-related products are posted, has access information including a link to visit the event area in the virtual space, and the method further includes a step of visiting the event area in the virtual space through the access information.

[0015] (6) It is also preferable to have a step of acquiring personal information of a visitor registered in advance based on specific information that identifies the visitor, in order to select the visitor with which the virtual visitor will interact.

[0016] (7) It is also preferable that the personal information includes affiliation / attribute information regarding the person's affiliation / attributes and / or knowledge / experience information regarding the event area.

[0017] (8) It is preferable that the method further comprises a step of storing time information and position information of the avatar element during a predetermined period during which an event is held in the event area.

[0018] (9) It is also preferable to have a step of making a payment for purchasing products available in the event area and products related to the products.

[0019] "Visitor location information" refers to information about the location within the event area of ​​a visitor who is actually visiting the event area, and is a concept that includes, for example, coordinates indicating a two-dimensional or three-dimensional point, coordinates indicating a specific area on a plane or in space, and quantities that can be converted thereto. Also, when the location to be visited is a farm, the information is about the actual location within the farm of the visitor who is visiting the farm, and is a concept that includes, for example, coordinates indicating a two-dimensional or three-dimensional point, coordinates indicating a specific range such as a plane or space, or quantities that can be converted into them. "Coordinate position information" refers to coordinates indicating two-dimensional or three-dimensional points in a virtual space, or coordinates indicating a specific range on a plane or in space, and is a concept that includes quantities that can be converted thereto. "Identifying information" refers to information that can be used to identify a person, such as name, address, My Number, pension number, driver's license number, credit card information, and physical characteristics including face, and is a concept that includes information linked to or that can be converted into such information. "Personal information" refers to at least one of the following: affiliation and attribute information regarding a person's affiliation and attributes, knowledge and experience information regarding the event area, physical characteristics including face, etc., and further includes a profile, information that a person has disclosed in order to let others know about them, and is a concept that includes information that can be converted into such information. If the place to be visited is a farm, the knowledge and experience information is related to agricultural knowledge and experience. Affiliation / attribute information is, for example, information about affiliation, the organization one belongs to, the area one lives in, such as an employee of a company / sole proprietor, a manager, a person renting a booth in the event area, an event area manager, an employee of the event area, a shop owner, a shop employee, an address, etc., and about attributes, such as information including one's own field of expertise, for example work history, and is a concept that includes information that can be converted into such information. For example, if the place to be visited is a farm, the information would be about the care farm residents, the care farm operator, those renting farm plots, the farm operator, the farm employees, the store owner, the store employees, and the neighboring residents, and the attributes would be information including one's own mental and physical state, such as medical history, and are a concept that includes information that can be converted into these. The knowledge and experience information is information on knowledge and experience related to the event, including hobby history, business experience, and research and academic history related to the event, and is a concept including information that can be converted into these. For example, if the place to be visited is a farm, the information is related to knowledge and experience regarding farm work, and includes agricultural experience, research and academic background related to agriculture, and is a concept including information that can be converted into these. "Location range" refers to a point or range used to identify the location or range in the event area where the product is located, and is a concept that includes coordinates indicating a two-dimensional or three-dimensional point, or coordinates indicating a specific range on a plane or in space, etc., and quantities that can be converted thereto. "Coordinate position range" is the coordinate range in virtual space that corresponds to the position range, and is a concept that includes quantities that can be converted into them.

[0020] "Event-related products" include products that can be obtained in the event area and products related to the above-mentioned products. Products include, for example, free and paid products, and include services other than goods, and are concepts that can be converted into those. Products related to the above-mentioned products include products that can be obtained outside the event area. "Information media" refers to tags and stickers attached to event-related products and their packaging, printed / formed parts on event-related products and their packaging, paper media such as pamphlets and leaflets describing event-related products, web pages and SNS sites that are described together with event-related products, and is a concept that can be converted into these. "Access information" refers to information such as a QR code (registered trademark) or URL that can be read by the camera of a user's device or entered into a user's device to access an event area in a virtual space, or a concept that can be converted into such information. For example, information that allows access to an event area in a virtual space may be embedded in digital content such as images or music using a technology called digital watermarking. "Product Information" means information about products related to the event. "A specified period during the event" includes the period from the start to the end of the event or any period between the start and end of the event.

[0021] (10) A server device according to another aspect of the present invention is a server device used in a method of interaction through an event area in a virtual space, which is executed by a server device and a user terminal and consists of two-dimensional or three-dimensional spatial data of an imaged space formed from an image of an event area including an event venue or a pseudo-space formed to imitate the imaged space, and is characterized in that it comprises a coordinate acquisition means for acquiring position information of a visitor visiting the event area, and a virtual space processing means for transmitting to the user terminal of the virtual visitor a viewpoint image moving through the event area of ​​the virtual space based on an operation of the virtual visitor visiting the event area of ​​the virtual space, and displaying a preset avatar element of the visitor at a coordinate position in the event area of ​​the virtual space corresponding to the position information.

[0022] (11) In such a server device, it is preferable that the coordinate acquisition means acquires coordinate position information regarding the coordinate position of the virtual visitor in an event area of ​​the virtual space, and the virtual space processing means superimposes and displays a predetermined avatar element of the virtual visitor at a position in the field of view through the visitor's user terminal that corresponds to the coordinate position information.

[0023] (12) It is also preferable that a predetermined position range including the products in the event area and a coordinate position range of the event area in the virtual space corresponding to the position range are set, and the virtual space processing means displays product display elements related to the products in the position range in the field of view through the visitor's user terminal and in the coordinate position range displayed on the user terminal of the virtual visitor.

[0024] (13) It is also preferable that the virtual visitor user terminal is provided with a storage unit for storing product information about products in the event area and products related to the products.

[0025] (14) It is also preferable to provide a personal information acquisition means for acquiring personal information of the visitor identified based on identification information that identifies the visitor, in order to select the visitor with which the virtual visitor will interact.

[0026] (15) It is also preferable that the personal information includes affiliation / attribute information regarding the person's affiliation / attributes and / or knowledge / experience information regarding the event area.

[0027] (16) It is also preferable that the event area further comprises a storage unit for storing time information and position information of the presence of the avatar element during a predetermined period during which an event is held in the event area.

[0028] (17) It is also preferable that the event-related product purchasing system is provided.

[0029] (18) A further aspect of the present invention is a system for linking event-related products with a virtual space, comprising an information medium including event-related products, including products that can be obtained in the event area or products related to the products, or a website on which the event-related products are posted, the above-mentioned server device, and a user terminal, wherein the event-related products or the information medium have access information including a link for visiting the event area in the virtual space.

[0030] The "virtual space processing means" corresponds to W2 (see FIG. 11) in the embodiment. "Payment method" corresponds to B7 and S11 (see FIG. 13 and FIG. 16) in the embodiment. In the embodiment, the "person information acquisition means" corresponds to V2, B2, and S2 (see Figs. 11, 13, and 16).

[0031] The following describes the case where the virtual space is a farm. "Visitor location information" refers to information about the actual location within a farm of a visitor who is visiting the farm, and is a concept that includes, for example, coordinates indicating a two-dimensional or three-dimensional point, coordinates indicating a specific area on a plane or in space, and quantities that can be converted thereto. "Coordinate position information" refers to coordinates indicating two-dimensional or three-dimensional points in a virtual space, or coordinates indicating a specific range on a plane or in space, and is a concept that includes quantities that can be converted thereto. "Identifying information" refers to information that can be used to identify a person, such as name, social security number, pension number, driver's license number, and physical characteristics including face, and is a concept that includes information linked to or that can be converted into such information. "Personal information" refers to knowledge and experience information about agricultural knowledge and experience. "Affiliation / attribute information" refers to information about residents of the care farm, the care farm operator, those renting farm plots, the farm operator, the farm employees, the shop owner, the shop employees, the neighboring residents, etc., and is a concept that includes information about attributes, such as one's own mental and physical state, such as medical history, and information that can be converted into these. "Knowledge and experience information" refers to information on knowledge and experience regarding agricultural work, including agricultural experience, research and academic background on agriculture, and information that can be converted into these. "Location range" refers to a point or range that identifies the location or range on a farm where agricultural products are located, and is a concept that includes coordinates indicating a two-dimensional or three-dimensional point, or coordinates indicating a specific range on a plane or in space, and quantities that can be converted into them. "Farm-related products" includes agricultural products and products related to said agricultural products. Agricultural products are all agricultural products, including crops and livestock products, and include grains, vegetables, fruits, flowers, dairy products, meat, eggs, leather, and processed products of these, and are concepts that can be converted into them. Processed products include, for example, alcoholic beverages such as wine and ham. Related products include products derived from agricultural products harvested on farms, specialty products from the areas surrounding the farms, agricultural products harvested around the farms, and crafts, sweets, and products manufactured around the farms, and are concepts that can be converted into them. "Information media" refers to tags and stickers attached to farm-related products and their packaging, printed / formed parts of farm-related products and their packaging, paper media such as pamphlets and leaflets that describe farm-related products, web pages and social media sites that describe farm-related products, and is a concept that can be converted into these. "Access information" refers to information such as a QR code (registered trademark) or URL that can be read by the camera of a user's device or entered into the user's device to access the farm in the virtual space, or a concept that can be converted into such information. For example, information that allows access to the farm in the virtual space may be embedded in digital content such as images and music using a technology called digital watermarking. "Product Information" means information on farm-related products. "Settlement" includes cases where agricultural products or other items are paid as compensation for a request. Effect of the Invention

[0032] Visitors can easily interact with each other, with virtual visitors, or with other virtual visitors. [Brief description of the drawings]

[0033] [Figure 1] FIG. 1 is a schematic diagram showing an overview of a system via an event area and a system for linking event-related merchandise with a virtual space. [Diagram 2] FIG. 13 is a functional block diagram illustrating yet another embodiment of the system via the event area / farm. [Diagram 3] 11 is a schematic diagram showing the screen display of the user terminal of a visitor and a virtual visitor. FIG. [Figure 4] FIG. 11 is a functional block diagram showing another embodiment of the system through a farm. [Diagram 5] FIG. 2 is a schematic diagram illustrating an example of a hardware configuration of a server device. [Figure 6] FIG. 2 is a schematic diagram illustrating an example of a hardware configuration of a user terminal. [Figure 7]FIG. 2 is a schematic diagram showing an example of a hardware configuration of a head mounted display unit. [Figure 8] 13 is a flowchart showing an embodiment of the flow of a registration process in entrance / exit management. [Figure 9] 11 is a flow chart illustrating an embodiment of a login process flow. [Figure 10] FIG. 2 is a schematic diagram showing a data structure of a person identification database. [Figure 11] 1 is a flow chart illustrating an embodiment of an interaction process flow. [Figure 12] FIG. 13 is a functional block diagram showing yet another embodiment of the system via a farm. [Figure 13] 1 is a flow chart illustrating an embodiment of a process for purchasing agricultural products. [Figure 14] FIG. 2 is a schematic diagram showing a data structure of a product information database for event-related products. [Figure 15] FIG. 1 is a functional block diagram illustrating an embodiment of a system through a farm. [Figure 16] 11 is a flowchart showing an embodiment of a process flow for requesting farm work from a remote person to a visitor. [Figure 17] FIG. 2 is a schematic diagram showing a data structure of a person information database. [Figure 18] This is a schematic diagram showing an outline of the system mediated by a farm and the system for linking farm-related products with a virtual space. [Figure 19] 11 is a schematic diagram showing the screen display of the user terminal of a visitor and a virtual visitor. FIG. [Figure 20] FIG. 2 is a schematic diagram showing a data structure of a product information database for farm-related products. [Figure 21] FIG. 2 is a schematic diagram showing a data structure of a person information database. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0034] [1-1. Communication through the event area] In the embodiment described below in detail, a case where an event area is used as the virtual space will be described, followed by a case where a farm is used as the virtual space.

[0035] [1-2. Overview] (Interaction system through event areas 53) First, an overview of the exchange system via an event area will be described with reference to Fig. 1. The exchange system via an event area (hereinafter referred to as the system) 53 shown in Fig. 1 is mainly used between visitors 21 who visit an event area 54 and remote persons 22 who are not visiting the event area 54 and who are, for example, at home. The remote persons 22 include virtual visitors 23 who visit an event area 54a (see Fig. 3) in a virtual space consisting of three-dimensional spatial data of an imaged space formed from an image of the event area 54 or a pseudo space formed by simulating the image.

[0036] A virtual visitor 23 visits an event area 54a in the virtual space, for example, to participate in an event, to exhibit at an event, to check out / purchase event-related merchandise 55, or to interact with other participants / exhibitors. A virtual visitor 23 can also interact with other virtual visitors 23 who are visiting the event area 54a in the virtual space.

[0037] (Event-related products 55 and virtual space collaboration system 56) The linking system 56 between event-related products 55 and virtual space is made up of an information medium 51 including event-related products 55 including products available in the event area or a website listing the event-related products, and a system 53 (see FIG. 2). The information medium 51 contains access information 43 including a link for visiting an event area 54a in the virtual space.

[0038] For example, a purchaser who picks up a DVD as an event-related product 55 at a store outside the event area 54 reads a QR code (registered trademark) as access information 43 printed on the DVD's packaging with his or her own user terminal. The purchaser, as a virtual visitor 23, accesses the event area 54a where a concert related to the DVD is being held, using the user terminal as a remote user terminal 3. The virtual visitor 23 enjoys an event such as a concert in the event area 54a in the virtual space, and interacts with the concert performers and visitors 21 attending the concert. It is also possible to purchase a DVD as an event-related product 55 at a store inside the event area 54 and visit the event area 54a in the virtual space.

[0039] The concert may be held in the future from the date of purchase of the event-related products 55 such as DVDs and related goods. Even if the concert is held in the future, the user can visit the event area 54a in the virtual space before the event and interact with other virtual visitors 23. For example, the user can make a promise to have fun together on the day of the event.

[0040] Even if an event has already ended on the purchase date, the user can participate in a past event such as a concert and virtually experience the event that has already ended. Furthermore, if an event such as a concert is being held on the purchase date, the user can participate in the event through the event area 54a in the virtual space.

[0041] The stores selling the event-related products 55 include stores in the event area 54 and the event area 54a in the virtual space, and also include roadside stations, local shops, department stores, supermarkets, and convenience stores, and are concepts that can be converted into these.

[0042] (Event Area 54) An event area includes an event venue where a specific event is held, and is an area for events held outdoors and / or indoors. Event venues include street corners, martial arts halls, exhibition halls, art museums, temples, churches, amusement parks, concert halls, gymnasiums, schools, auditoriums, baseball fields, athletic stadiums, parks, etc. Events include expositions such as the World Expo, exhibitions, sales events, product fairs, conferences, concerts, plays, music recitals, sports days, competitions, festivals, and fireworks displays.

[0043] (AC) The system 53 can display information on visitors 21 visiting the event area 54 and registered users who will likely become visitors 21 if the date and time permits, on the terminal of the remote person 22 as advance information for interaction. Furthermore, for example, even those of the remote persons 22 who cannot access the event area 54a in the virtual space can grasp the situation in the event area 54 from the images captured by the camera 25 installed in the event area 54 via a communication network 26 such as the Internet. As will be described later, by logging in to the system 53, the visitor 21 and the remote persons 22 (including the virtual visitor 23), and further the virtual visitor 23 and the remote persons 22 who do not access the event area 54a in the virtual space, can grasp each other's person information 7a (see FIG. 4) and interact with each other.

[0044] (User) In this embodiment, when a user (hereinafter referred to as a user) of the event area 54 and the event area 54a in the virtual space registers, the user is registered in, for example, a person identification database 6 (details of which will be described later). Registration is not essential. Even if a user does not visit the event area 54, the user can make an appointment with another user for a date and time, and can receive requests for events and appointments to interact with other users. Here, examples of users who use the event area 54 and the event area 54a in the virtual space include the following people. They are exhibitors who exhibit in the event area 54 or the event area 54a in the virtual space, and sellers / distributors who sell / distribute event-related products 55 at the event. These users are performers / lecturers who hold events in the event area 54 or the event area 54a in the virtual space. Although the exhibit area of ​​the event area 54 or the virtual space event area 54a is not rented, the exhibitor may become an exhibitor or seller / distributor at the request of the exhibitor or seller / distributor. A visitor to the event area 54 or the event area 54a in the virtual space. They are purchasers of event-related products 55. Purchasers also include those who plan to make purchases. The person in charge is the administrator of the event area 54 or the event area 54a in the virtual space. Furthermore, by linking with event areas of other virtual spaces or virtual spaces other than event area 54, it is possible to travel between other virtual spaces. Each user may fulfill more than one of the roles listed above.

[0045] [1-3.Each configuration] (System 53) First, a system 53 according to an embodiment of the present invention will be described with reference to the functional block diagram of FIG.

[0046] The system 53 comprises a server device 2, user terminals 3 and 14 (hereinafter referred to as remote user terminals) held by a virtual visitor 23, and a user terminal 4 (hereinafter referred to as visitor terminal) held by a visitor 21. The server device 2, the remote user terminal 3 (14), and the visitor terminal 4 are communicatively connected to each other via a communication network 26 (see FIG. 1) such as the Internet (intranet). As will be described later, reference numeral 14 denotes a head-mounted display system (see FIG. 6). The remote user 22 can also interact with the visitor 21 through text information without visiting the event area 54a in the virtual space.

[0047] In addition, the system 53 sets a predetermined position range in the event area 54 where the products are sold and a coordinate position range in the virtual space that corresponds to that position range. Furthermore, product display elements related to the products are displayed in the field of view through the visitor terminal 4 of the visitor 21 and on the viewpoint image of the remote terminal 3 (14) of the virtual visitor 23.

[0048] The avatar elements 45b and 46b are, for example, two-dimensional or three-dimensional spatial data of a captured image formed by capturing an image of the visitor 21 or the virtual visitor 23, or a pseudo image formed by simulating the captured image. Note that, regardless of the image, a desired image may be used as the avatar element. In this embodiment, tags on which one or more pieces of information selected from the product information 28 (see FIG. 14) are written are displayed as the product (agricultural product) display elements 48b, 49b. Alternatively, for example, two-dimensional or three-dimensional spatial data of a captured image formed by capturing an image of a product in the event area 54 or a pseudo image formed by simulating the image may be used as the tag. The data of the avatar elements 45b, 46b and the product display elements 48b, 49b are stored in the storage unit 31 of the server device 2, for example.

[0049] (Server device 2) In this embodiment, for example, a personal computer is used as the server device 2. The server device 2 mainly includes a virtual space processing means 17 and a coordinate acquisition means .

[0050] (Remote terminal 3 (14), visitor terminal 4) In this embodiment, the remote user terminal 3 (14) is, for example, a smartphone. Note that the remote user terminal 3 (14) may be a wearable computer, a head-mounted display system, a mobile phone, a tablet terminal, a personal computer, or the like, which is a computer that can be attached or worn. The remote user terminal 3 (14) is equipped with a display unit 3a (15a). Reference numeral 15a is the display unit of the head-mounted display system (see FIG. 6). The remote user terminal 3 (14) displays avatar elements of the visitor 21 in a viewpoint image of a virtual space as virtual reality (VR).

[0051] (Visitor Terminal 4) In this embodiment, the visitor terminal 4 is almost the same as the remote user terminal 3 (14). In this embodiment, the visitor 21 wears the visitor terminal 4, such as smart glasses or AR glasses. The visitor terminal 4 projects pre-registered avatar elements as digital images onto the field of view of the scenery in the real event area 54 as augmented reality (AR). The display unit 3a of the smart glasses or AR glasses is a part that allows the viewer to see the scenery through the display unit 3a and displays the digital images in an overlaid manner.

[0052] (Virtual space processing means 17) The virtual space processing means 17 generates a virtual image to be displayed on the display unit 3a (15a) of the remote terminal 3 (14) based on operation information 17a relating to the amount of operation output from the input / output device 32 (operation unit 15e) of the remote terminal 3 (14) (see Figs. 5 and 6). For example, in cooperation with the control device 16 of the head-mounted system 14, it generates images to be displayed on the display unit 15a and performs various calculation processes.

[0053] (Coordinate acquisition means 18) The coordinate acquisition means 18 acquires a coordinate position (viewpoint coordinates) in three-dimensional space corresponding to the viewpoint image displayed on the remote user terminal 3 (14). For example, in this embodiment, avatar elements representing virtual visitors 23 other than the user are displayed on the display unit 3a (15a) based on the viewpoint coordinates. Note that an avatar element representing the user himself / herself may also be displayed on the display unit 3a (15a) of the user's terminal 3 (14).

[0054] (Display section 3a (15a)) The display unit 3a (15a) may be, for example, a device for displaying images, such as a liquid crystal display (LCD), a plasma display panel (PDP), or an organic electroluminescence (EL). A touch panel may be provided on the display unit 3a. The touch panel outputs an output signal according to an operation by a user. The user can operate the touch panel to perform operations such as selecting information displayed on the display unit 3a (15a).

[0055] (Avatar element 45b of visitor 21) Specifically, the visitor terminal 4 acquires position information 45a within the event area 54 based on GPS or indoor positioning technology, and transmits the position information 45a to the coordinate acquisition means 18 of the server device 2. The virtual space processing means 17 of the server device 2 converts the position information 45a into a coordinate position in the virtual space corresponding to the position information 45a, and transmits an avatar element 45b (see FIG. 2) of the visitor 21 to be displayed at the coordinate position to the remote user terminal 3 (14).

[0056] (Virtual visitor (remote) avatar element 46b) Meanwhile, the server device 2 acquires coordinate position information 46a relating to the virtual space coordinate position of the virtual visitor 23 (remote person 22) visiting the virtual space. The virtual space processing means 17 transmits to the visitor terminal 4 a preset avatar element 46b of the virtual visitor to be displayed superimposed on the field of view of the visitor 21 through the visitor terminal 4 at a position in the event area 54 corresponding to the acquired coordinate position information 46a.

[0057] (Product (agricultural product) display elements 48b, 49b) In addition, in the system 53, a coordinate position range 49a (see FIG. 3) in the virtual space corresponding to a predetermined position range 48a (see FIG. 17) of the product in the event area 54 is set in advance and stored in the server device 2. The predetermined position range 48a in which the products are arranged in the event area 54 is a range that includes the products. The virtual space processing means 17 transmits product display elements 48b, 49b to the visitor terminal 4 and the remote user terminal 3 (14), respectively. Therefore, in the field of view of the visitor 21 through the visitor terminal 4, the product display element 48b is displayed in the position range 48a. Meanwhile, the product display element 49b is displayed in the coordinate position range 49a on the viewpoint image of the remote user terminal 3 (14).

[0058] The avatar elements 45b, 46b and the product display elements 48b, 49b are registered and stored in advance in the server device 2 or the user terminals 3 (14), 4, for example.

[0059] (Past viewpoint image) The server device 2 acquires, via the remote user terminal 3 (14), for example, a past date and time (past time information) 57a of an event that was held in the past that the virtual visitor 23 would like to experience, and a position (past position information) 57b in the event area of ​​the virtual space. The past time information 57a ​​and the past position information 57b can be arbitrarily determined by the virtual visitor 23. The storage unit 31 stores past data 58 including time information and position information when the avatar elements 45b, 46b and the product display elements 48b, 49b were present in the event area 54a in the virtual space. The virtual space means 17 acquires from the storage unit 32 the avatar elements 45b, 46b and the product display elements 48b, 49b having past data 58 corresponding to the past time information 57a ​​and the past position information 57b. A past viewpoint image to be displayed on the display unit 4a, 15a is created by superimposing avatar elements 45b, 46b and product display elements 48b, 49b having past data 58 on a viewpoint image corresponding to past position information 57 in an event area 54a in the virtual space.

[0060] (display screen) Next, the screen displays of the remote user terminal 3 (14) and the visitor terminal 4 will be described with reference to Fig. 3. The upper part of the screen display shown in the figure is the display screen 47 of the display unit of the remote user terminal 3 (14), and the lower part is the display screen 50 of the display unit of the visitor terminal 4.

[0061] (Virtual visitor terminal display screen 47) The display screen 47 of the remote user terminal 3 (14) displays an event area 54a, which is a virtual space made up of two-dimensional or three-dimensional spatial data of an imaged space formed from an image of the event area 54 or a pseudo space formed to imitate the image. In this embodiment, a virtual space made up of three-dimensional spatial data formed from an image is displayed.

[0062] The event-related product 55 is displayed as a landscape in the virtual space. A coordinate position range 49a in which the products are arranged so as to surround the event-related product 55 is set in advance. In this embodiment, the coordinate position range 49a is displayed on the display screen. Since the virtual space itself is like a landscape, by setting the coordinate position range 49a, the products to be sold in the virtual space are specified. In addition, the display screen 47 displays the avatar element 45b of the visitor 21 and the product display element 49b. The coordinate position range 49a may not be displayed normally, but may be displayed by the operation of the remote visitor 22 (23). In addition, the coordinate position range 49a may be any shape such as a rectangular parallelepiped, a spherical shape, a cigar shape, etc., as long as it includes the event-related product 55 to be specified, or may be indicated by an arrow, a leader line, or the like instead of a range. Note that a plurality of event-related products 55 may be specified collectively by the coordinate position range 49a.

[0063] (Visitor's device display screen 50) The display screen 50 of the visitor terminal 4 corresponds to the field of view of the visitor 21 seen through the video capture of the event area 54 or smart glasses or the like. A position range 48a in which the products are arranged is set in advance so as to surround the event-related products 55 in the capture or field of view. In this embodiment, the position range 48a is displayed on the screen. By setting a predetermined position range 48a in the landscape, the products to be sold are identified. In addition, the display screen 50 displays the avatar element 46b of the virtual visitor 23 and the product display element 48b. Note that the position range 48a is almost the same as the coordinate position range 49a described above, and any shape, arrow, etc. can be adopted. Note that a plurality of event-related products 55 may be identified collectively by the position range 48a.

[0064] The user can select the corresponding avatar elements 45b, 46b and the product display elements 48b, 49b through the input / output device 32 or by touching the corresponding portion of the display unit with a finger, thereby selecting the corresponding person or product. Selecting a person allows the user to obtain person information 7a (described later) and initiates a conversation, whereas selecting a product allows the user to obtain product information 28 (described later) and initiates a purchase.

[0065] (Others in System 53) The position range 48a and the coordinate position range 49a may specify one product, or may be set to specify a predetermined range. Each set range can be used as a unit of trade. For example, a user can specify the coordinate position range 49a or product display 49b indicating a desired product through a virtual space, not a real space, and purchase the product. The coordinate position range 49a of the virtual space and the position range 48a of the event area 54 may be set together with time information. When the time information can be set together with a given coordinate position range 49a, the corresponding range of the virtual space can be rented together with the range of the event area 54. The person selling the goods in the event area 54 may be different from the person selling the goods in the virtual space. The remote party 22 can proceed with the purchase while interacting with the seller. In this embodiment, the product display elements 48b, 49b, the position range 48a, and the coordinate position range 49a are displayed on the display unit, but it is also possible to display only one of them.

[0066] [2-1. Communication through farms] Next, a case where a farm is used as a virtual space will be described. Most of the parts are the same as those in the case where the event area is used as a virtual space described above, so the same parts are given the same reference numerals and their explanation will be omitted.

[0067] [2-2. Overview] (Farm-based exchange system 44) First, an overview of the exchange system via a farm will be described with reference to Fig. 18. The system for the exchange method via a farm (hereinafter referred to as the system) 44 shown in Fig. 18 is mainly used between a visitor 21 visiting a farm 24 and a remote person 22 who is not visiting the farm 24 and is, for example, at home. The remote person 22 includes a virtual visitor 23 visiting a farm 24a (see Fig. 19) in a virtual space consisting of three-dimensional spatial data of an imaged space formed from an image of the farm 24 or a pseudo space formed to imitate the image.

[0068] A virtual visitor 23 visits the farm 24a in the virtual space for sightseeing, to check out / purchase farm-related products 41, or to interact with producers / sellers, where the producers / sellers are visitors 21 of the real farm 24. The virtual visitor 23 can also interact with other virtual visitors 23 who are visiting the farm 24a in the virtual space.

[0069] (Farm-related products and virtual space linkage system 52) The linking system 52 between farm-related products and virtual space consists of an information medium 51 including farm-related products 41 including agricultural products obtained from a farm or a website on which farm-related products are posted, and a system 44 (see FIG. 2). The information medium 51 contains access information 43 including a link to visit the farm 24a in the virtual space.

[0070] For example, a prospective purchaser who picks up wine as a farm-related product 41 at a store outside the farm 24 reads a QR code (registered trademark) as access information 43 printed on the wine's packaging container with his or her own user terminal. The prospective purchaser, as a virtual visitor 23, accesses the farm 24a in the virtual space of the farm where grapes for wine are grown, using the user terminal as a remote terminal 3. The virtual visitor 23 can understand the quality of the grapes at the farm 24a in the virtual space, interact with the visitor 21 who is the producer, and hear about the quality and characteristics of the grapes and wine. After that, referring to the knowledge gained at the farm 24a in the virtual space, the virtual visitor 23 considers purchasing the wine. The stores selling farm-related products 41 are not limited to stores on farm 24 or on farm 24a in the virtual space, but include roadside stations, local agricultural product stores, grocery stores, department stores, supermarkets, and convenience stores, and are a concept that can be converted into these.

[0071] (Farm 24) Farm 24 (real farm) may be, for example, a tourist farm that is open to tourists, or a general farm. It may also be a community farm that is divided into many plots and rented out to users, with agricultural products being grown in each plot, or a farm that is attached to a nursing home as a care farm.

[0072] (AC) The system 44 can display information about visitors 21 who are visiting the farm 24 and about registered users who will likely become visitors 21 if the date and time permits, on the terminal of the remote person 22 as advance information for interaction. Furthermore, for example, even those of the remote persons 22 who cannot access the farm 24a in the virtual space can understand the situation of the farm 24 from the images of the cameras 25 installed in the farm 24 via a communication network 26 such as the Internet. As will be described later, by logging in to the system 44, the visitor 21 and the remote persons 22 (including the virtual visitor 23), and further the virtual visitor 3a and the remote persons 22 who do not access the farm 24a in the virtual space, can understand each other's person information 7a (see FIG. 7) and interact with each other. As an example of an exchange, if the remote party 22 is cultivating agricultural products using a plot of farm 24 but cannot visit the farm 24 today, the remote party 22 can request farm work from the visitor 21. If the visitor 21 has a lot of experience in farm work, the remote party 22 can get advice from the visitor 21. Conversely, depending on the date and time, the relationship between the remote party and the visitor may be reversed, and the remote party 22 who made the request for farm work will receive the request for farm work as the visitor 21. By cooperating with each other to manage and operate the farm, the burden of resources and labor related to the management and operation of the farm can be reduced. The person who receives the request for farm work can receive a specified remuneration as an incentive for making the request. The request may be accepted free of charge.

[0073] (User) In this embodiment, when a user (hereinafter referred to as a user) of the farm 24 registers, the user is registered, for example, in a person identification database 6 (details of which will be described later). Registration is not essential. Even if a user does not visit the farm 24, the user can make date and time arrangements with other users and accept requests for farm work or arrangements for socializing. Examples of users who use the farm 24 include the following people. A producer is someone who produces agricultural products at a farm 24. Also, a seller is someone who sells farm-related products 41 produced at the farm. A producer may be both a producer and a seller. A user is someone who rents a plot of the farm 24 and does farm work. For example, a local resident or an independent care farmer may be considered. A user who rents a plot of the farm 24 may also become a seller who sells farm-related products 41 that he or she produces. A person who has not rented a plot of the farm 24 but has been requested to do farm work. For example, a worker at a business establishment, for example, a user at a disability employment support business establishment, is assumed. Even if a person has not rented a plot of the farm 24, he or she may be a seller upon receiving a request to sell farm-related products 41. These users do not rent plots on the farm 24, but enjoy the farm for sightseeing, tours, and walks. For example, they may be family members of local residents who rent the farm, people in need of care at a care farm, staff at a care farm, family members of residents at a care farm, or people who are registered to be able to enter the farm repeatedly. They may also be purchasers of farm-related products 41. Purchasers may also include people who are planning to make a purchase. The manager of the farm24. Cultivation instructors are assumed to be, for example, farmers, employment support managers for people with disabilities, and staff of care farms. A virtual visitor 23 is a visitor to the farm 24a in the virtual space. He or she may rent a plot of land on the farm 24. This makes them both producers and buyers. The virtual visitor 23 can visit the farm 24a in the virtual space from afarm. By linking with farms in other virtual spaces or with virtual spaces other than the farm, the virtual visitor 23 can travel between other virtual spaces.

[0074] [2-3.Each configuration] (System 44) Returning to FIG. 2, a functional block diagram is shown illustrating a system 44 . In the system 44, a predetermined range of positions where the agricultural products of the farm 24 are grown and a coordinate position range in the virtual space corresponding to that range of positions are set. Furthermore, agricultural product display elements related to the agricultural products are displayed in the field of view through the visitor terminal 4 of the visitor 21 and on the viewpoint image of the remote terminal 3 (14) of the virtual visitor 23, respectively. In this embodiment, the agricultural product display elements 48b, 49b are tags on which one or more pieces of information selected from the product information 28 (see FIG. 20) are described. Alternatively, for example, two-dimensional or three-dimensional spatial data of a captured image formed by capturing an image of the agricultural product in the farm 24 or a pseudo image formed by simulating the captured image may be used as the tag. The data of the avatar elements 45b, 46b and the agricultural product display elements 48b, 49b are stored in the storage unit 31 of the server device 2, for example.

[0075] (Produce labeling elements 48b, 49b) Furthermore, in the system 44, a coordinate position range 49a in the virtual space corresponding to a predetermined position range 48a (see FIG. 19) in which agricultural products are grown on the farm 24 is preset and stored in the server device 2. The predetermined position range 48a in which agricultural products are grown on the farm 24 is a range that includes the agricultural products. The virtual space processing means 17 transmits agricultural product display elements 48b, 49b to the visitor terminal 4 and the remote user terminal 3 (14), respectively. Therefore, in the field of view of the visitor 21 through the visitor terminal 4, the agricultural product display element 48b is displayed in the position range 48a. Meanwhile, the agricultural product display element 49b is displayed in the coordinate position range 49a on the viewpoint image of the remote user terminal 3 (14).

[0076] The avatar elements 45b, 46b and the farm product display elements 48b, 49b are registered and stored in advance in the server device 2 or the user terminals 3 (14), 4, for example.

[0077] (Virtual visitor terminal display screen 47) The display screen 47 of the remote terminal 3 (14) displays the farm 24a in a virtual space consisting of two-dimensional or three-dimensional space data of an imaged space formed from an image of the farm 24 or a pseudo space formed simulating the image. In this embodiment, a virtual space consisting of three-dimensional space data formed from an image is displayed. The crops 28c are displayed as a landscape in the virtual space. A coordinate position range 49a in which the crops are grown is set in advance so as to surround the crops 28c. In addition to the crops, agricultural products 41 including livestock products may be specified by the coordinate position range 49a. In this embodiment, the coordinate position range 49a is displayed on the display screen. Since the virtual space itself is like a landscape, agricultural products to be sold in the virtual space are specified by setting the coordinate position range 49a. In addition, the display screen 47 displays an avatar element 45b of the visitor 21 and an agricultural product display element 49b. The coordinate position range 49a may not be displayed normally, but may be displayed by an operation of the remote visitor 22 (23). Coordinate position range 49a may be any shape, such as a rectangular parallelepiped, a sphere, a cigar shape, etc., as long as it includes crop 28c to be specified, or may not be a range and may instead point to crop 28c to be specified with an arrow, leader line, etc. Farm-related products 41, including livestock products and agricultural products, other than crops, may be specified by coordinate position range 49a.

[0078] (Visitor's device display screen 50) The display screen 50 of the visitor terminal 4 corresponds to the field of view of the visitor 21 seen through the image of a video of the farm 24 or smart glasses or the like. A position range 48a in which the crops are grown is set in advance so as to surround the crops 28c in the image or field of view. In this embodiment, the position range 48a is displayed on the screen. The crops to be sold are identified by setting a predetermined position range 48a in the landscape. Also displayed on the display screen 50 are an avatar element 46b of the virtual visitor 23 and an agricultural product display element 48b. The position range 48a is substantially the same as the coordinate position range 49a described above, and any shape, arrow, etc. may be adopted. In addition to agricultural products, farm-related products 41 including livestock products and agricultural products may be identified by the position range 48a.

[0079] The user can select the avatar elements 45b, 46b and the agricultural product display elements 48b, 49b using the input / output device 32 or by touching the corresponding parts of the display unit with a finger, thereby selecting the corresponding person or product (agricultural product 28c), respectively. Selecting a person allows acquisition of person information 7a, which will be described later, and serves as a catalyst for dialogue, whereas selecting a product (farm products 28c) allows acquisition of product information 28a, which will be described later, and serves as a catalyst for purchase.

[0080] (Others in System 44) The location range 48a and the coordinate location range 49a may specify one agricultural product, or may be set to specify a predetermined range, such as a unit of a ridge or a unit of the number of fruit trees. Each set range can be used as a unit of purchase and sale. For example, a user can view the ripeness, color, size, etc. of a desired agricultural product through the virtual space, specify the coordinate location range 49a or agricultural product display 49b, and purchase the product individually. The coordinate position range 49a in the virtual space and the position range 48a of the farm 24 may be set together with time information. For example, in the case of a rented farm where a plot is rented, the time information may be the rental period. If the time information can be set together with a predetermined coordinate position range 49a, the corresponding range in the virtual space can be rented together with the land of the farm 24. The person who grows / produces / raise the agricultural products on farm 24 may be different from the person who sells the agricultural products in the virtual space. If the growing process of agricultural products can be seen in virtual space, it is possible to purchase agricultural products in advance when they are not yet mature enough to be harvested, for example, when they are still in the sprout, seedling or immature stage. It is also possible to purchase chickens that are not laying eggs, livestock that are not used for meat, etc. In this case, the remote party 22 can proceed with the purchase while interacting with the person cultivating / producing / raising or selling the produce. In this embodiment, the agricultural product display elements 48b, 49b, the position range 48a, and the coordinate position range 49a are displayed on the display unit, but it is also possible to display only one of them.

[0081] (Mode of dialogue) Next, another embodiment of the systems 44 and 53 will be described. A system 29 (hereinafter, a second system) of another embodiment shown in Fig. 4 is almost similar to the above-mentioned systems 44 and 53, so the same parts are given the same reference numerals and the description thereof will be omitted.

[0082] (Second System 29) The second system 29 has a function that allows users to communicate with each other. The second system 29 is composed of a server device 2 that mediates between the remote user terminal 3 (14) and the visitor terminal 4. The function of the second system 29 may be incorporated into the system 44.

[0083] (Server device 2) The server device 2 further includes a person information acquiring means 7 and a person information database 8 (hereinafter referred to as a person information DB).

[0084] (Person information acquisition means 7) The personal information acquisition means 7 acquires pre-registered personal information 7a from the personal information DB 8 based on the login information 25c (specific information 5a). The data structure of the personal information DB 8 will be described later. The personal information 7a is transmitted to the remote terminal 3 (14) or the visitor terminal 4.

[0085] (User terminal 3 (14), 4) The user terminals 3 (14), 4 further include a person selection and acquisition means 10 for acquiring person information 7a, and a transmission means 11. In the figure, the remote user terminal 3 (14) is the terminal that initiates a conversation.

[0086] (Person selection acquisition means 10) The person selection and acquisition means 10 is used when it is desired to know information about a person for a conversation. It selects a person about whom information is desired to be obtained, and requests person information 7a from the server device 2. When a virtual visitor 23 visiting the virtual space wishes to select another virtual visitor 23 to talk to, the user may click on an avatar element displayed in the virtual space or touch the display unit by a user operation to request person information 7a corresponding to the clicked or touched avatar element.

[0087] (Means of communication 11) The communication means 11 transmits voice information or text information as communication information 11a to the visitor 21 and remote party 22 (virtual visitor 23) with whom the conversation should take place. In the case of voice information, the terminals with which the conversation should take place may directly communicate with each other without going through the server device 2. The communication information 11a is information in the form of text, voice, or video, and includes, as its contents, everyday conversation, information related to farm-related products 41, information, questions, requests, answers, etc., related to farm work.

[0088] (Visitor Terminal 4) In this embodiment, the visitor terminal 4 is substantially the same as the remote visitor terminal 3. The visitor terminal 4 is provided with a communication means 11.

[0089] [3. Hardware configuration] Next, the hardware configurations of the server device 2, the user terminal, and the head mounted display system 14 will be described with reference to FIGS. 5, 6, and 7, respectively.

[0090] (Hardware configuration of server device 2) As shown in FIG. 5, the server device 2 of this embodiment uses, for example, a computer. The computer includes a CPU 30. A memory (hereinafter referred to as a storage unit) 31, an input / output device 32 including a keyboard, a mouse, etc., a connection port 33 for connecting / reading a storage device 33a, etc., and a communication circuit 34 for communicating with the outside via a network are connected to the CPU 30 via a bus line 35. The storage unit 31 stores a person information DB8, a product information DB28 (described later), a person identification DB6 (see FIG. 10), systems 44 and 29, a server program 36 for processing systems 40 and 20 (described later), a browser program 37, and an OS 38 (operating system).

[0091] Furthermore, past virtual space event areas 54a, farms 24a, and avatar display elements 45b, 46b, and product display elements 48b, 49b in past virtual spaces can be recorded in chronological order like a video recording in the memory unit 31. The virtual visitor 23 (22) can visit events that have already ended and past farm virtual spaces 24a. In the past virtual space 54a, 24a, the avatar display element 45b, 46b can be selected, and the user can make contact through the contact information via the person information DB 8. Furthermore, in the past virtual space 54a, 24a, the user can select the product display element 48b, 49b, and purchase the product from the product information DB 28. When purchasing agricultural products, the user can check the past growth conditions.

[0092] In this embodiment, the server program 36 operates in cooperation with the functions of the OS 38 and the browser program 37. Note that the server program 36 may operate independently without using the browser program 37 and the OS 38. The server program 36 is stored in, for example, the storage device 33a. The server program 36 is installed in the server device 2 by reading the storage device 33a from the connection port 33.

[0093] (Hardware configuration of user terminals 3 and 4) Next, the hardware configuration of the user terminal will be described. The user terminal is used as the remote terminal 3 and the visitor terminal 4. It can also be used as a virtual visitor terminal 14. Here, the hardware configuration of the remote terminal 3 will be described, and the description of the visitor terminal 4 will be omitted. The hardware configuration of the remote user terminal 3 is almost the same as that of the server device 2 described above, so the same parts are given the same reference numerals and the description thereof is omitted. As shown in FIG. 6, the remote user terminal 3 of this embodiment may be, for example, a smartphone, a notebook computer, or a head-mounted display. The user terminal 3 includes a CPU 30. The CPU 30 is connected to a memory unit 31, a connection port 33 for connecting / reading a memory device 33a, etc., and a communication circuit 34 for communicating with the outside via a network, via a bus line 35. The input / output device 32 includes, for example, a microphone 32a, a speaker 32b, and an operation unit 32c. The microphone 32a, the speaker 32b, and the operation unit 32c are the same as the corresponding parts of the head mounted display 15 described later. The memory unit 31 stores a user terminal program 39 for processing the systems 44, 29, 40, and 20, a browser program 37, and an OS 38 (operating system). The user terminal program 39 is stored in, for example, the memory device 33a. The server program 36 is installed in the user terminals 3 and 4 by reading the memory device 33a from the connection port 33.

[0094] In the hardware configurations of the server device 2, remote terminal 3, and visitor terminal 4 described above, the functions of the systems shown in Figures 2, 4, 12, and 15 are realized, for example, using a CPU 30, a server program 36, and a remote terminal (visitor terminal) program 39, but some or all of them may be sequence-controlled using a logic circuit such as a microcomputer, or a PLC (programmable logic controller).

[0095] (Hardware configuration of head mounted display system 14) Next, a description will be given of the hardware configuration of the head mounted display system 14. In the hardware configuration of the head mounted display system 14, parts that are substantially the same as those in the hardware configuration of the remote user terminal 3 described above are denoted by the same reference numerals, and descriptions thereof will be omitted.

[0096] (Head Mounted Display System 14) Next, a head mounted display system as the virtual visitor terminal 14 will be described with reference to FIG. The head mounted display system 14 shown in the figure includes a head mounted display 15 that is worn on the user's head, and a control device 16. Note that the head mounted display system 14 described below is an example, and is not limited to this.

[0097] (Head Mounted Display 15) The head mounted display 15 mainly comprises a display unit 15a on which an image of a virtual space is displayed, and a head position detection sensor 15b. In this embodiment, the head mounted display 15 further comprises a speaker 15c, a microphone 15d, and an operation unit 15e. Note that the speaker 15c, the microphone 15d, and the operation unit 15e do not have to be integrated with the head mounted display 15, and any one of them may be integrated with the head mounted display 15.

[0098] (Display section 15a) The display unit 15a has left and right image display surfaces disposed at positions corresponding to the left and right eyes of the user so as to cover the left and right eyes of the user. A three-dimensional video may be displayed to the user by displaying images with parallax on the left and right image display surfaces, respectively.

[0099] (Head position detection sensor 15b) Head position detection sensor 15b detects posture information such as the direction and inclination of head mounted display 15. The sensor for detecting posture information is realized by appropriately combining a gyro sensor, an acceleration sensor, an angular acceleration sensor, etc. The position and posture of the user's head are detected, and the detection result is reflected in a three-dimensional image of the virtual space displayed by display unit 15a, to present a three-dimensional image (viewpoint image) seen from a viewpoint position according to the movement of the user's head.

[0100] (Speaker 15c, Microphone 15d) The speaker 15c outputs audio, such as real audio in the virtual space, audio and music that take into account the situation in the virtual space, and audio from a conversation with the visitor 21, a remote person 22, or another virtual visitor 23. The microphone 15d receives the user's voice when interacting with the visitor 21, the remote person 22, or another virtual visitor 23.

[0101] (Operation unit 15e) The operation unit 15e includes, for example, an operation lever and an operation button. By operating these, an option displayed on the display unit 15a can be selected and the selected option can be confirmed. For example, in this embodiment, a plurality of agricultural products available for purchase in the virtual space are displayed, and the agricultural product to be purchased is selected from the displayed agricultural products and the purchase is confirmed. In addition, by operating the operation unit 15e, the three-dimensional image seen from the viewpoint position can be moved, and the user can feel as if he or she is moving within the virtual space. The operation unit 15e is communicably connected to the control device 16 through a communication circuit.

[0102] (Control device 16) The hardware configuration of the control device 16 is almost the same as that of the server device 2 or the remote user terminal 3 described above, so the same parts are denoted by the same reference numerals and their explanations are omitted. The control device 16 generates images to be displayed on the display unit 15a of the head mounted display 15, and performs various calculation processes. The storage unit 31 stores processing programs and the like for generating images and the like to be displayed on the display unit 15a and for carrying out various types of arithmetic processing and the like.

[0103] [4. Program] (Flowchart of user registration process) Next, a flowchart of user registration processing will be described with reference to Fig. 8. Fig. 8 is a flowchart showing an embodiment of processing of a user terminal program 39a used in the user terminals 3, 4, 14 (hereinafter referred to as user terminals, etc.) of the systems 29, 44 and a server program 36a used in the server device 2. In this embodiment, the process is executed using the function of a web browser. However, the user registration process may be executed by a program installed on the user terminal or the like and the server device 2.

[0104] (T1) When an unregistered user who wishes to use the system 20 operates a user terminal or the like, the user terminal or the like requests the server device 2 to transmit a registration form for user registration. For example, in this embodiment, a function of a web browser is used.

[0105] (T2) The server device 2 transmits a registration form. In the registration form, a user name and password used for login processing, a handle name used in the systems 44 and 29, etc. are entered. Furthermore, information to be stored in the person identification DB 6 and the person information DB 8 is entered. Note that the information input to the person information DB 8 may be made optional.

[0106] When a user enters the farm 24 or the vent area 54a, a face image required for face authentication may be registered in the person identification DB6. Furthermore, when receiving a request for farm work or the like, it is preferable to enter detailed information in the personal information DB8 so that the information can serve as reference information for the requester. Furthermore, when receiving a reward, the registration form is filled with information necessary to receive the reward 8d (see FIG. 21). The necessary information is, for example, all information necessary to actually receive the reward. The necessary information includes, for example, bank account information, such as the bank name (bank code), branch name (branch number), account number, account name, and information that can be converted thereto. When the reward 8d is electronic money, points that can be used within the system, virtual currency, tokens (cryptocurrency), etc., all information necessary to receive the electronic money, points that can be used within the system, virtual currency, tokens (cryptocurrency), etc. is entered. All necessary information may be at least the minimum information necessary to receive the reward. These registration items may be registered all at once, or may be registered each time.

[0107] (T3) The unregistered user enters information for registration in the entry fields and transmits it to the server device 2.

[0108] (T4) Information required for registration is registered in the person identification DB 6 and the person information DB 8.

[0109] (Login process flow chart) FIG. 9 is a flow chart showing an embodiment of the processing of the user terminal program 39b used in the user terminals of the systems 29 and 44 and the server program 36b used in the server device 2. In FIG.

[0110] (R1) A user who wishes to log in starts the user terminal program 39b of the system 29, 44, enters the registered user name and password on the login information input screen, and transmits them to the server device 2. The visitor 21 can log in using face authentication via the authentication device 1 (see FIG. 1), but may also log in using a separate user name and password.

[0111] (R2) The server device 2 refers to a user registration database (for example, see the person registration DB 6 in FIG. 10) and searches for a registration that is identical to the transmitted user name 6b and password 6c. If there is no identical registration, the process returns to R1. If there is an identical registration, the user logs into the system 29, 44. Once logged in, a user terminal program 39d (see FIG. 11) for communication and dialogue is started. It is also possible to log in using a mechanism known as social login.

[0112] (Data structure of person-specific DB6) The data structure of the person identification DB is shown in Fig. 10. The person identification DB 6 shown in the figure is made up of, for example, an identification number 6a, a name / user name 6b, and registered face image information or password 6c.

[0113] (R3) In the case of face authentication, when the same registration is confirmed, the authentication device 1 transmits specific information such as the identification number 5a to the server device 2 (see the route indicated by the two-dot chain line).

[0114] (Authentication device 1) The authentication device 1 (see Figs. 1, 15, 18) is a device that identifies visitors 21 in the event area 54 or the farm 24, and acquires information such as the name of the identified person or an identification number that can be converted into a name. For example, in this embodiment, a device integrated with a camera device 25 is adopted. The authentication device 1 includes the above-mentioned person identification means 5 and person identification DB 6. The authentication device 1 may be installed at the entrance / exit of the farm 24 to manage the entry and exit of the visitors 21. Furthermore, multiple authentication devices 1 may be installed within the farm 24 to identify the position and time of the visitor 21 within the farm 24 and acquire the behavioral history.

[0115] (Facial recognition processing) A trained program based on, for example, machine learning for face recognition is built into the authentication device 1. When a visitor 21 enters the farm 24, a camera device 25 detects the face of the visitor 21. A person identification means 5 of the authentication device 1 identifies the visitor 21 based on data registered in a person identification DB 6, and transmits identification information 5a to the server device 2. Machine learning will be described later.

[0116] (Flowchart showing the interaction process) Fig. 11 is a flowchart showing an embodiment of the processing of the visitor terminal 4, the user terminal program 39d used in the virtual visitor terminal 3 (14) of the second system 29, and the server program 36d used in the server device 2. This flowchart shows an interaction process. The flowchart shown in Fig. 11 shows the interaction method 20a.

[0117] First, a process will be described in which the virtual visitor 23 operates the operation unit 15e to change the viewpoint image in the virtual space displayed on the display unit 15a. In this embodiment, it is assumed that the virtual visitor 23 moves around the virtual space, finds another virtual visitor 23 with whom he or she wants to talk, and then starts the conversation. For this reason, the process of changing the viewpoint image is performed before the dialogue process. However, the process of changing the viewpoint image may be performed after the dialogue process.

[0118] (W1) In response to an operation of the operation unit 15e, the CPU 30 of the remote user terminal 3 (14) transmits operation information 17a to the server device 2.

[0119] (W2) Based on the operation information 17a, the amount of displacement of the viewpoint coordinates is acquired, a viewpoint image of the displaced viewpoint coordinates is generated, and it is transmitted to the remote user terminal 3 (14).

[0120] Next, the processing of the interaction will be described. (V1) In order to select a person with whom one wishes to converse, the CPU 30 of the remote terminal 3 (14) can request person information 7a from the server 2. The request may be for all person information 7a of people who are logged in to the system, or for person information 7a limited to a specific person. When narrowing down the people, a screen section (not shown) for narrowing down search is displayed on the display section 15a, and the narrowing down item is selected and requested. Furthermore, if an avatar element of a virtual visitor 23 with whom one wishes to converse is displayed on the display section 15a, the avatar element may be selected via the operation section 15e. Note that the visitor 21 who can visually recognize the virtual visitor 23 with AR glasses or the like may request the person information 7a of the virtual visitor 23.

[0121] (V2) Based on the request, the person information 7a is transmitted to the remote user terminal 3 (14). The person who is logged in to the system 29 transmits the login information 25c to the server 2. Therefore, the server device 2 can obtain the person information 7a based on the login information 25c and the person information DB8.

[0122] (V3) Select a person to talk to.

[0123] (V4) Contact the remote terminal 3 (14) of the person you want to talk to to inform them that you want to talk (see communication information 11a in FIG. 4). Get a message of approval from the other party (communication information 11a) and talk via the server device 2. You can have a conversation using text information or voice information. If you know the contact information of the person you want to talk to from the person information 7a, you can contact them by phone, a conversation application, chat, email, or the like, without using the second system 29.

[0124] In the second system 29, a head mounted display system is used as the virtual visitor terminal 14, but a personal computer, a smartphone, or the like may also be used. When a personal computer or the like is used, an image of the virtual space is displayed on the display unit 3a. In the virtual space, the viewpoint image of the virtual space is moved by the input / output device 32 (see FIG. 5).

[0125] 5. Other embodiments (Third System 40) Next, a further embodiment of the system 44 will be described. A system 40 (hereinafter, the third system) of the further embodiment shown in Fig. 12 is almost similar to the second system 29 described above, so the same parts are denoted by the same reference numerals and the description thereof will be omitted.

[0126] In the third system 40, a virtual visitor 23 as a purchaser purchases goods or agricultural products from a visitor 21 as a seller. The purchaser may also be a remote person 22. The third system 40 comprises a remote person terminal 3 (14), a visitor terminal 4, and a server device 2 that acts as an intermediary between them.

[0127] (Server 2 of the third system 40, remote terminal 3 (14)) The server 2 further includes a settlement means 9, an update means 19, and a product information database (hereinafter, referred to as product information DB) 28. Reference numeral 42 denotes a camera that acquires three-dimensional data. The remote user terminal 3 (14) includes a product acquisition means 27.

[0128] (Payment method 9) The payment means 9 pays for the event-related products 55 or farm-related products 41 to the visitor 21 as a seller / producer. Payment is based on the settlement information 13. The settlement information 13 includes the settlement conditions. The settlement conditions include the payment method, the type of currency, the payment due date, etc. The settlement information 13 is transmitted from the remote user terminal 3 (14) to the server device 2. The settlement information 13 is stored in the memory unit 31. The amount of the fee / reward may also be determined through negotiation between the visitor 21 and the remote party 22. The fee / reward may be converted into cash, electronic money, virtual currency, or tokens (cryptocurrency), or may be paid to the visitor 21 as points, virtual currency, or tokens (cryptocurrency) that can be used to purchase products and services in the system 40. Furthermore, the payment method may be an item such as agricultural produce, or may be a payment method for paying a non-monetary reward, for example. Although details will be described later, a reward may be paid to the visitor 21 for a request such as farm work. A reward is paid to the visitor 21 who completes the request based on the request content registered in the storage unit 31. The reward amount for each request content is registered in advance in the person information 7a.

[0129] (Update method 19) The update means 19 updates the image of the virtual space to correspond to different events, the change of seasons in the farm 24, and the growth of agricultural products. The update means 19 collects images of three-dimensional data using a camera device 42 that collects three-dimensional data, creates a virtual space to be displayed, and stores the images in the storage unit 31. The camera device 42 may be fixed to the event area 54 or the farm 24.

[0130] (Product acquisition means 27, product information DB 28) The product acquisition means 27 acquires the product information 28a from the product information DB 28. The product information 28a is acquired by an operation of a user who operates the remote user terminal 3 (14). For example, the user acquires the product information 28a by clicking on a product image (not shown) for sale in the virtual space. For example, a product can be specified by the position range 48a, product / agricultural product display element 48b, coordinate position range 49a, and product / agricultural product display element 49b described in FIG. 3 or FIG. 19. Here, the product acquisition means 27 corresponds to B1 (see FIG. 13) in the embodiment.

[0131] (Seller 43, Visitor Terminal 4) The seller sells the product through the visitor terminal 4 as a seller in the third system 40. In this embodiment, the visitor terminal 4 is, for example, a smartphone. Other devices include a mobile phone, a tablet terminal, a personal computer, and a wearable computer that can be attached or worn. Examples of wearable terminals include a smart watch and smart glasses.

[0132] (Flowchart showing purchase process) 13 is a flowchart showing an embodiment of the processing of the user terminal program 39e used in the remote user terminal 3 (14) and the server program 36e used in the server device 2 of the third system 40. This flowchart shows a sales process.

[0133] (B1) To purchase a product, the CPU 30 of the virtual visitor terminal 14 requests product information 28a from the server 2. The request may be for all product information 28a of sellers logged in to the system, or for product information 28a limited to specific products. When narrowing down the products, a screen section (not shown) for narrowing down the search is displayed on the display section 3a (15a), and the item to be narrowed down is selected and requested. Furthermore, a product image (not shown) displayed on the display section 3a (15a) may be selected. When requesting product information 28a, personal information 7a of the seller may also be requested.

[0134] (B2) Based on the product information database (product information DB) 28, product information 28a is transmitted to the remote terminal 3 (14). At that time, personal information 7a of the seller may also be transmitted.

[0135] (Data structure of product information DB28) 14 shows the data structure of the product information DB for event-related products 53. The product information DB 28 shown in the figure includes, for example, an ID (identification number) 28a, a name 28b, a product 55, a stock quantity 28g, and a price 28e. Other information may also be registered. Fig. 20 shows the data structure of the product information DB for farm-related products 44. The product information DB 28 shown in the figure consists of, for example, an ID (identification number) 28a, a name 28b, a crop 28c, a sales unit 28d, a price 28e, and a harvest date 28f. Other information may also be registered. Agricultural produce or farm-related products 41 may be used instead of crops.

[0136] The identification number 28a is a number assigned to each person. The person identification DB 6 and the person information DB 8 are relational databases linked by the identification number and the name. Therefore, the person information 7a can be searched for from the specific identification number 28a in the product information DB 28. In this embodiment, the person information 7a of the person who cultivated the crop 28c from the received product information 28a, for example, the knowledge and experience information 8f and the affiliation and attribute information 8g, can be taken into consideration in the purchase decision. As the name 28b, a user name, a pen name, etc. may be registered instead of a real name. The crop 28c is the type of cultivated crop. The sales unit is a unit of sale. For example, it can be purchased per unit. The price 28e is the amount per unit. It may be a virtual currency such as points or bitcoin, or a token (cryptocurrency), etc. The harvest date 28f is the date when the crop 28c was harvested. The product 28g is an event-related product. The stock quantity 28g is the remaining number of products.

[0137] (B3) The visitor 21 selects a seller of the product to be purchased.

[0138] (B4) The visitor terminal 3 is contacted with a request to talk (transmission information 11a). A message of approval (transmission information 11a) is received, and a conversation is conducted via the server device 2. The conversation and negotiation can be conducted using text information or voice information. If the seller's contact information is known from the person information 7a, the seller may contact the visitor terminal 3 by telephone, a conversation application, chat, email, or the like, without using the third system 40. Alternatively, the customer may skip the conversation in step B4 and proceed directly to step B5 to purchase the product.

[0139] (B5) It is decided whether or not to purchase the product through an input operation by the virtual visitor 23. If the product is not to be purchased, the process ends.

[0140] (B6) If a purchase is made, the payment information 13, such as the fact that payment is to be made, the amount, and other necessary information, for example, the product name, the number of items to be purchased, and the delivery date, is transmitted to the server device 2.

[0141] (B7) Pay the purchase amount. In this embodiment, the payment may be made with points, virtual currency, or tokens (encrypted currency) that can be used in the third system 40. It is also possible to transfer cash to a transfer account registered in advance.

[0142] After payment, the seller delivers the agricultural produce or other goods to the buyer by mail, courier, etc. The buyer may register a buyer rating 8h (see Figure 16) based on the delivered goods. Meanwhile, the seller may also register a rating 8h for the interaction with the buyer.

[0143] (4th System 20) Next, a further embodiment of the system 44 will be described. The system 20 (hereinafter, the fourth system) of the further embodiment shown in Fig. 15 is almost similar to the second system 29 described above, so the same parts are denoted by the same reference numerals and the description thereof will be omitted.

[0144] The system 20 differs from the second system 29 mainly in that it includes an authentication device 1 for identifying visitors to the event area 54 or the farm 24, and a request / reward registration means 12 in the remote user terminal 3 (14).

[0145] (Request / reward registration method 12) The request / remuneration registration means 12 registers the details of the request, such as the person who accepted the request, the request details, and the amount of remuneration, in the storage unit 31.

[0146] (Flowchart showing request processing) 16 is a flowchart showing an embodiment of the processing of the user terminal program 39c used in the visitor terminal 3 and the remote user terminal 3 (14) of the fourth system 20 and the server program 36c used in the server device 2. This flowchart shows a request process.

[0147] (S1) After logging in, the user terminal program 39c is started. Based on the program 39c, the remote person 22 operates to request the server device 2 to transmit information about the visitor 21 and / or the registrant (hereinafter referred to as the visitor, etc.) to whom the request should be made. In the request, conditions may be specified based on the date and time of the requested work, the work content, the range of the remuneration amount, the affiliation and attribute information or gender of the visitor, etc., and transmitted to the server device 2.

[0148] (S2) The server device 2 receives the specific information 5a in real time or at predetermined time intervals from the authentication device 1. The CPU 30 of the server device 2 refers to the personal information DB 8 from the specific information 5a and acquires the personal information 7a. Furthermore, the visitor 21 can prevent the remote party 22 from knowing that he or she is visiting the farm 24 .

[0149] (Data structure of person information DB8) 17 shows the data structure of a person information DB used in the system 53 via the event area 54. The person information DB 8 shown in the figure is composed of, for example, an identification number 8a, a name 8b, contact information 8e, knowledge and experience information 8f, and affiliation and attribute information 8g. Other information may also be registered. 21 shows the data structure of a person information DB used in the system 44 via the farm 24. The person information DB 8 shown in the figure consists of, for example, an identification number 8a, a name 8b, a task content 8c, a remuneration 8d, contact information 8e, knowledge and experience information 8f, affiliation and attribute information 8g, an evaluation 8h, and a date and time 8i. Other information may also be registered.

[0150] The identification number 8a is a number assigned to each person. As the name 8b, a user name, a pen name, etc. may be registered instead of a real name. The work contents 8c include, for example, sending plot images, sending cultivation information, planting seeds or seedlings, fertilizing, watering, removing weeds, spraying pesticides, harvesting, advice, etc. Other work may be registered. Each user may be allowed to register what he or she can do. The reward 8d is determined in advance based on the effort and expertise of the farm work. Note that the user may register the reward by himself / herself based on, for example, his / her strengths and weaknesses. In the contact method 8e, contact methods and contact information permitted by the user are registered. Affiliation / attribute 8g registers the company name, the affiliation of care farm / neighborhood resident, and the attribute of disabled / elderly. The user may add other items to the affiliation and attributes, or may register in more detail. The evaluation 8h is the evaluation of the requester regarding the completed request. In this embodiment, a 5-point evaluation is used, with the higher the number from 1 to 5, the higher the evaluation. The number is the average of the evaluations obtained for each request. The evaluation may be in any number of stages, converted into symbols such as the alphabet, or evaluated with a score of 0 to 100. The visit date and time 8j is the usual date and time for visiting the farm 24. Alternatively, a specific date and time may be registered with pinpoint accuracy. In this embodiment, the user can register items other than the identification number 8a at his / her discretion. It is preferable that the user does not register information that he / she does not want to make public. It is also possible to specify the range of information in the personal information DB8 that can be made public.

[0151] Returning to FIG. 16, if there are conditions specified by the remote party 22 (hereinafter referred to as the requester), personal information 7a of those who meet the conditions may be transmitted from among visitors, etc. who have given permission to transmit location information and personal information 7a. If there are many matching people, a predetermined number of people are extracted and transmitted in order of highest evaluation. If there are no matching people, a message to that effect is transmitted. Note that even if there are no matching people, their personal information 7a may be transmitted as long as at least the date, time, and work content match. Furthermore, if nothing is specified in the request from the client, in this embodiment, for example, one or more highly rated visitors 21 currently visiting the farm 24 are identified and transmitted to the remote terminal 3. Note that the personal information 7a of all the visitors 21 may be transmitted.

[0152] (S3) Based on the acquired personal information 7a, a visitor or the like to whom a request should be made is identified.

[0153] (S4) The visitor or the like is notified of the requester's name, handle name or identification number, as well as the date and time of the requested work and the work content as communication information 11a. In this embodiment, for example, the information entered in step S1 is applied to the date and time and the work content. When specifying details such as the date and time of the work and the work content, the communication includes the information specifying the details. Note that a request may be made without transmitting the requester's name, handle name or identification number.

[0154] (S5) If the contacted visitor etc. approves the request, he / she sends a reply of approval (transmission information 11a) to the requester. If there are any unclear points such as questions about the date and time of the work, the work content, or the amount of remuneration, or requests, he / she contacts the requester about the unclear information (transmission information 11a). Before replying, the visitor etc. may request personal information corresponding to the requester's name, handle name, or identification number from the server 2.

[0155] (S4-S5) The visitor and the client communicate with each other regarding the date and time of the work, the work content, and the amount of compensation (see the two-dot chain line). Communication can be done by text or voice information. If the contact information of a visitor or the like is known from the person information 7a, the visitor or the like may be contacted by telephone, a conversation application, chat, e-mail, or the like, without relying on the system 20.

[0156] (S6) Decide whether to make the request.

[0157] (S7) If no request is to be made, the process ends. If a visitor or the like is to be selected again to make a request, the process returns to step S3.

[0158] (S8) When making a request, the request information 12a is registered in the server device 2. In this embodiment, the request information 12a corresponds to the requester, visitor, etc., the work date and time, the work content, and the remuneration amount. Other items may be included in the request content. For example, it may be possible to register an appointment between the parties.

[0159] (S9) Completion information 11b indicating the completion of the task is sent to the remote party terminal 3 (14) by the visitor terminal 4. Completion information 11b may be information indicating that the task has been completed, or it may be text information, audio information, or even image information showing the completed state.

[0160] (S10) When the client acquires the completion information 11b and confirms the completion of the work, the client transmits the payment information 13 to the server device 2. The payment information 13 includes payment instructions, evaluations 8h of visitors, etc., and other items to be registered.

[0161] (S11) Reward is paid. In this embodiment, reward is paid in points, virtual currency, or tokens (encrypted currency) that can be used within the system 20. Payment may also be made by incorporating a link with a credit card into the system. Furthermore, cash, the points, virtual currency such as Bitcoin, or tokens (encrypted currency), etc. may be transferred to a transfer account registered in advance.

[0162] (Modification) Next, a description will be given of a modified example of the system 20. The system according to the modified example is almost similar to the above-described system 20, and therefore a description of the same parts will be omitted. The system of the modified example does not use facial recognition by the authentication device 1. A base station (not shown) is installed near the entrance / exit of the event area 54 or the farm 24. When the visitor terminal 4 receives radio waves from the base station, the visitor terminal 4 transmits a signal to indicate that it has visited the farm 24. The signal is the visitor's own identification number or identification information 25b (see FIG. 15) that can be converted to the identification number. The identification information is transmitted to the authentication device 1 via the communication network 26, such as a wireless LAN or an Internet line within the event area 54 or the farm 24. The authentication device 1 identifies the person corresponding to the identification information 25b based on the person identification DB 6.

[0163] [6.Other] If the visitor terminal 4 of the visitor 21 has a GPS function, location information may be acquired so that the location of the visitor 21 within the farm 24 can be ascertained within the virtual space. For example, an avatar element (avatar image) of the visitor 21 is displayed at a corresponding position in the virtual space of the visitor 21. It is possible for the visitor to meet the visitor in the virtual space, to converse with the visitor, and to purchase agricultural products that the visitor is cultivating while conversing with the visitor. In addition, the location information makes it possible to ascertain the location of the visitor 21 within the farm, making it easy to find the visitor 21 with whom you wish to have a conversation. In the above-described head mounted display system 14, the head mounted display 15 and the control device 16 may be separate entities or may be integrated together. The head mounted display system 15 does not have to be a dedicated system, and may be, for example, a goggle-type headset to which a smartphone is attached. Head mounted displays include, for example, Virtual Reality (VR) type head mounted displays that display only a virtual space created by computer graphics or the like, and Mixed Reality (MR) type head mounted displays that display a real space (for example, a real space displayed optically through the real space) and a virtual space in real time. The present invention can be applied to either type of head mounted display. The person identification DB 6 may be provided in the server device 2 or an external server, rather than being integrated with the camera device 25. The server device 2 performs person identification. Furthermore, the person identification means 5 may be provided in the server device 2. A camera device 25 is provided at the entrance and exit of the farm, and the captured image information 25a is transmitted to the server device 2. The server device 2 manages entry and exit of people to and from the farm. The above-described embodiments, modifications, other embodiments, and other aspects may be used in appropriate combination. In the fourth system 40, the visitor terminal 14 may be set with an imaged space formed from an image of the event area 54 or farm 24, or a virtual space formed to simulate the image, rather than a field of view of the actual event area or farm.

[0164] (Machine Learning) Now let's explain machine learning. Machine learning techniques include, for example, "supervised learning," "unsupervised learning," and "reinforcement learning." Furthermore, to realize these techniques, there is a technique called "deep learning" that learns to extract the features themselves. In this embodiment, a CPU (see FIG. 5) is used, but if a GPU or the like is used, faster processing becomes possible.

[0165] "Supervised learning" involves providing a large amount of training data, i.e., pairs of input and result data, to learn the features of those data sets and inductively acquire a model that can infer results from inputs. "Unsupervised learning" is a method of learning by providing a large amount of input data, learning how the input data is distributed, and using a device that compresses, classifies, and formats the input data, without providing the corresponding teacher output data. For example, it is possible to cluster similar features in the data sets. Using the results of this, it is possible to set some kind of criterion and assign outputs that optimize it, thereby realizing output prediction.

[0166] "Reinforcement learning" refers to, for example, observing the state of the environment, deciding on an action, and learning to maximize the reward for that action. The environment changes according to certain rules, and one's own actions may also cause changes to the environment. Each time an action is taken, a reward is returned. What is desired to maximize is the total reward over the future. Learning starts from a state in which the consequences of actions are completely unknown, or only partially known. In other words, optimal actions are searched for through trial and error. Note that learning can start from a good starting point, using a state obtained through "supervised learning" or "inverse reinforcement learning" as the initial state.

[0167] Below, a case of supervised learning will be described as an example, but the present invention is not limited to supervised learning. From here, we will explain the learning unit (not shown) that uses machine learning (supervised) to improve the accuracy of judging suspicious people and people requiring observation. People requiring observation are people who behave suspiciously, are in poor health, or are at risk of causing accidents or trouble, and therefore require attention and observation. In this embodiment, the learning unit is provided in, for example, the authentication device 1 or the server device 2. The learning unit is used to create a required model in which the person was correctly identified as a suspicious person or a person requiring observation, and an unnecessary model in which the person was incorrectly identified. The required model is generated by learning information on behavioral history acquired via the camera device 25 in which the person was correctly identified. The unnecessary model is generated by learning information on behavioral history in which the person was incorrectly identified. The information on these behavioral histories is recorded in the memory unit 31.

[0168] [7. Other Summary] (Example for a farm) The method 20 of communication via a farm is executed by one or more computers and is a method of communication via a farm between a visitor 21 visiting the farm 24 and a remote party 22 viewing information about the farm 24, and is characterized in that it comprises a step of acquiring personal information 7a of a visitor 21 registered in advance based on specific information 5a that identifies the visitor 21, so that the remote party 22 can select a visitor 22 with whom he or she wishes to communicate, and a step of transmitting information to be conveyed to the selected visitor 21. Since personal information 7a of the visitor 21 visiting the farm 24 can be obtained, conversation can be encouraged both inside and outside the farm 24. A remote person 22 who cannot visit the farm 24 can appropriately request farm work from the visiting visitor 21. The visitor 21 and the remote person 22 can cooperate with each other to manage and operate the farm, reducing the burden of resources and labor involved in managing and operating the farm. Also, if the person is not feeling well or the weather or temperature is not suitable for the body, the person can request a visitor 21 to do the work as a remote person 22. Also, those who are bedridden or physically handicapped and cannot visit the farm 24 (remote people 22) can grow agricultural products in cooperation with visitors 22, including their family members and neighbors. Furthermore, if a remote party 22 is looking to purchase agricultural products, they can do so knowing what kind of person is growing them.

[0169] "Information about the farm" includes, for example, at least one of information about cultivation management, farm management, and safety management. Cultivation management information is information related to the climate for the cultivation and growth of agricultural products, and is equivalent to, for example, video information of the farm from surveillance cameras, weather forecast information, and even information provided by weather sensors, air temperature / soil temperature sensors, sunlight sensors, and rainfall sensors installed on the farm, and is a concept that includes information that can be converted into these. Farm management information is information about the status of farm equipment, such as usage information provided by electricity usage sensors, flow rate information from water flow meters, ON / OFF information for remote breakers, and open / close information for electric stop valves, and is a concept that includes information that can be converted into these. Safety management information is information related to safety management such as locking the farm and issuing alarms against intruders. For example, it includes the operation status of remote locking tools, and information on alarms issued due to intrusions by suspicious individuals into management huts, storage sheds, toilets, etc., and is a concept that includes information that can be converted into such information.

[0170] Users of community gardens and care farms are usually not engaged in agriculture and do not have much experience or knowledge of farm work. If users of these farms can cooperate to manage and operate the farms, it will reduce the burden of resources and labor required for managing and operating the farms. Furthermore, if users of community gardens and care farms can deepen their communication with each other through farm work, it is thought that this will contribute to, for example, the creation of local communities, the maintenance and improvement of public safety, and even the formation of communities in the event of a disaster. It can also help users get to know each other. It can make it easier for users to cooperate to operate and manage the farms.

[0171] In this farm-based communication method 20, since the personal information 7a includes information on visitors who will visit the farm 24, it is possible to contact visitors 21 who plan to visit in the future. In addition, farm work can be requested at an appropriate time.

[0172] The personal information 7a includes affiliation / attribute information 8g relating to the person's affiliation / attributes and / or knowledge / experience information 8f relating to agricultural knowledge and experience, the information to be communicated includes a request for farm work on a farm 24 to the visitor 21, and there is further a step of paying a fee for the request, so that the person to be requested and the person to whom the fee should be paid can be selected taking into consideration not only the farm work skill of the person to be requested but also the background of the person performing the farm work.

[0173] A virtual space consisting of two-dimensional or three-dimensional spatial data of an imaged space formed from an image of a farm 24 or a pseudo space formed to imitate the image is provided, and a viewpoint image moving within the virtual space is displayed on the display unit 15a of the virtual visitor terminal 14 of the virtual visitor 23 by the operation of the virtual visitor 23 visiting the virtual space. Since the system further includes a step of transmitting information to be communicated between users, the virtual visitors can talk to each other in the farm 24 as a virtual space. The conversation can be enjoyed without being affected by physical condition, weather, or temperature. The conversation can be carried out while looking at the same image of the farm 24. A person (virtual visitor 23) who is bedridden or has a physical disability and cannot visit the farm 24 can talk with the virtual visitors 23 including their family and neighbors through the farm 24 in the virtual space. If the virtual space can be accessed, for example, it is possible to visit the virtual space of the farm 24 of a care farm around the world. A person who is bedridden or has a physical disability and cannot go out can be taken out as a virtual visitor.

[0174] The system further includes a step of acquiring product information 28a including agricultural products and / or products related to the agricultural products in the farm 24 through the operation of the virtual visitor 23, and a step of making a payment to purchase the agricultural products and related products, so that an outsider who visits as a virtual visitor can purchase agricultural products from the farm 24. Furthermore, if the seller of the agricultural products is the virtual visitor 23, other virtual visitors 23 who are considering purchasing the agricultural products can purchase the agricultural products after talking with the seller in the virtual space. Agricultural products can be purchased from care farms 24 all over the world.

[0175] The system includes a step of acquiring location information 45a of a visitor 21 visiting the farm 24, and a step of displaying a preset avatar element 45b of the visitor 21 on the display unit 3a, 4a, 15a of the user terminal 3, 4, 14 at a position in the virtual space corresponding to the location information 45a, so that the visitor 21 can be remembered from the characteristics of the avatar element 45b.

[0176] The method further includes a step of acquiring coordinate position information 46a relating to the coordinate position of the virtual visitor 23 in the virtual space, and a step of superimposing and displaying a preset avatar element 46b of the virtual visitor 23 at a position in the field of view of the visitor 21 through the user terminal corresponding to the coordinate position information 46a, so that the virtual visitor 23 can be remembered from the characteristics of the avatar element 46b.

[0177] A predetermined position range 48a in which agricultural products are grown in the farm 24 and a coordinate position range 49a in the virtual space corresponding to the position range 48a are set, and a step is provided in which agricultural product display elements 48b, 49b relating to the agricultural products are displayed in the position range 48a in the field of view through the user terminal 4 of the visitor 21 and in the coordinate position range 49a displayed on each of the user terminals 3, 14 of the virtual visitor 23, respectively, so that the visitor 21 and the virtual visitor 23 can have a conversation while understanding the same agricultural products or information about the agricultural products.

[0178] The server device 2 is communicatively connected to both the visitor terminal 4 of the visitor 21 visiting the farm 24 and the remote terminal 3 of the remote person 22 viewing information about the farm 24, and is a server device used in a farm system for a communication method via a farm, and is characterized in that it is equipped with a personal information acquisition means 7 that acquires personal information 7a of the identified visitor 21 based on identification information 5a that identifies the visitor 21, so as to select a visitor 21 for the remote person 22 to communicate with. Since personal information 7a of the visitor 21 visiting the farm 24 can be obtained, conversation can be encouraged both inside and outside the farm 24. A remote person 22 who cannot visit the farm 24 can appropriately request farm work from the visiting visitor 21. The visitor 21 and the remote person 22 can cooperate with each other to manage and operate the farm, reducing the burden of resources and labor involved in managing and operating the farm. Also, if the person is not feeling well or the weather or temperature is not suitable for the body, the person can request a visitor 21 to do the work as a remote person 22. Also, those who are bedridden or physically handicapped and cannot visit the farm 24 (remote people 22) can grow agricultural products in cooperation with visitors 22, including their family members and neighbors. Furthermore, if a remote party 22 is looking to purchase agricultural products, they can do so knowing what kind of person is growing them.

[0179] In such a server device 2, the personal information 7a includes affiliation and attribute information regarding the person's affiliation and attributes and / or knowledge and experience information regarding agricultural knowledge and experience, the transmission includes a request for farm work to the visitor 21 selected based on the personal information 7a, and the server device 2 is further equipped with a payment means 9 for paying a fee for the request, so that the person to be requested and the person to whom the fee should be paid can be selected taking into account not only the farm work skill of the person to be requested but also the background for performing the farm work.

[0180] The system further includes a storage unit 31 that stores a virtual space consisting of two-dimensional or three-dimensional spatial data of an imaged space formed from an image of the farm 24 or a pseudo space simulating the imaged space, and a virtual space processing means 17 that displays a viewpoint image in the virtual space based on an operation of the virtual visitor 23 on the display unit 15a (3a) of the virtual visitor terminal 14 of the virtual visitor 23. The payment means 9 is for making payments for purchasing agricultural products in the farm 24 and products related to the agricultural products, so that the virtual visitors can talk to each other in the farm 24 as a virtual space. They can enjoy a conversation without being affected by their physical condition, weather, or temperature. They can talk while looking at the same farm image.

[0181] The server device 2 is a server device executed by one or more computers and used in a farm system for a communication method via a virtual space consisting of two-dimensional or three-dimensional spatial data of an imaged space formed from an image of a farm or a pseudo space formed to simulate the image, and is characterized in that it further includes a personal information acquisition means 7 for acquiring personal information 7a of the user registered in advance based on specific information 5a that identifies the user, in order to select a user with which to communicate. Since it is possible to obtain personal information 7a of visitors 21 visiting the farm 24, it is possible to encourage conversation between the farm and the virtual space. It is possible to invite virtual visitors 23 from outside the farm through the Internet from anywhere in the world.

[0182] The remote terminal 3 is a remote terminal of a remote person 22 that is communicatively connected to a visitor terminal 4 of a visitor 21 visiting a farm 24, and is used in a farm system 20 for a communication method via the farm and for viewing information about the farm 24, and is characterized in that it is equipped with a person selection and acquisition means 7 that requests personal information 7a of a visitor identified based on identification information 5a that identifies the visitor 21, in order to select a visitor 21 for the remote person 22 to communicate with. Since personal information 7a of the visitor 21 visiting the farm 24 can be obtained, conversation can be encouraged both inside and outside the farm 24. A remote person 22 who cannot visit the farm 24 can appropriately request farm work from the visiting visitor 21. The visitor 21 and the remote person 22 can cooperate with each other to manage and operate the farm, reducing the burden of resources and labor involved in managing and operating the farm. Also, if the person is not feeling well or the weather or temperature is not suitable for the body, the person can request a visitor 21 to do the work as a remote person 22. Furthermore, if a remote party 22 is looking to purchase agricultural products, they can do so knowing what kind of person is growing them.

[0183] Since the person information 7a of the remote user terminal 3 includes information on visitors who are likely to visit the farm 24, the remote user terminal 3 can contact the visitors 21 who are planning to visit in the future. In addition, the remote user terminal 3 can request farm work at an appropriate time.

[0184] Furthermore, the personal information 7a includes affiliation / attribute information regarding the person's affiliation / attributes and / or knowledge / experience information regarding agricultural knowledge and experience, and the information to be communicated includes a request for farm work to the visitor 21 selected based on the personal information 7a. Therefore, the person to be requested and the person to be paid can be selected taking into consideration not only the farm work skill of the person to be requested but also the background for performing the farm work.

[0185] The user terminals 3, 4, 14 are user terminals used in a farm system for a communication method via a virtual space that is executed by one or more computers and is made up of two-dimensional or three-dimensional spatial data of an imaged space formed from an image of a farm or a pseudo space formed to imitate the imaged space, and are characterized by being equipped with a person selection and acquisition means 10 that requests personal information of the user identified based on specific information 5a that identifies the user in order to select the user to whom information to be transmitted in order to communicate can be transmitted. Since personal information 7a of the visitor 21 or virtual visitor 23 visiting the farm 24 can be obtained, conversation can be promoted between the farm 24 and the virtual space.

[0186] The system 40 is a farm system that facilitates interaction between users who access a virtual space formed from an image of a farm 24 and consisting of two-dimensional or three-dimensional spatial data of an imaged space or a pseudo-space that simulates the imaged space, and is characterized in that it comprises a server device 2 that is equipped with a memory unit 31 that stores the virtual space and a personal information acquisition means 7 that acquires personal information 7a of virtual visitors 23 visiting the virtual space, and virtual visitor user terminals 3, 14 that are communicatively connected to the server device 2 and comprise a personal selection and acquisition means 10 that requests other personal information 7a in the virtual space in order to select other virtual visitors with whom the virtual visitor 23 will communicate, and a transmission means 11 for transmitting information to the selected virtual visitor 23. Virtual visitors can talk to each other in the virtual space of Farm 24. They can enjoy conversations regardless of their physical condition or the weather or temperature. They can talk while looking at the same farm image.

[0187] In such a system 40, the user terminal 3, 14 of the virtual visitor is provided with a product acquisition means 27 for acquiring product information 28a including agricultural products in the farm and products related to the agricultural products, and the server device 2 is provided with a payment means 13 for purchasing the agricultural products and related products, so that the user can purchase agricultural products from outside the farm 24. For example, the user can purchase the agricultural products after talking to the seller of the agricultural products. The user can purchase agricultural products from care farms 24 all over the world.

[0188] (Yet another example from a farm) The method 20a for interacting with producers / sellers via a farm in a virtual space is executed by a server device 2 and user terminals 3, 4, 14, and is a method for interacting with producers / sellers via a farm 24a in a virtual space consisting of two-dimensional or three-dimensional spatial data of an imaged space formed from an image of the farm 24 or a pseudo-space formed to imitate the imaged space, and is characterized by comprising the steps of: transmitting a viewpoint image moving around the farm in the virtual space based on the operation of a virtual visitor 23 as a purchaser / tourist visiting the farm in the virtual space to the user terminal of the virtual visitor; acquiring position information 45a of a visitor 21 as a producer / seller visiting the farm; and displaying a preset avatar element 45b of the visitor at a coordinate position 46a in the farm in the virtual space corresponding to the position information. Thus, a virtual visitor 23 can visit the virtual farm 24a for sightseeing, to view / purchase farm-related products 41, or to interact with producers / sellers.

[0189] Such a method 20a for interaction with producers / sellers via a farm in a virtual space includes a step of acquiring coordinate position information 46a relating to the coordinate position of the virtual visitor 23 in the farm 24a in the virtual space, and a step of superimposing and displaying a preset avatar element 46b of the virtual visitor 21 at a position in the field of view through the user terminal 3 of the visitor 21 that corresponds to the coordinate position information, so that each other's avatar elements can be seen, thereby encouraging interaction.

[0190] A predetermined position range 48a including the agricultural product 41 of the farm 24 and a coordinate position range 49a of the farm in the virtual space corresponding to the position range are set, and a step of displaying agricultural product display elements 48b, 49b relating to the agricultural product in the position range in the field of view through the user terminal of the producer / seller and in the coordinate position range displayed on the user terminal of the virtual visitor, respectively, is provided, so that the visitor 21 and the virtual visitor 23 can interact while understanding the agricultural product display elements 48b, 49b which are the same agricultural product 41. Also, the agricultural product 41 to be purchased can be selected.

[0191] In addition, since a step of dialogue between the virtual visitor 23 and the visitor 21 using voice information / text information 11a is provided, it is possible to have interactions with producers and other virtual visitors 23.

[0192] The virtual visitor 23 is also provided with a step of visiting the farm 24a in the virtual space via access information 43 including a link to farm-related products 41 including agricultural products obtained at the farm 24 and products related to the agricultural products, or an information medium 51 including a website on which the farm-related products are posted. This allows the virtual visitor 23 to visit the farm 24a in the virtual space from a sales outlet outside the farm, and gain knowledge about the farm-related products 41 through the state of the farm and interactions with the producers.

[0193] Further, in order for the virtual visitor 23 to select a visitor 21 to converse with, a step is provided for acquiring personal information 7a of the pre-registered visitor based on specific information 5a for identifying the visitor, so that personal information of the person to be conversed with is obtained, thereby encouraging conversation.

[0194] In addition, since the personal information 7a includes affiliation / attribute information regarding the person's affiliation / attributes and / or knowledge / experience information regarding agricultural knowledge / experience, the user can select a partner who matches the user, which can further promote conversation.

[0195] The system also includes a step of making a payment to purchase farm-related products 41 including agricultural products obtained at the farm 24 and products related to the agricultural products, so that the farm-related products 41 can be purchased within the farm 24a in the virtual space.

[0196] The server device is a server device 2 used in a method 20a for interacting with producers / sellers via a virtual space farm 24a consisting of two-dimensional or three-dimensional spatial data of an imaged space formed from an image of a farm 24 or a pseudo-space formed to simulate the image, and is characterized by having a coordinate acquisition means 18 for acquiring position information 45a of a visitor 21 as a producer / seller visiting the farm, and a virtual space processing means 17 for transmitting a viewpoint image of moving around the farm in the virtual space based on the operation of a virtual visitor 23 as a purchaser / tourist visiting the farm in the virtual space to the user terminal 3, 14 of the virtual visitor, and displaying a preset avatar element 45b of the visitor at a coordinate position in the farm in the virtual space corresponding to the position information. Thus, a virtual visitor 23 can visit the virtual farm 24a for sightseeing, to view / purchase farm-related products 41, or to interact with producers / sellers.

[0197] In such a server device 2, the coordinate acquisition means 18 acquires coordinate position information 46a relating to the coordinate position of the virtual visitor 23 in the farm 24a in the virtual space, and the virtual space processing means 17 superimposes and displays a preset avatar element 46b of the virtual visitor at a position in the field of view through the user terminal 4 of the visitor 21 that corresponds to the coordinate position information, so that each visitor can see the other's avatar elements, thereby encouraging interaction.

[0198] Also, a predetermined position range 48a including the agricultural product 41 of the farm 24 and a coordinate position range 49a of the farm 24a in the virtual space corresponding to said position range are set, and the virtual space processing means 17 displays agricultural product display elements 48b, 49b relating to said agricultural products in said position range in the field of view through the user terminal 4 of the producer / seller and in said coordinate position range displayed on the user terminals 3, 14 of the virtual visitor 23, respectively, so that the visitor 21 and the virtual visitor 23 can interact while understanding the agricultural product display elements 48b, 49b which are the same agricultural product 41. Also, the agricultural product 41 to be purchased can be selected.

[0199] The system is also equipped with a memory unit 31 that stores product information 28 of agricultural products of the farm 24 and farm-related products 41 that contain the agricultural products to be transmitted to the user terminal 3, 14 of the virtual visitor 23, thereby making it possible to obtain product information 28 linked to the selected agricultural product display elements 48b, 49b.

[0200] Also, since the payment means 9 for purchasing farm-related products 41 is provided, farm-related products 41 can be purchased within the farm in the virtual space.

[0201] Further, in order to select the visitor 21 with which the virtual visitor 23 will converse, a personal information acquisition means 7 is provided for acquiring personal information 7a of the visitor identified based on identification information 5a that identifies the visitor, and since the personal information 7a of the person with whom the virtual visitor 23 should converse is obtained, conversation can be promoted.

[0202] In addition, since the personal information 7a includes affiliation / attribute information regarding the person's affiliation / attributes and / or knowledge / experience information regarding agricultural knowledge / experience, the user can select a partner who matches the user, which can further promote conversation.

[0203] The linking system 52 between farm-related products and virtual space comprises farm-related products 41 including agricultural products obtained at the farm 24 or an information medium 51 including a website on which the farm-related products are posted, and the above-mentioned server device, and is characterized in that the farm-related products or the information medium have access information 43 including a link for visiting the farm 24a in the virtual space. Therefore, a customer can visit the farm 24a in the virtual space from a sales outlet outside the farm, and gain knowledge about farm-related products 41 by seeing the farm and interacting with the producers.

[0204] [8. Summary] (1)(9) A method of communication 20a through an event area in a virtual space is executed by a server device 2 and user terminals 3, 4, 14, and is a method of communication through an event area in a virtual space consisting of two-dimensional or three-dimensional spatial data of an imaged space formed from an image of an event area 54 including an event venue or a pseudo space formed to imitate the imaged space, and is characterized by comprising the steps of: transmitting a viewpoint image of a virtual visitor 23 visiting the event area in the virtual space to the user terminal of the virtual visitor, the viewpoint image of the virtual visitor 23 moving through the event area in the virtual space based on an operation of the virtual visitor 23, the virtual visitor 23 visiting the event area in the virtual space, acquiring position information 45a of the visitor 21 visiting the event area, and displaying a preset avatar element 45b of the visitor at a coordinate position 46a in the event venue in the virtual space corresponding to the position information. Thus, the virtual visitor 23 can visit the event area 54a in the virtual space to view / purchase event-related merchandise 53 or to interact with other visitors.

[0205] (2)(10) Such a method 20a for interaction via an event area in a virtual space includes a step of acquiring coordinate position information 46a relating to the coordinate position of the virtual visitor in the event area 54a in the virtual space, and a step of superimposing and displaying a preset avatar element 46b of the virtual visitor at a position in the field of view through the user terminal 3 of the visitor 21 that corresponds to the coordinate position information. Since each other's avatar elements are visible, interaction can be encouraged.

[0206] (3)(11) A predetermined position range 48a including the product 55 in the event area and a coordinate position range 49a of the event area in the virtual space corresponding to the position range are set, and a step of displaying product display elements 48b, 49b related to the product in the position range in the field of view through the visitor's user terminal and in the coordinate position range displayed on the user terminal of the virtual visitor, respectively, is provided, so that the visitor 21 and the virtual visitor 23 can interact while understanding the agricultural product display elements 48b, 49b, which are the same product 55. Also, the product 55 to be purchased can be selected.

[0207] (4) Also, since a step of dialogue between the virtual visitor 23 and the visitor 21 using the voice information / text information 11a is provided, it is possible to have interactions with other virtual visitors 23.

[0208] (5) In addition, the information medium 51 including the event-related products 55, including products available in the event area 54 and related products of the above products, or the website on which the event-related products are posted has access information 43 including a link to visit the event area in the virtual space, and further includes a step of visiting the event area in the virtual space through the access information. Therefore, it is possible to visit the event area 54a in the virtual space from a sales outlet outside the farm, and gain knowledge about the event-related products 55 through the state of the event area and interactions with exhibitors.

[0209] (6) In addition, in order for the virtual visitor 23 to select a visitor 21 to converse with, a step is provided for acquiring personal information 7a of the visitor registered in advance based on the specific information 5a that identifies the visitor. Since the personal information of the person with whom the virtual visitor 23 is to converse is obtained, it is possible to encourage conversation.

[0210] (7) Furthermore, since the person information 7a includes affiliation / attribute information regarding the person's affiliation / attributes and / or knowledge / experience information regarding the event area, it is possible to select a person who matches with oneself, and to further promote conversation.

[0211] (8) Also, since the system includes a step of storing time information 57a ​​and location information 57b of the avatar element during a predetermined period during an event held in the event area 54, it is possible to experience an event that has already ended. Also, past avatar elements 45b, 46b can be selected and contacted via the contact information 8e in the person information DB 8.

[0212] (9) Also, since there is provided a step of making a payment for purchasing event-related merchandise 55 including products available in the event area and products related to the aforementioned products, it is possible to purchase event-related merchandise 55 within the event area 54a in the virtual space.

[0213] (16) A linking system 56 between event-related goods and a virtual space comprises an information medium 51 including event-related goods 55 including goods available in an event area 54 and goods related to the said goods, or a website on which the said event-related goods are posted, the above-mentioned server device, and user terminals 3, 14, and is characterized in that the said event-related goods or the information medium has access information 43 including a link for visiting the event area 54a in the virtual space. This allows a visitor to visit the event area 54a in the virtual space via the information medium 51, and to experience the event and interact with visitors / exhibitors. [Explanation of symbols]

[0214] 1 Authentication device, 2 Server device, 3 Remote person terminal, 3a Display unit, 4 Visitor terminal, 5 Person identification means, 6 Person identification database, 7 Person information acquisition means, 7a Person information, 8 Person information database, 9 Payment means, 10 Person selection acquisition means, 11 Transmission means, 11a Transmission information, 11b Completion information, 12 Request / reward registration means, 12a Request information, 13 Payment information, 14 Virtual visitor terminal (head mounted display system), 15 Head mounted display, 15a Display unit, 15b Head position detection sensor, 15c Speaker, 15d Microphone, 15e Operation unit, 16 Control device, 17 Virtual space processing means, 17a Operation information, 18 Coordinate acquisition means, 19 Update means, 20 Fourth system, 20a Communication method, 21 Visitor, 22 Remote person, 23 Virtual visitor, 24 Farm, 25 Camera device, 25a face image information, 26 communication network, 27 product acquisition means, 28 product information database, 29 second system, 30 CPU, 31 memory, 32 input / output device, 33 connection port, 33a storage device, 34 communication circuit, 35 bus line, 36 server program, 37 browser program, 38 OS, 39 terminal program, 40 third system, 41 farm-related product, 42 three-dimensional camera, 43 access information, 44 system, 45a position information, 45b avatar element, 46a coordinate position information, 46b avatar element, 47 display screen, 48a position range, 48b agricultural product display element, 49a coordinate position range, 49b agricultural product display element, 50 display screen, 51 information medium, 52 farm-related product and virtual space linking system, 53 system, 54 event area, 55 event-related product, 56 Event-related products and virtual space linking system, 57a Past location information, 57b Past time information, 58 Past information

Claims

1. A method of communication performed by a server device and a user terminal, and which involves a virtual space consisting of three-dimensional spatial data of an imaging space formed from imaging of a real-world farm / event area or a pseudo-space formed by mimicking said imaging, The aforementioned virtual space is accessed via the user terminal of a virtual visitor. The steps include obtaining location information from a user's device held by a visitor visiting the aforementioned farm / event area in the real world, The steps include displaying the pre-configured visitor's avatar element at the coordinate position in the virtual space farm / event area corresponding to the location information, The steps include: the virtual visitor selects filtering criteria for the visitors who are visiting the farm / event area and requests the visitor's personal information; The steps include obtaining the person information based on the aforementioned request, The system includes a step of having a dialogue between the virtual visitor and the visitor corresponding to the acquired person information using voice information / text information. A method of interaction through virtual space.

2. The steps include: obtaining coordinate position information relating to the coordinate position of the virtual visitor in the virtual space; A method for interacting via a virtual space according to claim 1, comprising the step of overlaying a pre-set avatar element of the virtual visitor onto a position in the view through the visitor's user terminal corresponding to the coordinate position information.

3. The method of communication via a virtual space according to claim 1 or 2, wherein the person information includes affiliation and attribute information relating to the person's affiliation and attributes or knowledge and experience information relating to the farm / event area.

4. A server device used in a method of communication via a virtual space consisting of three-dimensional spatial data of an imaging space formed from imaging of a farm / event area in real space or a pseudo-space formed by mimicking said imaging, The aforementioned virtual space is accessed via the user terminal of a virtual visitor. A coordinate acquisition means for acquiring location information of a user terminal held by a visitor visiting the aforementioned farm / event area in the real space, A virtual space processing means that displays the pre-configured visitor's avatar elements on the virtual visitor's user terminal at coordinate positions in the virtual space farm / event area corresponding to the location information, A server device comprising: a person information acquisition means for acquiring person information of a visitor based on a request from the virtual visitor, which is made by selecting filtering items for the visitor who is visiting the farm / event area.

5. The coordinate acquisition means acquires coordinate position information relating to the coordinate position of the virtual visitor in the virtual space, The server device according to claim 4, wherein the virtual space processing means overlays and displays the pre-set avatar elements of the virtual visitor at the position in the view through the visitor's user terminal corresponding to the coordinate position information.

6. The server device according to claim 4 or 5, wherein the person information includes affiliation and attribute information relating to the person's affiliation and attributes, or knowledge and experience information relating to the farm / event area.

Images