Interaction method via event area in virtual space, server device, and system for linking event-related products with virtual space

Abstract

To provide an interaction method via a virtual space event area to reduce complexity by using the virtual space event area and linking system of a server device, event-related commodities, and a virtual space.SOLUTION: An interaction method that is executed by a server device 2 and a user terminal 3 through an imaging space formed from imaging of an event area 54 including an event venue or a virtual space event area composed of two-dimensional or three-dimensional spatial data of a pseudo-space formed by imitating the imaging, includes the steps for transmitting a viewpoint image moving through the event area of the virtual space based on an operation of a virtual visitor 23 who is visiting the event area of the virtual space to a user terminal of the virtual visitor, obtaining location information 45a of a visitor 21 who is visiting the event area, and displaying a predetermined avatar element 45b of the visitor at a coordinate position 46a in the event venue of the virtual space corresponding to the position information.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present invention relates to a method of communication via a virtual space. [Background technology]

[0002] In recent years, technologies using virtual spaces have been developed, which provide users with new experiences through virtual worlds.

[0003] Additionally, there have traditionally been farms set up in care farms (welfare facilities with attached farms, hereinafter the same), farms called community gardens where users can use plots of land, and tourist farms. For example, care farms provide a sense of purpose for the elderly and employment for people with disabilities, and farm work on these farms is also said to be effective in alleviating dementia and mental disorders. For example, community gardens are places where users living in urban areas regularly visit to cultivate agricultural products, and are effective in building regional cooperation in times of disaster.

[0004] Patent Document 1 discloses a method for linking the real world and the virtual world, which includes acquiring location information indicating a user's current location in the real world, determining whether the current location indicated by the location information is in a first area in the real world, and allowing the user to access a second area in the virtual world when the current location indicated by the location information is in the first area, wherein the first area and the second area have the same level for at least one parameter.

[0005] Patent Document 2 also discloses a system for utilizing agricultural produce cultivation information. This system supports agricultural produce cultivation plans by allowing users who cultivate agricultural produce in adjacent plots, such as community gardens, to share and mutually utilize cultivation information about the agricultural produce they are cultivating.

[0006] Furthermore, Patent Document 3 discloses an agricultural product growing game, in which people who do not have means of production such as farmland can experience the joy of agricultural production by growing agricultural products together with the player and manager through a simulated farming experience on a computer screen. [Prior art documents] [Patent documents]

[0007] [Patent Document 1] Patent No. 7158789 [Patent Document 2] Japanese Patent Application Laid-Open No. 2014-035700 [Patent Document 3] Japanese Patent Application Laid-Open No. 2002-78975 Summary of the Invention [Problem to be solved by the invention]

[0008] It is cumbersome to actually visit the event area and talk to visitors, or to go to the event area and get information about the products (including free products / goods) available in the event area and related products.

[0009] Therefore, an object of the present invention is to provide a method of interaction via an event area in a virtual space, a server device, and a system for linking event-related products with a virtual space in order to reduce complexity by using the event area in a virtual space. [Means for solving the problem]

[0010] (1) The method of communication through an event area in a virtual space of the present invention is executed by a server device and a user terminal, and is a method of communication through an event area in a virtual space consisting of two-dimensional or three-dimensional spatial data of an imaged space formed from an image of an event area including an event venue, or a pseudo-space formed to imitate the imaged space, and is characterized by comprising the steps of: transmitting a viewpoint image moving through the event area of ​​the virtual space based on an operation of a virtual visitor visiting the event area of ​​the virtual space to the user terminal of the virtual visitor; acquiring location information of the visitor visiting the event area; and displaying a preset avatar element of the visitor at a coordinate position in the event area of ​​the virtual space corresponding to the location information.

[0011] (2) Such a method of interaction via an event area in a virtual space preferably includes the steps of acquiring coordinate position information regarding the coordinate position of the virtual visitor in the event area in the virtual space, and superimposing and displaying a preset avatar element of the virtual visitor at a position in the field of view through the user terminal of the visitor that corresponds to the coordinate position information.

[0012] (3) A predetermined position range including the products in the event area and a coordinate position range of the event area in the virtual space corresponding to the predetermined position range are set, It is preferable to include a step of displaying product display elements related to the product in the position range in the field of view through the visitor's user terminal and in the coordinate position range displayed on the user terminal of the virtual visitor.

[0013] (4) It is also preferable to have a step of communicating between the virtual visitor and the visitor using voice information / text information.

[0014] (5) It is also preferable that the information medium, including the products available in the event area and the event-related products including the related products of the products, or the website on which the event-related products are posted, has access information including a link to visit the event area of ​​the virtual space, and further includes a step of visiting the event area of ​​the virtual space through the access information.

[0015] (6) It is also preferable to have a step of acquiring personal information of pre-registered visitors based on specific information that identifies the visitors, in order to select the visitors with whom the virtual visitors will interact.

[0016] (7) It is also preferable that the personal information includes affiliation and attribute information regarding the person's affiliation and attributes and / or knowledge and experience information regarding the event area.

[0017] (8) It is also preferable to have a step of storing time information and position information of the avatar element during a predetermined period while the event held in the event area is being held.

[0018] (9) It is also preferable to have a step of making a payment to purchase products related to the event, including products available in the event area and products related to the products.

[0019] "Visitor location information" refers to information about the location within the event area of ​​visitors who are actually visiting the event area, and is a concept that includes, for example, coordinates indicating two-dimensional or three-dimensional points, coordinates indicating a specified area such as a plane or space, and quantities that can be converted into these. Also, if the place to be visited is a farm, it is information about the actual location of the visitor within the farm, and is a concept that includes, for example, coordinates indicating a two-dimensional or three-dimensional point, coordinates indicating a specified range such as a plane or space, or quantities that can be converted into them. "Coordinate position information" refers to coordinates that indicate two-dimensional or three-dimensional points in virtual space, or coordinates that indicate a specific range on a plane or in space, and is a concept that includes quantities that can be converted into these. "Identifying information" refers to information that can be used to identify a person, such as name, address, My Number, pension number, driver's license number, credit card information, and physical characteristics including face, and is a concept that includes information linked to these or information that can be converted into these. "Personal information" refers to at least one of the following: affiliation and attribute information about a person's affiliation and attributes, knowledge and experience information about the event area, physical characteristics including face, and also includes a profile, information disclosed by the person to help others get to know them, and is a concept that includes information that can be converted into such information. If the place to be visited is a farm, the information is about agricultural knowledge and experience. Affiliation and attribute information is, for example, information about affiliation, the organization to which one belongs, the area of ​​residence, such as company / sole proprietorship employee, manager, event area booth renter, event area operator, event area employee, store owner, store employee, address, etc. Attributes are information including one's own field of expertise, such as work history, and is a concept that includes information that can be converted into these. For example, if the place to be visited is a farm, the information would be about the residents of the care farm, the care farm operator, those renting the farm plots, the farm operator, the farm employees, the store owner, the store employees, and the neighboring residents, and the attributes would be information including one's own mental and physical state, such as medical history, and the concept includes information that can be converted into these. Knowledge and experience information is information about knowledge and experience related to the event, including hobby history, business experience, research and academic history related to the event, and is a concept that includes information that can be converted into these. For example, if the place to be visited is a farm, it is information about knowledge and experience regarding farming, including agricultural experience, research and academic background related to agriculture, and is a concept that includes information that can be converted into these. "Location range" refers to a point or range that identifies the location or range of the product in the event area, and is a concept that includes coordinates that indicate a two-dimensional or three-dimensional point, coordinates that indicate a specific range on a plane or in space, and quantities that can be converted into these. "Coordinate position range" is a concept that refers to the coordinate range in virtual space that corresponds to the position range, and includes quantities that can be converted into them.

[0020] "Event-related products" include products available in the event area and related products of the aforementioned products. Products include, for example, free and paid products, and include services other than goods, and are concepts that can be converted into such services. Related products of the aforementioned products include products available outside the event area. "Information media" refers to tags and stickers attached to event-related products and their packaging, printed or formed parts on event-related products and their packaging, paper media such as pamphlets and leaflets that describe event-related products, web pages and social media sites that describe event-related products, and is a concept that can be converted into these. "Access information" refers to information such as a QR code (registered trademark) or URL that can be read by a user's device camera or entered into a user's device to access an event area in a virtual space, or a concept that can be converted into such information. For example, information that allows access to an event area in a virtual space may be embedded in digital content such as images or music using a technology known as digital watermarking. "Product Information" means information about event-related products. "A specified period during the event" includes the period from the start to the end of the event or any period between the start and end of the event.

[0021] (10) Another aspect of the server device of the present invention is a server device executed by a server device and a user terminal and used in a method of interaction via an event area in a virtual space consisting of two-dimensional or three-dimensional spatial data of an imaged space formed from an image of an event area including an event venue or a pseudo-space formed to imitate the imaged space, characterized in that it comprises a coordinate acquisition means for acquiring position information of a visitor visiting the event area, and a virtual space processing means for transmitting to the user terminal of the virtual visitor a viewpoint image moving through the event area of ​​the virtual space based on the operation of the virtual visitor visiting the event area of ​​the virtual space, and for displaying a preset avatar element of the visitor at a coordinate position in the event area of ​​the virtual space corresponding to the position information.

[0022] (11) In such a server device, it is preferable that the coordinate acquisition means acquires coordinate position information regarding the coordinate position of the virtual visitor in the event area of ​​the virtual space, and the virtual space processing means superimposes and displays a preset avatar element of the virtual visitor at a position in the field of view through the user terminal of the visitor that corresponds to the coordinate position information.

[0023] (12) It is also preferable that a predetermined position range including the products in the event area and a coordinate position range of the event area in the virtual space corresponding to the position range are set, and that the virtual space processing means displays product display elements related to the products in the position range in the field of view through the user terminal of the visitor and in the coordinate position range displayed on the user terminal of the virtual visitor.

[0024] (13) It is also preferable to have a storage unit that stores product information for the products in the event area and products related to the event, which is to be sent to the user terminal of the virtual visitor.

[0025] (14) It is also preferable to provide a personal information acquisition means for acquiring personal information of the identified visitor based on specific information that identifies the visitor, in order to select the visitor with whom the virtual visitor will interact.

[0026] (15) It is also preferable that the personal information includes affiliation and attribute information regarding the person's affiliation and attributes and / or knowledge and experience information regarding the event area.

[0027] (16) It is also preferable that the event area further comprises a storage unit for storing time information and position information of the avatar element during a predetermined period of time during an event held in the event area.

[0028] (17) It is also preferable that the event-related goods be purchased using a payment method.

[0029] (18) A further aspect of the present invention is a system for linking event-related products with a virtual space, which comprises an information medium including event-related products, including products available in the event area or related products of the products, or a website on which the event-related products are posted, the above-mentioned server device, and a user terminal, and is characterized in that the event-related products or the information medium have access information including a link for visiting the event area in the virtual space.

[0030] In the embodiment, the "virtual space processing means" corresponds to W2 (see FIG. 11). "Payment method" corresponds to B7 and S11 (see FIG. 13 and FIG. 16) in the embodiment. In the embodiment, the "person information acquisition means" corresponds to V2, B2, and S2 (see FIGS. 11, 13, and 16).

[0031] The following describes the case where the virtual space is a farm. "Visitor location information" refers to information about the actual location of visitors within the farm, and is a concept that includes, for example, coordinates indicating two-dimensional or three-dimensional points, coordinates indicating a specific area such as a plane or space, and quantities that can be converted into these. "Coordinate position information" refers to coordinates that indicate two-dimensional or three-dimensional points in virtual space, or coordinates that indicate a specific range on a plane or in space, and is a concept that includes quantities that can be converted into these. "Identifying information" refers to information that can be used to identify a person, such as name, My Number, pension number, driver's license number, and physical characteristics including face, and is a concept that includes information linked to these or information that can be converted into these. "Personal information" refers to agricultural knowledge and experience information. "Affiliation and attribute information" refers to information about care farm residents, care farm operators, those renting farm plots, farm operators, farm employees, store owners, store employees, and neighboring residents, and is a concept that includes information about attributes, such as one's own mental and physical state, such as medical history, and information that can be converted into these. "Knowledge and experience information" refers to information related to knowledge and experience of agricultural work, including agricultural experience, agricultural research and academic background, and information that can be converted into these. "Location range" refers to a point or range that identifies the location or range of agricultural products on a farm, and is a concept that includes coordinates that indicate two-dimensional or three-dimensional points, coordinates that indicate a specific range on a plane or in space, and quantities that can be converted into these. "Farm-related products" include agricultural products and related products. Agricultural products refer to all agricultural products, including crops and livestock, such as grains, vegetables, fruits, flowers, dairy products, meat, eggs, leather, and processed products thereof, and are concepts that can be converted into these. Processed products include, for example, alcoholic beverages such as wine and ham. Related products include products derived from agricultural products harvested on farms and specialty products from the surrounding area of ​​the farm, including agricultural products harvested around the farm, and crafts, sweets, and products manufactured around the farm, and are concepts that can be converted into these. "Information media" refers to tags and stickers attached to farm-related products and their packaging, printed or formed parts of farm-related products and their packaging, paper media such as pamphlets and leaflets that describe farm-related products, web pages and social media sites that describe farm-related products, and is a concept that can be converted into these. "Access information" refers to information such as a QR code (registered trademark) or URL that can be read by the camera on a user's device or entered into the user's device to access the virtual farm, or a concept that can be converted into such information. For example, information that allows access to the virtual farm can be embedded in digital content such as images or music using a technology called digital watermarking. "Product Information" means information about farm-related products. "Payment" includes cases where agricultural products or other items are paid as compensation for a request. [Effects of the Invention]

[0032] Visitors can easily interact with each other, with virtual visitors, or with other virtual visitors. [Brief explanation of the drawings]

[0033] [Figure 1] FIG. 1 is a schematic diagram showing an overview of a system via an event area and a system for linking event-related products with a virtual space. [Figure 2] FIG. 10 is a functional block diagram illustrating yet another embodiment of the system via the event area / farm. [Figure 3] FIG. 10 is a schematic diagram showing the screen display of the user terminal of the visitor and the virtual visitor. [Figure 4] FIG. 10 is a functional block diagram illustrating another embodiment of the system via a farm. [Figure 5] FIG. 2 is a schematic diagram illustrating an example of a hardware configuration of a server device. [Figure 6] FIG. 2 is a schematic diagram illustrating an example of a hardware configuration of a user terminal. [Figure 7]FIG. 2 is a schematic diagram illustrating an example of a hardware configuration of a head-mounted display unit. [Figure 8] 10 is a flowchart illustrating an embodiment of the flow of a registration process in entry / exit management. [Figure 9] 10 is a flowchart illustrating an embodiment of a login process flow. [Figure 10] FIG. 2 is a schematic diagram showing the data structure of a person identification database. [Figure 11] 1 is a flowchart illustrating an embodiment of a flow of an interaction process. [Figure 12] FIG. 10 is a functional block diagram illustrating yet another embodiment of the system via a farm. [Figure 13] 1 is a flowchart illustrating an embodiment of a process for purchasing agricultural products. [Figure 14] FIG. 10 is a schematic diagram illustrating a data structure of a product information database for event-related products. [Figure 15] FIG. 1 is a functional block diagram illustrating one embodiment of a farm-based system. [Figure 16] 10 is a flowchart illustrating an embodiment showing the flow of a process for requesting farm work from a remote party to a visitor. [Figure 17] FIG. 2 is a schematic diagram illustrating the data structure of a person information database. [Figure 18] This is a schematic diagram showing an outline of a system mediated by a farm and a system linking farm-related products with a virtual space. [Figure 19] FIG. 10 is a schematic diagram showing the screen display of the user terminal of the visitor and the virtual visitor. [Figure 20] FIG. 2 is a schematic diagram showing the data structure of a product information database for farm-related products. [Figure 21] FIG. 2 is a schematic diagram illustrating the data structure of a person information database. DETAILED DESCRIPTION OF THE INVENTION

[0034] [1-1. Communication via the event area] In the embodiment described below in detail, a case where an event area is used as a virtual space will be described, followed by a case where a farm is used as a virtual space.

[0035] [1-2. Brief explanation] (Interaction system through event area 53) First, an overview of the exchange system via an event area will be explained using Figure 1. The exchange system via an event area (hereinafter referred to as the system) 53 shown in Figure 1 is mainly used between visitors 21 visiting an event area 54 and remote persons 22 who are not visiting the event area 54, for example, at home. The remote persons 22 include virtual visitors 23 who visit an event area 54a (see Figure 3), which is a virtual space made up of three-dimensional spatial data of an imaged space formed from an image of the event area 54 or a pseudo space formed to simulate the image.

[0036] A virtual visitor 23 visits an event area 54a in the virtual space to, for example, participate in an event, exhibit at the event, check out / purchase event-related products 55, or interact with other participants / exhibitors. The virtual visitor 23 can also interact with other virtual visitors 23 who are visiting the event area 54a in the virtual space.

[0037] (Event-related products 55 and virtual space collaboration system 56) The linking system 56 between event-related products 55 and virtual space consists of an information medium 51 including event-related products 55, including products available in the event area, or a website listing the event-related products, and a system 53 (see FIG. 2). The information medium 51 contains access information 43 including a link for visiting the event area 54a in the virtual space.

[0038] For example, a purchaser who picks up a DVD as an event-related product 55 at a retailer outside event area 54 uses their own user terminal to read a QR code (registered trademark) as access information 43 printed on the DVD's packaging. The purchaser acts as a virtual visitor 23 and uses their user terminal as a remote user terminal 3 to access event area 54a where a concert related to the DVD is being held. In event area 54a in the virtual space, virtual visitor 23 enjoys an event such as a concert and interacts with concert performers and visitors 21 attending the concert. It is also possible to purchase a DVD as an event-related product 55 at a store inside the event area 54 and visit the event area 54a in the virtual space.

[0039] The concert may be held in the future from the date of purchase of the event-related products 55, such as DVDs and related goods. Even if the concert is held in the future, the user can visit the event area 54a in the virtual space before the event and interact with other virtual visitors 23. For example, the user can make a promise to have fun together on the day.

[0040] Even if an event has already ended on the day of purchase, you can participate in a past event such as a concert and virtually experience the event. Furthermore, if an event such as a concert is being held on the day of purchase, you can participate in it through the event area 54a in the virtual space.

[0041] The stores selling the event-related products 55 include stores in the event area 54 and the event area 54a in the virtual space, as well as roadside stations, local shops, department stores, supermarkets, and convenience stores, and are concepts that can be converted into these.

[0042] (Event Area 54) An event area includes an event venue where a specific event is held, and is an area for events held outdoors and / or indoors. Event venues include street corners, martial arts halls, exhibition halls, art museums, temples, churches, amusement parks, concert halls, gymnasiums, schools, auditoriums, baseball fields, athletic stadiums, parks, etc. Events include expositions such as the World's Fair, exhibitions, sales events, product fairs, conferences, concerts, plays, music recitals, sports days, competitions, festivals, and fireworks displays.

[0043] (AC) The system 53 can display information on the terminal of the remote person 22 about visitors 21 who are visiting the event area 54 and registered users who will likely become visitors 21 if the date and time permits, as advance information for interaction. Furthermore, for example, even remote persons 22 who cannot access event area 54a in the virtual space can understand the situation in event area 54 from images captured by cameras 25 installed in event area 54 via communication network 26 such as the Internet. As will be described later, by logging in to system 53, visitors 21 and remote persons 22 (including virtual visitors 23), as well as virtual visitors 23 and remote persons 22 who do not access event area 54a in the virtual space, can understand each other's person information 7a (see FIG. 4) and interact with each other.

[0044] (User) In this embodiment, when a user (hereinafter referred to as a user) of the event area 54 and the event area 54a in the virtual space registers, the user is registered in, for example, a person identification database 6 (details of which will be described later). However, registration is not essential. Even if a user does not visit the event area 54, the user can make appointments with other users and receive requests for events and appointments to interact with them. Here, examples of users who use the event area 54 and the event area 54a in the virtual space include the following: They are exhibitors who exhibit in the event area 54 or the event area 54a in the virtual space, and sellers / distributors who sell / distribute event-related products 55 at the event. A user who holds an event in the event area 54 or the event area 54a in the virtual space, such as a performer / lecturer. Although the exhibit area in the event area 54 or the event area 54a in the virtual space is not rented, the exhibitor may become an exhibitor or seller / distributor at the request of the exhibitor or seller / distributor. A visitor to the event area 54 or the event area 54a in the virtual space. Purchasers of event-related products 55. Purchasers also include those who plan to purchase. The administrator is the event area 54 or the event area 54a in the virtual space. Furthermore, by linking with the event areas of other virtual spaces or virtual spaces other than the event area 54, it is possible to move between other virtual spaces. Each user may fulfill more than one of the roles listed above.

[0045] [1-3.Each configuration] (System 53) First, a system 53 according to an embodiment of the present invention will be described with reference to the functional block diagram of FIG.

[0046] The system 53 comprises a server device 2, user terminals 3 and 14 (hereinafter referred to as remote user terminals) held by a virtual visitor 23, and a user terminal 4 (hereinafter referred to as visitor terminal) held by a visitor 21. The server device 2, remote user terminal 3 (14), and visitor terminal 4 are communicatively connected to each other via a communication network 26 (see FIG. 1) such as the Internet (intranet). As will be described later, reference numeral 14 denotes a head-mounted display system (see FIG. 6). The remote user 22 can also interact with the visitor 21 via text information without visiting the event area 54a in the virtual space.

[0047] The system 53 also sets a predetermined location range in the event area 54 where products are sold and a coordinate location range in the virtual space that corresponds to that location range. Furthermore, product display elements related to the products are displayed in the field of view through the visitor terminal 4 of the visitor 21 and on the viewpoint image of the remote terminal 3 (14) of the virtual visitor 23.

[0048] The avatar elements 45b and 46b are, for example, two-dimensional or three-dimensional spatial data of a captured image formed by capturing an image of the visitor 21 or virtual visitor 23, or a pseudo image formed by simulating the captured image. Note that, regardless of the captured image, any desired image may be used as the avatar element. In this embodiment, tags containing one or more pieces of information selected from the product information 28 (see FIG. 14) are displayed as product (agricultural product) display elements 48b, 49b. Alternatively, for example, two-dimensional or three-dimensional spatial data of a captured image formed by capturing an image of a product in the event area 54 or a pseudo image formed by simulating the image may be used as the tag. The data of the avatar elements 45b, 46b and the product display elements 48b, 49b are stored in the storage unit 31 of the server device 2, for example.

[0049] (Server device 2) In this embodiment, for example, a personal computer is used as the server device 2. The server device 2 mainly includes a virtual space processing means 17 and a coordinate acquisition means .

[0050] (Remote terminal 3 (14), visitor terminal 4) In this embodiment, the remote user terminal 3 (14) is, for example, a smartphone. It may also be a wearable computer, a head-mounted display system, a mobile phone, a tablet terminal, or a personal computer (PC), which can be attached or worn. The remote user terminal 3 (14) is equipped with a display unit 3a (15a). Reference numeral 15a denotes the display unit of the head-mounted display system (see FIG. 6). The remote user terminal 3 (14) displays an avatar element of the visitor 21 in a viewpoint image of a virtual space as virtual reality (VR).

[0051] (Visitor Terminal 4) In this embodiment, the visitor terminal 4 is almost the same as the remote visitor terminal 3 (14). In this embodiment, the visitor 21 wears the visitor terminal 4, such as smart glasses or AR glasses. The visitor terminal 4 projects pre-registered avatar elements as digital images onto the field of view of the scenery in the real event area 54 as augmented reality (AR). The display unit 3a of the smart glasses or AR glasses is a part that allows the scenery to be seen through and displays the digital image superimposed on it.

[0052] (Virtual space processing means 17) The virtual space processing means 17 generates a virtual image to be displayed on the display unit 3a (15a) of the remote terminal 3 (14) based on operation information 17a relating to the amount of operation output from the input / output device 32 (operation unit 15e) of the remote terminal 3 (14) (see FIGS. 5 and 6). For example, in cooperation with the control device 16 of the head-mounted system 14, it generates images to be displayed on the display unit 15a and performs various calculation processes.

[0053] (Coordinate acquisition means 18) The coordinate acquisition means 18 acquires coordinate positions (viewpoint coordinates) in three-dimensional space corresponding to the viewpoint image displayed on the remote user terminal 3 (14). For example, in this embodiment, avatar elements representing virtual visitors 23 other than the user are displayed on the display unit 3a (15a) based on the viewpoint coordinates. Note that an avatar element representing the user himself / herself may also be displayed on the display unit 3a (15a) of the user's terminal 3 (14).

[0054] (Display section 3a (15a)) The display unit 3a (15a) may be, for example, a device for displaying images, such as a liquid crystal display (LCD), a plasma display panel (PDP), or an organic electroluminescence (EL) display. The display unit 3a may also be provided with a touch panel. The touch panel outputs an output signal in response to a user operation. By operating the touch panel, the user can perform operations such as selecting information displayed on the display unit 3a (15a).

[0055] (Avatar element 45b of visitor 21) Specifically, the visitor terminal 4 acquires location information 45a within the event area 54 based on GPS or indoor positioning technology, and transmits the location information 45a to the coordinate acquisition means 18 of the server device 2. The virtual space processing means 17 of the server device 2 converts the location information 45a into a coordinate position in the virtual space corresponding to the location information 45a, and transmits an avatar element 45b (see FIG. 2) of the visitor 21 to be displayed at that coordinate position to the remote user terminal 3 (14).

[0056] (Virtual Visitor (Remote) Avatar Element 46b) Meanwhile, the server device 2 acquires coordinate position information 46a relating to the virtual space coordinate position of the virtual visitor 23 (remote person 22) visiting the virtual space. The virtual space processing means 17 transmits to the visitor terminal 4 a preset virtual visitor avatar element 46b to be displayed superimposed on the field of view of the visitor 21 through the visitor terminal 4 at the position in the event area 54 corresponding to the acquired coordinate position information 46a.

[0057] (Product (agricultural) labeling elements 48b, 49b) Furthermore, in the system 53, a coordinate position range 49a (see FIG. 3) in the virtual space corresponding to a predetermined position range 48a (see FIG. 17) of the products in the event area 54 is set in advance and stored in the server device 2. The predetermined position range 48a in which the products are arranged in the event area 54 is a range that includes the products. The virtual space processing means 17 transmits product display elements 48b, 49b to the visitor terminal 4 and the remote user terminal 3 (14), respectively. Therefore, in the field of view of the visitor 21 through the visitor terminal 4, the product display element 48b is displayed in the position range 48a. Meanwhile, the product display element 49b is displayed in the coordinate position range 49a on the viewpoint image of the remote user terminal 3 (14).

[0058] The avatar elements 45b, 46b and the product display elements 48b, 49b are registered and stored in advance in the server device 2 or the user terminals 3 (14), 4, for example.

[0059] (Past viewpoint image) The server device 2 acquires, via the remote user terminal 3 (14), for example, the past date and time (past time information) 57a of an event that was held in the past and the location in the event area of ​​the virtual space (past location information) 57b of the event that the virtual visitor 23 wants to experience. The past time information 57a ​​and the past location information 57b can be arbitrarily determined by the virtual visitor 23. The storage unit 31 stores past data 58 including time information and location information when the avatar elements 45b, 46b and the product display elements 48b, 49b were present in the event area 54a in the virtual space. The virtual space means 17 acquires from the storage unit 32 the avatar elements 45b, 46b and the product display elements 48b, 49b having past data 58 corresponding to the past time information 57a ​​and the past location information 57b. A past viewpoint image to be displayed on the display unit 4a, 15a is created by superimposing avatar elements 45b, 46b and product display elements 48b, 49b having past data 58 on a viewpoint image corresponding to past position information 57 in an event area 54a in the virtual space.

[0060] (display screen) Next, we will use Figure 3 to explain the screen displays of the remote terminal 3 (14) and the visitor terminal 4. The upper part of the screen display shown in the figure is the display screen 47 of the display unit of the remote terminal 3 (14), and the lower part is the display screen 50 of the display unit of the visitor terminal 4.

[0061] (Virtual visitor terminal display screen 47) The display screen 47 of the remote terminal 3 (14) displays an event area 54a, which is a virtual space made up of two-dimensional or three-dimensional spatial data of an imaged space formed from an image of the event area 54 or a pseudo-space formed to simulate the image. In this embodiment, a virtual space made up of three-dimensional spatial data formed from an image is displayed.

[0062] Event-related products 55 are displayed as scenery in the virtual space. A coordinate position range 49a in which the products are arranged is set in advance to surround the event-related products 55. In this embodiment, the coordinate position range 49a is displayed on the display screen. Because the virtual space itself is like a landscape, setting the coordinate position range 49a identifies products for sale in the virtual space. Also, the display screen 47 displays an avatar element 45b of the visitor 21 and a product display element 49b. The coordinate position range 49a may not normally be displayed, but may be displayed upon operation by the remote visitor 22 (23). The coordinate position range 49a may be any shape, such as a rectangular parallelepiped, a sphere, or a cigar shape, as long as it includes the event-related product 55 to be identified. Alternatively, the coordinate position range 49a may not be a range but may instead point to the event-related product 55 to be identified using an arrow, leader line, or the like. Multiple event-related products 55 may be identified collectively using the coordinate position range 49a.

[0063] (Visitor's device display screen 50) The display screen 50 of the visitor terminal 4 corresponds to the field of view of the visitor 21 as seen through a video capture of the event area 54 or smart glasses, etc. A position range 48a is set in advance to surround the event-related products 55 in the capture or field of view. In this embodiment, the position range 48a is displayed on the screen. By setting a predetermined position range 48a in the landscape, the products to be sold are identified. The display screen 50 also displays an avatar element 46b of the virtual visitor 23 and a product display element 48b. The position range 48a is substantially the same as the coordinate position range 49a described above, and any shape, arrow, etc. may be used. Multiple event-related products 55 may be identified collectively within the position range 48a.

[0064] The user can select the avatar elements 45b, 46b and the product display elements 48b, 49b using the input / output device 32 or touch the corresponding part of the display unit with a finger to select the corresponding person or product, respectively. Selecting a person allows the user to obtain person information 7a (described later) and initiate a conversation, whereas selecting a product allows the user to obtain product information 28 (described later) and initiate a purchase.

[0065] (Other in System 53) The location range 48a and the coordinate location range 49a may specify a single product, or may be set to specify a predetermined range. Each set range can be used as a unit of purchase or sale. For example, a user can specify the coordinate location range 49a or product display 49b indicating a desired product and purchase it through a virtual space, not a real space. The coordinate position range 49a of the virtual space and the position range 48a of the event area 54 may be set together with time information. If time information can be set together with a predetermined coordinate position range 49a, the corresponding range of the virtual space can be rented together with the range of the event area 54. The person selling the goods in the event area 54 may be different from the person selling the goods in the virtual space. The remote party 22 can proceed with the purchase while interacting with the seller. In this embodiment, the product display elements 48b, 49b, the position range 48a, and the coordinate position range 49a are displayed on the display unit, but it is also possible to display only one of them.

[0066] [2-1. Communication through the farm] Next, we will explain the case where a farm is used as a virtual space. Since most of the parts are the same as in the case where the event area is used as a virtual space, the same parts are given the same reference numerals and their explanation will be omitted.

[0067] [2-2. Brief explanation] (Farm-based exchange system 44) First, an overview of the farm-based communication system will be explained using Figure 18. The system for farm-based communication method (hereinafter referred to as the system) 44 shown in Figure 18 is mainly used between visitors 21 visiting a farm 24 and remote persons 22 who are not visiting the farm 24 and are, for example, at home. The remote persons 22 include virtual visitors 23 who visit a farm 24a (see Figure 19) in a virtual space made up of three-dimensional spatial data of an imaged space formed from an image of the farm 24 or a pseudo space formed to simulate the image.

[0068] A virtual visitor 23 visits the virtual farm 24a for sightseeing, to check out / purchase farm-related products 41, or to interact with producers / sellers. Here, the producers / sellers are visitors 21 of the real farm 24. The virtual visitor 23 can also interact with other virtual visitors 23 who are visiting the virtual farm 24a.

[0069] (Farm-related products and virtual space linkage system 52) The system 52 linking farm-related products with virtual space consists of an information medium 51 including farm-related products 41, including agricultural products obtained from the farm, or a website listing farm-related products, and a system 44 (see FIG. 2). The information medium 51 contains access information 43 including a link to visit the farm 24a in the virtual space.

[0070] For example, a prospective purchaser picks up wine as a farm-related product 41 at a retailer outside the farm 24 and uses his or her user terminal to read a QR code (registered trademark) as access information 43 printed on the wine's packaging. The prospective purchaser acts as a virtual visitor 23 and uses the user terminal as a remote terminal 3 to access farm 24a in the virtual space of the farm where the wine grapes are grown. At farm 24a in the virtual space, virtual visitor 23 can understand the quality of the grapes and interact with visitor 21, the producer, to hear about the quality and characteristics of the grapes and wine. Afterwards, the prospective purchaser uses the knowledge gained at farm 24a in the virtual space as a reference to consider purchasing the wine. The stores selling farm-related products 41 are not just stores within Farm 24 or the virtual Farm 24a, but also include roadside stations, local agricultural product stores, grocery stores, department stores, supermarkets, and convenience stores, and are a concept that can be converted into these.

[0071] (Farm 24) Farm 24 (real farm) may be, for example, a tourist farm that welcomes tourists, or a regular farm. It may also be a community farm that is divided into many plots that are rented out to users and where agricultural products are grown, or a farm that serves as a care farm attached to a facility for the elderly.

[0072] (AC) The system 44 can display information on the terminal of the remote person 22 about visitors 21 who are visiting the farm 24 and about registered users who will become visitors 21 if the date and time permits, as advance information for interaction. Furthermore, for example, even remote persons 22 who cannot access farm 24a in the virtual space can understand the situation of farm 24 from images captured by cameras 25 installed on farm 24 via a communication network 26 such as the Internet. As will be described later, by logging in to system 44, visitors 21 and remote persons 22 (including virtual visitors 23), as well as virtual visitors 3a and remote persons 22 who do not have access to farm 24a in the virtual space, can understand each other's personal information 7a (see FIG. 7) and interact with each other. As an example of an exchange, if a remote person 22 is cultivating agricultural products using a plot of land on farm 24 but is unable to visit farm 24 today, the remote person 22 can request farm work from visitor 21. If visitor 21 has extensive experience in farm work, he or she can receive advice. Conversely, depending on the date and time, the relationship between remote person and visitor may be reversed, with the remote person 22 who made the request for farm work receiving the request as visitor 21. By cooperating with each other to manage and operate the farm, the burden of resources and labor involved in managing and operating the farm can be reduced. The person who receives the request for farm work can receive a specified remuneration as an incentive for making the request. It is also possible to accept the request free of charge.

[0073] (User) In this embodiment, when a user (hereinafter referred to as a user) of the farm 24 registers, the user is registered, for example, in a person identification database 6 (details of which will be described later). However, registration is not mandatory. Even if the user has not visited the farm 24, the user can make appointments with other users and accept requests for farm work or socializing. Here, examples of users who use the farm 24 include the following: A producer is someone who produces agricultural products on a farm 24. A seller is also someone who sells farm-related products 41 produced on the farm. A producer may be both a producer and a seller. A user is someone who rents a plot of land on the farm 24 and does farm work. For example, a local resident or an independent care farmer may be considered. A user who rents a plot of land on the farm 24 may also become a seller who sells farm-related products 41 that he or she produces. A person who has not rented a plot of farm 24 but has received a request to do farm work. For example, a worker at a business, such as a user at a disability employment support business, is envisioned. Also, even if a person has not rented a plot of farm 24, they may be a seller when they receive a request to sell farm-related products 41. These users do not rent plots on the farm 24 but enjoy the farm for sightseeing, tours, or walks. For example, they may be family members of local residents who rent the farm, care-requiring residents at the care farm, care farm staff, family members of care farm residents, or people registered to be able to repeatedly enter the farm. Also envisioned are purchasers of farm-related products 41. Purchasers may also include people who are planning to make a purchase. The manager of the farm24. Cultivation instructors are expected to be farmers, employment support managers for people with disabilities, care farm staff, etc. A virtual visitor 23 is a visitor to the farm 24a in the virtual space. He or she may rent a plot of land on the farm 24. This makes them both producers and buyers. The virtual visitor 23 can visit the farm 24a in the virtual space from afarm. By linking with farms in other virtual spaces or virtual spaces other than the farm, the virtual visitor 23 can travel between other virtual spaces.

[0074] [2-3.Each configuration] (System 44) Returning to FIG. 2, a functional block diagram is shown depicting a system 44 . In the system 44, a predetermined range of locations where agricultural products are grown on the farm 24 and a coordinate position range in the virtual space corresponding to that range of locations are set. Furthermore, agricultural product display elements related to the agricultural products are displayed in the field of view through the visitor terminal 4 of the visitor 21 and on the viewpoint image of the remote terminal 3 (14) of the virtual visitor 23, respectively. In this embodiment, the agricultural product display elements 48b, 49b are displayed as tags containing one or more pieces of information selected from the product information 28 (see FIG. 20). Alternatively, for example, the tags may be two-dimensional or three-dimensional spatial data of a captured image formed by capturing an image of the agricultural products on the farm 24 or a pseudo image formed by simulating the captured image. The data of the avatar elements 45b, 46b and the agricultural product display elements 48b, 49b are stored in the storage unit 31 of the server device 2, for example.

[0075] (Produce labeling elements 48b, 49b) In addition, in the system 44, a coordinate position range 49a in the virtual space corresponding to a predetermined position range 48a (see FIG. 19) where agricultural products are grown on the farm 24 is preset and stored in the server device 2. The predetermined position range 48a where agricultural products are grown on the farm 24 is a range that includes the agricultural products. The virtual space processing means 17 transmits agricultural product display elements 48b and 49b to the visitor terminal 4 and the remote user terminal 3 (14), respectively. Therefore, in the field of view of the visitor 21 through the visitor terminal 4, the agricultural product display element 48b is displayed in the position range 48a. Meanwhile, the agricultural product display element 49b is displayed in the coordinate position range 49a on the viewpoint image of the remote user terminal 3 (14).

[0076] The avatar elements 45b, 46b and the agricultural product display elements 48b, 49b are registered and stored in advance in the server device 2 or the user terminals 3 (14), 4, for example.

[0077] (Virtual visitor terminal display screen 47) The display screen 47 of the remote terminal 3 (14) displays a virtual space, farm 24a, consisting of two-dimensional or three-dimensional spatial data of an imaged space formed from an image of the farm 24 or a pseudo-space formed to simulate the image. In this embodiment, a virtual space consisting of three-dimensional spatial data formed from the image is displayed. Agricultural crops 28c are displayed as a landscape in the virtual space. A coordinate position range 49a in which the crops are grown is preset to surround the crops 28c. Agricultural products 41, including not only agricultural crops but also livestock products, may be identified by the coordinate position range 49a. In this embodiment, the coordinate position range 49a is displayed on the display screen. Because the virtual space itself resembles a landscape, setting the coordinate position range 49a identifies agricultural products for sale in the virtual space. Also displayed on the display screen 47 are an avatar element 45b of the visitor 21 and an agricultural product display element 49b. The coordinate position range 49a may not normally be displayed but may be displayed upon operation by the remote visitor 22 (23). Furthermore, the coordinate position range 49a may be any shape, such as a rectangular parallelepiped, a sphere, or a cigar shape, as long as it includes the crop 28c to be identified, or it may not be a range, but may instead point to the crop 28c to be identified with an arrow, leader line, etc. In addition to crops, farm-related products 41 including livestock products and agricultural produce may also be identified by the coordinate position range 49a.

[0078] (Visitor's device display screen 50) The display screen 50 of the visitor terminal 4 corresponds to the field of view of the visitor 21 as seen through a video capture of the farm 24 or smart glasses or the like. A position range 48a in which the crops are grown is set in advance so as to surround the crops 28c in the image or field of view. In this embodiment, the position range 48a is displayed on the screen. By setting a predetermined position range 48a in the landscape, the crops to be sold are identified. Also displayed on the display screen 50 are an avatar element 46b of the virtual visitor 23 and an agricultural product display element 48b. The position range 48a is substantially the same as the coordinate position range 49a described above, and any shape, arrow, etc. can be used. In addition to agricultural products, farm-related products 41 including livestock products and agricultural produce may also be identified by the position range 48a.

[0079] The user can select the avatar elements 45b, 46b and the agricultural product display elements 48b, 49b using the input / output device 32 or touch the corresponding part of the display unit with a finger to select the corresponding person or product (agricultural product 28c). Selecting a person allows the user to obtain person information 7a (described later) and initiate a conversation, whereas selecting a product (agricultural produce 28c) allows the user to obtain product information 28a (described later) and initiate a purchase.

[0080] (Other in System 44) The location range 48a and the coordinate location range 49a may specify a single agricultural product, or may be set to specify a predetermined range, such as a unit of rows or a unit of number of fruit trees. Each set range can be used as a buying and selling unit. For example, a user can check the ripeness, color, size, etc. of the desired agricultural product through the virtual space, specify the coordinate location range 49a or agricultural product display 49b, and purchase the desired agricultural product individually. The coordinate position range 49a in the virtual space and the position range 48a of the farm 24 may be set together with time information. For example, in the case of a rental farm where plots are rented, the time information may be the rental period. By setting the time information together with a predetermined coordinate position range 49a, it is possible to rent the corresponding range in the virtual space along with the land of the farm 24. The person who cultivates / produces / raises agricultural products on the farm 24 may be different from the person who sells the agricultural products in the virtual space. By being able to see the growth process of agricultural products in virtual space, one can purchase agricultural products in advance when they are not yet mature enough to be harvested, for example, when they are still sprouts, seedlings, or immature. One can also purchase chickens that are not yet laying eggs, or livestock that are not used for meat. In this case, the remote party 22 can proceed with the purchase while interacting with the grower / producer / raiser or seller. In this embodiment, the agricultural product display elements 48b, 49b, the position range 48a, and the coordinate position range 49a are displayed on the display unit, but it is also possible to display only one of them.

[0081] (Implementation of dialogue) Next, we will explain another embodiment of the systems 44 and 53. A system 29 (hereinafter referred to as the second system) of another embodiment shown in Figure 4 is almost similar to the above-mentioned systems 44 and 53, so the same parts are given the same reference numerals and their explanation will be omitted.

[0082] (Second System 29) The second system 29 has a function that allows users to communicate with each other. The second system 29 is composed of a server device 2 that acts as an intermediary between the remote user terminal 3 (14) and the visitor terminal 4. The functions of the second system 29 may be incorporated into the system 44.

[0083] (Server device 2) The server device 2 further includes a person information acquisition means 7 and a person information database 8 (hereinafter referred to as a person information DB).

[0084] (Person information acquisition means 7) The personal information acquisition means 7 acquires pre-registered personal information 7a from the personal information DB 8 based on the login information 25c (specific information 5a). The data structure of the personal information DB 8 will be described later. The personal information 7a is transmitted to the remote user terminal 3 (14) or the visitor terminal 4.

[0085] (User terminals 3 (14), 4) The user terminals 3 (14), 4 further include a person selection and acquisition means 10 for acquiring person information 7a, and a transmission means 11. In the figure, the remote user terminal 3 (14) is the terminal on the speaking side.

[0086] (Person selection acquisition means 10) The person selection and acquisition means 10 is used when it is desired to know information about a person for a conversation. The person about whom information is desired is selected, and person information 7a is requested from the server device 2. When a virtual visitor 23 visiting a virtual space wants to select another virtual visitor 23 with whom to have a conversation, the user may click on an avatar element displayed in the virtual space or touch the display unit by a user operation to request person information 7a corresponding to the clicked or touched avatar element.

[0087] (Means of communication 11) The communication means 11 transmits voice information or text information as communication information 11a to the visitor 21 and the remote party 22 (virtual visitor 23) with whom the conversation is to take place. In the case of voice information, the terminals with which the conversation is to take place may communicate directly with each other without going through the server device 2. The communication information 11a is information in the form of text, voice, or video, and includes everyday conversation, information related to farm-related products 41, information, questions, requests, answers, etc. related to farm work.

[0088] (Visitor Terminal 4) In this embodiment, the visitor terminal 4 is substantially the same as the remote party terminal 3. The visitor terminal 4 is provided with a communication means 11.

[0089] [3. Hardware configuration] Next, the hardware configurations of the server device 2, the user terminal, and the head-mounted display system 14 will be described with reference to FIGS. 5, 6, and 7, respectively.

[0090] (Hardware configuration of server device 2) As shown in FIG. 5, the server device 2 of this embodiment uses, for example, a computer. The computer includes a CPU 30. Connected to the CPU 30 via a bus line 35 are a memory (hereinafter referred to as a storage unit) 31, an input / output device 32 including a keyboard, a mouse, etc., a connection port 33 for connecting / reading a storage device 33a, etc., and a communication circuit 34 for communicating with the outside world via a network. The storage unit 31 stores a person information DB 8, a product information DB 28 (described later), a person identification DB 6 (see FIG. 10), systems 44 and 29, a server program 36 for processing systems 40 and 20 (described later), a browser program 37, and an OS 38 (operating system).

[0091] Furthermore, past virtual space event areas 54a, farms 24a, and avatar display elements 45b, 46b, and product display elements 48b, 49b in past virtual spaces can be recorded in chronological order like a video recording in the storage unit 31. The virtual visitor 23 (22) can visit events that have already ended and past farm virtual spaces 24a. In the past virtual spaces 54a and 24a, the avatar display elements 45b and 46b can be selected, and contact can be made through contact details via the person information DB 8. Furthermore, in the past virtual spaces 54a and 24a, the product display elements 48b and 49b can be selected, and products can be purchased from the product information DB 28. When purchasing agricultural products, the past growth conditions can be checked.

[0092] In this embodiment, the server program 36 operates in cooperation with the OS 38 and the browser program 37 using their functions. Note that the server program 36 may also operate independently without using the browser program 37 or the OS 38. The server program 36 is stored, for example, in the storage device 33a. The server program 36 is installed in the server device 2 by reading the storage device 33a from the connection port 33.

[0093] (Hardware configuration of user terminals 3 and 4) Next, the hardware configuration of the user terminal will be explained. The user terminal is used as the remote terminal 3 and the visitor terminal 4. It can also be used as a virtual visitor terminal 14. Here, the hardware configuration of the remote terminal 3 will be explained, and the explanation of the visitor terminal 4 will be omitted. The hardware configuration of the remote user terminal 3 is almost the same as that of the server device 2 described above, so the same parts are given the same reference numerals and the description thereof will be omitted. As shown in FIG. 6, the remote user terminal 3 of this embodiment may be, for example, a smartphone, a notebook computer, a head-mounted display, or the like. The user terminal 3 includes a CPU 30. The CPU 30 is connected via a bus line 35 to a storage unit 31, a connection port 33 for connecting / reading a storage device 33a, and a communication circuit 34 for communicating with the outside world via a network. The input / output device 32 includes, for example, a microphone 32a, a speaker 32b, and an operation unit 32c. The microphone 32a, the speaker 32b, and the operation unit 32c are the same as the corresponding components of the head-mounted display 15 described below. The storage unit 31 stores a user terminal program 39 for processing the systems 44, 29, 40, and 20, a browser program 37, and an OS (operating system) 38. The user terminal program 39 is stored in, for example, the storage device 33a. By reading the storage device 33a from the connection port 33, a server program 36 is installed in the user terminals 3 and 4.

[0094] In the hardware configuration of the server device 2, remote terminal 3, and visitor terminal 4 described above, the functions of the system shown in Figures 2, 4, 12, and 15 are realized using, for example, a CPU 30, a server program 36, and a remote terminal (visitor terminal) program 39, but some or all of these may be sequence-controlled using a logic circuit such as a microcomputer or a PLC (programmable logic controller).

[0095] (Hardware configuration of head-mounted display system 14) Next, we will explain the hardware configuration of the head-mounted display system 14. In the hardware configuration of the head-mounted display system 14, parts that are almost the same as those in the hardware configuration of the remote user terminal 3 described above are assigned the same reference numerals, and explanations thereof will be omitted.

[0096] (Head-mounted display system 14) Next, a head-mounted display system as the virtual visitor terminal 14 will be described with reference to FIG. The head-mounted display system 14 shown in the figure includes a head-mounted display 15 that is worn on the user's head, and a control device 16. Note that the head-mounted display system 14 described below is an example and is not limited to this.

[0097] (Head-mounted display 15) The head-mounted display 15 mainly comprises a display unit 15a that displays an image of a virtual space, and a head position detection sensor 15b. In this embodiment, the head-mounted display 15 further comprises a speaker 15c, a microphone 15d, and an operation unit 15e. Note that the speaker 15c, the microphone 15d, and the operation unit 15e do not have to be integrated with the head-mounted display 15, and any one of them may be integrated with the head-mounted display 15.

[0098] (Display section 15a) The display unit 15a has left and right image display surfaces disposed at positions corresponding to the left and right eyes of the user so as to cover the left and right eyes of the user, respectively. A three-dimensional video may be displayed to the user by displaying images with parallax on the left and right image display surfaces, respectively.

[0099] (Head position detection sensor 15b) Head position detection sensor 15b detects posture information such as the direction and tilt of head-mounted display 15. The sensor for detecting posture information is realized by appropriately combining a gyro sensor, an acceleration sensor, an angular acceleration sensor, etc. The position and posture of the user's head are detected, and the detection results are reflected in the 3D image of the virtual space displayed by display unit 15a, thereby presenting a 3D image (viewpoint image) seen from a viewpoint position corresponding to the movement of the user's head.

[0100] (Speaker 15c, Microphone 15d) The speaker 15c outputs audio, such as real audio in the virtual space, audio and music that take into account the situation in the virtual space, and audio from a conversation with the visitor 21, a remote person 22, or another virtual visitor 23. The microphone 15d receives the user's voice when interacting with the visitor 21, the remote person 22, or another virtual visitor 23.

[0101] (Operation unit 15e) The operation unit 15e includes, for example, an operation lever and an operation button. By operating these, an option displayed on the display unit 15a can be selected and the selected option can be confirmed. For example, in this embodiment, a plurality of agricultural products available for purchase in the virtual space are displayed, and the agricultural products to be purchased are selected from the displayed options and the purchase can be confirmed. Furthermore, by operating the operation unit 15e, the three-dimensional image viewed from the viewpoint position can be moved, allowing the user to experience as if they themselves were moving within the virtual space. The operation unit 15e is communicably connected to the control device 16 via a communication circuit.

[0102] (Control device 16) The hardware configuration of the control device 16 is almost the same as that of the server device 2 or the remote user terminal 3. Therefore, the same components are denoted by the same reference numerals and their description will be omitted. The control device 16 generates images to be displayed on the display unit 15a of the head-mounted display 15, and performs various arithmetic processing. The storage unit 31 stores processing programs and the like for generating images and the like to be displayed on the display unit 15a and for performing various types of arithmetic processing and the like.

[0103] [4. Program] (Flowchart of user registration process) Next, a flowchart of the user registration process will be described with reference to Fig. 8. Fig. 8 is a flowchart showing an embodiment of the processing of the user terminal program 39a used in the user terminals 3, 4, 14 (hereinafter referred to as user terminals, etc.) of the systems 29, 44 and the server program 36a used in the server device 2. In this embodiment, the process is executed using the function of a web browser, but the user registration process may also be executed by a program installed on the user terminal or the like and the server device 2.

[0104] (T1) When an unregistered user who wishes to use the system 20 operates a user terminal or the like, the user terminal or the like requests the server device 2 to transmit a registration form for user registration. For example, in this embodiment, a function of a web browser is used.

[0105] (T2) The server device 2 transmits a registration form. In the registration form, a user name and password to be used for login processing, a handle name to be used in the systems 44 and 29, etc. are entered. Furthermore, information to be stored in the person identification DB 6 and the person information DB 8 is entered. Note that the information to be entered in the person information DB 8 may be selectable at will.

[0106] When a user enters the farm 24 or the vent area 54a, a face image required for face authentication may be registered in the person identification DB6. When receiving a request for farm work or the like, it is preferable to enter detailed information in the personal information DB8 so that it can serve as reference information for the requester. Furthermore, if a reward is to be received, the user enters information necessary to receive the reward 8d (see FIG. 21) into the registration form. The necessary information is, for example, all information necessary to actually receive the reward. The necessary information includes, for example, bank account information, such as the bank name (bank code), branch name (branch number), account number, account name, and information that can be converted into these. If the reward 8d is electronic money, points that can be used within the system, virtual currency, tokens (cryptocurrency), etc., all information necessary to receive the electronic money, points that can be used within the system, virtual currency, tokens (cryptocurrency), etc. is entered. All the necessary information needs to be at least the minimum information necessary to receive the reward. These registration items may be registered all at once or may be registered each time.

[0107] (T3) The unregistered user enters information for registration in the entry field and transmits it to the server device 2.

[0108] (T4) Information required for registration is registered in the person identification DB 6 and the person information DB 8.

[0109] (Login process flowchart) FIG. 9 is a flowchart showing an embodiment of the processing of the user terminal program 39b used in the user terminals of the systems 29 and 44 and the server program 36b used in the server device 2.

[0110] (R1) A user attempting to log in starts the user terminal program 39b of the system 29, 44, enters the registered username and password on the login information input screen, and transmits them to the server device 2. The visitor 21 can log in using facial authentication via the authentication device 1 (see FIG. 1), but may also log in using a separate username and password.

[0111] (R2) The server device 2 refers to a user registration database (for example, see the person registration DB 6 in FIG. 10) and searches for a registration that matches the transmitted username 6b and password 6c. If there is no matching registration, the process returns to R1. If there is a matching registration, the user logs in to the system 29, 44. Upon logging in, a user terminal program 39d (see FIG. 11) for communication and dialogue is launched. Note that a system known as social login may also be used to log in.

[0112] (Data structure of person identification DB6) The data structure of the person identification DB is shown in Fig. 10. The person identification DB 6 shown in the figure is made up of, for example, an identification number 6a, a name / user name 6b, and registered face image information or password 6c.

[0113] (R3) In the case of face authentication, when the same registration is confirmed, the authentication device 1 transmits specific information such as the identification number 5a to the server device 2 (see the route indicated by the two-dot chain line).

[0114] (Authentication Device 1) The authentication device 1 (see FIGS. 1, 15, and 18) is a device that identifies visitors 21 in the event area 54 or the farm 24 and acquires information such as the name of the identified person or an identification number that can be converted into a name. For example, in this embodiment, a device integrated with the camera device 25 is used. The authentication device 1 is equipped with the person identification means 5 and person identification DB 6 described above. The authentication device 1 may be installed at the entrance and exit of the farm 24 to manage the entry and exit of visitors 21. Alternatively, multiple authentication devices 1 may be installed within the farm 24 to identify the location and time of visitors 21 within the farm 24 and acquire their behavioral history.

[0115] (Facial recognition processing) A trained program based on, for example, machine learning for facial recognition is installed in the authentication device 1. When a visitor 21 enters the farm 24, a camera device 25 detects the face of the visitor 21. A person identification means 5 of the authentication device 1 identifies the visitor 21 based on data registered in a person identification DB 6, and transmits identification information 5a to the server device 2. Machine learning will be described later.

[0116] (Flowchart showing the interaction process) 11 is a flowchart showing an embodiment of the processing of the user terminal program 39d used in the visitor terminal 4 and virtual visitor terminal 3 (14) of the second system 29 and the server program 36d used in the server device 2. This flowchart shows the interaction processing. The flowchart shown in FIG. 11 shows the interaction method 20a.

[0117] First, we will explain the process in which the virtual visitor 23 operates the operation unit 15e to change the viewpoint image in the virtual space displayed on the display unit 15a. In this embodiment, it is assumed that the virtual visitor 23 moves around the virtual space, finds another virtual visitor 23 with whom he or she wants to talk, and then starts the conversation. For this reason, the process of changing the viewpoint image is performed before the dialogue process. However, the process of changing the viewpoint image may also be performed after the dialogue process.

[0118] (W1) The CPU 30 of the remote user terminal 3 (14) transmits the operation information 17a to the server device 2 in response to an operation on the operation unit 15e.

[0119] (W2) Based on the operation information 17a, the amount of displacement of the viewpoint coordinates is acquired, a viewpoint image of the displaced viewpoint coordinates is generated, and is transmitted to the remote terminal 3 (14).

[0120] Next, the processing of the interaction will be described. (V1) To select a person with whom one wishes to converse, the CPU 30 of the remote terminal 3 (14) can request person information 7a from the server 2. The request may be for all person information 7a of people logged in to the system, or for person information 7a limited to a specific person. When narrowing down the people, a screen section (not shown) for narrowing down the search is displayed on the display unit 15a, and the narrowing down item is selected and requested. Furthermore, if the avatar element of the virtual visitor 23 with whom one wishes to converse is displayed on the display unit 15a, the avatar element may be selected via the operation unit 15e. Note that the person information 7a of the virtual visitor 23 may be requested by a visitor 21 who can see the virtual visitor 23 using AR glasses or the like.

[0121] (V2) Based on the request, the person information 7a is sent to the remote user terminal 3 (14). The person who is logged in to the system 29 has sent the login information 25c to the server 2. Therefore, the server device 2 can acquire the person information 7a based on the login information 25c and the person information DB8.

[0122] (V3) Select a person to talk to.

[0123] (V4) A message (see communication information 11a in FIG. 4) is sent to the remote terminal 3 (14) of the person with whom you wish to talk, indicating that you wish to talk. An agreement (communication information 11a) is received from the other party, and a conversation takes place via the server device 2. The conversation can be carried out using text information or audio information. Note that if the contact information of the person with whom you wish to talk is known from the person information 7a, you may contact them separately by telephone, a conversation application, chat, email, or the like, without using the second system 29.

[0124] In the second system 29, a head-mounted display system was used as the virtual visitor terminal 14, but a personal computer, smartphone, or the like may also be used. When a personal computer or the like is used, an image of the virtual space is displayed on the display unit 3a. In the virtual space, the viewpoint image of the virtual space is moved using the input / output device 32 (see FIG. 5).

[0125] 5. Other Embodiments (Third System 40) Next, we will explain yet another embodiment of the system 44. The system 40 (hereinafter referred to as the third system) of this embodiment shown in Fig. 12 is almost the same as the second system 29 described above, so the same parts are given the same reference numerals and their explanation will be omitted.

[0126] In the third system 40, a virtual visitor 23 as a purchaser purchases goods or agricultural products from a visitor 21 as a seller. The purchaser may also be a remote person 22. The third system 40 comprises a remote person terminal 3 (14), a visitor terminal 4, and a server device 2 that acts as an intermediary between them.

[0127] (Server 2 of the third system 40, remote terminal 3 (14)) The server 2 further includes a payment means 9, an update means 19, and a product information database (hereinafter referred to as product information DB) 28. Reference numeral 42 denotes a camera that acquires three-dimensional data. The remote user terminal 3 (14) includes a product acquisition means 27.

[0128] (Payment Method 9) The payment means 9 pays the price of the event-related products 55 or farm-related products 41 to the visitor 21 as a seller / producer. The payment is based on the settlement information 13. The settlement information 13 includes the settlement conditions, such as the payment method, currency type, and payment due date. The settlement information 13 is sent from the remote user terminal 3 (14) to the server device 2. The settlement information 13 is stored in the memory unit 31. The amount of the fee / reward may also be determined through negotiation between the visitor 21 and the remote party 22. The fee / reward may be converted into cash, electronic money, virtual currency, or tokens (cryptocurrency), or may be paid to the visitor 21 as points, virtual currency, or tokens (cryptocurrency) that can be used to purchase goods or services in the system 40. Furthermore, payment may be made in the form of agricultural produce or other physical items, or may be made as a payment method for paying non-monetary rewards. As will be described in detail later, a reward may be paid to the visitor 21 for a request such as farm work. A reward is paid to the visitor 21 who completes the request based on the request details registered in the storage unit 31. The reward amount for each request detail is registered in advance in the person information 7a.

[0129] (Update method 19) The update means 19 updates the images in the virtual space to correspond to different events, the changing seasons in the farm 24, and the growth of agricultural products. The update means 19 collects images of three-dimensional data using a camera device 42 that collects three-dimensional data, creates a virtual space to be displayed, and stores the images in the storage unit 31. The camera device 42 may be fixed to the event area 54 or the farm 24.

[0130] (Product acquisition means 27, product information DB 28) The product acquisition means 27 acquires product information 28a from the product information DB 28. The product information 28a is acquired by the operation of the user operating the remote user terminal 3 (14). For example, the user acquires the product information 28a by clicking on a product image (not shown) for sale in the virtual space. For example, a product can be specified by the location range 48a, product / produce display element 48b, coordinate location range 49a, and product / produce display element 49b described in FIG. 3 or FIG. 19. Here, the product acquisition means 27 corresponds to B1 (see FIG. 13) in this embodiment.

[0131] (Seller 43, Visitor Terminal 4) The seller sells the product through the visitor terminal 4 as a seller in the third system 40. In this embodiment, the visitor terminal 4 is, for example, a smartphone. Other devices that may be used include a mobile phone, a tablet terminal, a personal computer, or a wearable computer that can be attached or worn. Examples of wearable terminals include a smart watch and smart glasses.

[0132] (Flowchart showing purchase process) 13 is a flowchart showing an embodiment of the processing of the user terminal program 39e used in the remote user terminal 3 (14) of the third system 40 and the server program 36e used in the server device 2. This flowchart shows a sales process.

[0133] (B1) To purchase a product, the CPU 30 of the virtual visitor terminal 14 requests product information 28a from the server 2. The request may be for all product information 28a of sellers logged in to the system, or for product information 28a limited to specific products. When narrowing down the products, a screen section (not shown) for narrowing down the search is displayed on the display section 3a (15a), and the narrowing item is selected and requested. Furthermore, a product image (not shown) displayed on the display section 3a (15a) may be selected. When requesting product information 28a, personal information 7a of the seller may also be requested.

[0134] (B2) Based on the product information database (product information DB) 28, product information 28a is transmitted to the remote terminal 3 (14). At that time, personal information 7a of the seller may also be transmitted.

[0135] (Data structure of product information DB28) 14 shows the data structure of the product information DB for event-related products 53. The product information DB 28 shown in the figure includes, for example, an ID (identification number) 28a, a name 28b, a product 55, a stock quantity 28g, and a price 28e. Other information may also be registered. Figure 20 shows the data structure of the product information DB for farm-related products 44. The product information DB 28 shown in the figure includes, for example, an ID (identification number) 28a, a name 28b, a crop 28c, a sales unit 28d, a price 28e, and a harvest date 28f. Other information may also be registered. Instead of crops, agricultural products or farm-related products 41 may be registered.

[0136] The identification number 28a is a number assigned to each person. The person identification DB6 and the person information DB8 are relational databases linked by identification number and name. Therefore, it is possible to search for person information 7a from a specific identification number 28a in the product information DB28. In this embodiment, the personal information 7a of the person who cultivated the crop 28c from the received product information 28a, such as knowledge and experience information 8f and affiliation and attribute information 8g, can be taken into consideration in making a purchase decision. A username, pen name, or the like may be registered as the name 28b instead of a real name. The crop 28c is the type of cultivated crop. The sales unit is the unit of sale. For example, the crop can be purchased per unit. The price 28e is the amount per unit. It may be points, virtual currency such as Bitcoin, or tokens (cryptocurrency), etc. The harvest date 28f is the date the crop 28c was harvested. The product 28g is an event-related product. The stock quantity 28g is the remaining quantity of the product.

[0137] (B3) The visitor 21 selects the seller of the product to be purchased.

[0138] (B4) A message (transmission information 11a) is sent to the visitor terminal 3 indicating that the visitor wishes to talk. The message (transmission information 11a) of approval is received, and a conversation is conducted via the server device 2. The conversation and negotiation can be conducted using text information or voice information. Note that if the seller's contact information is known from the person information 7a, the seller may be contacted separately by telephone, a conversation application, chat, email, or the like, without using the third system 40. Alternatively, the customer may proceed directly to step B5 and purchase the product without the conversation in step B4.

[0139] (B5) Decide whether to purchase or not through input operations by the virtual visitor 23. If not, the process ends.

[0140] (B6) If purchasing, the payment information 13 including the fact that payment is to be made, the amount, and other necessary information, such as the product name, the number of items to be purchased, and the delivery date, is transmitted to the server device 2.

[0141] (B7) Pay the purchase amount. In this embodiment, payment may be made using points, virtual currency, or tokens (encrypted currency) that can be used within the third system 40. Alternatively, cash may be transferred to a pre-registered transfer destination.

[0142] After payment, the seller delivers the agricultural products to the buyer by mail or courier. The buyer may register a buyer rating 8h (see Figure 16) based on the delivered product. Meanwhile, the seller may also register a rating 8h for their interaction with the buyer.

[0143] (4th System 20) Next, we will explain yet another embodiment of the system 44. The system 20 (hereinafter referred to as the fourth system) of this embodiment shown in Fig. 15 is almost the same as the second system 29 described above, so the same parts are given the same reference numerals and their explanation will be omitted.

[0144] The system 20 differs from the second system 29 mainly in that it includes an authentication device 1 for identifying visitors to the event area 54 or farm 24, and a request / reward registration means 12 in the remote user terminal 3 (14).

[0145] (Request / Reward Registration Method 12) The request / remuneration registration means 12 registers the details of the request, such as the person who accepted the request, the request details, and the amount of remuneration, in the storage unit 31.

[0146] (Flowchart showing request processing) 16 is a flowchart showing an embodiment of the processing of the user terminal program 39c used in the visitor terminal 3 and the remote user terminal 3 (14) of the fourth system 20 and the server program 36c used in the server device 2. This flowchart shows the request processing.

[0147] (S1) After logging in, the user terminal program 39c is started. Based on the program 39c, the remote person 22 operates the program to request the server device 2 to send information about the visitor 21 and / or registered person (hereinafter referred to as the visitor, etc.) to whom the request should be made. In the request, conditions may be specified based on the date and time of the requested work, the work content, the range of remuneration, the affiliation and attribute information or gender of the visitor, etc., and the like, and sent to the server device 2.

[0148] (S2) The server device 2 receives the specific information 5a in real time or at predetermined time intervals from the authentication device 1. The CPU 30 of the server device 2 refers to the personal information DB 8 from the specific information 5a and acquires the personal information 7a. The visitor 21 can prevent the remote person 22 from knowing that he or she is visiting the farm 24.

[0149] (Data structure of person information DB8) 17 shows the data structure of the person information DB used in the system 53 via the event area 54. The person information DB 8 shown in the figure is composed of, for example, an identification number 8a, a name 8b, contact information 8e, knowledge and experience information 8f, and affiliation and attribute information 8g. Other information may also be registered. 21 shows the data structure of the person information DB used in the system 44 via the farm 24. The person information DB 8 shown in the figure consists of, for example, an identification number 8a, a name 8b, a task content 8c, a remuneration 8d, contact information 8e, knowledge and experience information 8f, affiliation and attribute information 8g, an evaluation 8h, and a date and time 8i. Note that other information may also be registered.

[0150] The identification number 8a is a number assigned to each person. As the name 8b, a user name, a pen name, etc. may be registered instead of a real name. The work content 8c may include, for example, sending images of plots, sending cultivation information, planting seeds or seedlings, fertilizing, watering, weeding, spraying pesticides, harvesting, advice, etc. Other work may also be registered. Each user may be allowed to register what they can do. The reward 8d is predetermined based on the labor and expertise of the farm work. Note that the user may register the reward by himself / herself, for example, based on his / her strengths and weaknesses. In the contact method 8e, contact methods and contacts permitted by the user are registered. Affiliation / Attributes 8g registers the company name, affiliation as care farm / neighborhood resident, and attribute as disabled / elderly. The user may add other items or register more detailed information about affiliation and attributes. The rating 8h is the requester's rating of the completed request. In this embodiment, a 5-point rating system is used, with the higher the number from 1 to 5, the higher the rating. The number is the average of the ratings received for each request. The rating can be on any number of levels, and can be converted into symbols such as letters, or rated on a scale of 0 to 100. The visitable date and time 8j is the usual date and time when the farm 24 is visited. Alternatively, a specific date and time may be registered. In this embodiment, the user can register any items other than the identification number 8a at will. It is preferable that the user not register information that he or she does not want to make public. It is also possible to specify the range of information in the personal information DB8 that can be made public.

[0151] Returning to FIG. 16, if there are conditions specified by the remote party 22 (hereinafter referred to as the requester), personal information 7a of those who meet the conditions may be sent from among visitors, etc. who have given permission to send location information and personal information 7a. If there are many matching people, a predetermined number of people with the highest ratings are extracted and sent. If there are no matching people, a message to that effect is sent. Note that even if there are no matching people, their personal information 7a may be sent as long as at least the date, time, and work content match. Furthermore, if nothing is specified in the request from the client, in this embodiment, for example, one or more highly rated visitors 21 currently visiting the farm 24 are identified and transmitted to the remote terminal 3. Note that the personal information 7a of all visitors 21 may also be transmitted.

[0152] (S3) Based on the acquired personal information 7a, the visitor or the like to whom the request should be made is identified.

[0153] (S4) The visitor or the like is notified of the requester's name, handle name or identification number, as well as the date and time of the requested work and the work content as communication information 11a. In this embodiment, for example, the information entered in step S1 is used for the date and time and the work content. If details such as the date and time of the work and the work content are specified, the communication includes the information specifying the details. Note that the request may be made without transmitting the requester's name, handle name or identification number.

[0154] (S5) If the contacted visitor approves the request, he / she sends a reply of approval (transmission information 11a) to the requester. If there are any unclear points, such as questions or requests about the date and time of the work, the work content, or the amount of compensation, he / she contacts the requester about the unclear information (transmission information 11a). Before replying, he / she may request personal information corresponding to the requester's name, handle name, or identification number from the server 2.

[0155] (S4-S5) The visitor and the client communicate with each other regarding the date and time of the work, the work content, and the amount of compensation (see the two-dot chain line). Communication can be done via text or voice information. If the contact information of the visitor or the like is known from the person information 7a, the visitor or the like may be contacted separately by telephone, a conversation application, chat, email, or the like, without relying on the system 20.

[0156] (S6) Decide whether to make the request.

[0157] (S7) If no request is made, the process ends. If a visitor or the like is to be selected again to make a request, the process returns to step S3.

[0158] (S8) When making a request, the request information 12a is registered in the server device 2. In this embodiment, the request information 12a corresponds to the requester, visitor, etc., the date and time of the work, the work content, and the amount of remuneration. Other items may also be included in the request content. For example, it may be possible to register an appointment between the parties.

[0159] (S9) Completion information 11b indicating the completion of the work is sent by the visitor terminal 4 to the remote terminal 3 (14). Completion information 11b may be a message indicating that the work has been completed, or it may be text information, audio information, or even image information showing the completed state.

[0160] (S10) When the client acquires the completion information 11b and confirms the completion of the work, the client transmits the payment information 13 to the server device 2. The payment information 13 includes payment instructions, evaluations 8h of the visitor, etc., and other items to be registered.

[0161] (S11) Reward is paid. In this embodiment, reward is paid in points, virtual currency, or tokens (encrypted currency) that can be used within the system 20. Payment may also be made by incorporating a credit card into the system. Furthermore, cash, points, virtual currency such as Bitcoin, or tokens (encrypted currency) may be transferred to a pre-registered transfer destination.

[0162] (Variation) Next, a description will be given of a modified example of the system 20. The system according to the modified example is almost the same as the system 20 described above, so a description of the same parts will be omitted. The system of the modified example does not use facial recognition by the authentication device 1. A base station (not shown) is installed near the entrance / exit of the event area 54 or the farm 24. When the visitor terminal 4 receives radio waves from the base station, the visitor terminal 4 transmits a signal indicating that it has visited the farm 24. The signal is the visitor's own identification number or identification information 25b (see Figure 15) that can be converted to the identification number. The identification information is transmitted to the authentication device 1 via a communication network 26, such as a wireless LAN or an internet line within the event area 54 or the farm 24. The authentication device 1 identifies the person corresponding to the identification information 25b based on the person identification DB 6.

[0163] [6. Other] If the visitor terminal 4 of the visitor 21 has a GPS function, location information may be acquired so that the location of the visitor 21 within the farm 24 can be ascertained within the virtual space. For example, an avatar element (avatar image) of the visitor 21 may be displayed at a corresponding position in the virtual space of the visitor 21. The visitor may meet the visitor in the virtual space, converse with them, and purchase agricultural products they are cultivating while conversing. Furthermore, the location information allows the location of the visitor 21 within the farm to be ascertained, making it easy to find the visitor 21 with whom you wish to have a conversation. In the above-described head-mounted display system 14, the head-mounted display 15 and the control device 16 may be separate or integrated. The head-mounted display system 15 does not have to be a dedicated system, and may be, for example, a goggle-type headset to which a smartphone is attached. Head-mounted displays include, for example, virtual reality (VR) type head-mounted displays that display only a virtual space created by computer graphics or the like, and mixed reality (MR) type head-mounted displays that display a real space (for example, a real space displayed optically through the real space) and a virtual space in real time. The present invention can be applied to either type of head-mounted display. The person identification DB 6 may be provided in the server device 2 or an external server, rather than being integrated with the camera device 25. The server device 2 performs person identification. Furthermore, the person identification means 5 may be provided in the server device 2. A camera device 25 is provided at the entrance and exit of the farm, and the acquired image information 25a is transmitted to the server device 2. The server device 2 manages entry and exit of people to and from the farm. The above-described embodiments can be used in combination with the modifications, other embodiments, and other aspects. In the fourth system 40, the visitor terminal 14 may be set with an imaged space formed from an image of the event area 54 or farm 24, or a virtual space formed to simulate the imaged space, rather than a field of view of the actual event area or farm.

[0164] (Machine Learning) Now, let's explain machine learning. Machine learning techniques include, for example, "supervised learning," "unsupervised learning," and "reinforcement learning." Furthermore, to realize these techniques, there is a technique called "deep learning," which learns to extract the features themselves. In this embodiment, a CPU (see FIG. 5) is used, but if a GPU or the like is used, faster processing becomes possible.

[0165] "Supervised learning" is a method of inductively acquiring a model that can estimate results from inputs by providing a large amount of training data, i.e., a set of data consisting of certain inputs and results, and learning the characteristics of those data sets. "Unsupervised learning" is a technique in which a device learns the distribution of input data by providing only a large amount of input data, and then compresses, classifies, and formats the input data without providing corresponding supervised output data. For example, it is possible to cluster similar features in the data sets. Using this result, it is possible to set some kind of criterion and assign outputs that optimize it, thereby realizing output prediction.

[0166] "Reinforcement learning" is, for example, a method of observing the state of the environment, deciding on an action, and learning to maximize the reward for that action. The environment changes according to certain rules, and one's own actions may also cause changes to the environment. Each time an action is taken, a reward is returned. What is being sought to maximize is the total future reward. Learning starts from a state where the consequences of actions are completely unknown, or only partially known. In other words, the optimal action is sought through trial and error. Note that learning can also begin from a good starting point, using a state obtained through "supervised learning" or "inverse reinforcement learning" as the initial state.

[0167] Below, the case of supervised learning will be explained as an example, but the present invention is not limited to supervised learning. We will now explain the learning unit (not shown) that uses supervised machine learning to improve the accuracy of identifying suspicious individuals and those requiring observation. Individuals requiring observation are those whose behavior is suspicious, who are in poor health, or who may cause accidents or trouble, and who require attention and observation. In this embodiment, the learning unit is provided in, for example, the authentication device 1 or the server device 2. The learning unit is used to create a required model in which a person has been correctly identified as a suspicious person or a person requiring observation, and an unnecessary model in which a person has been incorrectly identified. The required model is generated by learning information on behavioral history acquired via the camera device 25 in which the person was correctly identified. The unnecessary model is generated by learning information on behavioral history in which the person was incorrectly identified. The information on these behavioral histories is recorded in the memory unit 31.

[0168] [7. Other Summary] (Example for a farm) The farm-based communication method 20 is executed by one or more computers and is a farm-based communication method between a visitor 21 visiting the farm 24 and a remote party 22 viewing information about the farm 24, and is characterized by comprising a step of acquiring personal information 7a of pre-registered visitors 21 based on specific information 5a that identifies the visitor 21, so that the remote party 22 can select the visitor 22 with whom they wish to communicate, and a step of sending information to be conveyed to the selected visitor 21. Since personal information 7a of visitors 21 visiting the farm 24 can be obtained, conversations can be encouraged both inside and outside the farm 24. A remote person 22 who cannot visit the farm 24 can appropriately request farm work from a visiting visitor 21. The visitor 21 and the remote person 22 can cooperate with each other to manage and operate the farm, thereby reducing the burden of resources and labor involved in managing and operating the farm. Also, if the person is not feeling well or the weather or temperature is not suitable for the body, the person can ask a visitor 21 to do the work as a remote person 22. Furthermore, those who are bedridden or physically disabled and cannot visit the farm 24 (remote people 22) can cultivate agricultural products in cooperation with visitors 22, including family members and neighbors. Furthermore, if a remote party 22 is looking to purchase agricultural products, they can do so knowing what kind of person is growing them.

[0169] "Information about the farm" includes, for example, at least one of information on cultivation management, farm management, and safety management. Cultivation management information is information related to the climate for the cultivation and growth of agricultural products, and is equivalent to, for example, video information of the farm from surveillance cameras, weather forecast information, and information provided by weather sensors, air temperature / soil temperature sensors, sunshine sensors, and rainfall sensors installed on the farm, and is a concept that includes information that can be converted into these. Farm management information is information about the status of farm equipment, such as usage information provided by electricity usage sensors, flow rate information from water flow meters, ON / OFF information for remote breakers, and open / close information for electric shut-off valves, and is a concept that includes information that can be converted into these. Safety management information is information related to safety management such as locking the farm and issuing alarms against intruders. For example, it includes the operation status of remote locking tools, and information on the occurrence of alarms due to intrusions by suspicious individuals into management sheds, storage sheds, toilets, etc., and is a concept that includes information that can be converted into such information.

[0170] Users of allotment gardens and care farms are usually not engaged in agriculture and do not have much experience or knowledge of farming. If users of these gardens can cooperate to manage and operate the gardens, it will have the effect of reducing the burden of resources and labor required for managing and operating the gardens. Furthermore, if users of allotment gardens and care farms can deepen their communication through farm work, it is thought that this will contribute to, for example, the creation of local communities, the maintenance and improvement of public safety, and the formation of communities in the event of a disaster. It will also help users get to know each other. It will make it easier for users to cooperate to operate and manage the gardens.

[0171] In this farm-based communication method 20, since the personal information 7a includes information on visitors who will likely visit the farm 24, it is possible to contact visitors 21 who plan to visit in the future. It is also possible to request farm work at an appropriate time.

[0172] The personal information 7a includes affiliation and attribute information 8g relating to the person's affiliation and attributes and / or knowledge and experience information 8f relating to agricultural knowledge and experience, the information to be communicated includes a request for farm work on the farm 24 to the visitor 21, and there is further a step of paying a fee for the request, so that the person to be requested and the person to be paid can be selected taking into consideration not only the farm work skill of the person to be requested but also the background of the person performing the farm work.

[0173] A virtual space is provided, consisting of two-dimensional or three-dimensional spatial data of an imaged space formed from an image of a farm 24 or a pseudo-space formed to simulate the image. A viewpoint image moving within the virtual space is displayed on the display unit 15a of the virtual visitor terminal 14 of the virtual visitor 23 by operation of a virtual visitor 23 visiting the virtual space. The system further includes a step of transmitting information to be communicated between users, allowing virtual visitors to converse with each other in the virtual space of the farm 24. Conversations can be enjoyed regardless of physical condition, weather, or temperature. Conversations can be held while viewing the same image of the farm 24. A person (virtual visitor 23) who is bedridden or physically disabled and cannot visit the farm 24 can converse with other virtual visitors 23, including family members and neighbors, through the farm 24 in the virtual space. Access to the virtual space allows, for example, visits to virtual spaces of care farms 24 around the world. A person who is bedridden or physically disabled and cannot go out can be taken out as a virtual visitor.

[0174] The system further includes a step of acquiring product information 28a including agricultural products and / or agricultural product-related products in the farm 24 through the operation of the virtual visitor 23, and a step of making a payment to purchase the agricultural products and related products, so that an outside person who visits as a virtual visitor can purchase agricultural products from the farm 24. Furthermore, if the seller of the agricultural products is the virtual visitor 23, other virtual visitors 23 who are considering purchasing can purchase the agricultural products after talking with the seller in the virtual space. Agricultural products can be purchased from care farms 24 all over the world.

[0175] The system includes a step of acquiring location information 45a of a visitor 21 visiting the farm 24, and a step of displaying a preset avatar element 45b of the visitor 21 on the display unit 3a, 4a, 15a of the user terminal 3, 4, 14 at a position in the virtual space corresponding to the location information 45a, so that the visitor 21 can be remembered from the characteristics of the avatar element 45b.

[0176] The system further includes a step of acquiring coordinate position information 46a relating to the coordinate position of the virtual visitor 23 in the virtual space, and a step of superimposing and displaying a preset avatar element 46b of the virtual visitor 23 at a position in the field of view of the visitor 21 through the user terminal that corresponds to the coordinate position information 46a, so that the virtual visitor 23 can be remembered from the characteristics of the avatar element 46b.

[0177] A predetermined location range 48a where agricultural products are grown on the farm 24 and a coordinate position range 49a in the virtual space corresponding to the location range 48a are set, and a step is provided in which agricultural product display elements 48b, 49b related to the agricultural products are displayed in the location range 48a in the field of view through the user terminal 4 of the visitor 21 and in the coordinate position range 49a displayed on each of the user terminals 3, 14 of the virtual visitor 23, so that the visitor 21 and the virtual visitor 23 can have a conversation while understanding the same agricultural products or information about the agricultural products.

[0178] The server device 2 is communicatively connected to both the visitor terminal 4 of a visitor 21 visiting the farm 24 and the remote terminal 3 of a remote person 22 viewing information about the farm 24, and is a server device used in a farm system for a communication method via a farm, and is characterized by having a personal information acquisition means 7 that acquires personal information 7a of the identified visitor 21 based on identification information 5a that identifies the visitor 21, in order to select a visitor 21 for the remote person 22 to communicate with. Since personal information 7a of visitors 21 visiting the farm 24 can be obtained, conversations can be encouraged both inside and outside the farm 24. A remote person 22 who cannot visit the farm 24 can appropriately request farm work from a visiting visitor 21. The visitor 21 and the remote person 22 can cooperate with each other to manage and operate the farm, thereby reducing the burden of resources and labor involved in managing and operating the farm. Also, if the person is not feeling well or the weather or temperature is not suitable for the body, the person can request a visitor 21 to do the work as a remote person 22. Furthermore, those who are bedridden or physically disabled and cannot visit the farm 24 (remote people 22) can cultivate agricultural products in cooperation with visitors 22, including family members and neighbors. Furthermore, if a remote party 22 is looking to purchase agricultural products, they can do so knowing what kind of person is growing them.

[0179] In such a server device 2, the personal information 7a includes affiliation and attribute information regarding the person's affiliation and attributes and / or knowledge and experience information regarding agricultural knowledge and experience, the transmission includes a request for farm work to a visitor 21 selected based on the personal information 7a, and the server device 2 is further equipped with a payment means 9 for paying a fee for the request, so that the person to be requested and the person to whom the fee should be paid can be selected taking into account not only the farm work skill of the person to be requested but also the background for performing the farm work.

[0180] The system also includes a storage unit 31 that stores a virtual space consisting of two-dimensional or three-dimensional spatial data of an imaged space formed from an image of the farm 24 or a pseudo-space that simulates the image, and a virtual space processing means 17 that displays a viewpoint image within the virtual space on the display unit 15a (3a) of the virtual visitor's terminal 14 based on the operation of the virtual visitor 23. The payment means 9 is used to make payments for purchasing agricultural products in the farm 24 and merchandise related to the agricultural products, allowing virtual visitors to converse with each other in the farm 24 as a virtual space. This allows for conversations to be enjoyed regardless of physical condition, weather, or temperature. The conversation can be conducted while viewing the same farm image.

[0181] The server device 2 is a server device executed by one or more computers and used in a farm system for a communication method via a virtual space consisting of two-dimensional or three-dimensional spatial data of an imaged space formed from an image of a farm or a pseudo-space formed to simulate the image, and is characterized in that it further comprises a personal information acquisition means 7 for acquiring personal information 7a of the user registered in advance based on specific information 5a that identifies the user in order to select a user with whom to communicate. Since personal information 7a of visitors 21 visiting the farm 24 can be obtained, conversations can be encouraged between the farm and the virtual space. Virtual visitors 23 can be called from outside the farm via the Internet from all over the world.

[0182] The remote terminal 3 is a remote terminal of a remote person 22 that is communicatively connected to a visitor terminal 4 of a visitor 21 visiting the farm 24, and is used in a farm system 20 for a communication method via the farm and for viewing information about the farm 24, and is characterized by having a person selection and acquisition means 7 that requests personal information 7a of an identified visitor based on identification information 5a that identifies the visitor 21, in order to select a visitor 21 for the remote person 22 to communicate with. Since personal information 7a of visitors 21 visiting the farm 24 can be obtained, conversations can be encouraged both inside and outside the farm 24. A remote person 22 who cannot visit the farm 24 can appropriately request farm work from a visiting visitor 21. The visitor 21 and the remote person 22 can cooperate with each other to manage and operate the farm, thereby reducing the burden of resources and labor involved in managing and operating the farm. Also, if the person is not feeling well or the weather or temperature is not suitable for the body, the person can request a visitor 21 to do the work as a remote person 22. Furthermore, if a remote party 22 is looking to purchase agricultural products, they can do so knowing what kind of person is growing them.

[0183] Such a remote user terminal 3 can contact visitors 21 who are planning to visit in the future because the person information 7a includes information about visitors who are likely to visit the farm 24. It can also request farm work at an appropriate time.

[0184] Furthermore, the personal information 7a includes affiliation and attribute information regarding the person's affiliation and attributes and / or knowledge and experience information regarding agricultural knowledge and experience, and the information to be conveyed includes a request for farm work to the visitor 21 selected based on the personal information 7a. Therefore, the person to be requested and the person to be paid can be selected taking into consideration not only the farming skill of the person to be requested but also the background for performing the farm work.

[0185] The user terminals 3, 4, 14 are user terminals executed by one or more computers and used in a farm system for a communication method via a virtual space consisting of two-dimensional or three-dimensional spatial data of an imaged space formed from an image of a farm or a pseudo-space formed to simulate the image, and are characterized by having a person selection and acquisition means 10 that requests personal information of the identified user based on identification information 5a that identifies the user, in order to select the user to whom information to be conveyed for communication should be sent. Since personal information 7a of visitors 21 or virtual visitors 23 visiting the farm 24 can be obtained, conversation can be encouraged between the farm 24 and the virtual space.

[0186] The system 40 is a farm system that facilitates interaction between users who access a virtual space formed from an image of a farm 24 and consisting of two-dimensional or three-dimensional spatial data of the imaged space or a pseudo-space that simulates the image, and is characterized by comprising a server device 2 that has a memory unit 31 that stores the virtual space and a person information acquisition means 7 that acquires person information 7a of virtual visitors 23 that visit the virtual space, and virtual visitor user terminals 3, 14 that are communicatively connected to the server device 2 and that are composed of a person selection and acquisition means 10 that requests other person information 7a in the virtual space so that the virtual visitor 23 can select other virtual visitors with whom to communicate, and a communication means 11 that communicates with the selected virtual visitor 23. Virtual visitors can talk to each other in the virtual space of Farm 24. They can enjoy conversations regardless of their physical condition or the weather. They can talk while looking at the same farm image.

[0187] In this system 40, the user terminals 3, 14 of the virtual visitors are equipped with product acquisition means 27 for acquiring product information 28a including agricultural products in the farm and products related to the agricultural products, and the server device 2 is equipped with a payment means 13 for purchasing the agricultural products and related products, so that agricultural products can be purchased from outside the farm 24. For example, agricultural products can be purchased after speaking with a seller of the agricultural products. Agricultural products can be purchased from care farms 24 around the world.

[0188] (Yet another example in the case of a farm) The method 20a for interacting with producers / sellers through a farm in a virtual space is executed by a server device 2 and user terminals 3, 4, 14, and is a method for interacting with producers / sellers through a farm 24a in a virtual space consisting of two-dimensional or three-dimensional spatial data of an imaged space formed from an image of the farm 24 or a pseudo-space formed to imitate the image, and is characterized by comprising the steps of: transmitting a viewpoint image of a virtual visitor 23 moving through the farm in the virtual space based on the operation of the virtual visitor 23 as a purchaser / tourist visiting the farm in the virtual space to the user terminal of the virtual visitor; acquiring location information 45a of a visitor 21 as a producer / seller visiting the farm; and displaying a preset visitor avatar element 45b at a coordinate position 46a in the farm in the virtual space corresponding to the location information. Thus, a virtual visitor 23 can visit the virtual farm 24a for sightseeing, to check out / purchase farm-related products 41, or to interact with producers / sellers.

[0189] The method 20a for interacting with producers / sellers via such a farm in a virtual space includes a step of acquiring coordinate position information 46a relating to the coordinate position of the virtual visitor 23 in the farm 24a in the virtual space, and a step of superimposing and displaying a pre-set avatar element 46b of the virtual visitor 21 at a position in the field of view through the user terminal 3 of the visitor 21 that corresponds to the coordinate position information, so that each other's avatar elements can be seen, thereby encouraging interaction.

[0190] A predetermined position range 48a including agricultural products 41 of farm 24 and a coordinate position range 49a of the farm in the virtual space corresponding to the position range are set, and a step of displaying agricultural product display elements 48b, 49b related to the agricultural products in the position range in the field of view through the user terminal of the producer / seller and in the coordinate position range displayed on the user terminal of the virtual visitor is provided, so that visitor 21 and virtual visitor 23 can interact while understanding agricultural product display elements 48b, 49b that represent the same agricultural product 41. In addition, agricultural products 41 to be purchased can be selected.

[0191] Furthermore, since the system is provided with a step of dialogue between the virtual visitor 23 and the visitor 21 using voice information / text information 11a, it is possible to have interactions with producers and other virtual visitors 23.

[0192] The virtual visitor 23 also has a step of visiting the farm 24a in the virtual space via access information 43 including a link to farm-related products 41 including agricultural products obtained at the farm 24 and products related to the agricultural products, or an information medium 51 including a website on which the farm-related products are posted. This allows the virtual visitor 23 to visit the farm 24a in the virtual space from a sales outlet outside the farm and gain knowledge about the farm-related products 41 through interactions with the producers and the state of the farm.

[0193] Furthermore, in order for the virtual visitor 23 to select a visitor 21 to converse with, the system includes a step of acquiring personal information 7a of the pre-registered visitor based on specific information 5a that identifies the visitor, and since personal information of the person with whom the virtual visitor 23 is to converse is obtained, conversation can be promoted.

[0194] Furthermore, since the personal information 7a includes affiliation and attribute information regarding the person's affiliation and attributes and / or knowledge and experience information regarding agricultural knowledge and experience, it is possible to select a partner who matches with oneself, further promoting conversation.

[0195] The system also includes a step of making a payment to purchase farm-related products 41 including agricultural products obtained at the farm 24 and products related to the agricultural products, so that the farm-related products 41 can be purchased within the farm 24a in the virtual space.

[0196] The server device is a server device 2 used in a method 20a for interacting with producers / sellers via a virtual space farm 24a consisting of two-dimensional or three-dimensional spatial data of an imaged space formed from an image of the farm 24 or a pseudo-space formed to imitate the image, and is characterized by comprising: a coordinate acquisition means 18 for acquiring location information 45a of a visitor 21 as a producer / seller visiting the farm; and a virtual space processing means 17 for transmitting to the user terminal 3, 14 of the virtual visitor a viewpoint image of moving around the farm in the virtual space based on the operation of a virtual visitor 23 as a purchaser / tourist visiting the farm in the virtual space, and for displaying a predetermined avatar element 45b of the visitor at a coordinate position in the farm in the virtual space corresponding to the location information. Thus, a virtual visitor 23 can visit the virtual farm 24a for sightseeing, to check out / purchase farm-related products 41, or to interact with producers / sellers.

[0197] In such a server device 2, the coordinate acquisition means 18 acquires coordinate position information 46a relating to the coordinate position of the virtual visitor 23 in the farm 24a in the virtual space, and the virtual space processing means 17 displays a pre-set avatar element 46b of the virtual visitor 21 superimposed on a position in the field of view through the user terminal 4 of the visitor 21 that corresponds to the coordinate position information, so that interaction can be encouraged since each other's avatar elements are visible.

[0198] A predetermined position range 48a including the agricultural products 41 of the farm 24 and a coordinate position range 49a of the farm 24a in the virtual space corresponding to the position range are set, and the virtual space processing means 17 displays agricultural product display elements 48b, 49b related to the agricultural products in the position range in the field of view through the user terminal 4 of the producer / seller and in the coordinate position range displayed on the user terminals 3, 14 of the virtual visitor 23, respectively, so that the visitor 21 and the virtual visitor 23 can interact while understanding the agricultural product display elements 48b, 49b, which are the same agricultural product 41. The visitor 21 can also select the agricultural product 41 to purchase.

[0199] It also has a memory unit 31 that stores product information 28 of agricultural products from the farm 24 and farm-related products 41 that include the agricultural products to be sent to the user terminal 3, 14 of the virtual visitor 23, so that the product information 28 linked to the selected agricultural product display elements 48b, 49b can be obtained.

[0200] Also, since the payment means 9 for purchasing farm-related products 41 is provided, farm-related products 41 can be purchased within the farm in the virtual space.

[0201] Furthermore, in order to select the visitor 21 with whom the virtual visitor 23 will converse, the system is provided with a personal information acquisition means 7 that acquires personal information 7a of the visitor identified based on the identification information 5a that identifies the visitor, and thus obtains the personal information 7a of the person with whom the virtual visitor 23 should converse, thereby encouraging conversation.

[0202] Furthermore, since the personal information 7a includes affiliation and attribute information regarding the person's affiliation and attributes and / or knowledge and experience information regarding agricultural knowledge and experience, it is possible to select a partner who matches with oneself, further promoting conversation.

[0203] The system 52 for linking farm-related products with virtual space comprises an information medium 51 including farm-related products 41 including agricultural products obtained at farm 24 or a website on which the farm-related products are posted, and the above-mentioned server device, and is characterized in that the farm-related products or the information medium have access information 43 including a link to visit farm 24a in virtual space. Therefore, customers can visit the virtual farm 24a from a sales outlet outside the farm and gain knowledge about farm-related products 41 by seeing the farm and interacting with the producers.

[0204] [8. Summary] (1)(9) The method of interaction 20a through an event area in a virtual space is executed by a server device 2 and user terminals 3, 4, 14, and is a method of interaction through an event area in a virtual space consisting of two-dimensional or three-dimensional spatial data of an imaged space formed from an image of an event area 54 including an event venue or a pseudo-space formed to imitate the imaged space, and is characterized by comprising the steps of: transmitting a viewpoint image of a virtual visitor 23 visiting the event area in the virtual space, based on the operation of the virtual visitor 23, to the user terminal of the virtual visitor; acquiring position information 45a of the visitor 21 visiting the event area; and displaying a preset avatar element 45b of the visitor at a coordinate position 46a in the event venue in the virtual space corresponding to the position information. Therefore, the virtual visitor 23 can visit the event area 54a in the virtual space to check out / purchase event-related products 53 or to interact with other visitors.

[0205] (2)(10) Such a method 20a for interaction via an event area in a virtual space includes a step of acquiring coordinate position information 46a relating to the coordinate position of the virtual visitor in the event area 54a in the virtual space, and a step of superimposing and displaying a preset avatar element 46b of the virtual visitor at a position in the field of view of the visitor 21 through the user terminal 3 that corresponds to the coordinate position information. Therefore, since each visitor can see the other's avatar elements, interaction can be encouraged.

[0206] (3)(11) A predetermined position range 48a including the product 55 in the event area and a coordinate position range 49a of the event area in the virtual space corresponding to the position range are set, and there is a step of displaying product display elements 48b, 49b related to the product in the position range in the field of view through the visitor's user terminal and in the coordinate position range displayed on the user terminal of the virtual visitor, respectively, so that the visitor 21 and the virtual visitor 23 can interact while understanding the agricultural product display elements 48b, 49b, which are the same product 55. In addition, the product 55 to be purchased can be selected.

[0207] (4) Furthermore, since the system is provided with a step of dialogue between the virtual visitor 23 and the visitor 21 using voice information / text information 11a, it is possible to have interactions with other virtual visitors 23.

[0208] (5) Furthermore, the information medium 51, which includes the products available in the event area 54 and the event-related products 55 including related products of the products, or the website on which the event-related products are posted, has access information 43 including a link to visit the event area in the virtual space, and further includes a step of visiting the event area in the virtual space through the access information. Therefore, it is possible to visit the event area 54a in the virtual space from a sales outlet outside the farm, and gain knowledge about the event-related products 55 through seeing the state of the event area and interacting with exhibitors.

[0209] (6) In addition, in order for the virtual visitor 23 to select a visitor 21 to converse with, a step is provided in which personal information 7a of the pre-registered visitor is acquired based on the specific information 5a that identifies the visitor. Therefore, since personal information of the person with whom the virtual visitor 23 is to converse is acquired, conversation can be encouraged.

[0210] (7) Furthermore, since the person information 7a includes affiliation and attribute information regarding the person's affiliation and attributes and / or knowledge and experience information regarding the event area, it is possible to select a person who matches with you, further promoting conversation.

[0211] (8) Furthermore, the system includes a step of storing time information 57a ​​and location information 57b of the avatar element's presence during a predetermined period of time during an event held in the event area 54, so that it is possible to experience an event that has already ended. Also, past avatar elements 45b and 46b can be selected and contacted via the contact information 8e in the person information DB 8.

[0212] (9) It also includes a step of making a payment to purchase event-related products 55, including products available in the event area and products related to the aforementioned products, so that event-related products 55 can be purchased within the event area 54a in the virtual space.

[0213] (16) The system 56 for linking event-related products with a virtual space comprises an information medium 51 including event-related products 55, including products available in an event area 54 and related products of the products, or a website on which the event-related products are posted, the above-mentioned server device, and user terminals 3 and 14, and is characterized in that the event-related products or the information medium have access information 43 including a link for visiting the event area 54a in the virtual space. This allows visitors to visit the event area 54a in the virtual space via the information medium 51, and to see what the event is like and interact with visitors / exhibitors. [Explanation of symbols]

[0214] 1 Authentication device, 2 Server device, 3 Remote person terminal, 3a Display unit, 4 Visitor terminal, 5 Person identification means, 6 Person identification database, 7 Person information acquisition means, 7a Person information, 8 Person information database, 9 Payment means, 10 Person selection and acquisition means, 11 Transmission means, 11a Transmission information, 11b Completion information, 12 Request and reward registration means, 12a Request information, 13 Payment information, 14 Virtual visitor terminal (head-mounted display system), 15 Head-mounted display, 15a Display unit, 15b Head position detection sensor, 15c Speaker, 15d Microphone, 15e Operation unit, 16 Control device, 17 Virtual space processing means, 17a Operation information, 18 Coordinate acquisition means, 19 Update means, 20 Fourth system, 20a Communication method, 21 Visitor, 22 Remote person, 23 Virtual visitor, 24 Farm, 25 Camera device, 25a facial image information, 26 communication network, 27 product acquisition means, 28 product information database, 29 second system, 30 CPU, 31 memory, 32 input / output device, 33 connection port, 33a storage device, 34 communication circuit, 35 bus line, 36 server program, 37 browser program, 38 OS, 39 terminal program, 40 third system, 41 farm-related products, 42 3D camera, 43 access information, 44 system, 45a location information, 45b avatar element, 46a coordinate location information, 46b avatar element, 47 display screen, 48a location range, 48b agricultural product display element, 49a coordinate location range, 49b agricultural product display element, 50 display screen, 51 information medium, 52 system for linking farm-related products and virtual space, 53 system, 54 event area, 55 event-related products, 56 Linking system between event-related products and virtual space, 57a Past location information, 57b Past time information, 58 Past information

Claims

1. A method of communication via a virtual space executed by a server device and a user terminal, the virtual space being made up of three-dimensional spatial data of an imaged space formed from an image of a farm / event area in real space or a pseudo-space formed to imitate the imaged space, The virtual space is visited via a user terminal of a virtual visitor, and a step of acquiring coordinate position information regarding a coordinate position of the virtual visitor in the virtual space; acquiring location information of a user terminal held by a visitor visiting the farm / event area in the real space; a step of superimposing and displaying a preset avatar element of the virtual visitor at a position in the field of view of the visitor through the user terminal corresponding to the coordinate position information; displaying a preset avatar element of the visitor at a coordinate position in the virtual space corresponding to the location information; A step of searching for the visitor or the virtual visitor based on specific information that identifies the visitor or the virtual visitor and pre-registered personal information; storing time information and position information of the avatar element in the virtual space; The virtual visitor visits a past farm / event area in the virtual space that is created based on the stored time information and location information; A method of communication via a virtual space, wherein the personal information includes affiliation / attribute information regarding the person's affiliation / attributes and / or knowledge / experience information regarding the farm / event area.

2. an information medium including a product related to the farm / event area in the real space or a website on which the product is posted has access information including a link to visit the virtual space; The method for interacting via a virtual space according to claim 1 , further comprising the step of visiting the virtual space as the virtual visitor from the user terminal via the access information.

3. A server device that is executed together with a user terminal held by a visitor visiting a farm / event area in real space, and is used in a method of interaction via a farm / event area in virtual space, which is made up of three-dimensional spatial data of an imaged space formed from an image of the farm / event area in real space or a pseudo-space formed to imitate said imaged space, The virtual space is visited via a user terminal of a virtual visitor, coordinate acquisition means for acquiring location information of the user terminal held by the visitor; a virtual space processing means for displaying a preset avatar element of the visitor at a coordinate position in the virtual space corresponding to the position information; a storage unit that stores time information and position information of the avatar element in the virtual space, the coordinate acquisition means acquires coordinate position information relating to a coordinate position of the virtual visitor in the virtual space, the virtual space processing means displays a preset avatar element of the virtual visitor superimposed on a position in a field of view of the visitor through the user terminal corresponding to the coordinate position information, A search is performed for the visitor or the virtual visitor based on specific information that identifies the visitor or the virtual visitor and pre-registered personal information, The personal information includes affiliation / attribute information regarding the person's affiliation / attribute and / or knowledge / experience information regarding the farm / event area, A server device in which the virtual visitor visits past farm / event areas in the virtual space created based on the stored time information and location information.

4. an information medium including a product related to the farm / event area in the real space or a website on which the product is posted has access information including a link to visit the virtual space; 4. The server device according to claim 3, wherein the virtual space is visited as the virtual visitor from the user terminal via the access information.

Images