Experience sharing system and experience sharing method

Abstract

An experience sharing system and an experience sharing method are provided, wherein an experience is shared between a client user terminal and an execution user terminal connected in a communicative manner via a network. An experience sharing system (1) is provided, wherein an experience is shared between a client user terminal (2) and an execution user terminal (3) connected in a communicative manner via a network, wherein the experience sharing system (1) comprises: an accepting unit, which accepts entrustment information related to the entrustment of the experience from the client user terminal (2), and accepts execution information related to the execution of the experience from the execution user terminal (3); an experience sharing determination unit, which determines the experience to be shared between the client user terminal (2) and the execution user terminal (3) based on the entrustment information and execution information accepted by the accepting unit; an information acquisition unit, which acquires the shared information when the execution user terminal acquires the shared information containing voice or image for sharing in the experience determined by the experience sharing unit; and a publishing unit, which publishes the shared information acquired by the information acquisition unit to the client user terminal (2).

Description

Technical Field

[0001] The present invention relates to an experience sharing system and an experience sharing method for sharing experience between a client user terminal and an execution user terminal that are communicatively connected via a network. Background Art

[0002] Conventionally, as a technology for remotely sharing images, videos, services, etc. between a plurality of terminals connected in a communicative manner via a network, for example, a remote tomb visiting system of Patent Document 1 and a digital data mediation method of Patent Document 2 have been proposed.

[0003] The disclosed technology of Patent Document 1 focuses on grave visits from a distance, and by providing this proxy service, the experience can be shared without actually going to the graveyard. Specifically, a selection menu for the grave visit proxy service is provided to the user via the Internet, and an order for the grave visit proxy service selected using the selection menu is received. Then, a real image after the grave visit proxy service is performed is provided to the user's computer. As a result, when visiting a grave from a distance, the user does not need to actually go to the graveyard at all, and can entrust the actual grave visit to be performed via the network. In addition, since a real image after the grave visit proxy service is performed by the grave visit proxy service provider can be provided, the user can immediately confirm that the grave visit proxy has been completed.

[0004] Patent document 2 discloses a technology related to a method for mediating digital data. In the technology disclosed in patent document 2, a photographer accesses a server of a service provider from a terminal and registers photography acceptance information. A photography client accesses a server of a service provider from a home terminal and registers photography commission information. The photography client operates the home terminal and selects a photographer to photograph a desired subject based on the photography acceptance information received by the registered photographer. The selected photographer takes the photo, and the photographed image is registered in the server. The photography client receives the image from the server of the service provider. In this way, it is possible to construct a service for generating commissions for or receiving generation commissions from a third party who is neither an acquaintance nor a friend.

[0005] Prior art literature

[0006] Patent Literature

[0007] Patent Document 1: Japanese Patent Application Publication No. 2005-284676

[0008] Patent Document 2: Japanese Patent No. 4297193 Summary of the invention

[0009] Problem that the invention aims to solve

[0010] However, the system described in the above-mentioned patent document 1 can confirm the results of the service even without going to the local area through the image of the real tomb provided after performing the tomb visiting agency service. However, in case of wanting to know the aspects that were noticed by referring to the provided image, such as the surrounding conditions, etc., it is necessary to confirm with the person in charge of the tomb visiting agency service.

[0011] In such a case, for example, if the client can go directly to the site and check the site with his own eyes, it is fine, but it takes time. In addition, if multiple people want to check, it is necessary to make adjustments and reservations with the grave visit agency service provider again. It is also possible to confirm the request with the cemetery manager by phone, but it is difficult to confirm the confirmation items related to the client's concerns, such as "I would like you to check ○○ too", "How is the surrounding area of ​​○○?", and the surrounding and surrounding conditions in real time.

[0012] In addition, the digital data intermediary method described in the above-mentioned patent document 2 is a service in which a client entrusts a photographer to take photos of a desired place or subject through an image intermediary service provider, and provides a photographic image taken by the photographer. Therefore, the photography client can convey the photography intention to the photographer by phone through the preview image sent from the photographer, but, as in the above, it is difficult to know the aspects noticed by referring to the provided image, objects other than the subject captured in the image, etc.

[0013] Furthermore, in the system described in Patent Document 1, the client entrusts the provider of the proxy service, etc. In addition, in the digital data intermediary method described in Patent Document 2, the client entrusts the intermediary service provider, the photographer, to take the photo. Therefore, the client cannot provide the client with images and videos of local places, local new information, attractive experiences, etc., which the client cannot know.

[0014] Therefore, the present invention is conceived in view of the above problems, and its object is to provide an experience sharing system and experience sharing method that can share local experience from a distance.

[0015] Means used to solve problems

[0016] The experience sharing system of the first invention shares an experience in a state where a delegating user terminal and an executing user terminal connected in a communicative manner are connected via a network, and the experience sharing system is characterized in that it comprises: an accepting unit that accepts entrustment information related to the entrustment of the experience from the delegating user terminal and accepts execution information related to the execution of the experience from the executing user terminal; an experience sharing determination unit that determines the delegating user terminal and the executing user terminal that share the experience based on whether the information including either the location and the time respectively included in the entrustment information accepted by the accepting unit and the execution information is consistent; and an information acquisition unit that receives the information received by the accepting unit and receives the execution information related to the execution of the experience. A unit, between the entrusting user terminal determined by the experience sharing determining unit and the executing user terminal, the information acquiring unit obtains shared information including voice or image for sharing in the experience from the executing user terminal, and obtains status information related to the location of the shared information based on the acquired shared information; and a publishing unit, which publishes the shared information acquired by the information acquiring unit to the entrusting user terminal in real time in a manner that is the same as the display of the shared information in the executing user terminal, and publishes the status information to the executing user terminal in real time in a manner that is displayed only on the executing user terminal.

[0017] The experience sharing system of the second invention is characterized in that, in the first invention, the information acquisition unit acquires status information related to the status of the voice or image included in the shared information, and the publishing unit adjusts the voice or image of the shared information based on the status information acquired by the information acquisition unit and publishes it to the entrusting user terminal.

[0018] The experience sharing system according to the third invention is characterized in that in the first invention or the second invention, the distributing unit distributes the identification information associated with the content of the shared information acquired by the information acquiring unit to the requesting user terminal or the executing user terminal.

[0019] The experience sharing system of the fourth invention is characterized in that, in the first invention or the second invention, the receiving unit obtains language information used in the entrusting user terminal or the executing user terminal, and the publishing unit has a translation unit, which translates the shared information based on the language information obtained by the receiving unit and publishes the shared information translated by the translation unit to the entrusting user terminal.

[0020] The experience sharing system of the fifth invention is characterized in that in the first invention, the experience sharing system further comprises an indication information sending unit, which sends indication information from the entrusting user terminal to the executing user terminal, wherein the indication information includes various indications related to the acquisition of shared information, and the information acquisition unit acquires shared information from the executing user terminal according to the indication information of the entrusting user terminal.

[0021] The experience sharing system of the 6th invention is characterized in that in the 5th invention, the indication information sending unit sends indication information including various instructions for the delegating user terminal to perform direct remote operations in obtaining shared information to the executing user terminal, and the executing user terminal has an operation control unit, which controls the operation for obtaining shared information according to the instructions included in the indication information sent by the indication information sending unit.

[0022] The experience sharing system of the 7th invention is characterized in that in the 5th invention, the indication information sending unit sends indication information including indications related to a time period for the executing user terminal to obtain the shared information to the executing user terminal, and the executing user terminal has a time period control unit, which controls the time period for obtaining the shared information according to the indications related to the time period included in the indication information sent by the indication information sending unit.

[0023] The experience sharing system of the 8th invention is characterized in that in the 5th invention, the indication information sending unit sends indication information including location-related indications for obtaining the shared information by the executing user terminal to the executing user terminal, and the executing user terminal has a photographic condition control unit, which controls the photographic conditions for obtaining the shared information according to the location-related indications included in the indication information sent by the indication information sending unit.

[0024] The experience sharing system of the 9th invention is characterized in that in the 1st or 2nd invention, when the acceptance unit accepts the delegation information recording the conditions related to the location and time of sharing the experience, and the execution information recording the location and time at which the experience can be executed, the experience sharing determination unit determines the delegation user terminal and the execution user terminal that share the experience to be shared after matching the delegation user terminal and the execution user terminal based on these delegation information and execution information.

[0025] The experience sharing system of the tenth invention is characterized in that in the fifth invention, the indication information sending unit sends indication information including an indication related to a time period for the executing user terminal to obtain the shared information or an indication related to a location for obtaining the shared information to the executing user terminal, and when it is determined that the executing user terminal that has sent the indication information cannot obtain the shared information based on the indication related to the time period or location included in the indication information, after searching for other executing user terminals that can obtain the shared information based on the indication, the indication information is sent to the other executing user terminals.

[0026] The experience sharing system of the 11th invention is characterized in that in the 1st or 2nd invention, the experience sharing system further comprises: a discrimination unit, which discriminates a person image, a product image or a structure image based on shared information including the image acquired by the information acquisition unit; and an image processing unit, which covers the person image, product image or structure image discriminated by the discrimination unit, or pastes a replacement image in an area of ​​the image.

[0027] The experience sharing system of the 12th invention is characterized in that, in the 1st or 2nd invention, the acceptance unit accepts entrustment information recording conditions including a remuneration to be paid for the entrustment and the execution information recording a desired remuneration for the execution of the experience, the experience sharing determination unit determines a entrusting user terminal and an executing user terminal that share the experience based on whether the remunerations respectively recorded in the entrustment information accepted by the acceptance unit and the execution information are consistent, and the information acquisition unit acquires the sharing information after the experience sharing determination unit determines the entrusting user terminal and the executing user terminal that share the experience and settles the payment of the remuneration.

[0028] The experience sharing method of the 13th invention is a method for sharing an experience between a client user terminal and an execution user terminal which are connected in a communicative manner via a network, and the experience sharing method is characterized by comprising the following steps: an acceptance step of accepting entrustment information related to the entrustment of the experience from the client user terminal and accepting execution information related to the execution of the experience from the execution user terminal; an experience sharing determination step of determining the client user terminal and the execution user terminal to share the experience based on whether the information including either one of the position and the time respectively included in the entrustment information accepted in the acceptance step and the execution information is consistent; an information acquisition step of acquiring, between the client user terminal and the execution user terminal determined in the experience sharing determination step, sharing information including voice or image for sharing in the experience from the execution user terminal, and acquiring status information related to the location of the sharing information based on the acquired sharing information; and a publishing step of publishing the sharing information acquired in the information acquisition step to the client user terminal in real time in a manner of displaying the same as the sharing information in the execution user terminal, and publishing the status information to the execution user terminal in real time in a manner of displaying the status information only in the execution user terminal.

[0029] Effects of the Invention

[0030] According to the first to thirteenth inventions, the receiving unit receives the request information from the requesting user terminal and receives the execution information from the executing user terminal. Therefore, the requesting user and the executing user can be matched. Thus, the local experience can be shared from a distance.

[0031] Furthermore, according to the first to thirteenth inventions, the information acquisition unit determines the experience shared between the requesting user terminal and the executing user terminal. Therefore, it is possible to share shared information including voice or images for sharing in the experience. As a result, it is possible to confirm related confirmation items, surroundings, surrounding conditions, etc. in real time.

[0032] According to the first invention, the experience sharing determination unit determines the experience to be shared between the requesting user terminal and the executing user terminal based on the request information and the execution information. Therefore, even in a remote location, local information can be confirmed. Thus, the local experience can be shared from a remote location.

[0033] Furthermore, according to the first invention, the publishing unit publishes the acquired shared information to the client user terminal. Therefore, even in a remote location, local information can be confirmed. Thus, the client can be provided with images and videos of local unique places, local new information, attractive experiences, etc. that the client cannot know.

[0034] Furthermore, according to the second invention, the information acquisition unit acquires status information related to the status of the voice or image included in the shared information. Therefore, the publishing unit can adjust the voice or image of the shared information. Thus, the local experience can be stably shared from a distance, and high-quality information can be shared.

[0035] Furthermore, according to the third invention, the publishing unit publishes identification information related to the content of the shared information to the client user terminal or the execution user terminal. Therefore, detailed information on the content of the shared information can be confirmed at the client user terminal or the execution user terminal. As a result, it is possible to provide the client with local unique places, local new information, attractive experiences, etc. that the client side and the execution side cannot know in the form of images or videos.

[0036] Furthermore, according to the fourth invention, the delivery unit includes a translation unit. Therefore, the shared information can be translated. Thus, the translated shared information can be delivered to the client user terminal, and the sharing of the local experience from a remote location can be further improved.

[0037] Furthermore, according to the fifth invention, the instruction information sending unit sends instruction information for obtaining shared information to the executing user terminal. Therefore, relevant confirmation items, surroundings, and surrounding conditions can be confirmed in real time. Thus, the sharing of local experience from a remote location can be further improved.

[0038] Furthermore, according to the sixth invention, the operation control unit controls the operation for obtaining the shared information according to the instruction contained in the instruction information. Therefore, the instruction information can be sent to the executing user terminal. Thus, the relevant confirmation items, surroundings, and surrounding conditions can be confirmed in real time.

[0039] According to the seventh invention, the instruction information includes instruction information related to the time period for the execution user terminal to obtain the shared information. Therefore, the time period control unit can control the time period for obtaining the shared information. Thus, the time for obtaining the shared information can be extended or shortened.

[0040] According to the eighth invention, the instruction information includes the instruction information related to the location for obtaining the shared information by the executing user terminal. Therefore, the photographic condition control unit can control the photographic conditions for obtaining the shared information. Thus, the photographic control corresponding to the content of the shared information can be performed.

[0041] Furthermore, according to the ninth invention, the delegation information includes a description of conditions related to the location and time of sharing the experience, and the execution information includes a description of the location and time at which the experience can be executed. Therefore, the experience to be shared can be determined after matching the delegation user terminal with the execution user terminal. As a result, the local experience can be shared more accurately from a distance.

[0042] According to the tenth invention, the instruction information sending unit determines that the shared information cannot be obtained. Therefore, after searching for another executing user terminal that can obtain the shared information, the instruction information can be sent to the other executing user terminal. Thus, the local experience can be continuously shared from a distance.

[0043] Furthermore, according to the eleventh invention, the discrimination unit discriminates a person image, a commodity image, or a structure image based on the shared information. Therefore, the image processing unit can cover the discriminated person image, commodity image, or structure image, or paste a substitute image in the area of ​​the image. Thus, it is possible to share a local experience from a distance while taking privacy and security into consideration.

[0044] Furthermore, according to the twelfth invention, the receiving unit receives the request information describing the conditions including the reward and the execution information describing the desired reward for the execution of the experience. Therefore, the experience to be shared can be determined according to the reward. Thus, after the payment of the reward is settled, the local experience can be shared from a distant place.

[0045] Furthermore, according to the 13th invention, in the experience sharing determination step, the experience shared between the delegating user terminal and the executing user terminal is determined based on the delegation information and the execution information. Therefore, even in a remote location, local information can be confirmed. Thus, the local experience can be shared from a remote location.

[0046] Furthermore, according to the 13th invention, in the publishing step, the acquired shared information is published to the client user terminal. Therefore, even in a remote place, local information can be confirmed. Thus, it is possible to provide the client with local unique places, local new information, attractive experiences, etc. that the client cannot know in the form of images or videos. BRIEF DESCRIPTION OF THE DRAWINGS

[0047] Figure 1 : is a schematic diagram showing an example of the experience sharing system in this embodiment.

[0048] Figure 2 (a) is a schematic diagram showing an example of a display of an execution user terminal in this embodiment, Figure 2 (b) is a schematic diagram showing an example of a display of a requesting user terminal in the present embodiment.

[0049] Figure 3 It is a schematic diagram showing an example of the configuration of the experience sharing system in this embodiment.

[0050] Figure 4 It is a schematic diagram showing an example of the functional structure of the experience sharing server.

[0051] Figure 5This is a flowchart showing an example of the operation of the experience sharing system in this embodiment.

[0052] Figure 6 (a) and Figure 6 (b) is a schematic diagram of a second variation of the experience sharing system in this embodiment.

[0053] Figure 7 (a) is a schematic diagram showing an example of request information stored in the experience sharing database in this embodiment. Figure 7 (b) is a schematic diagram showing an example of execution information stored in the experience sharing database in this embodiment.

[0054] Figure 8 (a) is a schematic diagram showing an example of a translation data table stored in the experience sharing database in this embodiment, Figure 8 (b) is a schematic diagram showing an example of an instruction information data table stored in the experience sharing database in this embodiment. DETAILED DESCRIPTION

[0055] Hereinafter, an example of an experience sharing system and an experience sharing method in an embodiment to which the present invention is applied will be described with reference to the drawings.

[0056] Reference Figure 1 An example of the experience sharing system 100 and the experience sharing server 1 in the present embodiment will be described.

[0057] For example, Figure 1 As shown, the experience sharing system 100 in this embodiment includes an experience sharing server 1. The experience sharing server 1 includes, for example, a database that stores various data. The experience sharing server 1 is connected to a plurality of requesting user terminals 2 (2a, 2b, etc.) via a network 4, for example. The experience sharing server 1 is connected to a plurality of executing user terminals 3 (3a, 3b, etc.) via a network 4, for example.

[0058] In the experience sharing system 100, for example Figure 2 (a) and Figure 2As shown in (b), the executing user terminal 3 captures a distant landscape 50. The experience sharing server 1 obtains the image of the landscape 50 captured by the executing user terminal 3 as shared information, and publishes it to the delegating user terminal 2 that has delegated the experience sharing. The delegating user terminal 2 receives the shared information published from the experience sharing server 1, and refers to it through a monitor or the like provided in the delegating user terminal 2. The shared information may also be in various data forms of voice or images captured locally by the executing user terminal 3. Contains information related to the location where the shared information was captured. In addition to being captured using a known camera provided in the executing user terminal 3, the shared information may also be captured using a known camera independent of the executing user terminal 3.

[0059] <Experience Sharing Server 1>

[0060] The experience sharing server 1 stores, for example, the above-mentioned various information. The experience sharing server 1 may also accumulate various information sent via the network 4, store the same information as the storage unit 104, and transmit and receive various information with the experience sharing system 100 via the network 4. That is, the experience sharing system 100 may use the experience sharing server 1 instead of the storage unit 104.

[0061] <Commissioned User Terminal 2>

[0062] The client terminal 2 inputs various client information that the client user wants to share the experience, and refers to the shared information published by the publishing unit 14. As the client terminal 2, a mobile phone (portable terminal) is mainly used, and in addition, electronic devices such as smart phones, tablet terminals, wearable terminals, personal computers, IoT devices, and user terminals that materialize the experience in all electronic devices can also be used. In addition to being connected to the experience sharing system 100 via the network 4, the client terminal 2 can also be directly connected to the execution user terminal 3, for example.

[0063] The client user terminal 2 may be composed of, for example, a plurality of client user terminals 2. In this case, the same shared information may be distributed to the plurality of client user terminals 2. The client user terminal 2 may display the shared information from the plurality of executing user terminals 3 on, for example, one display.

[0064] <Execute User Terminal 3>

[0065] The execution user terminal 3 performs input of various execution information for sharing experience provided by the local execution user terminal 3, and captures the shared information acquired by the information acquisition unit 13. The execution user terminal 3 can be any device as long as it has a capture function. For example, mobile phones (portable terminals) are mainly used in the execution user terminal 3. In addition, electronic devices such as smart phones, tablet terminals, wearable terminals, personal computers, IoT devices, and camera robots and drones that can remotely capture images can also be used. All of these execution user terminals are embodied in electronic devices.

[0066] In addition, the executing user terminal 3 can be an electronic device with a sensor, and can also measure or measure various numerical data such as distance, position information, shape, depth, size, material, color, temperature, infrared, etc. related to the subject or object of the shooting object.

[0067] In addition, the executing user terminal 3 may be directly connected to the entrusting user terminal 2, for example, in addition to being connected to the experience sharing system 100 via the network 4. The executing user may also obtain the shared information from the experience sharing system 100 using the executing user terminal 3, for example. When receiving common entrusting information at a large place or venue, for example, the executing user terminal 3 may obtain the shared information through a plurality of executing user terminals 3.

[0068] <Network 4>

[0069] The network 4 is the Internet or the like connected to the experience sharing system 100 or the like via a communication line. The network 4 may also be constituted by a so-called optical fiber network. In addition, the network 4 may be realized by a well-known network such as a wireless network in addition to a wired network.

[0070] <Experience Sharing Server 1>

[0071] Next, refer to Figure 3 , an example of the experience sharing server 1 in this embodiment is described. Figure 3 1 is a schematic diagram showing an example of the configuration of the experience sharing system 100 in the present embodiment.

[0072] As the experience sharing system 100, the experience sharing server 1 may be a structure such as a client server system or a cloud system (not shown), and includes a housing 10, a CPU (Central Processing Unit) 101, a ROM (Read Only Memory) 102, a RAM (Random Access Memory) 103, a storage unit 104, and a plurality of I / Fs 105 to 107, and each structure is connected via an internal bus 110. The CPU 101 controls the entire experience sharing server 1. The ROM 102 stores the operation code of the CPU 101. The RAM 103 is a work area used when the CPU 101 is working. The storage unit 104 stores information such as various information such as each location and position information in addition to information related to the requesting user and the executing user required for experience sharing. As the storage unit 104, for example, in addition to a HDD (Hard Disk Drivee), a data storage device such as an SSD (Solid State Drive), a hard disk, or a semiconductor memory (not shown) may be used.

[0073] The CPU 101 is implemented by executing a program stored in the storage unit 104 using the RAM 103 as a work area. In addition, for example, the experience sharing server 1 may also include a GPU (Graphics Processing Unit) (not shown). By including a GPU, a higher-speed calculation process than usual can be performed.

[0074] I / F 105 is an interface for transmitting and receiving various information connected via the network 4. I / F 106 transmits and receives various information to and from a plurality of entrusting user terminals 2 and executing user terminals 3 via the network 4. I / F 107 is an interface for transmitting and receiving information of an input section 108. As the input section 108, for example, a keyboard can be used, and the administrator of the experience sharing server 1 transmits and receives various information via the input section 108, or inputs control instructions for setting various information. I / F 107 is an interface for transmitting and receiving various information to and from an output section 109. The output section 109 outputs various information stored in the storage section 104 or processing status of the entrusting user terminal 2 and executing user terminal 3. As the output section 109, a display, for example, a touch panel type can be used.

[0075] <Experience Sharing Database 1a>

[0076] Various information acquired in advance is stored in the storage unit 104. The stored information is stored in, for example, an experience sharing database 1a of the experience sharing server 1 described later.

[0077] Figure 7 (a) is a schematic diagram showing an example of request information stored in the experience sharing database in this embodiment. Figure 7 (b) is a schematic diagram showing an example of execution information stored in the experience sharing database in this embodiment. Figure 8 (a) is a schematic diagram showing an example of a translation data table stored in the experience sharing database in this embodiment, Figure 8 (b) is a schematic diagram showing an example of an instruction information data table stored in the experience sharing database in this embodiment.

[0078] The experience sharing database 1a stores, for example, Figure 7 The entrustment information received by the entrusting user terminal 2 as shown in (a) Figure 7 The execution information received by the execution user terminal 3 as shown in (b) Figure 8 The translation data table shown in (a) Figure 8 An example of an indication information data table shown in (b).

[0079] Figure 4 1 is a schematic diagram showing an example of the functional structure of the experience sharing server 1. The experience sharing server 1 has a receiving unit 11, an experience sharing determination unit 12, an information acquisition unit 13, a publishing unit 14, a translation unit 14a included in the publishing unit 14, an instruction information sending unit 15, an operation control unit 16a, a time period control unit 16b, a photographing condition control unit 16c, an image processing unit 21, a determination unit 20, an output unit 22, and a storage unit 104, and may also have an update unit not shown in the figure. In addition, Figure 4 Each of the functions shown can also be realized by the CPU 101 executing a program stored in the storage unit 104 or the like using the RAM 103 as a work area, for example, by being controlled by artificial intelligence.

[0080] <Reception Department 11>

[0081] The receiving unit 11 receives entrustment information related to the entrustment of the experience from the entrusting user terminal 2, and receives execution information related to the execution of the experience from the executing user terminal 3. The receiving unit 11 receives entrustment information from the entrusting user terminal 2 and execution information from the executing user terminal 3 via the network 4 and the I / F 106. In addition, the frequency and cycle of the receiving unit 11 receiving entrustment information and execution information are arbitrary. In addition, the receiving unit 11 receives entrustment information that describes conditions including remuneration to be paid and execution information that describes the remuneration desired for the execution of the experience in response to the entrustment from the entrusting user terminal 2 or the executing user terminal 3. In addition, the receiving unit 11 receives entrustment information that describes conditions related to the location and time of sharing the experience and execution information that describes the location and time at which the experience can be executed.

[0082] <Experience sharing determination unit 12>

[0083] The experience sharing determination unit 12 determines the experience to be shared between the client user terminal 2 and the execution user terminal 3 based on the request information and execution information received by the receiving unit 11. The experience sharing determination unit 12 determines the experience to be shared based on the execution information describing the location and time at which the experience can be executed, respectively included in the request information received from the client user terminal 2 and the execution information received from the execution user terminal 3 via an application provided by the experience sharing system 100 or a platform provided via the Web, for example. The experience determined by the experience sharing determination unit 12 is stored in the storage unit 104. Furthermore, the experience sharing determination unit 12 determines the experience to be shared based on the remuneration described in the request information and execution information received by the receiving unit 11.

[0084] <Information Acquisition Unit 13>

[0085] When the shared information including the voice or image to be shared in the experience determined by the experience sharing determination unit 12 is obtained by the executing user terminal 3, the information acquisition unit 13 acquires the shared information. The information acquisition unit 13 acquires the shared information of the experience determined by the requesting user terminal 2 from the executing user terminal 3 via the network 4 and the I / F 106. In addition, the information acquisition unit 13 acquires the state information related to the state of the voice or image included in the shared information.

[0086] Here, the status information is, for example, status information related to the voice or image posted to the entrusting user terminal 2, and may also be information such as the status of the devices related to the entrusting user terminal 2 and the executing user terminal 3, the status of the radio waves / packets sent and received, and the battery status. The information acquisition unit 13 may further acquire, from the experience sharing database 1a, the location coordinates of the executing user terminal 3 where the shared information is obtained, the status information related to the location such as GPS information, and the identification information such as the category, characteristics, conditions, objects, coupons, etc. related to the content of the shared information.

[0087] Furthermore, after the experience is determined by the experience sharing determination unit 12 and the payment of the reward is settled, the information acquisition unit 13 acquires the shared information by executing the user terminal 3 .

[0088] <Publishing Department 14>

[0089] The delivery unit 14 delivers the shared information acquired from the executing user terminal 3 via the network 4 and the I / F 107 to the requesting user terminal 2 as if it were being viewed in real time. The delivery unit 14 adjusts the audio or image of the shared information based on the status information acquired by the information acquisition unit 13 and delivers it to the requesting user terminal 2.

[0090] Furthermore, the publishing unit 14 publishes the status information related to the status of the location where the shared information is obtained by the executing user terminal 3 to the requesting user terminal 2 or the executing user terminal 3. Thus, the requesting user terminal 2 and the executing user terminal 3 can each remotely share the experience, and on the other hand, for example, obtain the status information corresponding to the location where the shared information is obtained.

[0091] In addition, as the status of the location of the client terminal 2, for example, the distribution unit 14 may use detailed information on the location and subject of the shared information acquisition, or information on added value such as coupon information of a newly opened store. These location statuses may be stored or registered in advance in the experience sharing database 1a, for example, and provided based on an identifier related to the location of the shared information acquired from the execution user terminal 3. By adopting such a structure, it is possible to provide the client user with information that the local executor does not know.

[0092] In addition, as status information related to the status of the location published by the publishing unit 14 to, for example, the executing user terminal 3, it can also be a reminder (for example, entering is dangerous, there are steps, it is easy to slip, etc.) and a restriction (no entry, paid entry) related to the location or place where the shared information is obtained locally. These status information related to the status of the location can also be pre-registered in the experience sharing database 1a, for example. The publishing unit 14 can also provide it based on the status information related to the location of the shared information obtained by the executing user terminal 3. By adopting such a structure, for example, the executing user of the executing user terminal 3 can focus on shooting the shared information and can execute or continue shooting with peace of mind. As a result, it is possible to obtain shared information that feels more realistically local, and to share the experience with the entrusting user terminal 2.

[0093] In addition, the publishing unit 14 publishes the identification information related to the content of the shared information to the entrusting user terminal 2 or the executing user terminal 3 using the executing user terminal 3. For example, such identification information may be pre-stored or registered in the experience sharing database 1a, and detailed description information, the latest product information, various code information, etc. may be provided based on the identifier related to the content of the shared information obtained by the executing user terminal 3. In addition, the identification information may be appropriately selected and published based on the characteristics and preferences of the executing user who obtains the shared information and the entrusting user who entrusts the experience. By adopting such a structure, more detailed local identification information and identification information suitable for the entrusting user or the executing user can be published.

[0094] <Translation Unit 14a>

[0095] The publishing unit 14 includes a translation unit 14a. The translation unit 14a translates the shared information acquired by the information acquisition unit 13 based on the language information related to the language used by the entrusting user or the executing user acquired by the receiving unit 11. In addition, the translation unit 14a may also translate, for example, the instruction from the entrusting user terminal 2 to the executing user terminal 3 and the answer from the executing user terminal 3 to the entrusting user terminal 2 in real time. The translated translation result may be translated from text to voice in addition to text to text, and then published from the publishing unit 14.

[0096] <Instruction Information Transmitting Unit 15>

[0097] The instruction information sending unit 15 sends instruction information including various instructions related to the acquisition of shared information from the client user terminal 2 to the execution user terminal 3. The instruction information includes various instructions for the client user terminal 2 to directly remotely operate the acquisition of shared information, for example, instructions related to a time period for the execution user terminal to acquire shared information, instructions related to a location for the execution user terminal to acquire shared information, and sends them to the execution user terminal 3. The execution user terminal 3 performs control for acquiring shared information corresponding to the instruction information.

[0098] The instruction information sending unit 15 sends instruction information including an instruction related to a time period for the executing user terminal 3 to obtain the shared information or an instruction related to a location for obtaining the shared information to the executing user terminal 3. When it is determined that the executing user terminal 3 to which the instruction information has been sent cannot obtain the shared information based on the instruction related to the time period or location included in the instruction information, after searching for other executing user terminals 3 that can also obtain the shared information based on the instruction, the instruction information is sent to other executing user terminals 3. Thus, for example, even if an unexpected situation occurs on site, such as a device failure of the initially entrusted executing user terminal 3 or the inability to go to the originally intended location due to local restrictions on the day, the instruction information sending unit 15 can enable the entrusted user to continue sharing the experience.

[0099] <Operation Control Unit 16a>

[0100] The operation control unit 16a is provided in the executing user terminal 3, and controls the operation for obtaining the shared information according to the instructions (e.g., instructions related to the shooting direction such as right and left) contained in the instruction information sent by the instruction information sending unit 15. The instruction information can be associated in advance with the device type information, function information, UI information, etc. between the entrusting user terminal 2 and the executing user terminal 3, and can also be further associated with other forms (e.g., voice, screen lighting and flashing, vibration function of vibration mode, etc.) to indicate the instruction entrustment based on text or icon. Thus, for example, the entrusting user terminal 2 can directly instruct the executing user terminal 3 to perform remote operations.

[0101] <Time Zone Control Unit 16b>

[0102] The time period control unit 16b is provided in the executing user terminal 3, and controls the time period for obtaining the shared information according to the instruction related to the time period included in the instruction information sent by the instruction information sending unit 15. The instruction information may be, for example, the extension, shortening, time designation, and remaining time of the shared time related to the experience pre-agreed between the entrusting user terminal 2 and the executing user terminal 3. Thus, the entrusting user terminal 2 and the executing user terminal 3 can enjoy the shared experience efficiently or more deeply.

[0103] <Photography Condition Control Unit 16c>

[0104] The photographing condition control unit 16c is provided in the execution user terminal 3, and controls the photographing conditions for obtaining the shared information according to the instructions related to the position included in the instruction information sent by the instruction information sending unit 15. The photographing condition control unit 16c can, for example, restrict the photographing of the position obtained as the shared information, prohibit photographing in the photographing location, and can control the acquisition of images of the faces of the attendees, etc., in a place where many people gather.

[0105] <Determination Unit 20>

[0106] The discrimination unit 20 discriminates between a person image, a commodity image or a structure image based on the shared information including the image acquired by the information acquisition unit 13. Here, a person image refers to an image related to a person captured when photographing a local or on-site object, scenery, etc. A commodity image refers to an image related to a commodity, product, craftwork, manufactured object, etc. captured when photographing a local or on-site object, store, store interior, etc. A structure image refers to an image related to a building or structure such as a house, building, building, bridge, road, etc. captured when photographing a local or on-site object, scenery, etc. In addition, it may be an image of a natural mountain, river, etc. in the scenery.

[0107] The determination unit 20 may be realized by executing the object data or program stored in the storage unit 104, for example, and may be controlled by artificial intelligence. In addition, the determination unit 20 may also refer to a photographing condition data table (not shown) of prohibited places or prohibited objects stored in advance in the experience sharing database 1a to determine whether photography is allowed. Thus, for example, it is possible to prevent unauthorized photography of individuals (ordinary people, celebrities), houses, commodities owned by individuals, or natural objects such as mountains and rivers.

[0108] <Image Processing Unit 21>

[0109] The image processing unit 21 masks the person image, product image or structure image identified by the identification unit 20, or obtains a corresponding substitute image for the area of ​​the image by referring to the experience sharing database 1a, and pastes the obtained substitute image on the shared information.

[0110] <Output Unit 22>

[0111] The output unit 22 outputs the acquisition status of shared information, the status of various setting information, the distribution status of the distribution unit 14, the translation result, etc. In addition to outputting the shared information acquired by the executing user terminal 3 to the output part 109 via the I / F 107, the output unit 22 also transmits the shared information and various related information to the requesting user terminal 2 or the executing user terminal 3 via the distribution unit 14 via the I / F 105.

[0112] (An example of operation of the experience sharing system 100)

[0113] <Accepting Unit S110>

[0114] like Figure 5 As shown, the accepting unit 11 accepts request information related to the request of the experience from the requesting user terminal 2 and accepts execution information related to the execution of the experience from the executing user terminal 3 (accepting means S110 ).

[0115] here, Figure 7 An example of a data table of request information and execution information accepted by the accepting unit 11 from the requesting user terminal 2 and the executing user terminal 3 is shown.

[0116] Figure 7 (a) is an example of the request information received from the requesting user terminal 2 and stored in the experience sharing database 1a in this embodiment. Figure 7 (b) is an example of execution information received by the execution user terminal 3 and stored in the experience sharing database 1 a in the present embodiment.

[0117] about Figure 7 The entrustment information shown in (a) of FIG. 1 stores, for example, a "entrustment user ID" for identifying the entrusting user or the entrusting user terminal 2, a "name" and "address" determined as the entrusting user, and an "email address" for contacting the shared experience. In addition, information such as "location", "time", "language", and "remuneration" is sent from the entrusting user terminal 2 to the receiving unit 11 via the network 4 as entrustment information.

[0118] <Experience Sharing Determination Unit S120>

[0119] Next, based on the entrustment information received by the entrusting user terminal 2 and the execution information received by the execution user terminal 3, the experience shared between the entrusting user terminal 2 and the execution user terminal is determined (experience sharing unit S120). The experience sharing determination unit 12 may also make the entrustment information and execution information received by the acceptance unit 11 into a form that is easy for the entrusting user and the execution user to compare and determine, and can be determined via the entrusting user terminal 2 and the execution user terminal 3, and may also match the entrusting user terminal 2 with the execution user terminal 3 by, for example, the priority and consistency of each item.

[0120] In addition, the experience sharing determination unit 12 may also send information such as the content and conditions of the experience determined by the entrusting user terminal 2 and the executing user terminal 3 to the entrusting user terminal 2 and the executing user terminal 3. The experience determined by the experience sharing determination unit 12 may also be a future reservation, for example. In this case, the experience sharing determination unit 12 may also send a reminder contact to the entrusting user terminal 2 and the executing user terminal 3, for example, one day before the determined experience date, and publish it from the publishing unit 14.

[0121] In addition, according to the present embodiment, when the acceptance unit 11 accepts delegation information describing conditions related to the location and time of a shared experience and execution information describing the location and time at which the experience can be executed, the experience sharing determination unit 12 determines the experience to be shared after matching the delegation user terminal 2 with the execution user terminal 3 based on these delegation information and execution information.

[0122] <Information Acquisition Unit S130>

[0123] When the shared information including the voice or image to be shared in the experience determined by the experience sharing determination unit S120 is obtained by the executing user terminal 3 , the information acquisition unit 13 acquires the shared information (information acquisition unit S130 ).

[0124] The information acquisition unit 13 sequentially acquires the voice or image captured by the local execution user terminal 3 based on the request information and execution information determined by the experience sharing determination unit 12. The information acquisition unit 13 may store the acquired voice or image in the experience sharing database 1a in association with, for example, the request information or execution information related to the acquisition of the sharing information.

[0125] According to the present embodiment, the information acquisition unit 13 acquires various numerical data such as distance, position information, shape, depth, size, material, color, temperature, infrared, etc., which are related to the subject or object of the shooting object and are measured or measured by the sensor of the execution user terminal 3. For example, a 3D image can be generated using these acquired numerical data, and the generated 3D image can be published as shared information to the execution user terminal 3 or the entrusting user terminal 2.

[0126] As a result, the client user terminal 2 can view the actual local image in the virtual space as a virtual image generated using 3D data in another format.

[0127] <Release unit S140>

[0128] The publishing unit 14 publishes the shared information acquired by the information acquisition unit 13 to the client user terminal 2 (publishing means S140). The publishing unit 14 publishes the shared information acquired by the information acquisition unit 13 to the client user terminal 2 based on the client information and execution information determined by the experience sharing determination unit 12. For example, the publishing unit 14 may adjust the publishing of the shared information so that the local atmosphere can be experienced in real time, and publish the shared information of the local voice or image acquired by the information acquisition unit 13 to the client user who is viewing and listening through the client user terminal 2.

[0129] In the publishing unit 14, for example, the publishing destination of the shared information and the number of the publishing destinations may be multiple. In addition, the multiple different shared information published may be published in a manner that can be collected and viewed on one client user terminal 2. If such publishing is adopted, the client user can refer to related places and contents at the same time or refer to them from different scenes, angles, and multiple angles, and can enjoy the local experience more.

[0130] Thus, for example, the distribution unit 14 distributes the local shared information acquired by the information acquisition unit 13 to the requesting user terminal 2 , and the operation of the experience sharing system 100 in the present embodiment ends.

[0131] (First Modification of Operation of Experience Sharing System 100)

[0132] Next, a first modified example of the experience sharing system 100 in the present embodiment will be described.

[0133] The difference between the above-mentioned example of action and the first modified example is that the information acquisition unit S130 acquires status information related to the status of the voice or image included in the shared information. Also, the difference is that the publishing unit S140 adjusts the voice or image of the shared information based on the status information acquired by the information acquisition unit 13 and publishes it to the requesting user terminal 2. In addition, the description of the same contents as the above-mentioned example of action is omitted.

[0134] According to the present embodiment, the information acquisition unit 13 acquires status information related to the status of the voice or image included in the shared information. The status information refers to, for example, whether the voice or image is delivered normally, the strength of the radio wave, the forwarding speed of the image, and the delay status. According to the status information, it can be known that the shared information has been acquired without any problem between the requesting user terminal 2 and the executing user terminal 3.

[0135] In addition, according to the present embodiment, the information acquisition unit 13 can also obtain, for example, from each of the entrusting user terminals 2 and the executing user terminal 3 whether the voice or image is delivered normally, the strength of the radio waves, the forwarding speed of the image, the delay status, and obtain from a data table (not shown) the baseline value and adjustment-related correction values, parameters, etc. of the state of pre-keeping the acquired data in the experience sharing database.

[0136] Next, the distribution unit 14 adjusts, for example, the intensity, color tone, antenna directivity, etc. of the voice or image of the shared information based on the state information and correction value acquired by the information acquisition unit 13, and distributes the adjusted shared information to the client user terminal. Thus, the distribution unit 14 can avoid the influence caused by the congestion of radio waves, the failure of base stations, and the line speed, and can distribute stable and high-quality shared information.

[0137] Thus, the operation of the first variant of the experience sharing system 100 of the present embodiment is completed. In the experience sharing system 100 of the present embodiment, for example, the information acquisition unit 13 acquires the state information included in the shared information, and the publishing unit 14 adjusts the voice or image of the shared information based on the state information acquired by the information acquisition unit 13 and publishes it to the client user terminal 2.

[0138] Next, a second modified example and a third modified example of the experience sharing system 100 in the present embodiment will be described.

[0139] The difference between the above-mentioned one example of action and the first variant and the second and third variants is that the publishing unit S140 publishes the status information related to the status of the location where the shared information is obtained by the executing user terminal 3 to the entrusting user terminal 2 or the executing user terminal 3 (the second variant), and the publishing unit S140 publishes the identification information related to the content of the shared information obtained by the executing user terminal 3 to the entrusting user terminal 2 or the executing user terminal 3 (the third variant). In addition, the description of the same contents as the above-mentioned one example of action is omitted.

[0140] According to the present embodiment (second variant), the location where the shared information is obtained by the executing user terminal 3 may be obtained by the information obtaining unit 13 sequentially or at fixed intervals, for example, together with the GPS function of the executing user terminal 3 and the shared information of the information obtaining unit 13. Thus, the location where the shared information is obtained by the executing user terminal 3 can be determined.

[0141] Next, the publishing unit 14 obtains the status information related to the status of the location of the executing user terminal 3 that is determined from the experience sharing database 1a, and publishes it to the requesting user terminal 2 or the executing user terminal 3. The status information published to the requesting user terminal 2 or the executing user terminal 3 may be different information depending on the location of the requesting user terminal or the executing user terminal 3, for example.

[0142] Here, use Figure 6 (a) and Figure 6 (b) of the present invention will now describe a second variation of the experience sharing system 100 of the present embodiment. Figure 6 (a) and Figure 6 (b) is a schematic diagram of a second modified example of the experience sharing system 100 in this embodiment.

[0143] As described above, the publishing unit 14 publishes the status information related to the status of the location where the shared information is obtained by the executing user terminal 3 to the entrusting user terminal 2 or the executing user terminal 3. In this case, both the executing user terminal 3 and the entrusting user terminal 2 display the same shared information. Figure 6 As shown in (a), for example, if the location where the executing user terminal 3 captures the shared information is close to a river, the publishing unit 14 obtains the status information 30a such as "Please pay attention to your feet" from the status information data table (not shown) pre-stored in the experience sharing database, and publishes it to the target executing user terminal 3. Figure 6 As shown in (b), in the entrusting user terminal 2, the status information 30b such as "this river..." is obtained as the description information of the shared information from the status information data table (not shown) pre-stored in the experience sharing database, and is published to the target executing user terminal 3.

[0144] According to the present embodiment, the experience sharing database 1a stores the status information of the object in advance by associating the location information of the shared information photographed by the executing user terminal with the location information. The publishing unit 14 uses the location information included in the shared information photographed by the executing user terminal 3 to attach the status information 30a and the status information 30b to the published information published to the entrusting user terminal 2 and the executing user terminal 3 and publish it.

[0145] As a result, for example, the distributing unit 14 distributes different status information to the requesting user terminal 2 and the executing user terminal 3 , and the operation of the experience sharing system 100 in the present embodiment (second modified example) is completed.

[0146] Furthermore, according to the present embodiment (third variant), the publishing unit 14 publishes identification information related to the content of the shared information to the requesting user terminal 2 or the executing user terminal 3 using the executing user terminal 3. The experience sharing database 1a of the experience sharing server 1 stores, in addition to the location information related to the shared information, a plurality of similar images together with identification information such as explanatory sentences related to the shared information (not shown), as similar similar images, for example. The experience sharing database 1a stores, for example, identification information including identification codes attached to these images, explanations corresponding to the identification codes, and annotation data. Based on the shared information acquired by the information acquisition unit 13, it is identified whether an image similar to the acquired shared information is stored in the experience sharing database 1a, and the relevant identification information is acquired.

[0147] In the publishing unit 14, for the status information 30, based on the content of the shared information photographed by the executing user terminal 3, for example, with reference to an image similar to the image of the "souvenir shop in the park" or an identification code associated with the location corresponding to the shared information, the identification information published to the entrusting user terminal 2 is obtained.

[0148] The identification information published by the publishing unit 14 to the entrusting user terminal 2 may be, for example, "the price of a specialty" or "code information related to purchase". In addition, the identification information published to the executing user terminal 3 may be, for example, "another souvenir shop is 100 meters ahead" or other identification information used to guide the local area. The executor of the executing user terminal 3 may also input the identification information orally through the microphone of the executing user terminal 3 and transmit it to the entrusting user through the speaker of the entrusting user terminal 2 or the like.

[0149] In this way, the distributing unit 14 can distribute identification information corresponding to each position and purpose by distributing the identification information related to the content of the acquired shared information differently in the requesting user terminal 2 and the executing user terminal 3 .

[0150] Thus, for example, the distributing unit 14 distributes different status information in the requesting user terminal 2 and the executing user terminal 3 , and the operation of the experience sharing system 100 in the present embodiment (third variation) ends.

[0151] According to the present embodiment (second variation), together with the shared information, the information acquisition unit 13 may sequentially or at regular intervals acquire the location where the shared information was acquired by the executing user terminal 3, for example, by using the GPS function of the executing user terminal 3. Thus, the location where the shared information was acquired by the executing user terminal 3 can be identified.

[0152] According to the present embodiment, the receiving unit 11 obtains the language information used by the requesting user terminal 2 or the executing user terminal 3 (receiving means S110). The issuing unit 14 includes a translation unit 14a, which translates the shared information based on the language information obtained by the receiving unit 11. Figure 8 As shown in (a), the translation unit 14a has, for example, a translation data table stored in the experience sharing database 1a, and determines, for example, the language used in the entrusting user terminal 2 and the executing user terminal 3 based on the voice or text exchanged in the entrusting user terminal 2 and the executing user terminal 3 (translation unit S141).

[0153] The translation unit 14 a translates the shared information and instruction information exchanged between the client user terminal 2 and the executing user terminal 3 based on the language information used by the client user terminal 2 and the executing user terminal 3 , and then distributes the information to the client user terminal 2 and the executing user terminal 3 by the distribution unit 14 .

[0154] In addition, according to the present embodiment, the instruction information sending unit 15 sends instruction information including various instructions related to the acquisition of shared information from the requesting user terminal 2 to the executing user terminal 3 (instruction information sending unit S150). Figure 8 As shown in (b), instruction information including various instructions is stored in the instruction information data table of the experience sharing database 1a. For example, the instruction information is preset based on the device information such as the function of each terminal and the user interface.

[0155] The instruction information sending unit 15 refers to the instruction information data table of the experience sharing database 1a based on the instruction information obtained from the requesting user terminal 2, and sends the corresponding instruction information to the executing user terminal 3. Thus, the information obtaining unit 13 can obtain the shared information from the executing user terminal 3 via the experience sharing server 1 based on the instruction information from the requesting user terminal 2.

[0156] <Instruction Information Transmitting Units S151, S152>

[0157] Furthermore, according to the present embodiment, the instruction information transmitting unit 15 transmits instruction information including various instructions for requesting the user terminal 2 to perform direct remote operation related to acquisition of shared information to the executing user terminal 3 (instruction information transmitting means S151, S152).

[0158] <Operation Control Unit S160>

[0159] The operation control unit 16 a controls the operation for obtaining the shared information according to the instruction included in the instruction information transmitted from the instruction information transmitting unit 15 to the executing user terminal 3 (operation control unit S160 ).

[0160] <Time period control unit S170>

[0161] Furthermore, according to the present embodiment, the instruction information sending unit 15 sends the instruction information including the instruction related to the time period for the execution user terminal 3 to obtain the shared information to the execution user terminal 3. The time period control unit 16b controls the time period for obtaining the shared information, for example, according to the instruction related to the time period included in the instruction information sent by the instruction information sending unit 15. The time period control unit 16b controls the acquisition of the shared information by the execution user terminal 3, for example, according to the time period information (not shown) stored in the instruction data table of the experience sharing database 1a.

[0162] The time period control unit 16b controls the time period for the information acquisition unit 13 to acquire the shared information captured by the execution user terminal 3, based on the instruction related to the time period included in the instruction information sent by the instruction information sending unit 15. In this way, based on the instruction information from the requesting user terminal 2, the shared information corresponding to the time period can be acquired from the execution user terminal 3 via the experience sharing server 1.

[0163] <Photography Condition Control Unit S171>

[0164] Furthermore, in the present embodiment, the instruction information sending unit 15 sends instruction information including an instruction related to a position for obtaining shared information by the executing user terminal 3 to the executing user terminal 3. Then, the photographing condition control unit 16c controls the photographing condition for obtaining shared information according to the instruction related to the position included in the instruction information sent by the instruction information sending unit 15 to the executing user terminal 3 (photography condition control unit S171).

[0165] In the experience sharing database 1a, information related to various photographing conditions such as photographing objects, photographing locations, photographing time, photographing fees, and photographing methods is stored or registered in advance in correspondence with the location of the photographing shared information, for example, as a photographing condition control data table (not shown). The instruction information sending unit 15 refers to the photographing condition control data table, obtains information on the photographing conditions related to the acquisition of the shared information related to the location, and sends it to the execution user terminal 3.

[0166] The imaging condition control unit 16 c of the execution user terminal 3 performs control based on the imaging condition for obtaining shared information by the execution user terminal 3 according to the instruction related to the position included in the instruction information transmitted by the instruction information transmitting unit 15 .

[0167] <Determination Unit S180>

[0168] In addition, according to the present embodiment, the determination unit 20 determines a person image, a product image, or a structure image based on the shared information including the image acquired by the information acquisition unit 13 (determination unit S180). Various images, images covered by icons, characters, etc., and substitute images such as mosaics stored in the experience sharing database 1a are stored in a substitute image data table (not shown). The determination unit 20 refers to the image acquired by the information acquisition unit 13 and the experience sharing database 1a, determines whether it is an image of the object by, for example, a known similar image technology, and acquires a substitute image of the object.

[0169] <Image Processing Unit 21>

[0170] The image processing unit 21 masks a part or the whole of the identified person image, product image or structure image, or pastes the substitute image in the corresponding image area according to the identification result of the identification unit 20 and the obtained substitute image, or pastes the substitute image in the corresponding image area according to the identification result (image processing unit S190). The image processing unit 21 pastes the substitute image, for example, in the form of mosaic display or avatar display, which can protect the privacy of the client of the entrusting user terminal 2 and the executor of the executing user terminal 3. In addition, it can avoid unexpected and unauthorized shooting of ordinary people, specific products, structures and natural objects that require photography permission, etc. at the scene.

[0171] Furthermore, according to the present embodiment, the receiving unit 11 receives the entrustment information describing the conditions including the remuneration to be paid for the entrustment and the execution information describing the remuneration desired for the execution of the experience, and the experience sharing determination unit 12 determines the experience to be shared based on the remuneration described in the entrustment information and the execution information respectively accepted by the receiving unit 11. Furthermore, the information acquisition unit 13 can acquire the sharing information after the experience to be shared between the entrusting user terminal 2 and the execution user terminal 3 is determined by the experience sharing determination unit 12 and the payment of the remuneration is settled by the entrusting user terminal 2 or the execution user terminal 3. Thus, entrustment and execution can be reliably performed, and remuneration can be collected.

[0172] In addition, according to the present embodiment, the information acquisition unit 13 may also acquire various body numerical data such as posture, body temperature, and respiratory rate of the care object, the elderly, etc. measured or measured by the execution user terminal 3. The determination unit 20 determines the state of the care object, the elderly, etc. based on the various body numerical data such as posture, body temperature, and respiratory rate of the care object, the elderly, etc. obtained by the information acquisition unit 13. The image processing unit 21 converts the state of the care object, the elderly, etc. determined by the determination unit 20 into, for example, a 3D image. The publishing unit 14 may also publish the shared information converted into a 3D image to the entrusting user terminal 2 such as a caregiver such as a relative, a nurse of a nursing institution, etc.

[0173] As a result, the status of care recipients, elderly people, etc. can be remotely grasped and supported while ensuring the privacy of the care recipients and elderly people.

[0174] In addition, according to the present embodiment, the executing user terminal 3 may also entrust the confirmation and inspection of the shared information taken on site or locally to the entrusting user terminal 2 having professional information and knowledge via the experience sharing server 1. The executing user terminal 3 takes an image for which advice is desired, and publishes it to the entrusting user terminal 2 as shared information via the experience sharing server 1.

[0175] Thereby, the executing user terminal 3 can, for example, remotely confirm the commodity that the executing user terminal 3 wants to purchase with the requesting user terminal 2 and purchase the appropriate commodity.

[0176] In addition, according to the present embodiment, the experience sharing server 1 may also receive a task such as what can be done at the scene or in the local area from the execution user terminal 3 as execution information, and disclose it to the entrusting user terminal 2 registered in the experience sharing server 1. The experience sharing server 1 may also receive the entrusting user terminal 2. The experience sharing determination unit 12 determines the entrusting user terminal 2 that matches the execution information received by the execution user terminal 3, thereby the execution user terminal 3 performs a shooting task such as shooting at the scene or in the local area, confirming or investigating the status.

[0177] In addition, according to the present embodiment, the operation of the executing user terminal 3 may be, in addition to photographing, operations such as "please queue up" or "please check your lost items", and these conditions may be photographed as shared information. The shared information photographed by the executing user terminal 3 is acquired by the information acquisition unit 13 of the experience sharing server 1 and published to the requesting user terminal 2 by the publishing unit 14.

[0178] In addition, according to the present embodiment, the executor holding the execution user terminal 3 can, for example, stay at the local area and undertake the task of taking pictures of local-specific images corresponding to the remote client user terminal 2. The pictures are published to the client user terminal 2 via the experience sharing server 1. The client user holding the client user terminal 2 can stay at the remote area and experience the instant movement that creates virtual movement by referring to the shared images published by the publishing unit 14 of the experience sharing server 1.

[0179] The embodiments of the present invention are described, but the embodiments are presented as examples and are not intended to limit the scope of the invention. These new embodiments can be implemented in various other ways, and various omissions, substitutions and changes can be made without departing from the scope of the invention. These embodiments and their variations are included in the scope or spirit of the invention, and are included in the invention described in the claims and their equivalents.

[0180] Description of symbols

[0181] 1: experience sharing server; 1a: experience sharing database; 2, 2a, 2b: requesting user terminal; 3, 3a, 3b: executing user terminal; 4: network; 10: housing; 11: receiving unit; 12: experience sharing determination unit; 13: information acquisition unit; 14: publishing unit; 14a: translation unit; 15: instruction information sending unit; 16a: operation control unit; 16b: time period control unit; 16c: photographing condition control unit; 20: determination unit; 21: image processing unit; 22: output unit; 30a: status information A; 30b: status information B; 50: scenery; 100: experience sharing system; 101: CPU; 102: R OM; 103: RAM; 104: storage unit; 105: I / F; 106: I / F; 107: I / F; 108: input part; 109: output part; 110: internal bus; S110, S111: receiving unit; S120: experience sharing determination unit; S130: information acquisition unit; S140, S142: publishing unit; S141: translation unit; S150, S151, S152: instruction information sending unit; S160: operation control unit; S170: time period control unit; S171: photography condition control unit; S180: determination unit; S190: image processing unit.

Claims

1. An experience sharing system for sharing an experience by connecting a requesting user terminal and an executing user terminal that are communicatively connected via a network, wherein the experience sharing system has: an accepting unit for accepting entrustment information related to entrustment of the experience of the remote image from the entrusting user terminal, and accepting execution information related to execution of the experience of the local image from the executing user terminal; an experience sharing determination unit, which determines a delegating user terminal and an executing user terminal that share the experience according to whether at least one of the information of the location and the time included in the delegation information and the execution information is consistent; an information acquisition unit, which acquires shared information including local voice or image for sharing the experience between the entrusting user terminal and the executing user terminal, and status information based on the shared information, the status information being information related to a local location of the shared information, i.e., a location where the shared information is acquired; as well as a publishing unit that publishes the shared information to the entrusting user terminal in real time in a manner that is the same as the display of the shared information in the executing user terminal; and publishes the status information to the executing user terminal in real time in a manner that is displayed only on the executing user terminal; According to the location where the shared information is obtained, if there is a newly opened store at the location, the coupon information of the newly opened store is published to the entrusting user terminal, or if the location is prohibited, information related to the location, or reminders or restrictions related to the location are published to the executing user terminal, Among them, the experience sharing determination unit is further configured to, when the acceptance unit accepts the delegation information recording the conditions related to the location and time of sharing the experience, and the execution information recording the location and time at which the experience can be executed, match the delegation user terminal with the execution user terminal according to the location and time of sharing the experience and the location and time at which the experience can be executed, and determine that the experience is shared by the delegation user terminal and the execution user terminal.

2. The experience sharing system according to claim 1, characterized in that: The information acquisition unit acquires status information related to the status of the voice or image included in the shared information, The delivery unit adjusts the audio or image of the shared information based on the state information acquired by the information acquisition unit and delivers the adjusted audio or image to the requesting user terminal.

3. The experience sharing system according to claim 1 or 2, characterized in that: The distribution unit distributes the identification information associated with the content of the shared information acquired by the information acquisition unit to the requesting user terminal or the executing user terminal.

4. The experience sharing system according to claim 1 or 2, characterized in that: The receiving unit acquires language information used by the requesting user terminal or the executing user terminal, The issuing unit includes a translation unit that translates the shared information based on the language information acquired by the receiving unit. The shared information translated by the translation unit is distributed to the requesting user terminal.

5. The experience sharing system according to claim 1, characterized in that: The experience sharing system further comprises an instruction information sending unit, which sends instruction information from the entrusting user terminal to the executing user terminal, wherein the instruction information includes various instructions related to obtaining the shared information. The information acquisition unit acquires shared information from the executing user terminal based on the instruction information of the requesting user terminal.

6. The experience sharing system according to claim 5, characterized in that: The instruction information sending unit sends instruction information including various instructions for the requesting user terminal to perform direct remote operation in acquiring shared information to the executing user terminal. The executing user terminal includes an operation control unit that controls an operation for obtaining shared information according to an instruction included in the instruction information sent by the instruction information sending unit.

7. The experience sharing system according to claim 5, characterized in that: The instruction information sending unit sends instruction information including instructions related to a time period for the execution user terminal to obtain the shared information to the execution user terminal, The executing user terminal includes a time period control unit, which controls the time period for obtaining the shared information according to the indication related to the time period included in the indication information sent by the indication information sending unit.

8. The experience sharing system according to claim 5, characterized in that: The instruction information sending unit sends instruction information including instructions related to the location for the execution user terminal to obtain the shared information to the execution user terminal, The execution user terminal includes a photographing condition control unit that controls photographing conditions for obtaining shared information based on instructions related to a position included in the instruction information transmitted by the instruction information transmitting unit.

9. The experience sharing system according to claim 5, characterized in that: The indication information sending unit sends to the executing user terminal indication information including indications related to a time period for the executing user terminal to obtain the shared information or indications related to a location for obtaining the shared information. When it is determined that the executing user terminal that has sent the indication information cannot obtain the shared information based on the indications related to the time period or location included in the indication information, after searching for other executing user terminals that can obtain the shared information based on the indication, the indication information is sent to the other executing user terminals.

10. The experience sharing system according to claim 1 or 2, characterized in that: The experience sharing system also has: a distinguishing unit for distinguishing a person image, a product image, or a structure image based on the shared information including the image acquired by the information acquiring unit; as well as An image processing unit masks the person image, product image, or structure image identified by the identification unit, or pastes a substitute image in a region of the image.

11. The experience sharing system according to claim 1 or 2, characterized in that: The receiving unit receives the request information describing conditions including a remuneration to be paid for the request and the execution information describing a desired remuneration for execution of the experience, The experience sharing determination unit determines a requesting user terminal and an executing user terminal to share the experience based on whether the remunerations respectively described in the request information and the execution information accepted by the acceptance unit are consistent with each other, The information acquisition unit acquires the sharing information after the experience sharing determination unit determines the requesting user terminal and the executing user terminal that share the experience and settles the payment of the reward.

12. An experience sharing method for sharing an experience between a client user terminal and an execution user terminal connected in a communicative manner via a network, wherein the experience sharing method is characterized in that: The following steps are involved: an accepting step of accepting entrustment information related to entrustment of the experience of the remote image from the entrusting user terminal, and accepting execution information related to execution of the experience of the local image from the executing user terminal; an experience sharing determination step, determining a delegating user terminal and an executing user terminal that share the experience according to whether information including at least one of the location and the time included in the delegation information and the execution information is consistent; an information acquisition step of acquiring shared information including local voice or image for sharing the experience between the entrusting user terminal and the executing user terminal, and status information based on the shared information, the status information being information related to the local location of the shared information, i.e., the location where the shared information was acquired; as well as a publishing step of publishing the shared information to the entrusting user terminal in real time in a display manner identical to the display of the shared information in the executing user terminal; publishing the status information to the executing user terminal in real time in a manner that the status information is displayed only on the executing user terminal; According to the location where the shared information is obtained, if there is a newly opened store at the location, the coupon information of the newly opened store is published to the entrusting user terminal; if the location is prohibited, information related to the location, or reminders or restrictions related to the location are published to the executing user terminal, Among them, when the delegation information recording the conditions related to the location and time of sharing the experience and the execution information recording the location and time at which the experience can be executed are accepted, the delegation user terminal and the execution user terminal are matched according to the location and time of sharing the experience and the location and time at which the experience can be executed, and it is determined that the experience is shared by the delegation user terminal and the execution user terminal.

Images