Processing system, processing method, and program

Abstract

To perform remote operation of a robot existing in a remote area, and thereby enhance attraction of service allowing users to experience the remote area.SOLUTION: A processing system includes: a reception unit for receiving user input of operation instruction information instructing operation of a robot including information acquisition means and moving means; an experience control unit for controlling the operation of the robot based on the operation instruction information, and outputting an experience content generated based on acquisition information acquired by the information acquisition means to a user; and a privilege providing unit for determining a privilege provided to the user based on the operation history of the robot, and providing privilege information related to the determined privilege to the user.SELECTED DRAWING: Figure 1

Description

Technical Field

[0001] The present disclosure relates to a processing system, a processing method, and a program.

Background Art

[0002] The technology related to the present disclosure is disclosed in Patent Document 1. Patent Document 1 discloses a technology for remotely operating a bipedal robot to provide an amusement experience at a theme park, amusement facility, theater facility, sports facility, tourist destination, hotel, airport, station, etc. In this technology, a person who wishes to have an experience remotely operates the bipedal robot existing in the desired facility. Then, the technology collects various information with various sensors possessed by the bipedal robot and provides the collected information to the person who wishes to have an experience at a remote location.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] It is expected to further enhance the attractiveness of a service that allows a person to experience a remote location by remotely operating a robot existing at the remote location.

[0005] An example of the object of the present disclosure is to provide a processing system, a processing method, and a program that, in view of the above-described problems, further enhance the attractiveness of a service that allows a person to experience a remote location by remotely operating a robot existing at the remote location.

Means for Solving the Problems

[0006] According to the present disclosure, a reception unit that receives a user input of operation instruction information for instructing the operation of a robot including an information acquisition unit and a movement unit, An experience control means that controls the operation of the robot based on the operation instruction information and outputs experience content generated based on the acquisition information acquired by the information acquisition means to the user, A privilege providing means that determines a privilege to be provided to the user based on the operation history of the robot and provides privilege information regarding the determined privilege to the user, A processing system having the above is provided.

[0007] Also, according to the present disclosure, One or more computers Receive user input of operation instruction information for instructing the operation of a robot equipped with information acquisition means and moving means, Control the operation of the robot based on the operation instruction information, and output experience content generated based on the acquisition information acquired by the information acquisition means to the user, A processing method is provided that determines a privilege to be provided to the user based on the operation history of the robot and provides privilege information regarding the determined privilege to the user.

[0008] Also, according to the present disclosure, A computer A reception means for receiving user input of operation instruction information for instructing the operation of a robot equipped with information acquisition means and moving means, An experience control means that controls the operation of the robot based on the operation instruction information and outputs experience content generated based on the acquisition information acquired by the information acquisition means to the user, A privilege providing means that determines a privilege to be provided to the user based on the operation history of the robot and provides privilege information regarding the determined privilege to the user, A program for causing the above to function is provided.

Advantages of the Invention

[0009] According to one aspect of the present disclosure, a processing system, a processing method, and a program are realized that enhance the attractiveness of a service that allows a user to experience a remote location by remotely operating a robot existing at a remote location.

Brief Description of the Drawings

[0010]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Modes for Carrying Out the Invention

[0011] Hereinafter, embodiments of the present disclosure will be described with reference to the drawings. In the present disclosure, the drawings are associated with one or more embodiments. Also, in all the drawings, the same components are denoted by the same reference numerals, and the description will be omitted as appropriate.

[0012] <<First Embodiment>> FIG. 1 is a functional block diagram showing an overview of a processing system 10. The processing system 10 provides a service (hereinafter, sometimes referred to as a "remote area experience service") that can experience a remote area by remotely operating a robot existing in a remote area. FIG. 2 is a flowchart showing an example of the processing flow executed by the processing system 10.

[0013] As shown in FIG. 1, the processing system 10 includes a reception unit 11, an experience control unit 12, and a privilege providing unit 13. By these functional units, the processing of the flowchart in FIG. 2 is executed.

[0014] In S10, the reception unit 11 receives a user input of operation instruction information for instructing the operation of a robot equipped with information acquisition means and movement means.

[0015] In S11, the experience control unit 12 controls the operation of the robot based on the operation instruction information, and outputs experience content generated based on the acquisition information acquired by the information acquisition means to the user.

[0016] In S12, the privilege providing unit 13 determines a privilege to be provided to the user based on the operation history of the robot, and provides privilege information regarding the determined privilege to the user.

[0017] According to such a processing system 10, the user can experience a remote location by remotely operating a robot existing at the remote location. And the user can receive a privilege determined based on his / her own experience (operation history of the robot) in the remote location experience service.

[0018] In this way, according to the processing system 10 that provides a privilege to a user who has received a remote location experience service, the attractiveness of the remote location experience service can be further enhanced.

[0019] Also, the processing system 10 provides a privilege determined based on the user's own experience (operation history of the robot) in the remote location experience service. As a result, it becomes possible to provide a privilege that the user shows more interest in. According to such a processing system 10 that provides an appropriate privilege to the user, the attractiveness of the remote location experience service can be further enhanced.

[0020] <<Second Embodiment>> <Overview> The processing system 10 of the second embodiment is a specific implementation of the configuration of the processing system 10 of the first embodiment. It will be described in detail below.

[0021] <Hardware Configuration> First, an example of the hardware configuration of the processing system 10 will be described. Each functional unit of the processing system 10 is realized by an arbitrary combination of hardware and software. It is understood by those skilled in the art that there are various variations in the realization methods and apparatuses. Software includes programs stored in advance at the stage of shipping the apparatus, programs downloaded from recording media such as CDs (Compact Discs), servers on the Internet, and the like.

[0022] FIG. 3 is a block diagram illustrating the hardware configuration of the processing system 10. As shown in FIG. 3, the processing system 10 includes a processor 1A, a memory 2A, an input / output interface 3A, a peripheral circuit 4A, and a bus 5A. The peripheral circuit 4A includes various modules. The processing apparatus 10 may not have the peripheral circuit 4A. Note that the processing system 10 may be composed of a plurality of physically and / or logically separated apparatuses. In this case, each of the plurality of apparatuses can be provided with the above-described hardware configuration.

[0023] The bus 5A is a data transmission path for the processor 1A, the memory 2A, the peripheral circuit 4A, and the input / output interface 3A to transmit and receive data to and from each other. The processor 1A is an arithmetic processing device such as a CPU (Central Processing Unit) or a GPU (Graphics Processing Unit). The memory 2A is a memory such as a RAM (Random Access Memory) or a ROM (Read Only Memory). The input / output interface 3A includes an interface for acquiring information from an input device, an external device, an external server, an external sensor, a camera, etc., an interface for outputting information to an output device, an external device, an external server, etc., and an interface for connecting to a communication network such as the Internet. The input device is, for example, a keyboard, a mouse, a microphone, a physical button, a touch panel, etc. The output device is, for example, a display, a speaker, a printer, a mailer, etc. The processor 1A can issue commands to each module and perform operations based on their arithmetic results.

[0024] <Functional Configuration> Next, the functional configuration of the processing system 10 will be described in detail. FIG. 1 shows an example of a functional block diagram of the processing system 10. As shown in the figure, the processing system 10 includes a reception unit 11, an experience control unit 12, and a privilege providing unit 13.

[0025] The reception unit 11 receives user input of operation instruction information for instructing the operation of the robot.

[0026] First, the robot will be described. The robot includes information acquisition means and movement means. Note that the robot can include other means such as communication means and output means (display, speaker, etc.). Further, the robot can include an actuator and can perform various operations / controls according to electrical signals. For example, the robot may be able to perform an operation of grasping an object.

[0027] The information acquisition means is a means for acquiring various information about the periphery of the robot and the robot itself. For example, the information acquisition means has at least one of a camera, a microphone, an odor sensor, a tactile sensor, a current position measurement sensor, a speed sensor, and an acceleration sensor.

[0028] The camera photographs the periphery of the robot. Such a camera functions as the eyes of the robot. One robot may have a single camera (monocular) or multiple cameras (compound eyes). When one robot has multiple cameras, information on depth (distance) can be obtained. Also, the lens of the camera may be a lens with a standard angle of view of about 45°, or a wide-angle lens with a larger angle of view (e.g., 60° or more). The lens of the camera may be a so-called fish-eye lens. A camera may be installed on the robot to photograph 360° omnidirectionally. For example, the camera can capture a moving image while the user is remotely operating the robot. Note that the camera may be able to change the shooting settings according to user operations. For example, the camera may be able to zoom in or zoom out according to user operations.

[0029] The microphone collects sounds around the robot. Such a microphone functions as the ear of the robot. One robot may have a single microphone or multiple microphones. When one robot has multiple microphones, the multiple microphones may be installed at positions separated from each other. When one robot has multiple microphones, it becomes possible to estimate the position of the sound source of the sound collected by the microphones. For example, the microphone can collect sounds around the robot while the user is remotely operating the robot. Note that the microphone may be able to change the sound collection settings according to the user operation. For example, the microphone may be able to switch the ON / OFF of the sound collection process or adjust the volume level according to the user operation.

[0030] The odor sensor detects odors around the robot. Such an odor sensor functions as the nose of the robot. The odor sensor may digitize the intensity of the odor. In addition, the odor sensor may digitize the content rate of various odor components in the air. For example, the odor sensor can detect odors around the robot while the user is remotely operating the robot. Note that the odor sensor may be able to change the odor detection settings according to the user operation. For example, the odor sensor may be able to switch the ON / OFF of the odor detection process according to the user operation. Also, the odor sensor may be able to switch the odor component to be detected according to the user operation.

[0031] The tactile sensor detects various information obtained from an object in contact with a predetermined part of the robot. Such a tactile sensor functions as, for example, the hand of the robot. The tactile sensor detects, for example, the force (pressure), the direction of the force, vibration, and temperature applied from the object in contact to a predetermined part of the robot. Using the result of sensing by the tactile sensor, the hardness (softness) and texture of the object in contact can be evaluated. For example, the tactile sensor can detect various information of the object in contact with a predetermined part of the robot while the user is remotely operating the robot. Note that the tactile sensor may be able to change the setting of tactile detection according to a user operation. For example, the tactile sensor may be able to switch the ON / OFF of tactile detection processing according to a user operation.

[0032] The current position measurement sensor detects the current position of the robot. Detection of the current position of the robot using the current position measurement sensor can be realized using any widely known technique. For example, positioning using GPS (global positioning system), positioning using BLE (Bluetooth Low Energy) or Wi-Fi, positioning using the PDR (Pedestrian dead reckoning: acceleration and magnetism) of the robot, positioning using a camera, etc. are exemplified, but are not limited thereto. The current position of the robot is indicated by information such as latitude and longitude, for example. For example, the current position measurement sensor can detect the current position of the robot while the user is remotely operating the robot.

[0033] The speed sensor detects the moving speed of the robot. The acceleration sensor detects the acceleration of the robot. For example, the speed sensor and the acceleration sensor can detect the moving speed and acceleration of the robot while the user is remotely operating the robot.

[0034] The moving means may be a mechanism for moving on land or a mechanism for moving in the air. In either case, the robot can adopt any well-known moving mechanism. For example, the moving means may be a mechanism for two-legged walking or a mechanism for walking with three or more legs. Also, the moving means may be a mechanism equipped with wheels or crawlers, or other special mechanisms. Also, the robot may be a flying body that moves in the air like a drone.

[0035] Here, with reference to FIG. 4, an arrangement example of the robot 20 equipped with the information acquisition means and the moving means as described above will be described. As shown in FIG. 4, the robot 20 equipped with the information acquisition means and the moving means as described above is arranged at a remote location away from the user interface device 40.

[0036] The user interface device 40 is a device operated by a user of the remote experience service. The user interface device 40 is configured to be communicable with the processing system 10.

[0037] The user interface device 40 has an input device that receives input from the user and an output device that provides information to the user. Examples of the input device include, but are not limited to, a touch panel, a keyboard, a mouse, physical buttons, a microphone, a gesture input device, etc. Examples of the output device include, but are not limited to, a display, a projection device, a speaker, a printer, an olfactory output device, etc. The display may be of a type installed at a predetermined position or of a type worn by the user such as a head-mounted display. The speaker may be of a type installed at a predetermined position or of a type worn by the user such as earphones, headphones, a headset, etc.

[0038] In the example of FIG. 4, the user interface device 40 is arranged in area X, and the robots 20 are arranged in each of the two areas, area A and area B. And the processing system 10 is arranged in other areas. Area X is separated from areas A and B. The arrangement area of the processing system 10 is not particularly limited. The processing system 10 may be, for example, a cloud server.

[0039] The processing system 10 and each robot 20 are communicably connected to each other via a communication network 30 such as the Internet. Also, the processing system 10 and the user interface device 40 are communicably connected to each other via a communication network 30 such as the Internet. Note that these may be communicably connected to each other via a dedicated line.

[0040] In FIG. 4, the robots 20 are arranged in two areas, area A and area B, but the number of areas where the robots 20 are arranged may be one, two, or three or more. The more areas where the robots 20 are arranged, the more areas the user can experience, which is preferable.

[0041] Also, in FIG. 4, one robot 20 is arranged in each area, but one robot 20 may be arranged in each area, or a plurality of robots 20 may be arranged. If a plurality of robots 20 are arranged in one area, it is preferable that a plurality of users can experience that area at the same time. Also, the more robots 20 arranged in one area, the more users can experience that area at the same time, which is preferable.

[0042] Area X is an area where the user interface device 40 is arranged. The user remotely operates the robot 20 arranged at a remote location by operating the user interface device 40 arranged in area X. Area X is a facility that provides a remote area experience service via such a robot 20. Area X may be a station, an airport, etc., or a facility dedicated to the experience service, or others.

[0043] The areas A and B where the robot 20 is placed are areas that are the subject of experiences from a remote location. The areas A and B are, for example, tourist destinations, amusement facilities, shopping malls, and other facilities, etc., but are not limited thereto.

[0044] A modified example will be described with reference to FIG. 5. In the example of FIG. 5, the processing system 10 includes a user interface device 40. In this case, the processing system 10 is arranged in area X.

[0045] The reception unit 11 receives a user input of operation instruction information for instructing the operation of the robot 20 from a user in area X. The reception unit 11 can receive the user input via the user interface device 40.

[0046] The operation instruction information that can be input by the user may be content for controlling the information acquisition means and movement means of the robot 20. For example, the operation instruction information that can be input by the user may include at least one of the following instructions. Note that the examples here are merely examples, and the operation instruction information that can be input by the user may include other instructions.

[0047] · Instruction to start the movement of the robot 20 · Instruction to end the movement of the robot 20 · Instruction for the movement direction of the robot 20 · Instruction for the movement speed of the robot 20 · Instruction to change the orientation of the robot 20 (instruction to change the shooting direction of the camera) · Instruction to move to a facility designated by the user · Instruction to enter the facility designated by the user among the facilities included in the image captured by the camera of the robot 20 · Instruction to go outside the current facility · Instruction to touch the object designated by the user among the objects included in the image captured by the camera of the robot 20 · Instruction to grasp the object designated by the user among the objects included in the image captured by the camera of the robot 20 · Among the objects included in the image captured by the camera of the robot 20, an instruction to smell the object specified by the user (an instruction to bring the object closer to the odor sensor) · Among the objects included in the image captured by the camera of the robot 20, an instruction to closely observe the object specified by the user (an instruction to zoom in the camera on the object) · An instruction to speak (an instruction to output a preset fixed phrase or a free text input by the user to the processing system 10 via a speaker or a display)

[0048] By inputting such operation instruction information into the user interface device 40, the user can cause the robot 20 located at a remote location to perform a desired operation. For example, the user can move the robot 20 to a predetermined location, move it into a predetermined facility, make it touch a predetermined object, grasp a predetermined object, smell the odor of a predetermined object, closely observe a predetermined object, or have a conversation with a predetermined partner.

[0049] Returning to FIG. 1, the experience control unit 12 controls the operation of the robot 20 based on the operation instruction information received by the reception unit 11. Then, the experience control unit 12 outputs the experience content generated based on the acquisition information acquired by the information acquisition means of the robot 20 toward the user via the user interface device 40.

[0050] That is, the experience control unit 12 transmits the operation instruction information received by the reception unit 11 to the robot 20 and causes it to execute the operation according to the instruction indicated by the operation instruction information. The robot 20 is configured to execute the operation according to the instruction indicated by the operation instruction information received from the processing system 10.

[0051] In addition, the experience control unit 12 acquires the acquisition information acquired by the information acquisition means of the robot 20 from the robot 20. The robot 20 is configured to transmit the acquisition information acquired by the information acquisition means to the processing system 10 in real time.

[0052] Then, the experience control unit 12 generates experience content based on the acquired information obtained from the robot 20, and causes the user interface device 40 to output the generated experience content.

[0053] For example, the experience control unit 12 may output, as experience content, an image generated by the camera of the robot 20. In addition, when the camera of the robot 20 captures a wide range, such as 360° omnidirectional, the experience control unit 12 may switch the content of the image to be output according to the user's operation. Further, when the robot 20 has a plurality of cameras, depth (distance) information can be obtained. The experience control unit 12 may output the depth information (such as the distance to an object included in the image) as experience content. The experience control unit 12 can output the experience content via an output device (user interface device 40) such as a display or a projection device.

[0054] In addition, the experience control unit 12 may output, as experience content, the sound collected by the microphone of the robot 20. The experience control unit 12 can output the experience content via an output device (user interface device 40) such as a speaker. When one robot has a plurality of microphones, it becomes possible to estimate the position of the sound source of the sound collected by the microphones. The experience control unit 12 may output the estimation result of the sound source position as experience content. The experience control unit 12 can output the estimation result of the sound source position via an output device (user interface device 40) such as a display or a projection device and a speaker.

[0055] In addition, the experience control unit 12 may output the odor detected by the odor sensor of the robot 20 as experience content. The experience control unit 12 may cause the user interface device 40 to generate (reproduce) the odor indicated by the acquired information and output the generated odor (output the gas or liquid emitting the odor). In this case, the user interface device 40 includes an odor generating device and an odor spraying device. The odor generating device and the odor spraying device can be realized using any well-known technology. As another example, the experience control unit 12 may output information (such as text or a picture) indicating the type of odor (e.g., the smell of an apple, etc.) indicated by the acquired information via an output device (user interface device 40) such as a display or a projection device, or an output device (user interface device 40) such as a speaker. For example, the experience control unit 12 may output a message such as "There is a smell of an apple at the current location."

[0056] In addition, the experience control unit 12 may output various information obtained from the object in contact detected by the tactile sensor of the robot 20 as experience content. The experience control unit 12 may output information (such as text or a picture) indicating the hardness (softness) and texture of the object in contact indicated by the acquired information via an output device (user interface device 40) such as a display or a projection device, or an output device (user interface device 40) such as a speaker.

[0057] In addition, the experience control unit 12 may output information indicating the current position of the robot 20 detected by the current position measurement sensor of the robot 20 as experience content. For example, the experience control unit 12 may output information mapping the current position of the robot 20 on a map via an output device (user interface device 40) such as a display or a projection device.

[0058] In addition, the experience control unit 12 may output the moving speed detected by the speed sensor of the robot 20 and the acceleration detected by the acceleration sensor of the robot 20 as experience content. The experience control unit 12 may output information (such as text or pictures) indicating the speed and acceleration shown in the acquired information via an output device (user interface device 40) such as a display or a projection device, or an output device (user interface device 40) such as a speaker.

[0059] The experience control unit 12 can store the operation history of the robot 20 based on the operation instruction information input by the user in the storage device of the processing system 10.

[0060] The operation history can indicate at least one of the following. · The moving path of the robot 20 · The facilities visited by the robot 20 · The products touched by the robot 20 · The products grasped by the robot 20 · The products smelled by the robot 20 (products brought close to the smell sensor in response to an instruction to bring it close to the smell sensor) · The products seen by the robot 20 · The services received by the robot · The lines spoken by the robot 20 (lines spoken from the speaker or lines displayed on the display device) · The content heard by the robot 20 (content collected by the microphone)

[0061] The experience control unit 12 can identify the facilities visited by the robot 20 based on, for example, map data indicating the locations of the respective facilities, the current position of the robot 20, the movement route, and the like. Further, the experience control unit 12 can identify the products touched by the robot 20, the products grasped by the robot 20, the products whose smell the robot 20 smelled, and the products seen by the robot 20 through image analysis. For example, the experience control unit 12 can identify the products shown in the image using image recognition technology or the like. For example, the feature amounts of the appearances of a plurality of products are registered in the processing system 10 in advance. The experience control unit 12 can identify the types of products in the image by image recognition based on the feature amounts of the appearances of such a plurality of products.

[0062] In addition, the experience control unit 12 can identify the services received by the robot 20 by at least one of image analysis and voice analysis. The service is, for example, a service provided to a person who visits the area or the facility. For example, the services include, but are not limited to, a rickshaw use service, a tourist guide service, a pottery experience service, bungee jumping, horseback riding, an escape game, and the like.

[0063] For example, the feature amounts of the appearances of the objects (such as tools) used in each service are registered in the processing system 10 in advance. The experience control unit 12 can identify the service received by the robot 20 by detecting each object from the image by image recognition based on the feature amounts of the appearances of the respective objects used in such each service. In addition, the catchphrases and shouts uttered during the use of each service may be registered in the processing system 10 in advance. The experience control unit 12 may identify the service received by the robot 20 by detecting the catchphrases and shouts uttered during the use of each service from the voice collected by the microphone of the robot 20.

[0064] The privilege providing unit 13 determines the privilege to be provided to the user based on the operation history of the robot 20. Then, the privilege providing unit 13 provides the user with privilege information regarding the determined privilege.

[0065] For example, the privilege providing unit 13 may identify the facilities visited by the robot 20 based on the operation history of the robot 20, and provide the user with privilege information regarding the identified facilities. Additionally, the privilege providing unit 13 may identify the facilities visited by the robot 20 for a predetermined time period or more or a predetermined number of times or more based on the operation history of the robot 20, and provide the user with privilege information regarding the identified facilities. The privilege information regarding the identified facilities is, for example, a coupon (discount coupon, price cut coupon, free coupon, cash coupon, etc.) that can be used at the facility.

[0066] Additionally, the privilege providing unit 13 may identify at least one of the products touched by the robot 20, the products grasped by the robot 20, and the products smelled by the robot 20 based on the operation history of the robot 20, and provide the user with privilege information regarding the identified products. Additionally, the privilege providing unit 13 may identify the products touched by the robot 20 for a predetermined time period or more or a predetermined number of times or more based on the operation history of the robot 20, and provide the user with privilege information regarding the identified products. Additionally, the privilege providing unit 13 may identify the products grasped by the robot 20 for a predetermined time period or more or a predetermined number of times or more based on the operation history of the robot 20, and provide the user with privilege information regarding the identified products. Additionally, the privilege providing unit 13 may identify the products smelled by the robot 20 for a predetermined time period or more or a predetermined number of times or more based on the operation history of the robot 20, and provide the user with privilege information regarding the identified products. The privilege information regarding the identified products is, for example, a coupon (discount coupon, price cut coupon, free coupon, cash coupon, etc.) that can be used when purchasing the product.

[0067] Additionally, the privilege providing unit 13 may identify the products seen by the robot 20 based on the operation history of the robot 20, and provide the user with privilege information regarding the identified products. The privilege information regarding the identified products is, for example, a coupon (discount coupon, price cut coupon, free coupon, cash coupon, etc.) that can be used when purchasing the product.

[0068] The products seen by the robot 20 may be any one or more of the following. · Products shown in the images captured by the camera of the robot 20 · Products that appeared continuously for a predetermined time or more in the images captured by the camera of the robot 20 · Products that appeared for a total of a predetermined time or more in the images captured by the camera of the robot 20 · Products that appeared in the images captured by the camera of the robot 20 and were zoomed in according to user operation

[0069] In addition, the privilege providing unit 13 may identify the services received by the robot 20 based on the operation history of the robot 20, and provide the user with privilege information regarding the identified services. In addition, the privilege providing unit 13 may identify the services received by the robot 20 for a predetermined time or more or a predetermined number of times or more based on the operation history of the robot 20, and provide the user with privilege information regarding the identified services. The privilege information regarding the identified services is, for example, a coupon (discount coupon, price cut coupon, free coupon, cash coupon, etc.) that can be used when receiving the service.

[0070] In addition, the privilege providing unit 13 may identify the facilities, products, or services included in the lines spoken by the robot 20 (lines spoken from the speaker or lines displayed on the display device) based on the operation history of the robot 20. In addition, the privilege providing unit 13 may identify the facilities, products, or services included a predetermined number of times or more in the lines spoken by the robot 20 based on the operation history of the robot 20. Then, the privilege providing unit 13 may provide the user with privilege information regarding the identified facilities, products, or services.

[0071] The privilege providing unit 13 can provide the user with privilege information using any widely known technology.

[0072] For example, the privilege providing unit 13 may print out a paper medium showing the content of the privilege information. In this case, the user interface device 40 can include a printer.

[0073] In addition, when using the processing system 10, the user may input his / her user identification information into the processing system 10 via the user interface device 40. The user identification information may be user identification information dedicated to the services provided by the processing system 10, or may be user identification information used in other services. Examples of other services include, but are not limited to, services related to electronic money that can be used in railways, buses, shopping, etc., services related to code settlement, SNS (social networking service), services related to the use of shopping sites, and the like. When using the user identification information used in other services, the processing system 10 is in cooperation with the servers of other services. Such cooperation can be realized by using any well-known technology.

[0074] Then, the privilege providing unit 13 may register privilege information in association with the user identification information in the servers of other services or in the processing system 10. The user may be able to check and use the privilege information via an application installed on his / her terminal. Examples of the terminal include, but are not limited to, smartphones, tablet terminals, mobile phones, smart watches, personal computers, and the like.

[0075] Next, an example of the processing flow of the processing system 10 will be described using the flowchart of FIG. 6.

[0076] First, the processing system 10 receives a user input of user identification information via the user interface device 40 (S20). The user who uses the processing system 10 inputs his / her user identification information into the processing system 10 via the user interface device 40.

[0077] Next, the processing system 10 receives a user input for specifying the area to experience (S21).

[0078] For example, the processing system 10 selectively displays a plurality of experienceable areas on a display (user interface device 40). Then, the processing system 10 receives a user input for selecting one of them via the user interface device 40. Note that the processing system 10 may be aware of the robots 20 being used by other users and the robots 20 that are not being used. Then, the processing system 10 may display the area where the unused robot 20 is located as a selectable area. For example, the processing system 10 can recognize whether each robot 20 is in use based on notifications from each robot 20.

[0079] Note that if there is only one area where the robot 20 is originally placed, S21 may not be necessary. In this case, that one area is designated as the area to be experienced.

[0080] Next, the processing system 10 executes the experience program for the designated area (S22). Specifically, the processing system 10 executes the processing shown in the flowchart of FIG. 7.

[0081] That is, the processing system 10 receives a user input of operation instruction information for instructing the operation of the robot 20 via the user interface device 40 (S30). Then, the processing system 10 controls the operation of the robot 20 arranged in the designated area based on the input operation instruction information (S31). Also, the processing system 10 outputs the experience content generated based on the acquisition information acquired by the information acquisition means of the robot 20 to the user via the user interface device 40 (S31). Then, the processing system 10 accumulates the operation history of the robot 20 in a predetermined storage device (S32). The predetermined storage device may be provided inside the processing system 10 or may be provided inside an external device configured to be communicable with the processing system 10. The processing system 10 repeats this processing. Then, the processing system 10 ends the processing (experience program) of FIG. 7 in response to a user input instructing the end of the experience.

[0082] Returning to FIG. 6, after the experience program ends, based on the operation history of the robot accumulated during the experience program in S22, the processing system 10 determines the benefits to be provided to the user (S23). Then, the processing system 10 provides the benefit information regarding the determined benefits to the user specified by the user identification information input in S20 (S24). For example, in response to receiving a user input instructing the end of the experience, the processing system 10 may print out the benefit information via the user interface device 40. Alternatively, in response to receiving a user input instructing the end of the experience, the processing system 10 may register the benefit information in a predetermined server or the processing system 10 in association with the user identification information input in S20. In this case, the processing system 10 may notify the user that the benefit information has been provided. For example, the processing system 10 may output a message such as "Thank you for your use. We present you with a coupon that can be used at Facility A. Please check your ○○ account." via the user interface device 40.

[0083] <Operational effects> According to the processing system 10 of the present embodiment, the same operational effects as those of the processing system 10 of the first embodiment are achieved.

[0084] In addition, the processing system 10 can identify the facilities visited by the robot 20 according to the user operation, or the facilities visited for a predetermined time or more or a predetermined number of times or more, and provide the user with the benefit information regarding those facilities. The facilities visited by the user with the robot 20 are the facilities in which the user is interested. Also, the facilities visited by the user with the robot 20 for a long time are the facilities in which the user is interested. Moreover, the facilities visited by the user with the robot 20 many times are the facilities in which the user is interested. By providing the user with the benefit information of such facilities in which the user is interested, the attractiveness of the remote experience service can be further enhanced.

[0085] In addition, the processing system 10 can identify at least one of the products touched by the robot 20, grabbed by the robot 20, and smelled by the robot 20 in response to a user operation, and provide the user with privilege information regarding the product. Further, the processing system 10 can identify a product that the robot 20 has touched for a predetermined time or more or a predetermined number of times or more in response to a user operation, and provide the user with privilege information regarding the product. Further, the processing system 10 can identify a product that the robot 20 has grabbed for a predetermined time or more or a predetermined number of times or more in response to a user operation, and provide the user with privilege information regarding the product. Further, the processing system 10 can identify a product that the robot 20 has smelled for a predetermined time or more or a predetermined number of times or more in response to a user operation, and provide the user with privilege information regarding the product. Products that the user has allowed the robot 20 to touch, grab, or smell are products that the user is interested in. Also, products that the user has allowed the robot 20 to touch, grab, or smell for a long time are products that the user is interested in. Also, products that the user has allowed the robot 20 to touch, grab, or smell many times are products that the user is interested in. By providing the user with privilege information regarding such products that the user is interested in, the appeal of the remote experience service can be enhanced more.

[0086] In addition, the processing system 10 can identify a product that the robot 20 has seen in response to a user operation, and provide the user with privilege information regarding the product. Products that the user has allowed the robot 20 to see are products that the user is interested in. By providing the user with privilege information regarding such products that the user is interested in, the appeal of the remote experience service can be enhanced more.

[0087] In addition, the processing system 10 can identify the services received by the robot 20 according to user operations, or the services received for a predetermined time or more or a predetermined number of times or more, and provide the user with privilege information regarding the services. The services received by the user from the robot 20 are services that the user is interested in. In addition, the services received by the user from the robot 20 for a long time are services that the user is interested in. In addition, the services received by the user from the robot 20 many times are services that the user is interested in. By providing the user with privilege information regarding such services that the user is interested in, the attractiveness of the remote experience service can be further enhanced.

[0088] In addition, the processing system 10 can identify the facilities, products or services included in the lines spoken by the robot 20 according to user operations, and provide the user with privilege information regarding the facilities, products or services. In addition, the processing system 10 can identify the facilities, products or services included a predetermined number of times or more in the lines spoken by the robot 20 according to user operations, and provide the user with privilege information regarding the facilities, products or services. The facilities, products or services included in the lines spoken by the user to the robot 20 are facilities, products or services that the user is interested in. The facilities, products or services included many times in the lines spoken by the user to the robot 20 are facilities, products or services that the user is interested in. By providing the user with privilege information regarding such facilities, products or services that the user is interested in, the attractiveness of the remote experience service can be further enhanced.

[0089] As described above, based on the operation history of the robot 20 that operates according to user operations, the processing system 10 can accurately identify the objects of the user's interest and provide the user with privilege information regarding the objects. By providing the user with privilege information regarding the objects that the user is interested in in this way, the attractiveness of the remote experience service can be further enhanced. And it can enhance the user's feeling of actually visiting the remote area that has been experienced.

[0090] <<Third Embodiment>> The processing system 10 of this embodiment provides users with privilege information with an expiration date. This will be described in detail below.

[0091] The privilege providing unit 13 provides users with privilege information with an expiration date. First, the privilege providing unit 13 determines the expiration date of the privilege information. For example, the privilege providing unit 13 can determine the date after a predetermined number of days from the current day as the expiration date. The predetermined number of days is, for example, a fixed value determined in advance.

[0092] When the privilege providing unit 13 prints out a paper medium as privilege information, it further includes the expiration date on the paper medium. Also, when the privilege providing unit 13 registers the privilege information in a predetermined server or the processing system 10 in association with the user identification information, it registers the expiration date in association with each privilege information. Further, when the privilege providing unit 13 notifies the user of the grant of the privilege information via the output device of the user interface device 40, it may further notify the user of the expiration date.

[0093] Other configurations of the processing system 10 of this embodiment are the same as those of the processing system 10 of the first and second embodiments.

[0094] According to the processing system 10 of this embodiment, it is possible to provide users with privilege information with an expiration date. As time passes since the experience at a remote location using the robot 20, there is a concern that the user's interest in the subject that the user was interested in during that experience will gradually fade. And there is a concern that the user's intention to actually visit the remote location where the user had the experience will also gradually fade. By providing the user with privilege information with an expiration date as in this embodiment, it is possible to prompt the user to actually visit the remote location that the user experienced before the user's interest fades.

[0095] <<Fourth Embodiment>> The processing system 10 of this embodiment further uses the pre-registered preference information of the user to determine the privilege to be provided to the user. This will be described in detail below.

[0096] The privilege providing unit 13 determines the privileges to be provided to the user by further using the preference information of the pre-registered users.

[0097] In the present embodiment, the preference information of each user is registered in the processing system 10 in advance in association with the user identification information. The preference information indicates facilities, products, or services that the user is interested in. The processing system 10 may receive an input for registering the preference information from the user. Then, the processing system 10 may register the preference information input by the user. In addition, the processing system 10 may obtain the preference information of the user from other servers. Then, the processing system 10 may register the preference information obtained from other servers. In addition, the processing system 10 may generate the preference information of the user based on the information obtained from other servers. Then, the processing system 10 may register the generated preference information. For example, the processing system 10 may obtain the user's past purchase history, website visit history, etc. from other servers. Then, the processing system 10 may estimate the user's preferences based on those information and generate the preference information of the user.

[0098] The generation of the preference information by the processing system 10 can be realized by using any widely known technology. For example, the processing system 10 may identify products that the user has purchased in the past or products that the user has purchased a predetermined number of times or more in the past as products that the user is interested in. In addition, the processing system 10 may identify products similar to these products, etc. as products that the user is interested in. Similar products include products of the same type, products with the same price range, products of the same brand, etc.

[0099] In addition, the processing system 10 may identify services or facilities that the user has used in the past, or services or facilities that the user has used a predetermined number of times or more in the past, as services or facilities that the user is interested in. In addition, the processing system 10 may identify services or facilities similar to these services or facilities, etc., as services or facilities that the user is interested in. Similar services include the same type of service, services with the same price range, services of the same brand, etc. Similar facilities include the same type of facility, facilities with the same price range, facilities of the same brand, etc.

[0100] The privilege providing unit 13 provides the user with privilege information regarding a facility, product, or service that satisfies the conditions described in the second embodiment (e.g., the robot 20 visits, the robot 20 touches, etc.) and is shown to be of interest to the user based on the preference information.

[0101] Other configurations of the processing system 10 in the present embodiment are the same as those of the processing system 10 in the first to third embodiments.

[0102] According to the processing system 10 of the present embodiment, based on the operation history of the robot 20 that operates in response to a user operation and the preference information of the user, the object of the user's interest can be accurately identified. And the processing system 10 can provide the user with privilege information regarding the object. By providing the user with privilege information regarding an object that the user is truly interested in in this way, the charm of the remote experience service can be further enhanced. And the user's feeling of actually visiting the remote place experienced can be enhanced.

[0103] <<Modification Example>> Hereinafter, modification examples applicable to all embodiments will be described.

[0104] <Modification Example 1> The privilege providing unit 13 may provide the user with privilege information that can be used in public transportation. The privilege information that can be used in public transportation may be privilege information that can be used for moving to or from the area remotely experienced in the remote area experience service (the area where the remotely operated robot 20 is located. The same applies hereinafter). This privilege information may be, for example, a coupon (discount coupon, price cut coupon, free coupon, money coupon, etc.) that can be used when getting off at a station in that area or when boarding a train from a station in that area.

[0105] <Modification Example 2> The privilege providing unit 13 may provide the user with privilege information regarding accommodation facilities existing in the area remotely experienced in the remote area experience service. The privilege information regarding accommodation facilities may be, for example, a coupon (discount coupon, price cut coupon, free coupon, money coupon, etc.) that can be used at that accommodation facility.

[0106] <Modification Example 3> The privilege providing unit 13 may provide the user with a reservation priority coupon (privilege information) for a predetermined facility in the area remotely experienced in the remote area experience service. The predetermined facilities include, but are not limited to, popular facilities and facilities that tend to be crowded. The reservation priority coupon is a coupon that can receive preferential treatment (priority reservation) when making a reservation.

[0107] <Modification Example 4> The privilege providing unit 13 may provide the user with privilege information that can be used when purchasing a certain product sold at a certain facility according to the operation history of the robot 20, such as touching / grabbing / smelling the smell / seeing a certain product sold at that facility. The privilege information that can be used when purchasing that product may be, for example, a coupon (discount coupon, price cut coupon, free coupon, money coupon, etc.) that can be used when purchasing that product.

[0108] <Modification Example 5> The privilege providing unit 13 may provide the user with privilege information that can be used when purchasing a predetermined product sold at a certain facility according to the operation history of the robot 20 that visits the facility. The predetermined product may be a product ranked high in the sales ranking of the facility or a recommended product of the facility. The privilege information that can be used when purchasing a predetermined product is, for example, a coupon (discount coupon, price cut coupon, free coupon, cash coupon, etc.) that can be used when purchasing the product.

[0109] <Modification Example 6> The privilege providing unit 13 may provide the user with privilege information that can be used when purchasing the product sold at a certain facility according to the operation history of the robot 20 that receives a sales pitch of a certain product from a store clerk at the facility. For example, when the product name and keywords related to the sales pitch of the product are included in the conversation between the store clerk and the robot 20, the privilege providing unit 13 may determine that "the sales pitch of the product has been received from the store clerk". The privilege information that can be used when purchasing the product is, for example, a coupon (discount coupon, price cut coupon, free coupon, cash coupon, etc.) that can be used when purchasing the product.

[0110] <Modification Example 7> The privilege providing unit 13 may provide the user with privilege information that can be used at the facility when the robot 20 enters a certain facility. The privilege information that can be used at the facility is, for example, a coupon (discount coupon, price cut coupon, free coupon, cash coupon, etc.) that can be used at the facility.

[0111] <Modification Example 8> While remotely operating the robot 20, the user may register any one of the products or services that are the objects of the operations (seeing, touching, grasping, smelling the odor, experiencing, etc.) of the robot 20 as a favorite product or service. That is, the processing system 10 may provide such a registration service to the user who is using the remote experience service. By using the registration service, after the remote experience service, the user can recall the products and services that the user was interested in during the remote experience service based on the registration content.

[0112] Then, the privilege providing unit 13 may provide the user with privilege information regarding the product or service registered by the user as a favorite product. The privilege information regarding the product or service is, for example, a coupon (discount coupon, price cut coupon, free coupon, gift certificate, etc.) that can be used when purchasing the product or receiving the service.

[0113] <Modification Example 9> The processing system 10 may store, in the storage device of the processing system 10, the usage history of the user's past remote area experience service in association with the user identification information. The usage history indicates, for example, the usage date and time, the area experienced, the operation history of the robot 20, and the like.

[0114] Then, the privilege providing unit 13 may further utilize the user's past usage history to determine the privilege to be provided to the user. For example, the privilege providing unit 13 may provide predetermined privilege information that can be used in that area to a user who has experienced remote area experiences in the same area a predetermined number of times or more. The predetermined privilege information that can be used in that area is, for example, a coupon (discount coupon, price cut coupon, free coupon, gift certificate, etc.) that can be used in that area.

[0115] <Modification Example 10> The privilege providing unit 13 may provide privilege information to the user while the user is receiving the remote experience service. For example, while the robot 20 is visiting a predetermined facility, the privilege providing unit 13 may provide various types of information about the facility (advertisements, facility introductions, etc.) to the user via the output device of the user interface device 40. Also, in area X where the user interface device 40 is installed, if there is a merchandise corner provided for the facility or the area, information about the merchandise corner may be provided to the user via the output device of the user interface device 40. In that merchandise corner, for example, products related to the facility or the area are sold. Further, the privilege providing unit 13 may provide privilege information available at the merchandise corner to the user. The predetermined privilege information available at the merchandise corner is, for example, a coupon (discount coupon, price cut coupon, free coupon, cash coupon, etc.) available at the merchandise corner.

[0116] <Modification Example 11> When the processing system 10 cooperates with the servers of other services, the privilege providing unit 13 may provide privileges (points, coupons, etc.) available in other services to the user. Other services include, but are not limited to, services related to electronic money available for railways, buses, shopping, etc., services related to code settlement, SNS, services related to the use of shopping sites, etc.

[0117] <Modification Example 12> The privilege providing unit 13 may provide privilege information to users who meet predetermined conditions after using the remote experience service. The predetermined conditions include, but are not limited to, posting on SNS about the remote experience service, registering a review about the remote experience service from a predetermined site or application, etc.

[0118] <Modification Example 13> After the remote experience service, the privilege providing unit 13 may notify the user (provide privilege information) of awarding points for new membership registration for a predetermined service.

[0119] <Variant Example 14> While the user is receiving the remote experience service, the experience control unit 12 may provide useful information to the user via the output device of the processing system 10.

[0120] For example, in response to the robot 20 visiting a facility such as a souvenir shop or a restaurant, the experience control unit 12 may present recommended products of the facility to the user. In advance, the recommended products of each facility may be registered in the processing system 10. In addition, the experience control unit 12 may identify products that the user is interested in based on the preference information described in the fourth embodiment, and present similar products of the products to the user as recommended products. Similar products include products of the same type, products with the same price range, products of the same brand, etc. In advance, information on products handled by each facility is registered in the processing system 10.

[0121] In addition, when the robot 20 visits the previously visited facility again, the experience control unit 12 may present the operation history of the robot 20 at the previous visit to the user. For example, the experience control unit 12 may present to the user products that the robot 20 touched, grasped, smelled, saw, services received, products that received sales pitches from store clerks, etc. at the previous visit. In addition, the experience control unit 12 may present to the user products that the robot 20 did not touch, grasp, smell, see, services not received, products that did not receive sales pitches from store clerks, etc. at the previous visit. In advance, information on products handled by each facility is registered in the processing system 10.

[0122] In addition, in response to the robot 20 being located near (within a predetermined distance) a certain facility, the experience control unit 12 may present recommended products and recommended services of the facility to the user. In advance, the recommended products and recommended services of each facility are registered in the processing system 10.

[0123] In addition, the experience control unit 12 may present to the user facilities that the robot 20 has not visited. Then, the experience control unit 12 may present to the user information for introducing the facility. In advance, various information of the facilities existing in the area where the robot 20 is arranged is registered in the processing system 10.

[0124] In addition, the experience control unit 12 may present to the user information for guiding the user to the experience service in response to the user displaying the review results of other users regarding the experience service provided in the area on his or her own terminal device or the like. The user installs, for example, an application regarding the service of the processing system 10 on his or her own terminal device. Then, through this application, the review results of the above user are displayed on the user's own terminal device. The processing system 10 can detect that the user has displayed the review results of other users regarding the experience service provided in the area on his or her own terminal device or the like through the application.

[0125] As described above, the present disclosure has been described with reference to the embodiments. However, the present disclosure is not limited to the above-described embodiments. Various changes that can be understood by those skilled in the art can be made to the configuration and details of the present disclosure within the scope of the present disclosure. And each embodiment can be combined with other embodiments as appropriate.

[0126] Also, in the plurality of flowcharts used in the above description, a plurality of steps (processes) are described in order. However, the execution order of the steps executed in each embodiment is not limited to the described order. In each embodiment, the order of the illustrated steps can be changed within a range that does not interfere with the content.

[0127] Some or all of the above embodiments can be described as follows in the appended claims, but are not limited thereto. 1. A reception unit that receives a user input of operation instruction information for instructing an operation of a robot including an information acquisition unit and a movement unit; Controlling the operation of the robot based on the operation instruction information, and outputting the experience content generated based on the acquisition information acquired by the information acquisition means to the user, an experience control means; Determining a privilege to be provided to the user based on the operation history of the robot, and providing privilege information regarding the determined privilege to the user, a privilege providing means; A processing system having the above. 2. The privilege providing means Identifying the facility visited by the robot, and providing the user with the privilege information regarding the facility, the processing system according to 1. 3. The privilege providing means Identifying at least one of the products touched by the robot, the products grasped by the robot, and the products smelled by the robot, and providing the user with the privilege information regarding the products, the processing system according to 1. 4. The privilege providing means Identifying the service received by the robot, and providing the user with the privilege information regarding the service, the processing system according to 1. 5. The privilege providing means The privilege information available for use in public transportation, and providing the user with the privilege information available for moving to the area where the robot is located or moving from the area where the robot is located, the processing system according to 1. 6. The privilege providing means Providing the user with the privilege information regarding the accommodation facility existing in the area where the robot is located, the processing system according to 1. 7. The privilege providing means Providing the user with the privilege information with an expiration date, the processing system according to any one of 1 to 6. 8. The privilege providing means Further using the preference information of the user registered in advance to determine the privilege to be provided to the user, the processing system according to any one of 1 to 6. 9. One or more computers Receiving a user input of operation instruction information for instructing the operation of a robot equipped with information acquisition means and moving means, Control the operation of the robot based on the operation instruction information, and output the experience content generated based on the acquisition information acquired by the information acquisition means to the user. A processing method for determining a privilege provided to a user based on the operation history of the robot and providing privilege information regarding the determined privilege to the user. 10. A computer A reception means for receiving a user input of operation instruction information for instructing the operation of a robot provided with information acquisition means and movement means, An experience control means for controlling the operation of the robot based on the operation instruction information and outputting the experience content generated based on the acquisition information acquired by the information acquisition means to the user, A privilege providing means for determining a privilege provided to a user based on the operation history of the robot and providing privilege information regarding the determined privilege to the user, A program that functions as

[0128] Part or all of Appendices 2 to 8 that are subordinate to the processing system of Appendix 1 described above may also be subordinate to the processing method of Appendix 9 and the program of Appendix 10 in the same subordinate relationship as between Appendix 1 and Appendices 2 to 8. Further, within the scope not departing from the above-described embodiments, part or all of the configurations described as appendices can be realized in various hardware, software, various recording means for recording software, or systems.

Explanation of Signs

[0129] 10 Processing system 11 Reception unit 12 Experience control unit 13 Privilege providing unit 20 Robot 30 Communication network 40 User interface device 1A Processor 2A Memory 3A Input / output I / F 4A Peripheral circuit 5A Bus

Claims

1. Receiving means for receiving a user input of operation instruction information for instructing the operation of a robot equipped with information acquisition means and movement means; Experience control means for controlling the operation of the robot based on the operation instruction information and outputting experience content generated based on the acquisition information acquired by the information acquisition means to the user; Privilege providing means for determining a privilege to be provided to the user based on the operation history of the robot and providing privilege information regarding the determined privilege to the user; A processing system having the above.

2. The privilege providing means identifies a facility visited by the robot and provides the user with the privilege information regarding the facility. The processing system according to claim 1.

3. The privilege providing means identifies at least one of the products touched by the robot, the products grasped by the robot, and the products smelled by the robot, and provides the user with the privilege information regarding the products. The processing system according to claim 1.

4. The privilege providing means identifies the service received by the robot and provides the user with the privilege information regarding the service. The processing system according to claim 1.

5. The privilege providing means provides the user with the privilege information that can be used in public transportation and that can be used for moving to the area where the robot is located or moving from the area where the robot is located. The processing system according to claim 1.

6. The privilege providing means provides the user with the privilege information regarding the accommodation facilities existing in the area where the robot is located. The processing system according to claim 1.

7. The privilege providing means provides the user with the privilege information with an expiration date. The processing system according to any one of claims 1 to 6.

8. The privilege providing means further uses the preference information of the user registered in advance to determine the privilege to be provided to the user. The processing system according to any one of claims 1 to 6.

9. One or more computers receive a user input of operation instruction information for instructing the operation of a robot equipped with information acquisition means and movement means, control the operation of the robot based on the operation instruction information and output experience content generated based on the acquisition information acquired by the information acquisition means to the user, determine a privilege to be provided to the user based on the operation history of the robot and provide privilege information regarding the determined privilege to the user. A processing method.

10. A program that causes a computer to function as: a reception unit that receives user input of operation instruction information for instructing the operation of a robot including an information acquisition unit and a movement unit; an experience control unit that controls the operation of the robot based on the operation instruction information and outputs experience content generated based on the acquisition information acquired by the information acquisition unit to the user; a privilege providing unit that determines a privilege to be provided to the user based on the operation history of the robot and provides privilege information regarding the determined privilege to the user. ​

Images