Information processing device and program
The information processing apparatus and program address the challenge of prompting users to interact with entertainment robots by generating and controlling mission presentations, resulting in more effective feedback collection and enhanced user satisfaction.
Patent Information
- Application Number
- PCT/JP2024/041649
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2023-12-15
- Filing Date
- 2024-11-25
- Publication Date
- 2025-06-19
AI Technical Summary
Existing technologies do not effectively prompt users to interact with entertainment robots, which hinders the collection of effective feedback for improving user satisfaction.
An information processing apparatus and program that generate and control the presentation of missions to users, encouraging interactions with autonomous mobile bodies such as entertainment robots, and a method for receiving and controlling the presentation of mission information from another device.
The solution enables users to interact appropriately with autonomous mobile bodies, ensuring more even and frequent interactions, which leads to more effective feedback collection and improved user satisfaction.
Smart Images

Figure JP2024041649_19062025_PF_FP_ABST
Abstract
Description
Information processing device and program
[0001] The present technology relates to an information processing device and a program, and in particular to an information processing device and a program that can appropriately prompt a user to interact with an autonomous moving body.
[0002] In recent years, entertainment robots that can interact with users, such as through conversation, have become popular.
[0003] For example, in an entertainment robot, feedback including evaluations of interactions is collected from each user, and the interaction specifications are improved based on the collected feedback to increase user satisfaction. In this case, it is desirable for each user to perform various interactions evenly and frequently in order to collect as much useful feedback as possible.
[0004] Furthermore, a technology has been proposed that uses a game application to encourage users to take actions to improve their health index (see, for example, Patent Document 1).
[0005] International Publication No. 2018 / 163558
[0006] However, the invention described in Patent Document 1 does not consider encouraging users to interact with the entertainment robot.
[0007] The present technology has been made in light of such circumstances, and makes it possible to appropriately encourage users to interact with autonomous moving bodies such as entertainment robots.
[0008] An information processing device according to a first aspect of the present technology includes a mission generation unit that generates a mission that prompts a user to interact with an autonomous moving body, and a presentation control unit that controls presentation of the mission to the user.
[0009] An information processing method according to a second aspect of the present technology includes a communication unit that receives, from another information processing device, mission information relating to a mission that prompts a user to interact with an autonomous moving body, and an output control unit that controls the presentation of the mission based on the mission information.
[0010] A program according to a second aspect of the present technology causes a computer to receive, from another information processing device, mission information relating to a mission that prompts a user to interact with an autonomous moving body, and to execute a process of controlling the presentation of the mission based on the mission information.
[0011] In a first aspect of the present technology, a mission is generated that prompts a user to perform an interaction with an autonomous moving body, and presentation of the mission to the user is controlled.
[0012] In a second aspect of the present technology, mission information regarding a mission that prompts a user to perform an interaction with an autonomous moving body is received from another information processing device, and presentation of the mission is controlled based on the mission information.
[0013] 1 is a block diagram showing an embodiment of an information processing system to which the present technology is applied; FIG. 1 is a front view of an autonomous moving body; FIG. 2 is a rear view of the autonomous moving body; FIG. 3 is a perspective view of the autonomous moving body; FIG. 4 is a side view of the autonomous moving body; FIG. 5 is a top view of the autonomous moving body; FIG. 6 is a bottom view of the autonomous moving body; FIG. 7 is a schematic diagram for describing an internal structure of the autonomous moving body; FIG. 8 is a schematic diagram for describing an internal structure of the autonomous moving body; FIG. 9 is a block diagram showing an example of a functional configuration of the autonomous moving body; FIG. 10 is a block diagram showing an example of a functional configuration implemented by a control unit of the autonomous moving body; FIG. 11 is a block diagram showing an example of a functional configuration of an information processing terminal; FIG. 12 is a block diagram showing an example of a functional configuration of an information processing server; FIG. 13 is a flowchart for describing processing related to a mission; FIG. 14 is a diagram showing an example of a mission list screen; FIG. 15 is a diagram showing an example of a mission details screen; FIG. 16 is a diagram showing an example of a mission details screen; FIG. 17 is a diagram showing an example of a feedback input screen; FIG. 18 is a diagram showing an example of a mission details screen; FIG. 19 is a flowchart for describing normal mission generation processing; FIG. 19 is a diagram showing an example of a weekly mission details screen; FIG. 19 is a diagram showing an example of a feedback input screen; FIG. 19 is a diagram showing an example of a configuration of a computer.
[0014] Hereinafter, embodiments of the present technology will be described. The description will be made in the following order: 1. Embodiment 2. Modification 3. Other
[0015] <<1. Embodiment>> An embodiment of the present technology will be described with reference to FIGS. 1 to 22 .
[0016] <Configuration Example of Information Processing System 1> FIG. 1 is a block diagram showing an embodiment of an information processing system 1 to which the present technology is applied.
[0017] The information processing system 1 includes autonomous mobile bodies 11-1 to 11-n, information processing terminals 12-1 to 12-n, and an information processing server 13.
[0018] Hereinafter, when there is no need to distinguish between the autonomous mobile bodies 11-1 to 11-n, they will simply be referred to as the autonomous mobile body 11. Hereinafter, when there is no need to distinguish between the information processing terminals 12-1 to 12-n, they will simply be referred to as the information processing terminals 12.
[0019] Communication is possible between each autonomous mobile body 11 and the information processing server 13, between each information processing terminal 12 and the information processing server 13, between each autonomous mobile body 11 and each information processing terminal 12, between each autonomous mobile body 11, and between each information processing terminal 12 via the network 21. In addition, direct communication is also possible between each autonomous mobile body 11 and each information processing terminal 12, between each autonomous mobile body 11, and between each information processing terminal 12 without going through the network 21.
[0020] The autonomous mobile object 11 is an information processing device that performs autonomous operation without being controlled by the information processing terminal 12 and the information processing server 13, or by being controlled by the information processing terminal 12 or the information processing server 13. The autonomous mobile object 11 is also an agent device that enables interaction with a user (e.g., conversation, physical contact, etc.) to be realized more naturally and effectively.
[0021] The autonomous mobile body 11 is an information processing device that recognizes its own and its surrounding situations based on collected sensing data, etc., and autonomously selects and executes various actions according to the situation. Unlike a robot that simply acts in accordance with user instructions, one of the features of the autonomous mobile body 11 is that it autonomously executes appropriate actions according to the situation.
[0022] The autonomous mobile body 11 can, for example, perform user recognition, object recognition, etc. based on captured images, and perform various autonomous actions according to the recognized user, object, etc. The autonomous mobile body 11 can also, for example, perform voice recognition based on the user's speech, and perform actions based on the user's instructions, etc.
[0023] Furthermore, the autonomous mobile body 11 performs pattern recognition learning to acquire the ability to recognize users and objects. In this case, the autonomous mobile body 11 can perform pattern recognition learning related to objects, etc., not only by supervised learning based on given learning data, but also by dynamically collecting learning data based on instructions from a user, etc.
[0024] Furthermore, the autonomous moving body 11 can be disciplined by a user. Here, the discipline of the autonomous moving body 11 is broader than, for example, general discipline in which the autonomous moving body 11 is taught rules and prohibited actions and made to memorize them, and refers to changes in the autonomous moving body 11 that the user can sense as a result of the user's interaction with the autonomous moving body 11.
[0025] Furthermore, the autonomous mobile body 11 can express its own state and communicate with a user or other autonomous mobile bodies by outputting output sounds. The output sounds of the autonomous mobile body 11 include operation sounds that are output in response to the state of the autonomous mobile body 11, and speech sounds for communicating with a user, other autonomous mobile bodies, etc.
[0026] The shape, capabilities, desires, and other levels of the autonomous mobile body 11 can be designed as appropriate depending on the purpose and role. For example, the autonomous mobile body 11 is configured as an autonomous mobile robot that autonomously moves within a space and performs various actions.
[0027] Specifically, for example, the autonomous mobile body 11 may be composed of various types of robots, such as a running type, a walking type, a flying type, a swimming type, etc. For example, the autonomous mobile body 11 may be composed of an autonomous mobile robot that has a shape and behavioral capabilities that mimic those of an animal such as a human or a dog. For example, the autonomous mobile body 11 may be composed of a vehicle or other device that has the ability to interact with a user.
[0028] The information processing terminal 12 is, for example, a smartphone, a tablet terminal, a PC (personal computer), or the like, and is used by the user of the autonomous mobile body 11. The information processing terminal 12 realizes various functions by executing a predetermined application program (hereinafter simply referred to as an application). For example, the information processing terminal 12 manages and customizes the autonomous mobile body 11 by executing the predetermined application.
[0029] For example, the information processing terminal 12 communicates with the information processing server 13 via the network 21 or directly with the autonomous mobile body 11 to collect various data related to the autonomous mobile body 11, present the data to the user, or give instructions to the autonomous mobile body 11.
[0030] The information processing server 13, for example, collects various types of data from each autonomous mobile body 11 and each information processing terminal 12, provides various types of data to each autonomous mobile body 11 and each information processing terminal 12, and controls the behavior of each autonomous mobile body 11. Furthermore, for example, the information processing server 13 can perform pattern recognition learning and processing corresponding to user discipline, similar to the autonomous mobile body 11, based on the data collected from each autonomous mobile body 11 and each information processing terminal 12. Furthermore, for example, the information processing server 13 supplies each information processing terminal 12 with the above-mentioned applications and various types of data related to each autonomous mobile body 11.
[0031] The network 21 may be composed of, for example, public networks such as the Internet, telephone networks, and satellite communication networks, various LANs (Local Area Networks) including Ethernet (registered trademark), and WANs (Wide Area Networks). The network 21 may also include dedicated network such as an IP-VPN (Internet Protocol-Virtual Private Network). The network 21 may also include wireless communication networks such as Wi-Fi (registered trademark) and Bluetooth (registered trademark).
[0032] The configuration of the information processing system 1 can be flexibly changed depending on the specifications, operation, etc. For example, the autonomous mobile body 11 may communicate information with various external devices in addition to the information processing terminal 12 and the information processing server 13. The above external devices can include, for example, servers that transmit weather, news, and other service information, and various home appliances owned by the user.
[0033] Furthermore, for example, the autonomous mobile bodies 11 and the information processing terminals 12 do not necessarily have to have a one-to-one relationship, and may have, for example, a many-to-many, many-to-one, or one-to-many relationship. For example, one user can use one information processing terminal 12 to check data related to multiple autonomous mobile bodies 11, or can use multiple information processing terminals to check data related to one autonomous mobile body 11.
[0034] <Configuration Example of Autonomous Mobile Body 11> Next, a configuration example of the autonomous mobile body 11 will be described with reference to FIGS. 2 to 11. The autonomous mobile body 11 can be various devices that perform autonomous operation based on environmental recognition. In the following, a case will be described in which the autonomous mobile body 11 is an agent-type robot device with an oblong shape that travels autonomously on wheels. The autonomous mobile body 11 performs autonomous operation according to, for example, the user, the surroundings, and its own situation, thereby realizing various interactions including information presentation. The autonomous mobile body 11 is, for example, a small robot that is large and heavy enough to be easily lifted by a user with one hand.
[0035] <Examples of Exterior of Autonomous Moving Body 11> First, examples of exterior of the autonomous moving body 11 will be described with reference to FIGS. 2 to 7 .
[0036] Fig. 2 is a front view of the autonomous mobile body 11, and Fig. 3 is a rear view of the autonomous mobile body 11. Figs. 4A and 4B are perspective views of the autonomous mobile body 11. Fig. 5 is a side view of the autonomous mobile body 11. Fig. 6 is a top view of the autonomous mobile body 11. Fig. 7 is a bottom view of the autonomous mobile body 11.
[0037] 2 to 6 , the autonomous moving body 11 is provided with eye units 101L and 101R corresponding to the left and right eyes on the upper part of the main body. The eye units 101L and 101R are realized by, for example, LEDs and can express gaze, blinking, etc. Note that the eye units 101L and 101R are not limited to the above example and may be realized by, for example, a single or two independent OLEDs (Organic Light Emitting Diodes).
[0038] The autonomous moving body 11 also includes cameras 102L and 102R above the eye units 101L and 101R. The cameras 102L and 102R have the function of capturing images of the user and the surrounding environment. In this case, the autonomous moving body 11 may implement simultaneous localization and mapping (SLAM) based on the images captured by the cameras 102L and 102R.
[0039] The eye 101L, the eye 101R, the camera 102L, and the camera 102R are disposed on a substrate (not shown) disposed inside the exterior surface. The exterior surface of the autonomous mobile body 11 is basically formed using an opaque material, but a head cover 104 made of a transparent or translucent material is provided in the portion corresponding to the substrate on which the eye 101L, the eye 101R, the camera 102L, and the camera 102R are disposed. This allows the user to recognize the eye 101L and the eye 101R of the autonomous mobile body 11, and the autonomous mobile body 11 can capture images of the outside world.
[0040] 2, 4, and 7, the autonomous moving body 11 is equipped with a time-of-flight (ToF) sensor 103 at the bottom of the front face. The ToF sensor 103 has a function of detecting the distance to an object present in front. The ToF sensor 103 enables the autonomous moving body 11 to, for example, accurately detect the distance to various objects and detect steps and the like to prevent the autonomous moving body 11 from falling or tipping over.
[0041] 3, 5, etc., the autonomous moving body 11 is provided on its rear surface with a connection terminal 105 for an external device and a power switch 106. The autonomous moving body 11 can connect to an external device via the connection terminal 105 and perform information communication, for example.
[0042] 7, the autonomous mobile body 11 is provided with wheels 107L and 107R on its bottom surface. The wheels 107L and 107R are driven by different motors (not shown). This allows the autonomous mobile body 11 to perform moving operations such as moving forward, backward, turning, and rotating.
[0043] The wheels 107L and 107R can be stored inside the main body and can be protruded to the outside. For example, the autonomous mobile body 11 can perform a jumping motion by forcefully protruding the wheels 107L and 107R to the outside. Note that FIG. 7 shows a state in which the wheels 107L and 107R are stored inside the main body.
[0044] In the following, when there is no need to distinguish between the eye unit 101L and the eye unit 101R, they will simply be referred to as the eye unit 101. In the following, when there is no need to distinguish between the camera 102L and the camera 102R, they will simply be referred to as the camera 102. In the following, when there is no need to distinguish between the wheel 107L and the wheel 107R, they will simply be referred to as the wheel 107.
[0045] <Example of Internal Structure of Autonomous Moving Body 11> FIGS. 8 and 9 are schematic diagrams showing the internal structure of the autonomous moving body 11. FIG.
[0046] 8, the autonomous moving body 11 includes an inertial sensor 121 and a communication device 122 arranged on an electronic board. The inertial sensor 121 detects the acceleration and angular velocity of the autonomous moving body 11. The communication device 122 is configured to realize wireless communication with the outside, and includes, for example, a Bluetooth or Wi-Fi antenna.
[0047] The autonomous moving body 11 also includes a speaker 123, for example, inside the side surface of the main body. The autonomous moving body 11 can output various sounds using the speaker 123.
[0048] 9 , the autonomous mobile body 11 is provided with a microphone 124L, a microphone 124M, and a microphone 124R inside the upper part of the main body. The microphones 124L, 124M, and 124R collect the user's speech and surrounding environmental sounds. By providing the autonomous mobile body 11 with multiple microphones 124L, 124M, and 124R, it is possible to collect sounds generated in the surrounding area with high sensitivity and detect the position of the sound source.
[0049] 8 and 9, the autonomous mobile body 11 is equipped with motors 125A to 125E (however, motor 125E is not shown). Motor 125A and motor 125B, for example, drive a substrate on which the eye unit 101 and camera 102 are disposed in the vertical and horizontal directions. Motor 125C realizes a forward tilt posture of the autonomous mobile body 11. Motor 125D drives wheel 107L. Motor 125E drives wheel 107R. Motors 125A to 125E enable the autonomous mobile body 11 to express a wide range of movements.
[0050] In the following description, when it is not necessary to distinguish between the microphones 124L to 124R, they will be simply referred to as microphones 124. In the following description, when it is not necessary to distinguish between the motors 125A to 125E, they will be simply referred to as motors 125.
[0051] 10 shows an example of the functional configuration of the autonomous mobile body 11. The autonomous mobile body 11 includes a control unit 201, a sensor unit 202, an input unit 203, a memory unit 204, a light source 205, a sound output unit 206, a drive unit 207, and a communication unit 208.
[0052] The control unit 201 has a function of controlling each component of the autonomous mobile body 11. For example, the control unit 201 controls the activation and deactivation of each component. The control unit 201 also supplies control signals received from the information processing server 13 to the light source 205, sound output unit 206, and drive unit 207.
[0053] The sensor unit 202 has a function of collecting various data related to the user and the surrounding conditions. For example, the sensor unit 202 includes the above-mentioned camera 102, ToF sensor 103, inertial sensor 121, microphone 124, etc. In addition to the above-mentioned sensors, the sensor unit 202 may also include various other sensors, such as a geomagnetic sensor, a touch sensor, various optical sensors including an IR (infrared) sensor, a temperature sensor, a humidity sensor, etc. The sensor unit 202 supplies sensor data output from each sensor to the control unit 201.
[0054] The input unit 203 includes, for example, buttons and switches such as the power switch 106 described above, and detects physical input operations by the user.
[0055] The storage unit 204 stores various programs and data necessary for the processing of the autonomous moving body 11 .
[0056] The light source 205 includes, for example, the above-described eye unit 101 and expresses the eye movement of the autonomous moving body 11 .
[0057] The sound output unit 206 includes, for example, the above-mentioned speaker 123 and an amplifier, and outputs an output sound based on the output sound data supplied from the control unit 201 .
[0058] The drive unit 207 includes, for example, the wheels 107 and the motor 125 described above, and is used to express the body movement of the autonomous mobile body 11 .
[0059] The communication unit 208 includes, for example, the above-mentioned connection terminal 105 and communication device 122, and communicates with the information processing terminal 12, the information processing server 13, and other external devices.
[0060] <Configuration Example of Information Processing Unit 241> FIG. 11 shows a configuration example of the information processing unit 241 that is realized by the control unit 201 of the autonomous moving body 11 executing a predetermined control program.
[0061] The information processing unit 241 includes a recognition unit 251 , an action planning unit 252 , a motion control unit 253 , and a sound control unit 254 .
[0062] The recognition unit 251 has a function of recognizing the user and environment around the autonomous mobile body 11 and various information related to the autonomous mobile body 11 based on sensor data supplied from the sensor unit 202.
[0063] For example, the recognition unit 251 performs user identification, recognition of the user's facial expression and gaze, object recognition, color recognition, shape recognition, marker recognition, obstacle recognition, step recognition, brightness recognition, recognition of stimuli to the autonomous mobile body 11, etc. For example, the recognition unit 251 performs emotion recognition related to the user's voice, word understanding, recognition of the position of a sound source, etc. For example, the recognition unit 251 recognizes the ambient temperature, the presence of an animal, the posture and movement of the autonomous mobile body 11, etc. For example, the recognition unit 251 recognizes a device combined with the autonomous mobile body 11 (hereinafter referred to as a combined device).
[0064] Examples of the autonomous mobile body 11 being combined with a combination device include when one of the autonomous mobile body 11 and the combination device is attached to the other, when one of the autonomous mobile body 11 and the combination device rides on the other, when the autonomous mobile body 11 and the combination device are combined, etc. Examples of the combination device include parts that can be attached to and detached from the autonomous mobile body 11 (hereinafter referred to as optional parts), a vehicle on which the autonomous mobile body 11 can ride (hereinafter referred to as a boarding vehicle), and a device to which the autonomous mobile body 11 can be attached and detached (hereinafter referred to as an attachment device).
[0065] Possible optional parts include, for example, parts that resemble parts of an animal's body (e.g., eyes, ears, nose, mouth, beak, horns, tail, wings, etc.), costumes, mascot costumes, parts that extend the functions and capabilities of the autonomous mobile body 11 (e.g., medals, weapons, etc.), wheels, caterpillar tracks, etc. Possible ride-on mobile bodies include, for example, cars, drones, robot vacuum cleaners, etc. Possible attachment devices include, for example, combined robots composed of multiple parts including the autonomous mobile body 11.
[0066] The combined device does not necessarily have to be a device dedicated to the autonomous moving body 11, but may be, for example, a general-purpose device.
[0067] The recognition unit 251 also has a function of estimating and understanding the environment and situation in which the autonomous moving body 11 is placed, based on the recognized information. In this case, the recognition unit 251 may perform comprehensive situation estimation using environmental knowledge stored in advance.
[0068] The recognition unit 251 supplies data indicating the recognition result to the action planning unit 252 , the motion control unit 253 , and the sound control unit 254 .
[0069] The behavior planning unit 252 sets an operation mode that defines the operation of the autonomous mobile body 11 based on the recognition result by the recognition unit 251, for example, the recognition result of the combined device by the recognition unit 251. The behavior planning unit 252 also has a function of planning the behavior to be performed by the autonomous mobile body 11 based on, for example, the recognition result by the recognition unit 251, the operation mode, and learning knowledge. Furthermore, the behavior planning unit 252 executes the behavior plan using, for example, a machine learning algorithm such as deep learning. The behavior planning unit 252 supplies the operation data and data indicating the behavior plan to the operation control unit 253 and the sound control unit 254.
[0070] The operation control unit 253 controls the operation of the autonomous mobile body 11 by controlling the light source 205 and the drive unit 207 based on the recognition result by the recognition unit 251, the action plan by the action planning unit 252, and the operation mode. The operation control unit 253, for example, causes the autonomous mobile body 11 to move while maintaining a forward leaning posture, or to perform forward and backward movement, turning movement, rotational movement, etc. The operation control unit 253 also causes the autonomous mobile body 11 to actively perform an inducement action that induces interaction between the user and the autonomous mobile body 11. The operation control unit 253 also supplies information regarding the operation being performed by the autonomous mobile body 11 to the sound control unit 254.
[0071] In addition, the operation control unit 253 transmits information regarding the operation of the autonomous mobile body 11 (e.g., the operation history of the autonomous mobile body 11) to the information processing terminal 12 and the information processing server 13 via the communication unit 208 and, if necessary, the network 21.
[0072] The sound control unit 254 controls the output sound by controlling the sound output unit 206 based on the recognition result by the recognition unit 251, the action plan by the action planning unit 252, and the operation mode. For example, the sound control unit 254 sets a control method for the output sound based on the operation mode, etc., and controls the output sound (e.g., control of the content of the output sound to be generated and the output timing of the output sound, etc.) based on the set control method. The sound control unit 254 then generates output sound data for outputting the output sound and supplies it to the sound output unit 206. The sound control unit 254 also supplies information regarding the output sound being output by the autonomous mobile body 11 to the operation control unit 253.
[0073] <Example of Functional Configuration of Information Processing Terminal 12> FIG. 12 shows an example of the functional configuration of the information processing terminal 12. As shown in FIG.
[0074] The information processing terminal 12 includes an input unit 301 , a communication unit 302 , an information processing unit 303 , an output unit 304 , and a storage unit 305 .
[0075] The input unit 301 includes an input device for a user to input data, instructions, etc. For example, the input unit 301 includes a touch panel, buttons, switches, etc.
[0076] The communication unit 302 communicates with the autonomous mobile body 11 and the information processing server 13 via the network 21 , and also communicates directly with the autonomous mobile body 11 without going through the network 21 .
[0077] The information processing unit 303 includes a mobile object control unit 311 , an output control unit 312 , and an information generation unit 313 .
[0078] The mobile object control unit 311 includes a recognition unit 321, a behavior planning unit 322, a motion control unit 323, and a sound control unit 324. The recognition unit 321, the behavior planning unit 322, the motion control unit 323, and the sound control unit 324 have the same functions as the recognition unit 251, the behavior planning unit 252, the motion control unit 253, and the sound control unit 254 of the autonomous mobile object 11. In other words, the recognition unit 321, the behavior planning unit 322, the motion control unit 323, and the sound control unit 324 can perform various processes in place of the recognition unit 251, the behavior planning unit 252, the motion control unit 253, and the sound control unit 254 of the autonomous mobile object 11.
[0079] This allows the information processing terminal 12 to remotely control the autonomous mobile body 11, and the autonomous mobile body 11 can perform various operations and output various output sounds under the control of the information processing terminal 12.
[0080] The output control unit 312 controls the output of various types of information (for example, visual information, auditory information, tactile information, etc.) from the output unit 304.
[0081] The information generation unit 313 generates various types of information and transmits the information to the autonomous moving body 11 or the information processing server 13 as necessary.
[0082] The output unit 304 includes an output device that outputs various types of information (for example, visual information, auditory information, tactile information, etc.) For example, the output unit 304 includes a display device, a speaker, a haptic element, etc.
[0083] The storage unit 305 stores program data and the like necessary for processing by the information processing terminal 12 .
[0084] <Example of Functional Configuration of Information Processing Server 13> FIG. 13 shows an example of the functional configuration of the information processing server 13. As shown in FIG.
[0085] The information processing server 13 includes a communication unit 401 , an information processing unit 402 , an interaction history DB 403 , a mission implementation status DB 404 , a feedback DB 405 , and a storage unit 406 .
[0086] The communication unit 401 communicates with the autonomous moving body 11 and the information processing terminal 12 via the network 21 .
[0087] The information processing unit 402 includes a mobile unit control unit 411 , a mission control unit 412 , and a learning unit 413 .
[0088] The mobile object control unit 411 includes a recognition unit 421, a behavior planning unit 422, a motion control unit 423, and a sound control unit 424. The recognition unit 421, the behavior planning unit 422, the motion control unit 423, and the sound control unit 424 have the same functions as the recognition unit 251, the behavior planning unit 252, the motion control unit 253, and the sound control unit 254 of the autonomous mobile object 11. In other words, the recognition unit 421, the behavior planning unit 422, the motion control unit 423, and the sound control unit 424 can perform various processes in place of the recognition unit 251, the behavior planning unit 252, the motion control unit 253, and the sound control unit 254 of the autonomous mobile object 11.
[0089] This allows the information processing server 13 to remotely control the autonomous mobile body 11, and the autonomous mobile body 11 can perform various operations and output various output sounds under the control of the information processing server 13.
[0090] The mission control unit 412 controls processing related to missions given to each user. Missions are given to users, for example, to encourage interaction with the autonomous mobile body 11, and details will be described later. The mission control unit 412 includes a mission generation unit 431, an implementation status detection unit 432, a presentation control unit 433, and a feedback acquisition unit 434.
[0091] The mission generation unit 431 generates a mission to be given to a user based on the interaction history of each user stored in the interaction history DB 403. The mission generation unit 431 supplies information about the generated mission to the presentation control unit 433.
[0092] The implementation status detection unit 432 detects the implementation status of each user's mission based on the interaction history of each user stored in the interaction history DB 403. The implementation status detection unit 432 supplies information indicating the detection result of the implementation status of each user's mission to the presentation control unit 433, or stores the information in the mission implementation status DB 404.
[0093] The presentation control unit 433 controls the presentation of the missions and the progress status of the missions on the information processing terminal 12. For example, the presentation control unit 433 generates mission information including the content of the missions to be assigned to the user and the progress status of the missions by the user, and transmits the information processing terminal 12 via the communication unit 401 and the network 21. In this way, the presentation of the missions assigned to the user and the progress status of the missions is controlled on the information processing terminal 12.
[0094] The feedback acquisition unit 434 acquires feedback including an evaluation of each user's mission. For example, the feedback acquisition unit 434 receives feedback information including the user's evaluation of the mission via the network 21 and the communication unit 401, and stores the received feedback information in the feedback DB 405.
[0095] The learning unit 413, for example, executes a learning process related to the operation of the autonomous mobile body 11. For example, the learning unit 413 executes the learning process based on the feedback information of each user stored in the feedback DB 405, and improves the interaction specifications of the autonomous mobile body 11.
[0096] The interaction history DB 403 stores an interaction history indicating the history of interactions between each user and the autonomous mobile body 11. The interaction history includes, for example, identification information of the user (e.g., a user ID, etc.), identification information of the autonomous mobile body 11 (e.g., an ID of the autonomous mobile body 11), the date and time of the interaction, the content of the interaction, etc.
[0097] The mission implementation status DB 404 stores information about the implementation status of each user's mission detected by the implementation status detection unit 432. The information about the implementation status of the mission includes, for example, the user's identification information, the autonomous moving body 11's identification information, the date and time of the mission, the content of the mission, etc.
[0098] The feedback DB 405 stores feedback information from each user acquired by the feedback acquisition unit 434. The feedback information includes, for example, user identification information, autonomous mobile body 11 identification information, the date and time when the feedback was acquired, the content of the mission that is the subject of the feedback, and the user's evaluation of the mission.
[0099] The storage unit 406 stores various programs and data required for the processing of the information processing server 13 .
[0100] <Processing Related to Mission> Next, processing related to a mission executed by the information processing system 1 will be described with reference to the flowchart of FIG.
[0101] In step S1, the information processing terminal 12 requests information about the mission.
[0102] For example, the user uses the input unit 301 to perform an operation to present information about the mission.
[0103] In response to this, the input unit 301 instructs the information processing unit 303 to present information related to the mission. The output control unit 312 of the information processing unit 303 generates a mission information request signal requesting information related to the mission, and transmits the signal to the information processing server 13 via the communication unit 302 and the network 21.
[0104] In response to this, in step S11, the information processing server 13 generates a mission. Specifically, the information processing unit 402 receives a mission information request signal via the network 21 and the communication unit 401. The mission generation unit 431 generates at least one of a normal mission, a daily mission, and a weekly mission based on the mission information request signal.
[0105] A normal mission is, for example, a mission given to a user to help the user learn how to use the autonomous mobile body 11 and how to interact with the autonomous mobile body 11. For example, as will be described later with reference to FIG. 20 , a normal mission is generated for each user based on the implementation status of the user's interaction with the autonomous mobile body 11.
[0106] The daily mission is a mission for ensuring daily active users (DAU) by having users interact with the autonomous mobile body 11 every day. For example, a common daily mission is given to all users on a daily basis from among a predetermined number of types of simple missions.
[0107] The weekly mission is, for example, a mission for testing purposes, such as changing the behavior of the autonomous mobile body 11 for a predetermined period (e.g., one week) and observing the user's reaction. For example, during the period for which the weekly mission is assigned, the autonomous mobile body 11 will talk more than usual. For example, the weekly mission is assigned to all users in common.
[0108] The mission generation unit 431 supplies information about the generated mission to the presentation control unit 433. The information about the mission includes, for example, the content, method, difficulty, etc. of the mission.
[0109] In step S12, the implementation status detection unit 432 detects the implementation status of the missions. For example, the implementation status detection unit 432 detects the implementation status of the user's past missions based on the user's interaction history stored in the interaction history DB 403. For example, the implementation status detection unit 432 detects whether each mission was completed, the date and time of completion, etc. The implementation status detection unit 432 supplies information indicating the detection result of the user's mission implementation status to the presentation control unit 433.
[0110] In step S13, the presentation control unit 433 transmits information related to the mission. For example, the presentation control unit 433 generates mission information including information related to the mission for the user. The mission information includes, for example, information related to the mission to be assigned to the user and the user's implementation status of the mission. The presentation control unit 433 transmits the mission information to the user's information processing terminal 12 via the communication unit 401 and the network 21.
[0111] In response to this, in step S2, the information processing terminal 12 presents a mission. Specifically, the information processing unit 303 receives the mission information via the network 21 and the communication unit 302. For example, the output control unit 312 causes the output unit 304 to display the mission list screen of FIG. 15 based on the mission information.
[0112] A and B of Fig. 15 show one mission list screen. Fig. 15A shows the mission list screen from the top to the middle, and Fig. 15B shows the mission list screen from the middle to the bottom. Note that the screen of Fig. 15A and the screen of Fig. 15B partially overlap.
[0113] The mission list screen includes a guide button 501, a title column 502, a daily mission column 503, a mission waiting for evaluation column 504, an incomplete mission column 505, and a completed mission column 506. The title column 502, the daily mission column 503, the mission waiting for evaluation column 504, the incomplete mission column 505, and the completed mission column 506 are arranged vertically.
[0114] When the guide button 501 is pressed, a guide screen (not shown) for explaining the concept of the mission and the like is displayed.
[0115] The title column 502 displays information about titles given to the user.
[0116] Titles are awarded based on the user's mission completion status. For example, titles are awarded based on the number of normal missions the user has completed. In other words, the more normal missions the user has completed, the higher the title rank. Note that the higher the title rank, the more difficult it is to increase the rank. For example, the higher the title rank, the more normal missions the user must complete in order to increase the rank.
[0117] The title column 502 displays the name of the title given to the user and information indicating the number of completed missions. The background of the title column 502 changes depending on the title given to the user.
[0118] The daily mission column 503 displays the contents of the daily mission given to the user today and information regarding the user's progress in completing the daily mission.
[0119] In this example, a daily mission to "poke the robot" is given.
[0120] The status of daily missions for the past week, including today, is also displayed. Specifically, an icon is displayed on days when daily missions have been completed, and no icon is displayed on days when daily missions have not been completed.
[0121] The missions waiting for evaluation column 504, the unexecuted missions column 505, and the completed missions column 506 are columns that show information about normal missions.
[0122] Information about missions awaiting evaluation is displayed in the mission awaiting evaluation field 504. A mission awaiting evaluation is a normal mission that has already been completed but for which feedback has not yet been provided. The mission awaiting evaluation field 504 displays the name or summary of the mission awaiting evaluation together with an icon indicating that it is awaiting evaluation.
[0123] The unexecuted mission column 505 displays information about unexecuted missions. Unexecuted missions are normal missions that have not yet been executed. The unexecuted mission column 505 displays the name or summary of the unexecuted mission along with an icon. The design of the icon changes depending on the difficulty level of the unexecuted mission. For example, an icon corresponding to an unexecuted mission of low difficulty is copper-colored and displays one star in the center. An icon corresponding to an unexecuted mission of medium difficulty is silver-colored and displays two stars in the center. An icon corresponding to an unexecuted mission of high difficulty is gold-colored and displays three stars in the center.
[0124] In addition, a new arrival badge 507 is displayed in the upper right corner of the icon corresponding to a new, unexecuted mission. A new, unexecuted mission is a normal mission that has not yet been executed and for which detailed information has not yet been confirmed (displayed) by the user.
[0125] The completed mission column 506 displays information about completed missions. A completed mission is a normal mission that has been performed and for which feedback has been provided, in other words, a normal mission that has been achieved. The completed mission column 506 displays the name or summary of the completed mission along with an icon. The design of the icon changes depending on the difficulty level of the completed mission. For example, an icon corresponding to a completed mission with a low level of difficulty is copper, an icon corresponding to a completed mission with a medium level of difficulty is silver, and an icon corresponding to a normal mission with a high level of difficulty is gold.
[0126] In this way, unexecuted missions, missions waiting for evaluation, and completed missions are displayed in a distinguishable manner.
[0127] For example, when one of the icons in the unexecuted mission column 505 is pressed, a mission details screen for the normal mission (unexecuted mission) corresponding to the pressed icon is displayed, as shown in FIG. 16A.
[0128] The mission details screen in FIG. 16A includes a summary field 521 , a hint field 522 , and a button 523 .
[0129] The summary section 521 displays an icon indicating the difficulty level of the normal mission, the name of the normal mission, and a brief description.
[0130] The hint column 522 displays hints predicting how to complete a normal mission.
[0131] When the button 523 in the hint column 522 is pressed, the mission details screen of FIG. 16B is displayed.
[0132] The mission details screen in Figure 16B is different from the mission details screen in Figure 16A in that it includes an overview column 521, but it includes a guidance column 531 instead of the hint column 522 and button 523.
[0133] Guidance showing how to perform a normal mission is displayed in the guidance field 531. For example, a video showing the steps of the normal mission and the specific content of each step is displayed.
[0134] For example, the user performs a daily mission or a normal mission by referring to the screens of Fig. 15 and 16. By performing the daily mission or the normal mission, the user performs an interaction with the autonomous moving body 11 that is a condition for accomplishing the mission.
[0135] In response to this, the operation control unit 253 of the autonomous mobile body 11 transmits information about the interaction performed by the user (hereinafter referred to as interaction performance information) to the information processing server 13 via the communication unit 208 and the network 21 .
[0136] The interaction implementation information includes, for example, the user's identification information, the autonomous moving body 11's identification information, the date and time when the interaction was implemented, and the content of the interaction.
[0137] In response to this, the information processing unit 402 of the information processing server 13 receives the interaction implementation information via the network 21 and the communication unit 401. The information processing unit 402 updates the user's interaction history stored in the interaction history DB 403 based on the interaction implementation information.
[0138] Details of the weekly mission will be described later with reference to FIGS.
[0139] In step S3, the information processing terminal 12 transmits feedback.
[0140] For example, when the user wants to provide feedback on an evaluation of a completed normal mission, the user presses the icon corresponding to the mission waiting for evaluation that the user wants to evaluate in the mission waiting for evaluation column 504 on the mission list screen of FIG.
[0141] In response to this, as shown in FIG. 17, a mission details screen for the normal mission (mission waiting for evaluation) corresponding to the pressed icon is displayed.
[0142] The mission details screen of FIG. 17 is the same as the mission details screen of FIG. 16B in that it includes a guidance column 531, but differs in that it includes a summary column 551 instead of the summary column 521.
[0143] For example, the summary column 551 differs from the summary column 521 in that it includes a button 552. The summary column 551 also displays the implementation date of the mission awaiting evaluation.
[0144] For example, when button 552 is pressed, the feedback input screen of FIG. 18A is displayed.
[0145] The feedback input screen in FIG. 18A includes an evaluation input field 571 and buttons 572 to 574 .
[0146] The evaluation input field 571 is a field where the user inputs an evaluation of the normal mission. For example, the user evaluates on a four-point scale from 1 to 4 whether the normal mission will enable the user to become closer to the autonomous mobile body 11. For example, if the user thinks that they will not be able to become very close to the autonomous mobile body 11, the user selects 1, and if they think that they will become very close to the autonomous mobile body 11, the user selects 4. Furthermore, if the user finds it difficult to rate on a four-point scale, the user selects button 572.
[0147] When button 573 is pressed, the feedback input screen is closed.
[0148] When button 574 is pressed, the feedback input screen of FIG. 18B is displayed.
[0149] The feedback input screen in FIG. 18B includes a comment field 581 , a button 582 , and a button 583 .
[0150] The user can freely enter comments about the normal mission in the comment field 581.
[0151] When the button 582 is pressed, the feedback input screen of FIG. 18A is displayed.
[0152] When the button 583 is pressed, the evaluation of the normal mission input by the user is finalized. In other words, the evaluation of the interaction with the autonomous moving body 11 performed by the user through the normal mission is finalized.
[0153] Then, the mission details screen of FIG. 19 is displayed.
[0154] The mission details screen of FIG. 19 is the same as the mission details screen of FIG. 17 in that it includes a guidance column 531, but differs in that it includes a summary column 601 instead of the summary column 551.
[0155] For example, summary section 601 differs from summary section 551 in that it includes button 602 instead of button 542 .
[0156] When the button 602 is pressed, for example, a list screen (not shown) of completed (achieved) missions is displayed.
[0157] For example, when button 583 is pressed on the feedback input screen of FIG. 18B, the information generation unit 313 generates feedback information that includes an evaluation of the normal mission that has been input via the feedback input screen and confirmed.
[0158] The feedback information includes, for example, identification information of the user, identification information of the autonomous moving body 11, information indicating the normal mission that is the subject of the feedback, and an evaluation of the normal mission.
[0159] The information generation unit 313 transmits the feedback information to the information processing server 13 via the communication unit 302 and the network 21 .
[0160] Thereafter, the processing of the information processing terminal 12 ends.
[0161] In response to this, in step S14, the information processing server 13 accumulates the feedback. Specifically, the feedback acquisition unit 434 receives the feedback information via the network 21 and the communication unit 401. The feedback acquisition unit 434 stores the received feedback information in the feedback DB 405.
[0162] Thereafter, the processing of the information processing server 13 ends.
[0163] For example, the feedback information accumulated in the feedback DB 405 is fed back to the developer or operator of the autonomous mobile body 11. For example, the developer or operator can evaluate the user experience for the interaction performed through the normal mission based on the feedback information and improve the interaction specifications of the autonomous mobile body 11, etc.
[0164] For example, the feedback information accumulated in the feedback DB 405 is used for learning processing by the learning unit 413. For example, the learning unit 413 performs learning processing such as machine learning using the feedback information, and improves the interaction specifications of the autonomous mobile body 11 so as to receive higher ratings from users.
[0165] This improves the user's satisfaction with the autonomous moving body 11.
[0166] <Normal Mission Generation Processing> Next, the normal mission generation processing executed by the information processing server 13 in step S11 of FIG. 14 will be described with reference to the flowchart of FIG.
[0167] In step S51, the mission generation unit 431 determines whether or not there is an insufficient conversation with the autonomous mobile body 11, based on the user's interaction history stored in the interaction history DB 403. For example, if the user's conversation with the autonomous mobile body 11 over the past three days has been less than 30 turns, the mission generation unit 431 determines that there is an insufficient conversation with the autonomous mobile body 11, and the processing proceeds to step S52.
[0168] In step S52, the mission generation unit 431 generates a mission (hereinafter referred to as a conversation mission) the achievement condition of which is to have a conversation with the autonomous moving body 11. For example, a mission such as "try to continue the conversation for 10 turns" is generated.
[0169] After that, the normal mission generation process ends.
[0170] On the other hand, in step S51, for example, if the user has had 30 or more turns of conversation with the autonomous mobile body 11 over the past three days, the mission generation unit 431 determines that there is not a shortage of conversation with the autonomous mobile body 11, and processing proceeds to step S53.
[0171] In step S53, the mission generation unit 431 determines whether or not the user has not stroked the autonomous moving body 11 enough, based on the user's interaction history stored in the interaction history DB 403. For example, if the user has not stroked the autonomous moving body 11 in the past three days, the mission generation unit 431 determines that the user has not stroked the autonomous moving body 11 enough, and the processing proceeds to step S54.
[0172] In step S54, the mission generation unit 431 generates a mission (hereinafter referred to as a touch mission) whose achievement condition is to stroke the autonomous moving body 11.
[0173] After that, the normal mission generation process ends.
[0174] On the other hand, in step S53, for example, if the user has stroked the autonomous moving body 11 in the past three days, the mission generation unit 431 determines that the act of stroking the autonomous moving body 11 is not lacking, and the processing proceeds to step S55.
[0175] In step S55, the mission generation unit 431 determines whether or not the user is not playing enough with the autonomous mobile body 11, based on the user's interaction history stored in the interaction history DB 403. For example, if the user has not played with the autonomous mobile body 11 in the past three days, the mission generation unit 431 determines that the user is not playing enough with the autonomous mobile body 11, and the processing proceeds to step S56.
[0176] In step S56, the mission generation unit 431 generates a mission (hereinafter referred to as a play mission) whose achievement condition is to play with the autonomous moving body 11.
[0177] After that, the normal mission generation process ends.
[0178] On the other hand, in step S55, for example, if the user has been playing with the autonomous mobile body 11 for the past three days, the mission generation unit 431 determines that there is no shortage of playing with the autonomous mobile body 11, and processing proceeds to step S57.
[0179] In step S57, the mission generation unit 431 randomly generates a mission. For example, the mission generation unit 431 randomly selects and generates one of a conversation mission, a touch mission, and a play mission.
[0180] After that, the normal mission generation process ends.
[0181] In this way, interactions for which the user has not yet achieved a target value are selected, and a normal mission for encouraging the selected interaction is generated and presented to the user. The amount of interaction is evaluated, for example, by one or more of the number of times the interaction has been performed, the duration of the interaction, and the frequency of the interaction.
[0182] This appropriately prompts the user to interact with the autonomous mobile body 11 that has not been performed in sufficient volume. In contrast, by performing a normal mission, the user can naturally perform interactions without being aware of the lack of interactions.
[0183] Furthermore, each user can be made to perform various interactions evenly, and valid evaluations for the various interactions can be collected evenly, which enables developers and operators to appropriately evaluate the user experiences for the various interactions and appropriately improve the interactions of the autonomous mobile body 11.
[0184] The target value may be changed for each user. For example, the target value may be lowered for a user with a low achievement rate for normal missions. For example, the target value may be lowered for a normal mission that encourages interactions that are not performed often by the user.
[0185] The number and types of normal missions may be changed as needed. Furthermore, the priority of the normal missions (e.g., the order of presentation) may be changed as needed. For example, the priority of the normal missions may be changed for each user.
[0186] This may allow, for example, the developer or operator to prioritize and prompt the user to select an interaction that is desired by the developer or operator.
[0187] <Presentation Example of Weekly Mission> Next, a presentation example of a weekly mission will be described with reference to FIGS. 21 and 22. FIG.
[0188] For example, during the period when a weekly mission is being carried out, a banner indicating that the weekly mission is being carried out is displayed on the mission list screen of Fig. 15. When this banner is pressed, for example, a weekly mission details screen shown in Fig. 21A or Fig. 21B is displayed.
[0189] The weekly mission details screen in FIG. 21A includes an explanation field 701 .
[0190] The content of the weekly mission is displayed in the description field 701. For example, the title, period, image, and summary of the weekly mission are displayed.
[0191] The weekly mission details screen of Fig. 21B is different from the weekly mission details screen of Fig. 21A in that it includes a description field 701, but it also includes a button 702. In other words, this weekly mission details screen allows feedback of an evaluation of the weekly mission.
[0192] When the button 702 is pressed, the feedback input screen shown in A of Fig. 22 is displayed. The feedback input screen includes an evaluation input field 721 and buttons 722 to 724.
[0193] The evaluation input field 721 is a field in which the user inputs an evaluation of the weekly mission. More specifically, the evaluation input field 721 is a field in which the user inputs an evaluation of the behavior of the autonomous moving body 11 during the weekly mission.
[0194] For example, the user evaluates the behavior of the autonomous mobile body 11 during the weekly mission on a four-point scale from 1 to 4. For example, if the user thinks that the behavior of the autonomous mobile body 11 during the weekly mission was not very good, the user selects 1, and if the user thinks that the behavior of the autonomous mobile body 11 during the weekly mission was very good, the user selects 4. Furthermore, if the user finds it difficult to evaluate on a four-point scale, the user selects button 722.
[0195] When the button 723 is pressed, the feedback input screen is closed.
[0196] When button 724 is pressed, the feedback input screen of FIG. 22B is displayed.
[0197] The feedback input screen includes a comment field 731 , a button 732 , and a button 733 .
[0198] The user can freely enter comments about the behavior of the autonomous moving body 11 during the weekly mission in the comment field 731.
[0199] When the button 732 is pressed, the feedback input screen of FIG. 22A is displayed.
[0200] When the button 733 is pressed, the evaluation of the weekly mission input by the user is finalized. In other words, the evaluation of the behavior of the autonomous moving body 11 during the weekly mission is finalized.
[0201] Then, the information generation unit 313 generates feedback information including an evaluation of the confirmed weekly mission, and transmits the information to the information processing server 13 via the communication unit 302 and the network 21 .
[0202] In response to this, the feedback acquisition unit 434 of the information processing server 13 receives the feedback information via the network 21 and the communication unit 401. The feedback acquisition unit 434 stores the received feedback information in the feedback DB 405.
[0203] For example, the feedback information accumulated in the feedback DB 405 is fed back to the developer or operator of the autonomous mobile body 11. For example, the developer or operator can evaluate the user experience with the behavior of the autonomous mobile body 11 presented by the weekly mission based on the feedback information and improve the behavior of the autonomous mobile body 11, etc.
[0204] For example, the feedback information accumulated in the feedback DB 405 is used for learning processing by the learning unit 413. For example, the learning unit 413 performs learning processing such as machine learning using the feedback information, and improves the behavior specifications of the autonomous moving body 11 so as to receive higher ratings from users.
[0205] This improves the user's satisfaction with the autonomous moving body 11.
[0206] <<2. Modifications>> Modifications of the above-described embodiments of the present technology will now be described.
[0207] 14 has been described with reference to an example in which the information processing server 13 generates a mission in response to a request from the information processing terminal 12. However, for example, the information processing server 13 may generate a mission before receiving a request from the information processing terminal 12. The information processing server 13 may then transmit information relating to the mission generated in advance in response to a request from the information processing terminal 12. Furthermore, for example, the information processing server 13 may transmit information relating to the generated mission to the information processing terminal 12 at a predetermined timing or the like, without receiving a request from the information processing terminal 12.
[0208] For example, the information processing terminal 12 may select an interaction to prompt the user based on the user's interaction history, and present the user with a normal mission that prompts the selected interaction.
[0209] For example, based on the interaction history of multiple users (e.g., all users), interactions for which the total amount of execution by multiple users has not reached a target value may be selected, and a normal mission to encourage the selected interaction may be presented to the multiple users.
[0210] For example, missions that encourage interactions desired by developers or operators may be presented to users as daily missions or regular missions.
[0211] <<3. Others>> <Example of Computer Configuration> The above-described series of processes can be executed by hardware or software. When the series of processes is executed by software, the programs that make up the software are installed on a computer. Here, the computer includes a computer built into dedicated hardware, and a general-purpose personal computer, for example, that can execute various functions by installing various programs.
[0212] FIG. 23 is a block diagram showing an example of the hardware configuration of a computer that executes the above-described series of processes by a program.
[0213] In the computer 1000 , a CPU (Central Processing Unit) 1001 , a ROM (Read Only Memory) 1002 , and a RAM (Random Access Memory) 1003 are interconnected by a bus 1004 .
[0214] An input / output interface 1005 is further connected to the bus 1004. An input unit 1006, an output unit 1007, a storage unit 1008, a communication unit 1009, and a drive 1010 are connected to the input / output interface 1005.
[0215] The input unit 1006 includes input switches, buttons, a microphone, an image sensor, etc. The output unit 1007 includes a display, a speaker, etc. The storage unit 1008 includes a hard disk, a non-volatile memory, etc. The communication unit 1009 includes a network interface, etc. The drive 1010 drives removable media 1011 such as a magnetic disk, an optical disk, a magneto-optical disk, or a semiconductor memory.
[0216] In the computer 1000 configured as described above, the CPU 1001 performs the above-described series of processes by, for example, loading a program recorded in the memory unit 1008 into the RAM 1003 via the input / output interface 1005 and the bus 1004 and executing it.
[0217] The program executed by the computer 1000 (CPU 1001) can be provided by being recorded on a removable medium 1011 such as a package medium, for example. The program can also be provided via a wired or wireless transmission medium such as a local area network, the Internet, or digital satellite broadcasting.
[0218] In the computer 1000, the program can be installed in the storage unit 1008 via the input / output interface 1005 by inserting the removable medium 1011 into the drive 1010. The program can also be received by the communication unit 1009 via a wired or wireless transmission medium and installed in the storage unit 1008. Alternatively, the program can be installed in the ROM 1002 or the storage unit 1008 in advance.
[0219] The program executed by the computer may be a program that processes in chronological order according to the order described in this specification, or may be a program that processes in parallel or at the required timing, such as when called.
[0220] In this specification, a system refers to a collection of multiple components (devices, modules (components), etc.), regardless of whether all of the components are housed in the same housing. Therefore, multiple devices housed in separate housings and connected via a network, and a single device housed in a single housing with multiple modules, are both systems.
[0221] Furthermore, the embodiments of the present technology are not limited to the above-described embodiments, and various modifications are possible within the scope of the gist of the present technology.
[0222] For example, the present technology can be configured as a cloud computing system in which a single function is shared and processed collaboratively by a plurality of devices via a network.
[0223] Furthermore, each step described in the above flowchart can be executed by one device, or can be shared and executed by a plurality of devices.
[0224] Furthermore, when one step includes multiple processes, the multiple processes included in that one step can be executed by one device or can be shared and executed by multiple devices.
[0225] <Examples of Combinations of Configurations> The present technology can also have the following configurations.
[0226] (1) An information processing device comprising: a mission generation unit that generates a mission that prompts a user to interact with an autonomous moving body; and a presentation control unit that controls presentation of the mission to the user. (2) The information processing device described in (1), wherein the mission generation unit generates the mission based on an interaction history that is a history of interactions performed by the user with the autonomous moving body. (3) The information processing device described in (2), wherein the mission generation unit selects an interaction based on the interaction history, and generates the mission that prompts the user to perform the selected interaction. (4) The information processing device described in (3), wherein the mission generation unit selects an interaction for which the amount of interaction performed by the user has not reached a target value. (5) The information processing device described in (4), wherein the amount of interaction performed is represented by the number of times performed, the duration of performance, or the frequency of performance. (6) The information processing device described in any of (3) to (5), wherein the mission generation unit selects an interaction for which the amount of interaction performed by a plurality of users as a whole has not reached a target value, based on the interaction histories of the plurality of users. (7) The information processing device according to any of (2) to (6), further comprising an implementation status detection unit that detects an implementation status of the mission by the user based on the interaction history, and the presentation control unit controls presentation of the implementation status of the mission to the user. (8) The information processing device according to any of (1) to (7), wherein the mission generation unit generates the mission that changes the behavior of the autonomous moving body for a predetermined period of time. (9) The information processing device according to any of (1) to (8), further comprising a feedback acquisition unit that acquires feedback information including a user's evaluation of the mission. (10) The information processing device according to (9), further comprising a learning unit that learns interaction specifications of the autonomous moving body based on the feedback information. (11) The information processing device according to any of (1) to (10), wherein the presentation control unit controls presentation of the mission to the user by transmitting information related to the mission to another information processing device.(12) An information processing device comprising: a communication unit that receives, from another information processing device, mission information related to a mission that prompts a user to interact with an autonomous moving body; and an output control unit that controls presentation of the mission based on the mission information. (13) The information processing device described in (12), wherein the output control unit controls display of the missions to distinguish between missions that have not yet been performed, missions that have been performed and for which feedback including an evaluation of the mission has not been provided, and missions that have been performed and for which the feedback has been provided. (14) The information processing device described in (13), wherein the output control unit controls display of a feedback input screen for inputting the feedback. (15) The information processing device described in (14), further comprising: an information generation unit that generates feedback information including an evaluation of the mission based on information input via the feedback input screen, and the communication unit transmits the feedback information to the other information processing device. (16) The information processing device described in any of (12) to (15), wherein the output control unit controls display of difficulty levels of the missions. (17) The information processing device according to any of (12) to (16), wherein the output control unit controls display of guidance showing a method for the mission. (18) The information processing device according to any of (12) to (17), wherein the output control unit controls presentation of the mission to prompt the user to perform an interaction selected based on an interaction history that is a history of interactions performed by the user with the autonomous moving body. (19) A program for causing a computer to execute processing of receiving, from another information processing device, mission information regarding a mission to prompt the user to perform an interaction with the autonomous moving body, and controlling presentation of the mission based on the mission information.
[0227] The effects described in this specification are merely examples and are not limiting, and other effects may also be present.
[0228] REFERENCE SIGNS LIST 1 Information processing system, 11 Autonomous mobile object, 12 Information processing terminal, 113 Information processing server, 201 Control unit, 241 Information processing unit, 251 Recognition unit, 252 Action planning unit, 253 Operation control unit, 254 Sound control unit, 302 Communication unit, 303 Information processing unit, 304 Output unit, 311 Mobile object control unit, 312 Output control unit, 313 Information generation unit, 401 Communication unit, 402 Information processing unit, 403 Interaction history DB, 404 Mission implementation status DB, 405 Feedback DB, 411 Mobile object control unit, 412 Mission control unit, 413 Learning unit, 431 Mission generation unit, 432 Implementation status detection unit, 433 Presentation control unit, 434 Feedback acquisition unit
Claims
1. An information processing device comprising: a mission generation unit that generates a mission that prompts a user to interact with an autonomous moving body; and a presentation control unit that controls presentation of the mission to the user.
2. The information processing device according to claim 1, wherein the mission generation unit generates the mission based on an interaction history, which is a history of interactions performed by a user with the autonomous moving body.
3. The information processing device according to claim 2, wherein the mission generation unit selects an interaction based on the interaction history, and generates the mission for encouraging the user to perform the selected interaction.
4. The information processing device according to claim 3, wherein the mission generation unit selects an interaction for which the amount of execution by the user has not reached a target value.
5. The information processing device according to claim 4, wherein the amount of interaction is represented by the number of interactions, the duration of interactions, or the frequency of interactions.
6. The information processing device according to claim 3, wherein the mission generation unit selects an interaction for which the total amount of execution by the plurality of users has not reached a target value, based on the interaction histories of the plurality of users.
7. The information processing device according to claim 2, further comprising an implementation status detection unit that detects the user's implementation status of the mission based on the interaction history, and the presentation control unit controls the presentation of the mission implementation status to the user.
8. The information processing device according to claim 1, wherein the mission generation unit generates the mission for changing a behavior of the autonomous moving body for a predetermined period of time.
9. The information processing device according to claim 1, further comprising a feedback acquisition unit that acquires feedback information including a user's evaluation of the mission.
10. The information processing device according to claim 9, further comprising a learning unit that learns interaction specifications of the autonomous mobile body based on the feedback information.
11. The information processing device according to claim 1, wherein the presentation control unit controls presentation of the mission to a user by transmitting information relating to the mission to another information processing device.
12. An information processing device comprising: a communication unit that receives mission information regarding a mission that prompts a user to interact with an autonomous moving body from another information processing device; and an output control unit that controls the presentation of the mission based on the mission information.
13. The information processing device according to claim 12, wherein the output control unit controls the display of the missions so as to distinguish between the missions that have not yet been performed, the missions that have been performed and for which feedback including an evaluation of the mission has not been given, and the missions that have been performed and for which feedback has been given.
14. The information processing device according to claim 13, wherein the output control unit controls display of a feedback input screen for inputting the feedback.
15. An information processing device as described in claim 14, further comprising an information generation unit that generates feedback information including an evaluation of the mission based on information input via the feedback input screen, and the communication unit transmits the feedback information to the other information processing device.
16. The information processing device according to claim 12, wherein the output control unit controls display of the difficulty level of the mission.
17. The information processing device according to claim 12, wherein the output control unit controls the display of guidance showing a method for completing the mission.
18. The information processing device according to claim 12, wherein the output control unit controls the presentation of the mission to prompt the user to perform an interaction selected based on an interaction history, which is a history of interactions performed by the user with the autonomous moving body.
19. A program for causing a computer to execute a process of receiving, from another information processing device, mission information regarding a mission that prompts a user to interact with an autonomous mobile body, and controlling the presentation of the mission based on the mission information.
Citation Information
Patent Citations
Information processing device, information processing method, and program
WO2020213244A1
Autonomous mobile body and information processing method
WO2022158279A1