Information processing device and information processing method

Abstract

The present technology relates to an information processing device and an information processing method that make it possible to easily generate a virtual item to be attached to a moving virtual body in a virtual space. This information processing device comprises: an image acquisition unit that acquires image data of an autonomous moving body that takes a pose corresponding to an attached item; and an image processing unit that generates, on the basis of the image data, a virtual item that can be attached to a moving virtual body in a virtual space. The present technology can be applied to, for example, smartphones.

Description

Information processing device and information processing method

[0001] The present technology relates to an information processing device and an information processing method, and more particularly to an information processing device and an information processing method suitable for use when generating a virtual item to be worn by a virtual moving object in a virtual space.

[0002] 2. Description of the Related Art Conventionally, a technique has been proposed for constructing a virtual space that conforms to the real space in which a self-propelled robot exists (see, for example, Patent Document 1).

[0003] In recent years, applications that allow users to communicate with virtual moving objects corresponding to autonomous moving objects such as pet robots in a virtual space (hereinafter referred to as virtual moving object applications) have become widespread. Some virtual moving object applications allow users to equip the virtual moving objects with virtual items such as virtual clothing.

[0004] JP 2023-41983 A

[0005] For example, in virtual mobile applications, there is a need to generate unique virtual items.

[0006] The present technology has been made in light of such circumstances, and makes it possible to easily generate virtual items to be worn by virtual moving objects in a virtual space.

[0007] An information processing device according to one aspect of the present technology includes an image acquisition unit that acquires image data of a first autonomous moving body that assumes a pose corresponding to an attached item, and an image processing unit that generates, based on the image data, a virtual item that can be attached to the first virtual moving body in a virtual space.

[0008] An information processing method according to one aspect of the present technology includes an information processing device acquiring image data of an autonomous moving body assuming a pose corresponding to an attached item, and generating a virtual item that can be attached to a virtual moving body in a virtual space based on the image data.

[0009] In one aspect of the present technology, image data of an autonomous moving body taking a pose corresponding to an attached item is acquired, and a virtual item that can be attached to a virtual moving body in a virtual space is generated based on the image data.

[0010] 1 is a block diagram showing an embodiment of an information processing system to which the present technology is applied. FIG. 1 is a diagram showing an example of the hardware configuration of an autonomous moving body. FIG. 2 is a diagram showing an example of the configuration of an actuator provided in the autonomous moving body. FIG. 3 is a diagram for explaining functions of a display provided in the autonomous moving body. FIG. 4 is a diagram showing an example of the operation of the autonomous moving body. FIG. 5 is a block diagram showing an example of the functional configuration of the autonomous moving body. FIG. 6 is a block diagram showing an example of the functional configuration of the information processing terminal. FIG. 7 is a block diagram showing an example of the functional configuration of an information processing unit of the information processing terminal. FIG. 8 is a block diagram showing an example of the functional configuration of an information processing server. FIG. 9 is a flowchart for explaining a dress-up item generation process. FIG. 10 is a flowchart for explaining details of a scan process. FIG. 11 is a diagram showing an example of a scan pose. FIG. 12 is a diagram showing an example of a scan pose. FIG. 13 is a diagram showing an example of a scan pose. FIG. 14 is a diagram showing an example of a scan pose. FIG. 15 is a diagram showing an example of a scan pose. 10 is a diagram illustrating an example of the use of a dress-up item.

[0011] Hereinafter, embodiments of the present technology will be described. The description will be made in the following order: 1. Embodiment 2. Modification 3. Other

[0012] <<1. Embodiment>> An embodiment of the present technology will be described with reference to FIGS. 1 to 24 .

[0013] <Configuration Example of Information Processing System 1> FIG. 1 is a block diagram showing an embodiment of an information processing system 1 to which the present technology is applied.

[0014] The information processing system 1 includes autonomous mobile bodies 11-1 to 11-n, information processing terminals 12-1 to 12-n, and an information processing server 13.

[0015] In the following, when there is no need to distinguish between the autonomous mobile bodies 11-1 to 11-n, they will simply be referred to as the autonomous mobile body 11. In the following, when there is no need to distinguish between the information processing terminals 12-1 to 12-n, they will simply be referred to as the information processing terminals 12.

[0016] Communication is possible between each autonomous mobile body 11 and the information processing server 13, between each information processing terminal 12 and the information processing server 13, between each autonomous mobile body 11 and each information processing terminal 12, between each autonomous mobile body 11, and between each information processing terminal 12 via the network 21. In addition, direct communication is also possible between each autonomous mobile body 11 and each information processing terminal 12, between each autonomous mobile body 11, and between each information processing terminal 12 without going through the network 21.

[0017] The autonomous mobile body 11 is an information processing device that recognizes its own and its surrounding situations based on collected sensor data, etc., and autonomously selects and executes various actions according to the situation. Unlike a robot that simply performs actions according to user instructions, one of the features of the autonomous mobile body 11 is that it autonomously executes appropriate actions according to the situation.

[0018] The autonomous mobile body 11 can, for example, perform user recognition, object recognition, etc. based on captured images, and perform various autonomous actions according to the recognized user, object, etc. The autonomous mobile body 11 can also, for example, perform voice recognition based on the user's speech, and perform actions based on the user's instructions, etc.

[0019] Furthermore, the autonomous mobile body 11 performs pattern recognition learning to acquire the ability to recognize users and objects. In this case, the autonomous mobile body 11 can perform pattern recognition learning related to objects, etc., not only by supervised learning based on given learning data, but also by dynamically collecting learning data based on instructions from a user, etc.

[0020] Furthermore, the autonomous moving body 11 can be disciplined by a user. Here, the discipline of the autonomous moving body 11 is broader than, for example, general discipline in which the autonomous moving body 11 is taught rules and prohibited actions and made to memorize them, and refers to changes in the autonomous moving body 11 that the user can sense as a result of the user's interaction with the autonomous moving body 11.

[0021] The shape, capabilities, desires, and other levels of the autonomous mobile body 11 can be designed appropriately according to the purpose and role. For example, the autonomous mobile body 11 is configured by an autonomous mobile robot that autonomously moves within a space and performs various actions. Specifically, for example, the autonomous mobile body 11 is configured by an autonomous mobile robot that has a shape and movement capabilities that mimic those of a human, a dog, or other animal. Furthermore, for example, the autonomous mobile body 11 is configured by a vehicle or other device that has the ability to communicate with a user.

[0022] The information processing terminal 12 is, for example, a smartphone, a tablet terminal, a PC (personal computer), or the like, and is used by the user of the autonomous mobile body 11. The information processing terminal 12 realizes various functions by executing a predetermined application program (hereinafter simply referred to as an application). For example, the information processing terminal 12 communicates with the information processing server 13 via the network 21 or directly with the autonomous mobile body 11 to collect various data related to the autonomous mobile body 11, present the data to the user, or give instructions to the autonomous mobile body 11.

[0023] The applications executed by the information processing terminal 12 include, for example, a virtual mobile body application that enables communication, etc., within a virtual space with a virtual mobile body corresponding to the autonomous mobile body 11. The virtual mobile body application includes, for example, a dress-up function that enables virtual items (hereinafter referred to as dress-up items) such as virtual clothing to be attached to the virtual mobile body.

[0024] The virtual moving body corresponding to the autonomous moving body 11 is, for example, a virtual moving body that simulates the autonomous moving body 11 in a virtual space. Note that the appearance of the virtual moving body does not necessarily have to be identical to that of the autonomous moving body 11, and may be deformed to some extent. Also, for example, characteristics of the autonomous moving body 11 other than the appearance (for example, gender, age, personality, behavioral patterns, etc.) may be simulated by the virtual moving body.

[0025] The information processing server 13, for example, collects various types of data from each autonomous mobile body 11 and each information processing terminal 12, provides various types of data to each autonomous mobile body 11 and each information processing terminal 12, and controls the operation of each autonomous mobile body 11. Furthermore, for example, the information processing server 13 can perform pattern recognition learning and processing corresponding to user discipline, similar to the autonomous mobile body 11, based on the data collected from each autonomous mobile body 11 and each information processing terminal 12. Furthermore, for example, the information processing server 13 supplies each information processing terminal 12 with the above-mentioned applications and various types of data related to each autonomous mobile body 11.

[0026] The network 21 may be composed of, for example, public networks such as the Internet, telephone networks, and satellite communication networks, various LANs (Local Area Networks) including Ethernet (registered trademark), and WANs (Wide Area Networks). The network 21 may also include dedicated network such as an IP-VPN (Internet Protocol-Virtual Private Network). The network 21 may also include wireless communication networks such as Wi-Fi (registered trademark) and Bluetooth (registered trademark).

[0027] The configuration of the information processing system 1 can be flexibly changed depending on the specifications, operation, etc. For example, the autonomous mobile body 11 may communicate information with various external devices in addition to the information processing terminal 12 and the information processing server 13. The above external devices can include, for example, servers that transmit weather, news, and other service information, and various home appliances owned by the user.

[0028] Furthermore, for example, the autonomous mobile bodies 11 and the information processing terminals 12 do not necessarily have to have a one-to-one relationship, and may have, for example, a many-to-many, many-to-one, or one-to-many relationship. For example, one user can use one information processing terminal 12 to check data related to multiple autonomous mobile bodies 11, or can use multiple information processing terminals to check data related to one autonomous mobile body 11.

[0029] <Example of Hardware Configuration of Autonomous Mobile Body 11> Next, a description will be given of an example of the hardware configuration of the autonomous mobile body 11. Note that the following description will be given taking as an example a case where the autonomous mobile body 11 is a dog-type four-legged walking robot.

[0030] 2 is a diagram showing an example of the hardware configuration of the autonomous moving body 11. The autonomous moving body 11 is a dog-like quadruped walking robot that includes a head, a body, four legs, and a tail.

[0031] The autonomous moving body 11 is provided with two displays, a display 51L and a display 51R, on its head. Hereinafter, when there is no need to distinguish between the display 51L and the display 51R, they will be simply referred to as the display 51.

[0032] The autonomous moving body 11 also includes various sensors, such as a microphone 52, a camera 53, a ToF (Time Of Flight) sensor 525, a human presence sensor 55, a distance measurement sensor 56, a touch sensor 57, an illuminance sensor 58, a sole button 59, and an inertial sensor 60.

[0033] The autonomous mobile body 11 is provided with, for example, four microphones 52 on its head. Each microphone 52 collects surrounding sounds including, for example, the user's speech and surrounding environmental sounds. Furthermore, by providing multiple microphones 52, it is possible to collect surrounding sounds with high sensitivity and to localize the sound source.

[0034] The autonomous mobile body 11 is equipped with two wide-angle cameras 53, for example, at the nose and the waist, which capture images of the surroundings of the autonomous mobile body 11. For example, the camera 53 located at the nose captures images within the forward field of view of the autonomous mobile body 11 (i.e., the dog's field of view). The camera 53 located at the waist captures images of the surroundings centered above the autonomous mobile body 11. The autonomous mobile body 11 can extract feature points of the ceiling, for example, based on images captured by the camera 53 located at the waist, and realize SLAM (Simultaneous Localization and Mapping).

[0035] The ToF sensor 54 is provided, for example, at the tip of the nose and detects the distance to an object present in front of the head. The ToF sensor 54 enables the autonomous mobile body 11 to accurately detect the distance to various objects, and realizes operation according to the relative position of targets including the user, obstacles, etc.

[0036] The human presence sensor 55 is placed, for example, on the chest, and detects the location of the user, a pet kept by the user, etc. By detecting an animal present in front of the autonomous moving body 11 using the human presence sensor 55, the autonomous moving body 11 can perform various actions toward the animal, for example, actions according to emotions such as interest, fear, surprise, etc.

[0037] The distance measurement sensor 56 is placed, for example, on the chest, and detects the situation on the floor surface in front of the autonomous mobile body 11. The distance measurement sensor 56 allows the autonomous mobile body 11 to accurately detect the distance to an object present on the floor surface in front of it, and enables it to perform operations according to the relative position of the object.

[0038] The touch sensor 57 is arranged in areas where the user is likely to touch the autonomous moving body 11, such as the top of the head, under the chin, or on the back, and detects contact by the user. The touch sensor 57 is configured, for example, by a capacitance-type or pressure-sensitive touch sensor. The touch sensor 57 allows the autonomous moving body 11 to detect contact actions by the user, such as touching, stroking, hitting, or pushing, and can perform an action in accordance with the contact action.

[0039] The illuminance sensor 58 is disposed, for example, at the base of the tail on the back of the head, and detects the illuminance of the space in which the autonomous mobile body 11 is located. The autonomous mobile body 11 can detect the ambient brightness using the illuminance sensor 58 and perform an operation according to the detected brightness.

[0040] The sole buttons 59 are, for example, arranged at the locations corresponding to the pads of each of the four legs, and detect whether or not the bottom surfaces of the legs of the autonomous mobile body 11 are in contact with the floor. The sole buttons 59 enable the autonomous mobile body 11 to detect contact or non-contact with the floor surface, and to know, for example, that it has been picked up by a user.

[0041] The inertial sensors 60 are disposed, for example, on the head and torso, respectively, and detect physical quantities such as the speed, acceleration, and rotation of the head and torso. For example, the inertial sensors 60 are configured with a six-axis sensor that detects acceleration and angular velocity along the X-, Y-, and Z-axes. The autonomous mobile body 11 can accurately detect the movement of the head and torso using the inertial sensors 60, and realize operation control according to the situation.

[0042] The configuration of the sensors included in the autonomous mobile body 11 can be flexibly changed depending on the specifications, operation, etc. For example, in addition to the above configuration, the autonomous mobile body 11 may further include various communication devices including a temperature sensor, a geomagnetic sensor, and a GNSS (Global Navigation Satellite System) signal receiver.

[0043] Next, a configuration example of the joints of the autonomous mobile body 11 will be described with reference to Fig. 3. Fig. 3 shows a configuration example of an actuator 71 provided in the autonomous mobile body 11. In addition to the rotation points shown in Fig. 3, the autonomous mobile body 11 has two degrees of freedom of rotation each in the ears and tail, and one in the mouth, for a total of 22 degrees of freedom of rotation.

[0044] For example, the autonomous mobile body 11 has three degrees of freedom in its head, allowing it to perform both nodding and tilting its head. In addition, the autonomous mobile body 11 can reproduce swinging movements of its waist using the actuators 71 provided in its waist, allowing it to achieve natural and flexible movements that are closer to those of a real dog.

[0045] The autonomous mobile body 11 may achieve the above-mentioned 22 degrees of rotational freedom by combining, for example, a single-axis actuator and a two-axis actuator. For example, single-axis actuators may be used in the elbows and knees of the legs, and two-axis actuators may be used in the shoulders and thighs.

[0046] Next, the function of the display 51 provided in the autonomous moving body 11 will be described with reference to FIG.

[0047] The autonomous mobile body 11 is equipped with two displays 51R and 51L corresponding to the right and left eyes, respectively. Each display 51 has a function of visually expressing the eye movements and emotions of the autonomous mobile body 11. For example, each display 51 expresses the movements of the eyeballs, pupils, and eyelids according to emotions and actions, thereby producing natural movements similar to those of real animals such as dogs, and can express the line of sight and emotions of the autonomous mobile body 11 with high precision and flexibility. Furthermore, the user can intuitively grasp the state of the autonomous mobile body 11 from the eyeball movements displayed on the display 51.

[0048] Each display 51 is realized by, for example, two independent OLEDs (Organic Light Emitting Diodes). By using OLEDs, it is possible to reproduce the curved surface of an eyeball. As a result, a more natural appearance can be achieved compared to when a pair of eyeballs are represented by a single flat display or when two eyeballs are respectively represented by two independent flat displays.

[0049] With the above configuration, the autonomous moving body 11 can reproduce movements and emotional expressions that are closer to those of real living creatures by precisely and flexibly controlling the movements of the joints and eyeballs, as shown in Figure 5.

[0050] Note that Figure 5 is a diagram showing an example of the operation of the autonomous moving body 11, but in Figure 5, the external structure of the autonomous moving body 11 is shown in a simplified manner in order to focus the explanation on the operation of the joints and eyeballs of the autonomous moving body 11.

[0051] <Example of Functional Configuration of Autonomous Mobile Body 11> Next, an example of the functional configuration of the autonomous mobile body 11 will be described with reference to Fig. 6. The autonomous mobile body 11 includes an input unit 101, a sensing unit 102, a communication unit 103, an information processing unit 104, a drive unit 105, an output unit 106, and a storage unit 107.

[0052] The input unit 101 includes input devices such as switches, buttons, etc. The input unit 101 supplies the information processing unit 104 with input data input via the input devices.

[0053] 2 and has a function of collecting various sensor data relating to the user and the surrounding conditions. The sensing unit 102 supplies the collected sensor data to the information processing unit 104.

[0054] The communication unit 103 communicates with other autonomous mobile bodies 11, the information processing terminal 12, and the information processing server 13 via the network 21 or without the network 21, and transmits and receives various types of data. The communication unit 103 supplies received data to the information processing unit 104 and obtains data to be transmitted from the information processing unit 104.

[0055] The communication method of the communication unit 103 is not particularly limited, and can be flexibly changed according to the specifications and operation.

[0056] The information processing unit 104 includes, for example, a processor such as a CPU (Central Processing Unit), and performs various types of information processing and controls each unit of the autonomous mobile body 11. The information processing unit 104 includes a recognition unit 121, a learning unit 122, a behavior planning unit 123, and an operation control unit 124.

[0057] The recognition unit 121 recognizes the situation in which the autonomous mobile body 11 is located, based on input data supplied from the input unit 101, sensor data supplied from the sensing unit 102, and received data supplied from the communication unit 103. The situation in which the autonomous mobile body 11 is located includes, for example, its own situation and its surroundings. The autonomous mobile body's own situation includes, for example, the state and movement of the autonomous mobile body 11. The surrounding situation includes, for example, the state, movement, and instructions of surrounding people such as a user, the state and movement of surrounding living things such as pets, the state and movement of surrounding objects, time, place, and the surrounding environment. The surrounding objects include, for example, other autonomous mobile bodies. In addition, in order to recognize the situation, the recognition unit 121 performs, for example, person identification, facial expression and gaze recognition, emotion recognition, object recognition, action recognition, spatial region recognition, color recognition, shape recognition, marker recognition, obstacle recognition, step recognition, brightness recognition, temperature recognition, voice recognition, word understanding, position estimation, posture estimation, etc.

[0058] The recognition unit 121 also has a function of estimating and understanding a situation based on the various types of recognized information. In this case, the recognition unit 121 may comprehensively estimate the situation using knowledge stored in advance.

[0059] The recognition unit 121 supplies data indicating the recognition result or estimation result of the situation (hereinafter referred to as situation data) to the learning unit 122 and the action planning unit 123. In addition, the recognition unit 121 registers the data indicating the recognition result or estimation result of the situation in the action history data stored in the storage unit 107.

[0060] The behavior history data is data that indicates the history of behavior of the autonomous moving body 11. The behavior history data includes, for example, items such as the date and time when the behavior started, the date and time when the behavior ended, the trigger for performing the behavior, the location where the behavior was instructed (if a location was instructed), the situation when the behavior was performed, and whether the behavior was completed (whether the behavior was performed to the end).

[0061] For example, if an action is triggered by a user instruction, the content of the instruction is registered as the trigger for the execution of the action. Also, for example, if an action is triggered by a specific situation, the content of the situation is registered. Furthermore, for example, if an action is triggered by an object pointed to or recognized by the user, the type of the object is registered.

[0062] The learning unit 122 learns the situation, the behavior, and the effect of the behavior on the environment based on the input data supplied from the input unit 101, the sensor data supplied from the sensing unit 102, and the received data supplied from the communication unit 103, based on the situation data supplied from the recognition unit 121, the data related to the behavior of the autonomous mobile body 11 supplied from the behavior planning unit 123, and the behavior history data stored in the memory unit 107. For example, the learning unit 122 performs the pattern recognition learning described above and learns behavior patterns corresponding to the user's discipline.

[0063] For example, the learning unit 122 realizes the above learning using a machine learning algorithm such as deep learning. Note that the learning algorithm employed by the learning unit 122 is not limited to the above example and can be designed as appropriate.

[0064] The learning unit 122 supplies data indicating the learning results (hereinafter referred to as learning result data) to the action planning unit 123 and stores the data in the storage unit 107 .

[0065] The behavior planning unit 123 plans behavior to be performed by the autonomous mobile body 11 based on the recognized or estimated situation and the learning result data. The behavior planning unit 123 supplies data indicating the planned behavior (hereinafter referred to as behavior plan data) to the operation control unit 124. In addition, the behavior planning unit 123 supplies data regarding the behavior of the autonomous mobile body 11 to the learning unit 122 and registers the data in the behavior history data stored in the memory unit 107.

[0066] The operation control unit 124 controls the operation of the autonomous mobile body 11 so as to execute the planned action by controlling the drive unit 105 and the output unit 106 based on the action plan data. The operation control unit 124 performs, for example, rotation control of the actuator 71, display control of the display 51, and audio output control by the speaker based on the action plan.

[0067] The driving unit 105 bends and stretches the multiple joints of the autonomous mobile body 11 based on control by the operation control unit 124. More specifically, the driving unit 105 drives the actuators 71 provided in each joint based on control by the operation control unit 124.

[0068] The output unit 106 includes, for example, a display 51, a speaker, a haptic device, etc., and outputs visual information, auditory information, tactile information, etc. based on the control of the operation control unit 124.

[0069] The storage unit 107 includes, for example, a non-volatile memory and a volatile memory, and stores various programs and data.

[0070] In the following, the expression "via the communication unit 103 and the network 21" will be omitted as appropriate when each unit of the autonomous mobile body 11 communicates with the information processing server 13, etc. via the communication unit 103 and the network 21. For example, when the recognition unit 121 communicates with the information processing server 13 via the communication unit 103 and the network 21, it will simply be described as "the recognition unit 121 communicates with the information processing server 13."

[0071] <Example of Functional Configuration of Information Processing Terminal 12> Next, an example of the functional configuration of the information processing terminal 12 will be described with reference to Fig. 7. The information processing terminal 12 includes an input unit 201, a sensing unit 202, a communication unit 203, an information processing unit 204, an output unit 205, and a storage unit 206.

[0072] The input unit 201 includes input devices such as switches (not shown), buttons (not shown), etc. The input unit 201 supplies input data input via the input devices to the information processing unit 204.

[0073] The sensing unit 202 includes various sensors, such as a camera (not shown), a microphone (not shown), an inertial sensor (not shown), etc. The sensing unit 202 supplies sensor data output from the various sensors to the information processing unit 204.

[0074] The communication unit 203 communicates with the autonomous mobile body 11, other information processing terminals 12, and the information processing server 13 via the network 21 or without the network 21, and transmits and receives various types of data. The communication unit 203 supplies received data to the information processing unit 204 and obtains data to be transmitted from the information processing unit 204.

[0075] The communication method of the communication unit 203 is not particularly limited, and can be flexibly changed according to the specifications and operation.

[0076] The information processing unit 204 includes, for example, a processor such as a CPU, and performs various types of information processing, controls each unit of the information processing terminal 12, and executes various applications.

[0077] The output unit 205 includes, for example, a display (not shown), a speaker (not shown), a haptic device (not shown), etc., and outputs visual information, auditory information, tactile information, etc. based on the control of the information processing unit 204.

[0078] The storage unit 206 includes, for example, a non-volatile memory and a volatile memory, and stores various programs and data.

[0079] The functional configuration of the information processing terminal 12 can be flexibly changed depending on the specifications and operation.

[0080] Furthermore, hereinafter, the expression "via the communication unit 203 and the network 21" will be omitted as appropriate when each unit of the information processing terminal 12 communicates with the information processing server 13, etc. via the communication unit 203 and the network 21. For example, when the information processing unit 204 communicates with the information processing server 13 via the communication unit 203 and the network 21, it will simply be described as "the information processing unit 204 communicates with the information processing server 13."

[0081] <Example of Functional Configuration of Information Processing Unit 204> Next, Fig. 8 shows a part of an example of the functional configuration of the information processing unit 204 of the information processing terminal 12. In particular, Fig. 8 shows an example of the functional configuration of a part that performs processing related to the dress-up function of the virtual mobile application.

[0082] The information processing unit 204 includes a dress-up item generating unit 241 , a dress-up image generating unit 242 , and a UI control unit 243 .

[0083] The dress-up item generating unit 241 executes a process of generating a dress-up item, and includes an image acquiring unit 251, an image processing unit 252, and a registration unit 253.

[0084] The image acquisition unit 251 acquires image data obtained by photographing the real autonomous moving body 11 wearing real items such as clothing from the sensing unit 202. The image acquisition unit 251 supplies the acquired image data to a 3D (three-dimensional) data generation unit 261 of the image processing unit 252.

[0085] Also, for example, the image acquisition unit 251 can control the capturing of images of the autonomous mobile body 11 by the sensing unit 202. Furthermore, for example, the image acquisition unit 251 can control the autonomous mobile body 11 to assume a pose for scanning when capturing images by giving instructions to the autonomous mobile body 11 via the communication unit 203.

[0086] The image processing unit 252 generates a dress-up item by executing image processing on the image data of the autonomous moving body 11. The image processing unit 252 includes a 3D data conversion unit 261 and a virtual item conversion unit 262.

[0087] The 3D data generation unit 261 generates 3D data of the autonomous moving body 11 (hereinafter referred to as a 3D moving body) based on the image data of the autonomous moving body 11. The 3D data generation unit 261 supplies the data of the 3D moving body to the extraction unit 271 of the virtual item generation unit 262.

[0088] The virtual item creation unit 262 generates, based on the 3D moving body, a dress-up item, which is a virtual item corresponding to an item worn by the autonomous moving body 11. The virtual item creation unit 262 includes an extraction unit 271 and an editing unit 272.

[0089] The extraction unit 271 uses the 3D model of the autonomous mobile body 11 to extract 3D data of items (hereinafter referred to as 3D items) worn by the autonomous mobile body 11 from the 3D mobile body. The 3D model of the autonomous mobile body 11 is, for example, CAD data created when the autonomous mobile body 11 was designed, and is stored in the storage unit 206. The extraction unit 271 supplies the data of the 3D items to the editing unit 272.

[0090] The editing unit 272 executes various editing processes on the 3D items to generate dress-up items. The editing unit 272 supplies data of the dress-up items to the registration unit 253.

[0091] The registration unit 253 transmits data of the dress-up item to the information processing server 13 and executes a process of registering the dress-up item in the dress-up function of the virtual mobile application.

[0092] The dress-up image generation unit 242 receives data of the virtual moving object and data of the dress-up items from the information processing server 13. The dress-up image generation unit 242 generates an image of the virtual moving object with the dress-up items attached (hereinafter referred to as a dress-up image), and supplies the data of the dress-up image to the UI control unit 243.

[0093] The UI control unit 243 controls the user interface related to the dress-up function by the input unit 201 and the output unit 205. For example, the UI control unit 243 controls the display of a dress-up image by the output unit 205.

[0094] <Example of Functional Configuration of Information Processing Server 13> Next, an example of the functional configuration of the information processing server 13 will be described with reference to Fig. 9. The information processing server 13 includes a communication unit 301, an information processing unit 302, and a storage unit 303.

[0095] The communication unit 301 communicates with each autonomous mobile body 11 and each information processing terminal 12 via the network 21, and transmits and receives various types of data. The communication unit 301 supplies received data to the information processing unit 302, and obtains data to be transmitted from the information processing unit 302.

[0096] The communication method of the communication unit 301 is not particularly limited, and can be flexibly changed according to the specifications and operation.

[0097] The information processing unit 302 includes, for example, a processor such as a CPU, and performs various types of information processing and controls each unit of the information processing terminal 12. The information processing unit 302 includes an autonomous mobile object control unit 321 and an application control unit 322.

[0098] The autonomous mobile object control unit 321 has the same configuration as the information processing unit 104 of the autonomous mobile object 11. Specifically, the autonomous mobile object control unit 321 has a recognition unit 331, a learning unit 332, a behavior planning unit 333, and an operation control unit 334.

[0099] The autonomous mobile body control unit 321 has the same functions as the information processing unit 104 of the autonomous mobile body 11. For example, the autonomous mobile body control unit 321 receives sensor data, input data, behavioral history data, etc. from the autonomous mobile body 11 and recognizes the situation of the autonomous mobile body 11 and its surroundings. For example, the autonomous mobile body control unit 321 generates control data for controlling the operation of the autonomous mobile body 11 based on the situation of the autonomous mobile body 11 and its surroundings, and transmits this to the autonomous mobile body 11 to control the operation of the autonomous mobile body 11. For example, like the autonomous mobile body 11, the autonomous mobile body control unit 321 performs pattern recognition learning and learning of behavioral patterns corresponding to user discipline.

[0100] In addition, the learning unit 332 of the autonomous mobile unit control unit 321 can also learn collective intelligence common to multiple autonomous mobile units 11 by performing pattern recognition learning and learning behavioral patterns corresponding to user discipline based on data collected from multiple autonomous mobile units 11.

[0101] The application control unit 322 communicates with the autonomous moving body 11 and the information processing terminal 12 via the communication unit 301 and controls the application executed by the information processing terminal 12 .

[0102] For example, the application control unit 322 collects various types of data related to the autonomous mobile body 11 from the autonomous mobile body 11 via the communication unit 301. Then, the application control unit 322 transmits the collected data to the information processing terminal 12 via the communication unit 301, thereby causing the data related to the autonomous mobile body 11 to be displayed in an application executed by the information processing terminal 12.

[0103] For example, the application control unit 322 receives data indicating instructions to the autonomous mobile body 11 input via an application from the information processing terminal 12 via the communication unit 301. Then, the application control unit 322 transmits the received data to the autonomous mobile body 11 via the communication unit 301, thereby giving instructions from the user to the autonomous mobile body 11.

[0104] For example, the application control unit 322 receives data related to various operations on the virtual mobile application from the information processing terminal 12 via the communication unit 301. Then, the application control unit 322 controls and configures the virtual mobile application based on the data received via the communication unit 301.

[0105] The storage unit 303 includes, for example, a non-volatile memory and a volatile memory, and stores various programs and data.

[0106] The functional configuration of the information processing server 13 can be flexibly changed according to the specifications and operation.

[0107] Furthermore, hereinafter, the expression "via the communication unit 301 and the network 21" will be omitted as appropriate when each unit of the information processing server 13 communicates with the information processing terminal 12, etc. via the communication unit 301 and the network 21. For example, when the application control unit 322 communicates with the information processing terminal 12 via the communication unit 301 and the network 21, it will simply be stated that the application control unit 322 communicates with the information processing terminal 12.

[0108] <Dress-up Item Generation Process> Next, a dress-up item generation process executed by the information processing system 1 will be described with reference to the flowchart of FIG.

[0109] In step S1, the information processing system 1 executes a scan process.

[0110] The scanning process will now be described in detail with reference to the flowchart of FIG.

[0111] In step S21, the information processing system 1 accepts the start of scanning of the autonomous moving body 11.

[0112] For example, the output unit 205 of the information processing terminal 12 displays an operation menu under the control of the UI control unit 243. For example, the operation menu includes an item for "item scan" for scanning an item attached to the autonomous moving body 11.

[0113] In response to this, for example, when the user selects "item scan" from the operation menu via the input unit 201, the input unit 201 notifies the information processing unit 204 that item scan has been selected.

[0114] The UI control unit 243 of the information processing unit 204 notifies the autonomous moving body 11 via the communication unit 203 that an item scan will be started.

[0115] In response to this, the recognition unit 121 of the autonomous mobile body 11 receives the notification from the information processing terminal 12 via the communication unit 103. As a result, the recognition unit 121 recognizes that an item scan will be started.

[0116] The process of step S21 can be omitted.

[0117] In step S22, the autonomous moving body 11 starts a pause for scanning.

[0118] For example, the user instructs the autonomous moving body 11 to perform a pause for scanning by issuing a predetermined voice command (for example, "Hi, scan").

[0119] In response to this, the sensing unit 102 of the autonomous mobile body 11 collects the voice corresponding to the voice command and supplies the voice data corresponding to the collected voice to the information processing unit 104. The recognition unit 121 of the information processing unit 104 recognizes that an instruction to perform a pause for scanning has been issued by recognizing the voice command based on the voice data.

[0120] Alternatively, for example, the user inputs an instruction to the autonomous moving body 11 to perform a scan pause via the input unit 201 of the information processing terminal 12 .

[0121] In response to this, the input unit 201 of the information processing terminal 12 notifies the information processing unit 204 that an instruction to start a scan pause has been input. The image acquisition unit 251 of the information processing terminal 12 transmits an instruction to execute a scan pause to the autonomous moving body 11 via the communication unit 203.

[0122] In response to this, the recognition unit 121 of the autonomous mobile body 11 receives an instruction to execute a pause for scanning from the information processing terminal 12 via the communication unit 103. As a result, the recognition unit 121 recognizes that an instruction to execute a pause for scanning has been issued.

[0123] When the recognition unit 121 of the autonomous mobile body 11 recognizes that an instruction to perform a scan pose has been issued, it recognizes the position of the item attached to the autonomous mobile body 11 based on sensor data from the sensing unit 202, etc. The recognition unit 121 supplies the action planning unit 123 with situation data indicating the instruction to perform a scan pose and the recognition result of the position of the attached item.

[0124] The behavior planning unit 123 plans the behavior of the autonomous mobile body 11 so that the autonomous mobile body 11 assumes a pose that corresponds to the item worn by the autonomous mobile body 11. The pose that corresponds to the item worn is, for example, a pose that makes it easy to photograph the item. The behavior planning unit 123 supplies behavior plan data indicating the planned behavior to the operation control unit 124.

[0125] The movement control unit 124 controls the movement of the autonomous moving body 11 so that it assumes a pose corresponding to the item being worn, by controlling the drive unit 105 and the output unit 106 based on the action plan data.

[0126] For example, when the autonomous moving body 11 is wearing shoes (not shown), it assumes a pose in which it stands still for a while with its legs raised, as shown in A and B of FIG. 12, so that the soles of its feet can be easily photographed.

[0127] For example, when the autonomous moving body 11 is wearing a hat (not shown) or a collar (not shown), it poses in a sitting position with its head held up firmly so that it can be easily photographed from the front, back, left, and right, as shown in Fig. 13. Furthermore, when the autonomous moving body 11 is wearing a collar, it closes its mouth, for example, so that it can be easily photographed around its neck.

[0128] For example, when the autonomous moving body 11 is wearing clothes (not shown), it takes a standing pose with its legs spread and stretched out so that it is easy to photograph the underside of its abdomen, as shown in Fig. 14. For example, when the autonomous moving body 11 has a ribbon (not shown) or the like attached to its tail, it takes a pose in which it is stationary with its tail raised, as shown in Fig. 14.

[0129] For example, as shown in FIG. 15, when the autonomous moving body 11 has taken a pose, it may bark "Woof!" to notify the user that the pose has been taken.

[0130] In step S23, the information processing terminal 12 captures an image of the autonomous moving body 11.

[0131] For example, the output unit 205 of the information processing terminal 12 displays guidance for capturing an image of the autonomous moving body 11 under the control of the UI control unit 243 .

[0132] In response to this, the user follows the guidance and photographs the autonomous moving body 11 using the information processing terminal 12. For example, the autonomous moving body 11 is photographed using a method similar to that used when generating a 3D model using general photogrammetry. Specifically, for example, the autonomous moving body 11 is photographed from all directions around 360 degrees, in a number of images that is sufficient to generate 3D data of at least the area around the part of the autonomous moving body 11 where the item is attached.

[0133] At this time, for example, the user may photograph the autonomous mobile body 11 while moving around the autonomous mobile body 11 with the information processing terminal 12. Alternatively, for example, as shown in Fig. 16, the user may photograph the autonomous mobile body 11 while rotating a turntable 402 on which the autonomous mobile body 11 is placed, with the information processing terminal 12 fixed.

[0134] FIG. 16 shows an example in which the autonomous moving body 11 is wearing a hat 401 as an item.

[0135] Also, for example, as shown in FIG. 17, the user may use the information processing terminal 12 to capture images of the surroundings of the autonomous moving body 11 from three directions: diagonally above, from the front, and from diagonally below the autonomous moving body 11.

[0136] The image acquisition unit 251 of the information processing terminal 12 acquires image data obtained by capturing an image of the autonomous moving body 11 from the sensing unit 202 .

[0137] For example, the image acquisition unit 251 may generate information indicating the progress of the photographing (scanning) of the autonomous mobile body 11, and supply it to the UI control unit 243 or transmit it to the autonomous mobile body 11 via the communication unit 203.

[0138] Information indicating the progress of the photographing of the autonomous moving body 11 includes, for example, information indicating the image data that has been photographed and the image data that has not yet been photographed among the image data required to generate the 3D moving body, information regarding the direction in which photographing is required, etc.

[0139] In response to this, for example, the output unit 205 may display the progress of the image capturing of the autonomous moving body 11 under the control of the UI control unit 243 .

[0140] Furthermore, for example, the autonomous mobile body 11 may be configured to show a reaction according to the progress of the image capturing by the autonomous mobile body 11. For example, as shown in Fig. 17 , when image capturing is progressing smoothly, the autonomous mobile body 11 may bark "woof." For example, when image capturing is not progressing smoothly, for example, when image capturing is not being performed from a required direction, the autonomous mobile body 11 may be configured to meow "meow."

[0141] For example, when the autonomous mobile body 11 is wearing multiple items, the autonomous mobile body 11 may be configured to assume a different pose for each item. Then, the user may photograph the autonomous mobile body 11 from 360 degrees around it each time the autonomous mobile body 11 assumes a different pose.

[0142] In step S24, the autonomous moving body 11 ends the scanning pause.

[0143] For example, the user instructs the autonomous moving body 11 to end the scanning pause by issuing a predetermined voice command (for example, "That's enough," "It's done," etc.).

[0144] In response to this, the sensing unit 102 of the autonomous mobile body 11 collects the voice corresponding to the voice command and supplies the voice data corresponding to the collected voice to the information processing unit 104. The recognition unit 121 of the information processing unit 104 recognizes that an instruction to end the scan pause has been issued by recognizing the voice command based on the voice data.

[0145] Alternatively, for example, the user inputs an instruction to end the scanning pause to the autonomous moving body 11 via the input unit 201 of the information processing terminal 12 .

[0146] In response to this, the input unit 201 of the information processing terminal 12 notifies the information processing unit 204 that an instruction to end the scan pause has been input. The image acquisition unit 251 of the information processing terminal 12 transmits the instruction to end the scan pause to the autonomous moving body 11 via the communication unit 203.

[0147] In response to this, the recognition unit 121 of the autonomous mobile body 11 receives an instruction to end the scan pause from the information processing terminal 12 via the communication unit 103. As a result, the recognition unit 121 recognizes that an instruction to end the scan pause has been issued.

[0148] When the recognition unit 121 of the autonomous mobile body 11 recognizes that an instruction to end the scan pause has been issued, it supplies situation data indicating the recognition result to the action planning unit 123 .

[0149] The behavior planning unit 123 plans the behavior of the autonomous mobile body 11 so as to end the scan pause. The behavior planning unit 123 supplies the motion control unit 124 with behavior plan data indicating the planned behavior.

[0150] The motion control unit 124 ends the scan pause by controlling the drive unit 105 and the output unit 106 based on the action plan data.

[0151] The scanning process then ends.

[0152] Returning to FIG. 10, in step S2, the information processing terminal 12 executes a 3D data generation process.

[0153] Here, the 3D data creation process will be described in detail with reference to the flowchart of FIG.

[0154] In step S41, the 3D data generation unit 261 of the information processing terminal 12 generates 3D data (3D moving body) of the autonomous moving body 11. Specifically, the image acquisition unit 251 supplies image data of the autonomous moving body 11 to the 3D data generation unit 261.

[0155] The 3D data generation unit 261 generates a 3D moving body, which is 3D data of the autonomous moving body 11, from multiple image data captured from multiple different directions using, for example, general photogrammetry technology.

[0156] In step S42, the 3D data generation unit 261 adjusts the size of the 3D data (3D moving body) of the autonomous moving body 11. For example, the 3D data generation unit 261 detects a predetermined part of the 3D moving body (e.g., a hand, an eye, etc.). Based on the detected part, the 3D data generation unit 261 adjusts the size (e.g., dimensions) of the 3D moving body to a size equivalent to the actual size of the autonomous moving body 11. The 3D data generation unit 261 supplies the 3D moving body after the size adjustment to the extraction unit 271.

[0157] After that, the 3D data creation process ends.

[0158] Returning to FIG. 10, in step S3, the information processing terminal 12 executes a virtual item creation process.

[0159] The virtual item creation process will now be described in detail with reference to the flowchart of FIG.

[0160] In step S61, the extraction unit 271 of the information processing terminal 12 extracts 3D data of an item (3D item). For example, the extraction unit 271 extracts the 3D item, which is 3D data of an item attached to the autonomous mobile body 11, by subtracting the 3D model of the autonomous mobile body 11 from the 3D mobile body.

[0161] For example, A in FIG. 20 shows an example of a 3D model 411 (CAD data) of the head of the autonomous moving body 11.

[0162] Fig. 20B schematically shows a portion to be deleted from the 3D data of the autonomous moving body 11 wearing the hat 401 shown in Fig. 16 based on the 3D model 411 of Fig. 20A. For example, the portion shown by diagonal lines in Fig. 20B is deleted.

[0163] As a result, for example, 3D data of a hat 401 is extracted as shown in FIG.

[0164] The extraction unit 271 supplies the 3D items to the editing unit 272 .

[0165] In step S62, the editing unit 272 adjusts the size of the 3D data of the item (3D item). For example, the editing unit 272 adjusts the size of the 3D item for a virtual mobile object application.

[0166] For example, the processing of step S62 may be omitted, and the size of the 3D item may be adjusted as necessary in step S64, which will be described later.

[0167] In step S63, the editing unit 272 changes the surface texture of the 3D data of the item (3D item). For example, the editing unit 272 changes the surface texture (material) of the 3D item for a virtual mobile object application.

[0168] The editing unit 272 supplies the 3D item to the UI control unit 243. The output unit 205 displays the 3D item under the control of the UI control unit 243.

[0169] For example, the processing of step S63 may be omitted, and the texture of the 3D item may be changed as necessary in step S64, which will be described later.

[0170] In step S64, the editing unit 272 edits the 3D data of the item (3D item).

[0171] For example, the user may perform an operation to edit the 3D item displayed on the output unit 205 via the input unit 201 as needed. For example, if the 3D item includes multiple items, the user may perform an operation to separate each item. For example, the user may perform an operation to remove noise from the 3D item or adjust the shape as needed. For example, the user may perform an operation to change the size or design (e.g., color, pattern, shape, etc.) of the 3D item as needed. For example, the user may perform an operation to combine 3D data of another item with the 3D item.

[0172] In response to this, the input unit 201 supplies input data indicating the editing content by the user to the information processing unit 204. The editing unit 272 of the information processing unit 204 edits the 3D item based on the editing content by the user. As a result, a dress-up item, which is a virtual item corresponding to the item attached to the autonomous moving body 11, is generated.

[0173] If editing is not required, the process of step S64 may be omitted.

[0174] Furthermore, for example, the editing unit 272 may automatically edit the 3D items using AI (Artificial Intelligence) or the like.

[0175] In step S65, the editing unit 272 gives a title to the dress-up item.

[0176] For example, the user inputs a title to be given to the dress-up item via the input unit 201 of the information processing terminal 12 .

[0177] In response to this, the input unit 201 supplies input data indicating the input title to the information processing unit 204. The editing unit 272 of the information processing unit 204 assigns the input title to the dress-up item.

[0178] The editing unit 272 supplies the dress-up item with the title to the registration unit 253.

[0179] For example, a title may be assigned to a 3D item before editing it.

[0180] Then, the virtual item creation process ends.

[0181] 10, in step S4, the registration unit 253 registers the dress-up item. Specifically, the registration unit 253 transmits data of the dress-up item to the information processing server 13.

[0182] In response to this, the information processing unit 302 of the information processing server 13 receives the data of the dress-up item. For example, the application control unit 322 of the information processing unit 302 adds the newly generated dress-up item to a list of dress-up items in the virtual mobile application of the user's account.

[0183] This allows the user to select and use the created dress-up item in the virtual mobile application.

[0184] Then, the dress-up item generation process ends.

[0185] <Dressing-Up Process> Next, the dressing-up process executed by the information processing terminal 12 will be described with reference to the flowchart of FIG.

[0186] In step S101, the information processing terminal 12 acquires a dress-up item.

[0187] For example, the output unit 205 displays the menu screen 451 shown in Fig. 23 under the control of the UI control unit 243. The menu screen 451 includes an item for "changing clothes."

[0188] In response to this, for example, the user selects “change clothes” from the menu screen 451 via the input unit 201 .

[0189] In response to this, the input unit 201 supplies input data indicating that "Dress Up" has been selected to the information processing unit 204. The UI control unit 243 of the information processing unit 204 controls the output unit 205 to display a list of dress-up items that the user can use.

[0190] In response to this, for example, the user selects a desired dress-up item from the list of dress-up items via the input unit 201 .

[0191] In response to this, the input unit 201 supplies input data indicating the selected dress-up item to the information processing unit 204. The dress-up image generation unit 242 receives data on the virtual moving object and the selected dress-up item from the information processing server 13.

[0192] In step S102, the dress-up image generation unit 242 attaches dress-up items to the virtual moving object. Specifically, the dress-up image generation unit 242 generates a 3D image in which the virtual moving object is combined with the dress-up items based on data of the virtual moving object and the dress-up items. The dress-up image generation unit 242 supplies data of the generated 3D image to the UI control unit 243.

[0193] In step S103, the information processing terminal 12 displays a virtual moving object wearing the dress-up item. Specifically, the UI control unit 243 causes the output unit 205 to display a 3D image of the virtual moving object wearing the dress-up item based on the acquired 3D image data. As a result, for example, as shown in A of Fig. 24, a virtual moving object 501 wearing a hat 502, which is a dress-up item, is displayed.

[0194] For example, the viewpoint from which the virtual moving object is displayed may be freely changed in accordance with a user operation. For example, as shown in B of Fig. 24, the viewpoint from which the virtual moving object 501 wearing a hat 502 is displayed may be changed.

[0195] Then, the dress-up process ends.

[0196] In this way, dress-up items that can be worn on virtual moving objects can be easily generated.

[0197] For example, a user can attach items such as a hat, clothes, or shoes to the autonomous moving body 11 and generate dress-up items corresponding to the attached items simply by photographing the autonomous moving body 11 using the information processing terminal 12.

[0198] This allows the user to easily create original, one-of-a-kind dress-up items. Also, for example, the user can easily create dress-up items using commercially available items, fabrics, etc.

[0199] Furthermore, for example, when an attempt is made to generate a dress-up item by photographing an item alone, the item may not be able to maintain a shape that matches the form of the autonomous moving body 11. In other words, the shape of the item may differ from the state when it is attached to the autonomous moving body 11. As a result, the image of the generated dress-up item may differ from the image when it is actually attached to the autonomous moving body 11.

[0200] On the other hand, in the present technology, the dress-up item is generated based on the item actually attached to the autonomous moving body 11, and therefore the shape of the dress-up item is maintained in an ideal state.

[0201] Furthermore, because the dress-up items are generated based on the items actually attached to the autonomous moving body 11, for example, the virtual item generation unit 262 of the information processing terminal 12 can easily recognize the attachment position of the dress-up items on the virtual moving body. By using this recognized information, for example, it becomes possible to automatically attach the dress-up items to appropriate positions on the virtual moving body without the user having to set the attachment position of the dress-up items.

[0202] <<2. Modifications>> Modifications of the above-described embodiments of the present technology will now be described.

[0203] <Modifications Regarding Allocation of Processing in Information Processing System 1> The allocation of processing among the devices in the information processing system 1 described above is one example, and can be changed as appropriate.

[0204] For example, the information processing server 13 may be configured to execute part of the processing of the information processing terminal 12. For example, the information processing server 13 may be configured to execute part of the processing of the dress-up item generation unit 241 of the information processing terminal 12. In other words, the information processing server 13 may be configured to generate dress-up items.

[0205] For example, an autonomous moving body 11 (hereinafter referred to as a target moving body) equipped with an item may be photographed by another autonomous moving body 11 (hereinafter referred to as a photographing moving body).

[0206] For example, when a user instructs the photographing moving object to scan a target moving object, the target moving object assumes a pose corresponding to the item it is wearing. The photographing moving object photographs the target moving object with the camera 53 while moving around the target moving object.

[0207] In this case, for example, the photographing mobile object may generate a dress-up item based on the photographed image data, or, for example, the photographing mobile object may transmit the photographed image data to the information processing terminal 12 or the information processing server 13, and the information processing terminal 12 or the information processing server 13 may generate a dress-up item.

[0208] For example, the image acquisition unit 251 of the information processing terminal 12 may transmit an instruction for a pose for scanning to the autonomous moving body 11 via the communication unit 203 and control the pose of the autonomous moving body 11.

[0209] <Regarding the reuse of dress-up items> For example, a dress-up item for a virtual moving body (hereinafter referred to as a destination virtual moving body) corresponding to another autonomous moving body (hereinafter referred to as a destination real moving body) may be generated based on an item worn by the autonomous moving body 11 (hereinafter referred to as the source real moving body) or a dress-up item for a virtual moving body (hereinafter referred to as the source virtual moving body) corresponding to the autonomous moving body 11.

[0210] For example, the 3D data conversion unit 261 of the information processing terminal 12 modifies the size and shape of a 3D item generated based on the image data of the source real moving body to correspond to the destination real moving body, based on the size and shape of the source real moving body, the size and shape of the destination real moving body, and the expected attachment position of the item. In other words, the size and shape of the 3D item generated based on the image data of the source real moving body are changed to match the destination real moving body. Then, a dress-up item is generated based on the modified 3D item, thereby generating a virtual item that can be attached to the destination virtual moving body.

[0211] For example, the editing unit 272 of the information processing terminal 12 modifies the size and shape of the dress-up item for the source virtual moving body to correspond to the shape and attachment position of the destination virtual moving body based on the size and shape of the source virtual moving body and the size, shape, and attachment position of the dress-up item of the destination virtual moving body. In other words, the size and shape of the dress-up item for the source virtual moving body are changed to match the destination virtual moving body. This generates a virtual item that can be attached to the destination virtual moving body.

[0212] 25, a hat 522B is generated which is a virtual item that can be worn by a virtual moving body 521 corresponding to a different type of autonomous moving body from the virtual moving body 501 and has the same design as a hat 522A which is a virtual item worn by the virtual moving body 501. For example, as shown in FIG. 26, a costume 531B is generated which is a virtual item that can be worn by the virtual moving body 521 and has the same design as a costume 531A which is a virtual item worn by the virtual moving body 501.

[0213] In the latter generation method, a destination real moving object corresponding to the destination virtual moving object does not necessarily have to exist. That is, the destination virtual moving object may exist only in the virtual space.

[0214] Conversely, for example, by using a similar method, it is possible to generate a dress-up item for a virtual mobile body corresponding to the autonomous mobile body 11 based on an item attached to another autonomous mobile body or a dress-up item for a virtual mobile body corresponding to another autonomous mobile body.

[0215] In this case, for example, by setting another autonomous moving body as the user, it is possible to generate a dress-up item for the virtual moving body corresponding to the autonomous moving body 11 based on the item worn by the user. This makes it possible, for example, in a virtual moving body application, to wear a dress-up item that matches the user's.

[0216] Furthermore, for example, by treating the other autonomous moving body as a pet such as a dog or cat, it is possible to generate a dress-up item for the virtual moving body corresponding to the autonomous moving body 11 based on the item attached to the pet. This makes it possible, for example, in a virtual moving body application, to attach a dress-up item that matches the pet to the virtual moving body.

[0217] <Other Modifications> For example, the dress-up items may be 3D data or 2D (two-dimensional) data.

[0218] For example, a dress-up item created by a certain user may be made public on the Internet or the like, so that other users can use it. Furthermore, other users may be allowed to edit the published dress-up item.

[0219] The autonomous moving body to which the present technology can be applied is not particularly limited as long as it is a real autonomous moving body that can be equipped with an item in the real world and can equip a corresponding virtual moving body with a virtual item in a virtual space. Such an autonomous moving body may be a living being such as a person (e.g., a user) or an animal (e.g., a pet).

[0220] <<3. Others>> <Example of Computer Configuration> The above-described series of processes can be executed by hardware or software. When the series of processes is executed by software, the programs that make up the software are installed on a computer. Here, the computer includes a computer built into dedicated hardware, and a general-purpose personal computer, for example, that can execute various functions by installing various programs.

[0221] FIG. 27 is a block diagram showing an example of the hardware configuration of a computer that executes the above-described series of processes by a program.

[0222] In the computer 1000 , a CPU (Central Processing Unit) 1001 , a ROM (Read Only Memory) 1002 , and a RAM (Random Access Memory) 1003 are interconnected by a bus 1004 .

[0223] An input / output interface 1005 is further connected to the bus 1004. An input unit 1006, an output unit 1007, a recording unit 1008, a communication unit 1009, and a drive 1010 are connected to the input / output interface 1005.

[0224] The input unit 1006 includes input switches, buttons, a microphone, an image sensor, etc. The output unit 1007 includes a display, a speaker, etc. The recording unit 1008 includes a hard disk, a non-volatile memory, etc. The communication unit 1009 includes a network interface, etc. The drive 1010 drives removable media 1011 such as a magnetic disk, an optical disk, a magneto-optical disk, or a semiconductor memory.

[0225] In the computer 1000 configured as described above, the CPU 1001 loads a program recorded in the recording unit 1008, for example, into the RAM 1003 via the input / output interface 1005 and the bus 1004, and executes the program, thereby performing the above-described series of processes.

[0226] The program executed by the computer 1000 (CPU 1001) can be provided by being recorded on a removable medium 1011 such as a package medium, for example. The program can also be provided via a wired or wireless transmission medium such as a local area network, the Internet, or digital satellite broadcasting.

[0227] In the computer 1000, the program can be installed in the recording unit 1008 via the input / output interface 1005 by inserting the removable medium 1011 into the drive 1010. The program can also be received by the communication unit 1009 via a wired or wireless transmission medium and installed in the recording unit 1008. Alternatively, the program can be installed in the ROM 1002 or the recording unit 1008 in advance.

[0228] The program executed by the computer may be a program that processes in chronological order according to the order described in this specification, or may be a program that processes in parallel or at the required timing, such as when called.

[0229] In this specification, a system refers to a collection of multiple components (devices, modules (components), etc.), regardless of whether all of the components are housed in the same housing. Therefore, multiple devices housed in separate housings and connected via a network, and a single device housed in a single housing with multiple modules, are both systems.

[0230] Furthermore, the embodiments of the present technology are not limited to the above-described embodiments, and various modifications are possible within the scope of the present technology.

[0231] For example, the present technology can be configured as a cloud computing system in which a single function is shared and processed collaboratively by a plurality of devices via a network.

[0232] Furthermore, each step described in the above flowchart can be executed by one device, or can be shared and executed by a plurality of devices.

[0233] Furthermore, when one step includes multiple processes, the multiple processes included in that one step can be executed by one device or can be shared and executed by multiple devices.

[0234] <Examples of Combinations of Configurations> The present technology can also have the following configurations.

[0235] (1) An information processing device comprising: an image acquisition unit that acquires image data of a first autonomous moving body assuming a pose corresponding to an attached item; and an image processing unit that generates, based on the image data, a virtual item that can be attached to a first virtual moving body in a virtual space. (2) The image processing unit comprises: a 3D data generation unit that generates a 3D moving body, which is 3D data of the first autonomous moving body, based on a plurality of image data photographed of the first autonomous moving body from a plurality of different directions; an extraction unit that extracts a 3D item, which is 3D data of the item, from the 3D moving body; and an editing unit that edits the 3D item to generate the virtual item. (3) The information processing device described in (2), wherein the editing unit changes at least one of the size, design, and surface texture of the 3D item. (4) The information processing device described in (2) or (3), wherein the extraction unit extracts the 3D item from the 3D moving body using a 3D model of the first autonomous moving body. (5) The information processing device according to any one of (2) to (4), wherein the first virtual moving body is a simulation of a second autonomous moving body different from the first autonomous moving body in the virtual space. (6) The information processing device according to (5), wherein the editing unit changes the size and shape of the 3D item to match the second autonomous moving body based on the size and shape of the first autonomous moving body and the size, shape, and attachment position of the item of the second autonomous moving body, edits the changed 3D item, and generates the virtual item. (7) The information processing device according to (5), wherein the editing unit changes the size and shape of the virtual item to match the first virtual moving body based on the size and shape of a second virtual moving body corresponding to the first autonomous moving body, and the size, shape, and attachment position of the virtual item of the first virtual moving body. (8) The information processing device according to any one of (1) to (4), wherein the first virtual moving body is a simulation of the first autonomous moving body in the virtual space.(9) The information processing device according to any one of (1) to (8), wherein the pose corresponding to the item is a pose that makes it easy to photograph the item. (10) The information processing device according to any one of (1) to (9), wherein the image acquisition unit controls a pose of the first autonomous moving body. (11) The information processing device according to any one of (1) to (10), wherein the image acquisition unit outputs information indicating a progress status of photographing the first autonomous moving body. (12) The information processing device according to (1) to (11), wherein the image generation unit generates an image of the first virtual moving body wearing the virtual item in the virtual space. (13) An information processing method, including: an information processing device acquiring image data of an autonomous moving body taking a pose corresponding to the worn item; and generating a virtual item that can be worn by a virtual moving body in the virtual space based on the image data.

[0236] The effects described in this specification are merely examples and are not limiting, and other effects may also be present.

[0237] 1 Information processing system, 11-1 to 11-n Autonomous mobile body, 12-1 to 12-n Information processing terminal, 13 Information processing server, 104 Information processing unit, 105 Drive unit, 106 Output unit, 121 Recognition unit, 123 Action planning unit, 124 Operation control unit, 202 Sensing unit, 204 Information processing unit, 241 Dress-up item generation unit, 242 Dress-up image generation unit, 243 UI control unit, 251 Image acquisition unit, 252 Image processing unit, 261 3D data generation unit, 262 Virtual item generation unit, 271 Extraction unit, 272 Editing unit, 302 Information processing unit, 322 Application control unit, 501 Virtual mobile body

Claims

1. An information processing device comprising: an image acquisition unit that acquires image data of a first autonomous moving body assuming a pose corresponding to an attached item; and an image processing unit that generates a virtual item that can be attached to the first virtual moving body in a virtual space based on the image data.

2. The information processing device according to claim 1, wherein the image processing unit comprises: a 3D data conversion unit that generates a 3D moving body, which is 3D data of the first autonomous moving body, based on a plurality of image data photographed from a plurality of different directions of the first autonomous moving body; an extraction unit that extracts a 3D item, which is 3D data of the item, from the 3D moving body; and an editing unit that edits the 3D item and generates the virtual item.

3. The information processing device according to claim 2, wherein the editing unit changes at least one of the size, design, and surface texture of the 3D item.

4. The information processing device according to claim 2, wherein the extraction unit extracts the 3D item from the 3D moving body using a 3D model of the first autonomous moving body.

5. The information processing device according to claim 2, wherein the first virtual moving body is a simulation of a second autonomous moving body different from the first autonomous moving body in the virtual space.

6. The information processing device according to claim 5, wherein the editing unit changes the size and shape of the 3D item to match the second autonomous moving body based on the size and shape of the first autonomous moving body, and the size, shape, and attachment position of the item of the second autonomous moving body, edits the changed 3D item, and generates the virtual item.

7. The information processing device described in claim 5, wherein the editing unit changes the size and shape of the virtual item to match the first virtual moving body based on the size and shape of a second virtual moving body corresponding to the first autonomous moving body, as well as the size and shape of the first virtual moving body and the position where the virtual item is attached.

8. The information processing device according to claim 1, wherein the first virtual moving body is a simulation of the first autonomous moving body in the virtual space.

9. The information processing device according to claim 1, wherein the pose corresponding to the item is a pose that makes it easy to photograph the item.

10. The information processing device according to claim 1, wherein the image acquisition unit controls the pose of the first autonomous moving body.

11. The information processing device according to claim 1, wherein the image acquisition unit outputs information indicating a progress status of the image capture of the first autonomous moving body.

12. The information processing device according to claim 1, further comprising an image generating unit that generates an image of the first virtual moving object equipped with the virtual item in the virtual space.

13. An information processing method including: an information processing device acquiring image data of an autonomous moving body assuming a pose corresponding to an attached item; and generating a virtual item that can be attached to the virtual moving body in a virtual space based on the image data.

Images