Remote controller, and avatar control system

Abstract

To provide a remote controller capable of improving the operability of an avatar in a virtual space, and an avatar control system.SOLUTION: A remote controller comprises: a movable part 2a corresponding to a portion of a first avatar 41 moving in a virtual space VS; a first movement detection unit 2c which detects the movement of a main body to which the movable part 2a is connected and a movable part 2b; and a transmission unit (first communication unit 12) which transmits first movement information based on an output of the first movement detection unit 2c to the outside. Further, the remote controller comprises a second movement detection unit (first inertia sensor 18) which detects the movement of the main body. The remote controller transmits second movement information based on an output of the second movement detection unit to the outside by using the transmission unit.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present invention relates to a remote controller and an avatar control system that mainly controls the movement of an avatar in a virtual space. [Background technology]

[0002] In recent years, virtual spaces created using computer graphics (CG) have been utilized in various fields, including education, entertainment, business, and social activities. Furthermore, the metaverse, an advanced form of virtual space, interconnects multiple virtual spaces (worlds), merging reality and virtuality to provide users with new experiences and possibilities. In virtual spaces, users interact with their avatars, interacting with other users and learning and working. By improving the operability of avatars in virtual spaces, users can convey more natural movements to the avatar, enhancing the sense of immersion in the virtual space. Furthermore, improved communication between users facilitates smoother interpersonal relationships and collaboration within the virtual space. In other words, improving the operability of avatars is expected to make virtual spaces more accessible to a greater number of users.

[0003] To operate an avatar in a virtual space, input devices such as a keyboard, a mouse, a game controller, a touchpad, or a VR controller have conventionally been used. Furthermore, known technologies for improving the operability of an avatar include a technology for converting image data of a user captured by a camera or the like into an avatar, and a technology for reflecting the user's body movements detected by motion capture on the avatar.

[0004] One known technology for converting image data of a user into an avatar is a program that causes a computer equipped with a processor to execute functions as virtual camera software that outputs video data to an application that functions as an online video communication tool, the program causing a user terminal to execute the following steps: acquiring the user's image data; generating video data in which the user is converted into an avatar based on the image data; a first output step of outputting the generated video data to the application; and a second output step of outputting, in response to an operation by another user, composite data in which the other user's avatar is composited with the user's video data to the application (Patent Document 1).

[0005] According to Patent Document 1, it is possible to realize diverse communication between users who use online video communication tools, and it is also possible to realize communication via avatars by synthesizing avatar images of multiple users using only commonly available online video communication tools and virtual camera software, without the need for a special system.

[0006] Furthermore, as a technique for reflecting the user's movements detected by motion capture in the operation of an avatar, for example, a method is known in which the three-dimensional positions of the user's hands, face, etc. are acquired by real-time image recognition, and movements are generated from a small number of movement inputs to represent them as an avatar (Non-Patent Document 1).

[0007] According to Non-Patent Document 1, motion information defined for each object is triggered by the user's physical motion input, and the system selects appropriate information from this and reflects it as the actual avatar's motion or scene event. Specifically, examples include detailed finger motions according to the characteristics of virtual objects, motions adapted to changes in objects caused by opening and closing doors, and gaze control to turn the face toward a virtual object of interest. These are expected to enhance the presentation effect of the interaction being performed to the user and improve operation efficiency. [Prior art documents] [Patent documents]

[0008] [Patent Document 1] Patent No. 7133257 [Non-patent literature]

[0009] [Non-Patent Document 1] Satoshi Yonemoto, Rinichiro Taniguchi, "Avatar Motion Control Considering Efficient Manipulation of Virtual Objects", 66th National Convention of Information Processing Society of Japan, March 10, 2004 DISCLOSURE OF THE INVENTION [Problem to be solved by the invention]

[0010] However, conventional control using input devices is complicated because the input device does not directly correspond to the parts of the avatar, making it difficult to reproduce natural movements in the avatar. Furthermore, the technology disclosed in Patent Document 1 merely extracts feature points on the user's face from image data, tracks the movement of the feature points, and generates a video in accordance with the tracked movement of the parts of the avatar corresponding to the feature points, but does not suggest reflecting the movements of the limbs or the entire body in the avatar. Furthermore, the technology disclosed in Non-Patent Document 1 employs motion capture, which requires an imaging means such as a camera and a system for recognizing the user's movements, which generally makes the system complex and expensive.

[0011] The present invention has been devised to solve the problems of the prior art, and its purpose is to provide a remote controller and an avatar control system that can improve the operability of an avatar in a virtual space with a simple configuration. [Means for solving the problem]

[0012] The present invention, which has been made to solve the above problems, provides a remote controller including: a movable part corresponding to a part of a first avatar that moves in a virtual space; a main body to which the movable part is connected; a first motion detection part that detects the movement of the movable part; and a transmission part that transmits first motion information based on the output of the first motion detection part to an external device. This allows for easy and intuitive control and manipulation of each part of the first avatar in a virtual space.

[0013] Furthermore, the present invention includes a second motion detection unit that detects the motion of the main body, and the transmission unit transmits second motion information based on the output of the second motion detection unit to the outside, thereby enabling the entire first avatar to be moved easily and intuitively within the virtual space.

[0014] Furthermore, the present invention is also configured to include a switch section, and to determine whether or not to transmit the second movement information to the outside based on an operation state of the switch section by a user. This makes it possible to further improve the operability when moving the entire first avatar in virtual space.

[0015] In addition, in the present invention, the main body and the movable parts constitute a robot, and the movable parts are arms or legs of the robot, so that by manipulating parts of the robot, it becomes possible to control a first avatar in a virtual space.

[0016] Further, the present invention provides a driving source that displaces the movable portion relative to the main body, The remote control is configured to be switchable between a first operation mode in which the drive source is controlled based on the output of the first movement detection unit and a second operation mode in which the first movement information is transmitted to the outside, thereby enabling a user to use the remote control as a so-called personal assistant in the real space and to control an avatar in the virtual space.

[0017] Furthermore, the present invention includes an instruction unit that instructs switching between the first operation mode and the second operation mode, and when an instruction to switch from the first operation mode to the second operation mode is given, the instruction unit drives the drive source to position the movable part at a predetermined position relative to the main body, thereby making it possible to accurately measure the position of the movable part of the remote control.

[0018] Furthermore, the present invention controls the drive source based on the external information to displace the movable part, thereby enabling interactions occurring between the first avatar and other virtual objects in the virtual space to be fed back to the real world.

[0019] In addition, in the present invention, the transmission unit transmits the first movement information and the second movement information to a predetermined information terminal located between the transmission unit and a management unit that manages the virtual space. As a result, the first movement information and the second movement information are transmitted to an information terminal located near the remote controller using short-range wireless communication. By employing short-range wireless communication, it is possible to reduce the cost of the remote controller.

[0020] The present invention also provides an avatar control system including a management unit that manages a virtual space and a remote controller, wherein the management unit displaces a part of the first avatar corresponding to the movable part based on the first movement information output from the remote controller, thereby enabling each part of the first avatar in the virtual space to be easily and intuitively controlled and operated.

[0021] The present invention also provides an avatar control system that includes a management unit that manages a virtual space and a remote controller, wherein the management unit controls the position or orientation of the first avatar in the virtual space based on the second movement information output from the remote controller, thereby enabling the entire first avatar to be displaced easily and intuitively within the virtual space.

[0022] In addition, the present invention is configured such that the second movement information includes information regarding acceleration, and when the acceleration is greater than a predetermined value, the management unit displaces the first avatar by a larger displacement than the displacement based on the second movement information. This allows the first avatar to move largely as a whole in virtual space, for example, to move quickly between multiple virtual spaces (VSs) that make up a metaverse.

[0023] In addition, in the present invention, when the management unit detects that a predetermined event has occurred in the virtual space between the first avatar and a second avatar different from the first avatar or a predetermined virtual object, it transmits event information corresponding to the event to the remote controller. This makes it possible to notify the remote controller of an interaction that has occurred between the first avatar and another virtual object in the virtual space.

[0024] In addition, in the present invention, the remote controller includes a drive source for displacing the movable part, and the drive source displaces the movable part based on the event information, thereby enabling an interaction occurring between the first avatar and another virtual object in the virtual space VS to be fed back to the real world. [Effects of the Invention]

[0025] In this way, according to the present invention, it is possible to improve the operability of an avatar in a virtual space with a simple configuration. [Brief explanation of the drawings]

[0026] [Figure 1] FIG. 1 is a diagram showing the configuration of an avatar control system S1 according to an embodiment of the present invention. [Figure 2] An explanatory diagram showing the appearance of the remote control [Figure 3] Block diagram showing the configuration of the remote control [Figure 4] 1A and 1B are explanatory diagrams showing how the remote control 2 is used, and 1C and 1D are explanatory diagrams showing the movement of the first avatar 41 in response to the operation of the remote control 2. [Figure 5] FIG. 1 is an explanatory diagram showing the relationship between a first avatar 41 and other virtual objects in a virtual space VS. [Figure 6] An explanatory diagram showing a situation in which a first avatar 41 moves between worlds 62 in a virtual space VS. DETAILED DESCRIPTION OF THE INVENTION

[0027] (First embodiment) A first embodiment of the present invention will be described below with reference to the drawings. FIG. 1 is a configuration diagram showing the configuration of an avatar control system S1 according to the first embodiment of the present invention. The avatar control system S1 is made up of a server 30, an information terminal 3, and a remote controller (hereinafter sometimes referred to as a "remote control 2"). The server 30 is a known computer system, and is made up of a server control unit 30a, a server storage unit 30b, and a server communication unit 30c. When the virtual space VS is large-scale or for the purpose of avoiding failures, a so-called cluster system may be constructed by combining multiple servers 30.

[0028] The server control unit 30a is composed of a central processing unit (CPU) and a storage unit (not shown), and controls the components of the server 30. The server storage unit 30b includes a large-capacity storage configured with a RAID (Redundant Array of Independent Disks) or the like, together with a read-only memory (ROM) and a random access memory (RAM).

[0029] This large-capacity storage stores spatial data such as the location and status of the terrain, objects, and entities as information about the virtual space VS itself. It also stores information related to users 1 who use the virtual space VS, such as account information, settings, profiles, activity history, content created by users 1, and behavior within the virtual space VS, as well as transaction data such as transactions conducted within the virtual space VS, communications between users, and events. The server control unit 30a manages this information, updates the status of the virtual space VS in real time, and synchronizes it among all users.

[0030] Here, the information related to user 1 also includes information about the avatar that represents user 1 in virtual space VS. In general, virtual space VS provides an avatar creation tool. Using the avatar creation tool, user 1 selects the type of entity they wish to use as their avatar, such as a human, animal, or imaginary creature. Then, depending on the selected entity type, they select appearance parameters (body type, color, features, skin, etc.), movement parameters (specific movements, etc.), and characteristic parameters (specific abilities, skills, etc.). These selected parameters are stored in server storage unit 30b.

[0031] The server communication unit 30c is configured with, for example, a network interface card (NIC) or the like, and connects to the network 50 using a protocol such as TCP / IP. Note that if real-time performance is important, a protocol such as WebSockets or WebRTC may be used.

[0032] The information terminal 3 is, for example, a mobile information terminal such as a smartphone or tablet terminal, or a PC (Personal Computer). The information terminal 3 includes a second control unit 3a, a second storage unit 3b, a second communication unit 3c, an input unit 3d, and a display unit 3e. The second control unit 3a is configured with a CPU or the like, and operates according to a control program stored in the second storage unit 3b, which is configured with a ROM, RAM, etc. The second control unit 3a and the other components are connected, for example, by a bus, and the second control unit 3a controls the other components via the bus or the like.

[0033] The second communication unit 3c includes a first communication module (not shown) that complies with a short-range wireless standard, such as Bluetooth (registered trademark) Low Energy (BLE). The first communication module establishes a connection with the remote control 2 to transmit and receive information. The second communication unit 3c further includes a second communication module (not shown) that complies with a wireless communication standard, such as LTE (Long Term Evolution), LTE-M (Long Term Evolution-Machine, LTE Cat. M1), 4G, or 5G, connects to the network 50 using a predetermined protocol, and transmits and receives information to and from the server 30. Of course, the second communication module may also be compliant with the WiFi (Wireless Fidelity) standard and connected to the network 50 via a wireless router, for example.

[0034] The input unit 3d is configured with input devices such as a keyboard and a mouse (neither of which is shown). The input unit 3d may also include an audio input device such as a microphone (not shown). The user 1 inputs predetermined commands, text information, and audio information to the information terminal 3 via the input unit 3d. The input information is then transmitted to the server 30. If the information input to the input unit 3d is audio information, the second control unit 3a may perform voice recognition to convert the audio information into text information and transmit the text information to the server 30. Of the information input to the input unit 3d, a mode switching command (described later) is transmitted from the information terminal 3 to the remote control 2.

[0035] The display unit 3e is configured, for example, by an LCD (Liquid Crystal Display) or an OLED (Organic Light Emitting Diode). The input unit 3d and the display unit 3e may be configured separately from the information terminal 3 and connected to the information terminal 3. Specifically, the display unit 3e may be VR (Virtual Reality) goggles, a VR headset, or the like. The information terminal 3 is provided with an audio output unit (not shown) such as a speaker or a headphone jack. The audio output unit is also used to provide information to the user 1.

[0036] The server 30 and the information terminal 3 are connected to a network 50, and the server 30 and the information terminal 3 transmit and receive information to and from each other via the network 50. The remote control 2 and the information terminal 3 are placed near each other and transmit and receive information to and from each other via short-range wireless communication. Of course, the remote control 2 may be configured to be connected to the network 50.

[0037] Here, the server 30 and the information terminal 3 constitute a client-server system (CSS). The server control unit 30a grasps the three-dimensional structure of the virtual space VS and the positions and postures of virtual objects such as avatars, and performs modeling. Furthermore, the server control unit 30a manages information related to the virtual space VS (including modeled information, hereinafter sometimes referred to as "virtual space-related information"), such as data related to the user 1, spatial data, transaction data, and security data. The server control unit 30a also controls access control for the user 1, updating and synchronizing the virtual space VS, managing transactions, maintaining security, and so on. Through this information and control, the server 30 ensures consistency and safety in the operation and management of the virtual space VS.

[0038] Here, the virtual space-related information includes event information that occurs between avatars or between an avatar and a virtual object (information about interactions and contact between avatars, interference (e.g., collisions) between an avatar and another virtual object (including another avatar), and purchase, sale, exchange, etc. of a virtual object). The event information also serves as an event occurrence notification that notifies that an event has occurred. When an event involving the first avatar 41 occurs, the server 30 transmits the event information to the information terminal 3. The server 30 may transmit the event information to both the information terminal 3 and the remote control 2.

[0039] Meanwhile, the information terminal 3, which serves as a client terminal, receives virtual space-related information from the server 30. The second control unit 3a then performs drawing processing, such as rendering and texture mapping, on virtual objects such as avatars in the virtual space VS, and displays the image on the display unit 3e. Based on the virtual space-related information, text information may be displayed on the display unit 3e, and audio may be reproduced by an audio output unit such as a speaker (not shown). The second control unit 3a also transmits operation information (first movement information and second movement information, which will be described later) received from the remote control 2 to the server 30. The remote control 2 may also transmit operation information to both the information terminal 3 and the server 30. Upon receiving event information from the server 30, the second control unit 3a also transmits the event information to the remote control 2. In this way, the avatar control system S1 is configured as a CSS, and processing related to the virtual space VS is shared between the server 30 and the information terminal 3. From this perspective, it can be said that the management unit is configured by the server 30 and the information terminal 3 working together.

[0040] FIG. 2 is an explanatory diagram showing the appearance of the remote control 2. Here, the remote control 2 has the form of a so-called humanoid robot, but it may of course be a robot imitating the form of an animal such as a dog or cat, or an imaginary creature. Note that here, a robot means a machine equipped with three elements: a sensor system, an intelligence / control system, and a drive system (see the "Robot Policy Study Group Report" (May 2006, Ministry of Economy, Trade and Industry)), and its form is not important; for example, it may not have legs 2L.

[0041] In one aspect, the remote control 2 functions as a personal assistant that communicates with the user 1 using gestures, voice, etc., and provides the user 1 with information about, for example, lifestyle and health management based on information acquired via the network 50. There are no particular restrictions on the size of the remote control 2, but considering operability, the remote control 2 is configured to be approximately 15 cm in height. In the following description, the side of the remote control 2 visible in FIG. 2 may be referred to as the front, the opposite side as the back, the direction of the right arm 2AR as the right, the direction of the left arm 2AL as the left, the direction of the head 2HD as the up, and the opposite side as the down.

[0042] The remote control 2 is composed of a main body 2BD, a head 2HD, arms 2A (right arm 2AR, left arm 2AL), and legs 2L (right leg 2LR, left leg 2LL) as visible external elements. The arms 2A and legs 2L are connected to the main body 2BD. Joints (not shown) may be provided at least at the shoulders 2p, elbows 2q, and wrists of the arms 2A, and at the portions of the legs 2L that engage with the main body 2BD (the bases 2s of the legs 2L), knees 2t, and ankles 2u. Furthermore, motors (drive sources 2b (see FIGS. 1 and 3)) are disposed near the joints at least at the shoulders 2p, bases 2s, and ankles 2u. When the drive source 2b is driven, the arms 2A and legs 2L rotate within a predetermined range around the joints.

[0043] Furthermore, by applying an external force to the arm 2A, the remote control 2 can rotate (displace) the arm 2A relative to the main body 2BD around a joint provided at the shoulder 2p (see FIG. 4(A)). Similarly, the leg 2L can be rotated relative to the main body 2BD around a joint provided at the base 2s. The arm 2A can rotate (360°) around the joint at the shoulder 2p. As will be described later, the movements of the arm 2A and leg 2L are detected as first movement information and used to control the avatar in the virtual space VS.

[0044] As described above, the remote control 2 of the first embodiment includes the arms 2A and legs 2L as the movable part 2a, and the movable part 2a is connected to the main body. The main body and the movable part 2a form a robot. This makes it possible to control the first avatar 41 in the virtual space VS by manipulating the robot parts.

[0045] Furthermore, the remote controller 2 is provided with a first notification unit 14, a second notification unit 15, a first switch 16, and a second switch 17 on the main body 2BD or the head 2HD. These function as a so-called user interface.

[0046] FIG. 3 is a block diagram showing the configuration of the remote control 2. Hereinafter, the description will continue with FIG. 3 in conjunction with FIG. 1 and FIG. 2. In addition to the above-mentioned components, the remote control 2 is also configured with a first control unit 10, a first memory unit 11, a first communication unit 12, a first inertial sensor 18, a right leg drive unit 2LRa, a right leg motor 2LRb, a right leg motion detection unit 2LRc, a left leg drive unit 2LLa, a left leg motor 2LLb, a left leg motion detection unit 2LLc, a right arm drive unit 2ARa, a right arm motor 2ARb, a right arm motion detection unit 2ARc, a left arm drive unit 2ALa, a left arm motor 2ALb, and a left arm motion detection unit 2ALc. Here, each motor, such as the right leg motor 2LRb, is configured, for example, as a DC servo motor. In the following description, the right leg motion detection unit 2LRc, left leg motion detection unit 2LLc, right arm motion detection unit 2ARc, and left arm motion detection unit 2ALc may be collectively referred to as the "first motion detection unit 2c."

[0047] The first control unit 10 is made up of a CPU and the like, and operates according to a control program stored in a first storage unit 11 made up of a ROM, RAM, and the like. The first control unit 10 and other components are connected via a bus 20 and the like, and the first control unit 10 controls the other components via the bus 20 and the like. The first storage unit 11 also includes a non-volatile memory (such as an EEPROM (Electrically Erasable Programmable Read-Only Memory)). This non-volatile memory stores a plurality of operation patterns that are referenced when the remote control 2 is actively operated (as a robot).

[0048] The first communication unit 12 includes a communication module (not shown) that complies with a short-range wireless standard such as BLE. The first communication unit 12 transmits and receives information to and from the information terminal 3 via the communication module. The first communication unit 12 may further include a communication module (not shown) that complies with a wireless communication standard such as LTE or LTE-M. In this case, the remote control 2 connects directly (without going through the information terminal 3) to the network 50 and transmits and receives predetermined information to and from the server 30.

[0049] The first notification unit 14 includes a light-emitting element such as an LED (Light Emitting Diode). The LED is arranged in a position on the remote control 2 that corresponds to a human eye. The first control unit 10 changes the lighting pattern of the first notification unit 14 to indicate, for example, the operation mode of the remote control 2 to the user 1. Furthermore, the first notification unit 14 includes a speaker, and audio information is provided to the user 1 via the speaker.

[0050] The second notification unit 15 is configured with a display using, for example, an LCD or OLED. The second notification unit 15 displays, for example, text information or images. The first switch 16 is a push switch or the like provided in approximately the center of the main body 2BD (see FIG. 2) so that the user 1 can easily operate it with his / her finger, and is used when the remote control 2 operates in a second operation mode, which will be described later. The first switch 16 may determine whether or not a part of the first switch 16 is covered by the user 1's finger or the like, or whether or not the finger or the like is in contact with the first switch 16. In this case, the first switch 16 may be configured with a reflective sensor, a capacitive touch sensor, or the like.

[0051] The second switch 17 is a push switch or the like located on the top of the remote control 2. When the second switch 17 is pressed, the remote control 2 starts / stops operation. Note that the control mode of the remote control 2 may be changed depending on how the second switch 17 is pressed (for example, whether it is pressed long or short).

[0052] The first inertial sensor 18 is composed of, for example, a triaxial acceleration sensor and / or a gyro sensor. Here, the triaxial acceleration sensor outputs the direction and degree of speed change of the remote control 2 (acceleration) for the three axes X, Y, and Z. The gyro sensor outputs the direction and speed at which the remote control 2 is rotating (angular velocity) for the three axes X, Y, and Z. Generally, the gyro sensor detects the direction of movement, and the acceleration sensor detects the movement speed and distance. In this way, the first inertial sensor 18 outputs triaxial acceleration information and triaxial angular velocity information based on the movement of the remote control 2. The first control unit 10 performs offset (origin deviation) and sensitivity correction, etc. on the output of the first inertial sensor 18 to generate second movement information.

[0053] The user 1 operates the input unit 3d (see FIG. 1) of the information terminal 3 to select the operation mode of the remote control 2. Specifically, the user 1 selects either a "first operation mode" in which the remote control 2 operates actively (autonomously) as a robot, or a "second operation mode" in which the remote control 2 controls the first avatar 41 in the virtual space VS (i.e., operates passively as a controller). The first operation mode and the second operation mode can be switched as appropriate. The second control unit 3a transmits a mode switching command to the remote control 2 based on an instruction from the user 1. The first control unit 10, which receives the mode switching command, executes processing according to the operation mode.

[0054] If the information terminal 3 includes a voice input unit such as a microphone as the input unit 3d and the second control unit 3a performs voice recognition based on the output of the voice input unit, a mode switching command may be generated based on the result of the voice recognition.Whether the remote control 2 is operating in the first operation mode or the second operation mode is indicated to the user 1 by changing the lighting pattern of the first notification unit 14, which is constituted by, for example, an LED.

[0055] As described above, the remote control 2 of the first embodiment includes a drive source 2b (such as the right arm 2 motor ARb) that displaces the movable portion 2a (the arms 2A and legs 2L) relative to the main body (main body 2BD), and is configured to be switchable between a first operation mode in which the drive source 2b is controlled based on the output of the first movement detection portion 2c, and a second operation mode in which the first movement information is transmitted to an external device (such as the information terminal 3 or the server 30). This allows the user 1 to use the remote control 2 as a so-called personal assistant in the real space, and to control the first avatar 41 in the virtual space VS.

[0056] The operation of the remote control 2 in the first operation mode will be described below. For simplicity, the following description will be given using the right arm 2AR as an example. A right arm motion detection unit 2ARc is mechanically engaged with the right arm motor 2ARb. The right arm motion detection unit 2ARc is composed of a so-called rotary encoder, which outputs a pulse signal as it rotates. In other words, the right arm motion detection unit 2ARc constitutes the first motion detection unit 2c. The first control unit 10 measures the displacement speed and position (first movement information) of the right arm 2AR based on the pulse signal. The rotary encoder may be either an incremental type or an absolute type, but in the case of an incremental type, an origin sensor is further provided to detect the origin position of the right arm 2AR.

[0057] The first control unit 10 determines control targets (driving direction, target position, target speed) based on a predetermined movement pattern, and outputs a control command to the right arm drive unit 2ARa. The right arm drive unit 2ARa determines drive conditions (for example, the ON duty ratio of PWM (Pulse Width Modulation) control) based on the control command. The right arm drive unit 2ARa includes a motor driver, which supplies power to the right arm motor 2ARb based on the drive conditions. The right arm 2AR then moves (rotates) due to the drive force generated by the right arm motor 2ARb.

[0058] The first control unit 10 measures the position of the right arm 2AR based on the number of pulse signals output from the rotary encoder, and further measures the rotational speed of the right arm motor 2ARb (i.e., the movement speed (more precisely, the rotation speed) of the right arm 2AR) based on the period of the pulse signals (e.g., rising edges). In this way, first movement information of the right arm 2AR is measured. Then, the first movement information is compared with a control target, and, for example, PID (Proportional-Integral-Differential) control (feedback control) is performed. As a result, the right arm 2AR is displaced (rotated) in a specified drive direction to a target position at a target speed.

[0059] The left arm 2AL, right arm 2AR, and left leg 2LL are controlled in the same manner as the right arm 2AR. While Fig. 3 shows a single right leg drive unit 2LRa, right leg motor 2LRb, and right leg motion detector 2LRc for the right leg 2LR, in reality, a drive unit, motor, and motion detector are provided at the shoulder 2p of the arm 2A, the engagement portion between the main body 2BD and the leg 2L (the base 2s of the leg 2L), and the ankle 2u, respectively, and the first control unit 10 controls all of these. Furthermore, the ankle 2u is provided with a mechanism (a swing mechanism including a joint and a balance control motor (not shown)) for maintaining left-right balance when the remote control 2 is moved forward, etc., and the first control unit 10 drives the balance control motor using second motion information based on the output of the first inertial sensor 18.

[0060] The operation of the remote control 2 in the second operation mode will be described below. When a mode switching command received from the information terminal 3 instructs a transition to the second operation mode, the first control unit 10 returns the arm 2A and leg 2L to their initial positions. The following description will be continued using the right arm 2AR as an example. When the right arm motion detection unit 2ARc is configured with, for example, an incremental rotary encoder, the return to the initial position is performed by initializing (positioning) the right arm 2AR to a predetermined position with reference to the output of an origin sensor. After the return to the initial position is performed, the movement distance (movement speed) and movement direction, i.e., the relative position of the right leg 2LR with respect to the main body 2BD, are measured based on the number and phase of the pulse signal (two-phase) output by the rotary encoder.

[0061] After returning to the initial position, the first control unit 10 may displace the right arm 2AR to a predetermined position. The other arms 2A and legs 2L are controlled in the same manner, and the remote control 2 is controlled to, for example, position the robot upright ("attention" position). Of course, if the right arm movement detection unit 2ARc is configured with, for example, an absolute rotary encoder, the absolute position of the right arm 2AR is detected, and therefore returning to the initial position is not necessary.

[0062] As described above, the remote controller 2 of the first embodiment includes an instruction unit (input unit 3d of the information terminal 3) that instructs switching between the first operation mode and the second operation mode, and when an instruction to switch from the first operation mode to the second operation mode is given, the remote controller 2 drives the drive source 2b (right arm motor 2ARb, etc.) to position the movable parts 2a (arms 2A, legs 2L) at predetermined positions relative to the main body (main body body 2BD). This makes it possible to accurately measure the position of each movable part 2a relative to the main body body 2BD.

[0063] As described above, the right arm movement detection unit 2ARc is composed of a rotary encoder, which outputs a pulse signal as it rotates. The first control unit 10 measures the displacement speed and position (first movement information) of the right arm 2AR based on the pulse signal output by the right arm movement detection unit 2ARc. The measured first movement information is transmitted to the outside (here, the information terminal 3) via the first communication unit 12. The first movement information is also measured for the left arm 2AL, right leg 2LR, and left leg 2LL in the same way as for the right leg 2LR, and transmitted to the information terminal 3.

[0064] Furthermore, the first control unit 10 transmits second movement information based on the output of the first inertial sensor 18 to the outside (information terminal 3). That is, the second movement information obtained by measuring the displacement (movement) of the entire remote control 2 is transmitted to the outside. However, the first control unit 10 transmits the second movement information to the information terminal 3 when it detects that the first switch 16 has been pressed (that is, operated by the user 1).

[0065] When transitioning to the second operation mode, the first control unit 10 may issue a command to the right leg drive unit 2LRa to short-circuit both terminals of the right leg motor 2LRb, thereby establishing a so-called short brake state (the same applies to the other movable units 2a). This prevents the arm 2A from being displaced against the user 1's intention, for example, by its own weight, even if the user 1 changes the orientation of the remote control 2 after displacing the movable unit 2a of the remote control 2.

[0066] 4(A) and (B) are explanatory diagrams showing how the remote control 2 is used, and FIGS. 4(C) and (D) are explanatory diagrams showing the movement of a first avatar 41 in response to the operation of the remote control 2. The first avatar 41 shown in FIGS. 4(C) and (D) is a character representing the user 1 in the virtual space VS. The first avatar 41 includes an avatar right arm 41AR, an avatar left arm 41AL, an avatar right leg 41LR, and an avatar left leg 41LL. Here, the right arm 2AR, left arm 2AL, right leg 2LR, and left leg 2LL (i.e., movable parts 2a) of the remote control 2 correspond to the avatar right arm 41AR, avatar left arm 41AL, avatar right leg 41LR, and avatar left leg 41LL of the first avatar 41, respectively.

[0067] Hereinafter, the explanation will be continued using FIG. 1 in addition to FIG. 4. As shown in FIG. 4(A), the user 1, for example, holds the main body 2BD of the remote control 2 with his / her left hand, while displacing the right arm portion 2AR of the remote control 2 upward with his / her right hand. First movement information measured by the remote control 2 is transmitted to the information terminal 3. The information terminal 3 transmits the received first movement information to the server 30. The server control unit 30a that has received the first movement information performs modeling based on the received first movement information, and transmits updated virtual space related information (here, updated modeling information) to the information terminal 3. The information terminal 3 that has received the virtual space related information performs a drawing process for an avatar, etc. in the virtual space VS based on the updated modeling information.

[0068] In this way, an image in which the avatar right arm 41AR of the first avatar 41 is displaced upward is displayed on the display unit 3e of the information terminal 3 as shown in FIG. 4(C) (if the information terminal 3 is a VR goggle or the like, a 3D display may be performed). Specifically, when the user 1 slowly raises the right arm 2AR of the remote control 2 to the height of the shoulder 2p, the avatar right arm 41AR of the first avatar 41 slowly rises to the height of the shoulder. Similarly, when the user 1 displaces the left arm 2AL, right leg 2LR, or left leg 2LL of the remote control 2, the corresponding parts of the first avatar 41 are displaced in accordance with the movement of the remote control 2. That is, the first avatar 41 is displaced in accordance with the displacement amount and displacement speed of the movable part 2a (i.e., the first movement information).

[0069] 4(B), when the user 1 moves the entire remote control 2, second movement information measured by the remote control 2 is transmitted to the server 30 via the information terminal 3. Similar to the processing for the first movement information described above, the server control unit 30a that receives the second movement information performs modeling and transmits updated modeling information to the information terminal 3. The information terminal 3 performs a drawing process for the avatar, etc. in the virtual space VS based on the updated modeling information.

[0070] In this way, the first avatar 41 moves within the virtual space VS. Specifically, as shown in FIG. 4(D), when the user 1 moves the remote control 2 upward (into the air), the first avatar 41 moves into the air in the virtual space VS. However, the user 1 may be required to perform other operations to move the first avatar 41 within the virtual space VS. Specifically, when the user 1 displaces the entire remote control 2 while pressing the first switch 16 (when the first switch 16 is configured with a reflective sensor or the like, a state in which a finger or the like touches the first switch 16), the first avatar 41 is moved within the virtual space VS based on the second movement information.

[0071] Conversely, if user 1 does not press first switch 16 but simply displaces the entire remote control 2, the second movement information is not transmitted to information terminal 3 and first avatar 41 does not move. User 1 can perform action A: with first switch 16 pressed, move the entire remote control 2 from bottom to top to move first avatar 41 up, and action B: temporarily release first switch 16 from the pressed state and return the remote control 2 to the bottom, and then repeat actions A and B, thereby continuing to raise first avatar 41 in virtual space VS. Of course, downward, forward / backward, left / right movement of first avatar 41 may also be controlled in a similar manner.

[0072] As described above, the remote controller 2 of the first embodiment includes a switch unit (first switch 16), and determines whether or not to transmit the second movement information to an external device (here, the information terminal 3) based on the operation state of the switch unit by the user 1. This further improves the operability when moving the entire first avatar 41 in the virtual space VS.

[0073] The remote controller 2 of the first embodiment also includes movable parts 2a (plural movable parts 2a, i.e., right arm 2AR, left arm 2AL, right leg 2LR, and left leg 2LL) corresponding to the respective parts of the first avatar 41 that move in the virtual space VS (plural parts, i.e., avatar right arm 41AR, avatar left arm 41AL, avatar right leg 41LR, and avatar left leg 41LL), a main body (main body 2BD) to which the movable parts 2a are connected, a first motion detection unit 2c that detects the motion of the movable parts 2a, and a transmission unit (first communication unit 12) that transmits first motion information based on the output of the first motion detection unit 2c to an external device (information terminal 3). This makes it possible to easily and intuitively control and operate each part of the first avatar 41 in the virtual space VS.

[0074] Furthermore, the remote controller 2 of the first embodiment includes a second motion detection unit (first inertial sensor 18) that detects the motion of the main body (main body 2BD), and a transmission unit (first communication unit 12) transmits second motion information based on the output of the second motion detection unit to the outside (information terminal 3). This makes it possible to move the entire first avatar 41 within the virtual space VS simply and intuitively.

[0075] As described above, the first movement information and the second movement information are transmitted from the remote control 2 to the information terminal 3, and then from the information terminal 3 to the server 30. The server 30 models the virtual space VS, while the information terminal 3 renders the virtual space VS and virtual objects, including avatars within the virtual space VS. From this perspective, in the first embodiment, the server 30 constitutes a management unit for the virtual space VS, or the information terminal 3 and the server 30 cooperate to constitute the management unit. That is, the avatar control system S1 of the first embodiment includes a management unit (the server 30, or the information terminal 3 and the server 30) that manages the virtual space VS and the remote control 2. The management unit displaces a part of the first avatar 41 (such as the avatar right arm 41AR) corresponding to the movable part 2a (such as the right arm 2AR) based on the first movement information output from the remote control 2. This makes it possible to easily and intuitively control and operate each part of the first avatar 41 within the virtual space VS.

[0076] Furthermore, the avatar control system S1 of the first embodiment includes a management unit that manages the virtual space VS and a remote control 2. The management unit controls the position or orientation of the first avatar 41 in the virtual space VS based on the second movement information output from the remote control 2. Note that "controlling the position or orientation" includes moving the first avatar 41 up and down, left and right, front and back, or any combination of these directions, rotating the first avatar 41 in any direction, and even combining movement and rotation. This makes it possible to easily and intuitively displace the entire first avatar 41 within the virtual space VS.

[0077] Here, because the first inertial sensor 18 includes a triaxial acceleration sensor, the second movement information originally includes acceleration information. The first control unit 10 may include the acceleration information in the second movement information and transmit it to the information terminal 3. In this case, the information terminal 3, which has received the acceleration information, processes the movement of the first avatar 41 based on the acceleration information to make it appear larger, and transmits the processed information to the server 30. Of course, this processing may be performed by the server 30. As a result, in FIGS. 4(B) and 4(D), when the user 1 applies an acceleration to the remote control 2 that is greater than a predetermined acceleration, the first avatar 41 moves through the virtual space VS with a displacement greater than the original displacement controlled based on the second movement information. That is, in FIG. 4(D), the first avatar 41 rises to a higher position.

[0078] Thus, in the avatar control system S1 of the first embodiment, the second movement information includes information about acceleration, and when the acceleration is greater than a predetermined value, the management unit (server 30) displaces the first avatar 41 by a displacement greater than the displacement calculated based on the second movement information. Note that "displacement" here primarily refers to movement. This allows the entire first avatar 41 to move significantly in the virtual space VS, enabling, for example, high-speed movement between multiple virtual spaces VS (worlds) that make up the Metaverse.

[0079] In the above description, the management unit that manages the virtual space VS may be configured by the server 30 alone, or may be configured by the server 30 and the information terminal 3 working together. Here, when it is considered that the management unit is configured by the server 30 alone, the remote control 2 of the first embodiment may have a configuration in which the transmission unit (first communication unit 12) transmits the first movement information and the second movement information to a predetermined information terminal 3 that is interposed between the transmission unit and the management unit (server 30) that manages the virtual space. As a result, the first movement information and the second movement information are transmitted to an information terminal located near the remote control using short-range wireless communication such as BLE. The use of short-range wireless communication enables the cost of the remote control 2 to be reduced.

[0080] FIG. 5 is an explanatory diagram showing the relationship between a first avatar 41 and other virtual objects in the virtual space VS. The following explanation will continue with FIG. 5 in conjunction with FIG. 1 and FIG. 3. Here, the virtual space VS is modeled to imitate a city in the real world. This modeled virtual city contains buildings that reflect the real cityscape, roads for cars and pedestrians, and the like. Public places such as parks, squares, and monuments, as well as commercial facilities such as stores and offices, are also designed. These virtual objects are important elements for making the virtual space VS a lifelike environment similar to the real world.

[0081] Virtual stores 44 are scattered throughout the virtual space VS, and users 1 can purchase products and items and obtain information through their first avatar 41. Furthermore, special avatars, such as flying avatars 43, exist, allowing users 1 to explore the virtual space VS not only on the ground but also in the air. The first avatar 41, controlled by user 1 using remote control 2, interacts with other avatars (second avatars 42) within the virtual space VS. Examples of such interactions include text-based conversations via chat, and real-time communication using voice and video chat. User 1 can freely explore the virtual space VS and gain new experiences through interactions with other users and avatars.

[0082] As described above, the displacement of the first avatar 41 in the virtual space VS is controlled based on the operation of the remote control 2. By displacing the movable part 2a of the remote control 2, the part of the first avatar 41 corresponding to the movable part 2a is displaced. This makes it possible to more accurately reflect the movements of the user 1 in the first avatar 41 in, for example, a competitive tournament such as sumo or wrestling held in the virtual space VS. Of course, the remote control 2 and avatar control system S1 of the first embodiment can also be applied to other e-sports (tennis, soccer, etc.) in which the first avatar 41 moves the arms 2A or legs 2L. This allows for deeper interaction between the first avatar 41 and other avatars compared to communication based on voice, text, etc.

[0083] The first avatar 41 can move within the virtual space VS and touch and move virtual objects. As a result, interactions occur between the first avatar 41 and other virtual objects, including the second avatar 42, in the virtual space VS, just as in the real world. Examples of such physical interactions include handshakes, hugs, and collisions between the first avatar 41 and the second avatar 42. Such interactions are managed by the management unit (server 30). When a physical interaction occurs, the server control unit 30a generates event information including information that an interaction has occurred, the content of the event, and information about the body part where the interaction occurred, and transmits the event information to the information terminal 3. Of course, the event information may be transmitted directly to the remote control 2 without going through the information terminal 3.

[0084] Upon receiving the event information, the remote controller 2 drives the drive source 2b to displace the movable part 2a corresponding to the location where the interaction included in the event information occurred. Of course, the amount and speed of the displacement may be changed as appropriate depending on the content of the event. Specifically, for example, if the second avatar 42 shakes hands with the first avatar 41 with its right hand, the first control unit 10 slowly displaces the right arm 2AR that receives the handshake up and down at waist height, recreating a situation in which the two avatars are shaking hands. Furthermore, if an interaction occurs in which the first avatar 41 collides with another virtual object such as the second avatar 42 or a tree, the arm 2A and leg 2L are vibrated finely to notify (feed back) the user 1 that a collision has occurred.

[0085] Since the movement at this time is also detected by the first movement detection unit 2c, the first control unit 10 may transmit the first movement information output from the first movement detection unit 2c to the information terminal 3. In this case, the first movement information is ultimately transmitted to the server 30, and in the virtual space VS, the first avatar 41 reproduces, for example, a reaction when colliding with another avatar. However, when the first avatar 41 performs this reaction, further interactions (collisions or interference) may occur with other virtual objects, and a chain reaction of interactions and feedback (or reactions) may occur. As a countermeasure against this, for example, feedback may be provided to the user 1, and the first movement information detected at that time may be transmitted to an external device, and then feedback to the user 1 may be stopped for a predetermined period (for example, several tens of seconds).

[0086] In this way, the remote control 2 of the first embodiment controls the drive source 2b based on information (event information) from the outside (a management unit, here the server 30) to displace the movable unit 2a. This makes it possible to feed back, to the real world, an interaction that occurs between the first avatar 41 and another virtual object in the virtual space VS.

[0087] Furthermore, in the avatar control system S1 of the first embodiment, when the management unit (server 30) detects that a predetermined event has occurred in the virtual space VS between the first avatar 41 and a second avatar 42 different from the first avatar 41 or a predetermined virtual object, it transmits event information corresponding to the event to the remote control 2. This makes it possible to notify the remote control 2 of an interaction that has occurred between the first avatar 41 and another virtual object in the virtual space VS.

[0088] Furthermore, in the avatar control system S1, the remote control 2 includes a drive source 2b that displaces the movable part 2a, and the drive source 2b displaces the movable part 2a based on event information. This makes it possible to feed back interactions that occur between the first avatar 41 and other virtual objects in the virtual space VS to the real world.

[0089] FIG. 6 is an explanatory diagram showing a situation in which a first avatar 41 moves between worlds 62 in a virtual space VS. The virtual space VS in FIG. 6 may be a so-called metaverse, and each world may be a virtual space VS as a component of the metaverse. The following explanation will be continued using FIG. 6 in conjunction with FIG. 1 and FIG. 5. Various worlds 62, such as cities, buildings, mountainous areas, and forests, that reflect the real world are constructed in the virtual space VS. Each world 62 has its own unique landscape and characteristics, providing a different experience for the user 1. The virtual space VS is represented as a map 60, and the first avatar 41 can move freely between the worlds 62. In the virtual space VS, the avatar is provided with the attribute of being able to fly (see the flying avatar 43 in FIG. 5), allowing the first avatar 41 to explore the virtual space VS efficiently and quickly in a game-like manner.

[0090] The operation of moving the first avatar 41 between worlds 62 is performed by the user 1 displacing the entire remote control 2. The management unit (server 30) determines the movement direction of the first avatar 41 based on the tilt and orientation of the remote control 2 detected by the first inertial sensor 18 (i.e., second movement information), and further determines the movement speed of the first avatar 41 based on the swing amplitude and acceleration of the remote control 2. This allows the user 1 to intuitively control the first avatar 41. As described above, the management unit (server 30) causes the first avatar 41 to move faster (with greater displacement) when the acceleration applied to the remote control 2 is greater than a predetermined value. Furthermore, the movement direction and movement speed are displayed by a predetermined indicator 61. The indicator 61 visually shows the current movement state of the first avatar 41 and provides feedback on the operation of the remote control 2 to the user 1. This allows the user 1 to check the current movement status and adjust the operation as necessary.

[0091] The remote control 2 and avatar control system S1 of the first embodiment can represent the user 1 not only in the virtual space VS but also, for example, in a web conference. In this case, a robot (hereinafter, sometimes referred to as the "second robot") acting as a physical entity representing the user 1 may be placed on the other side of the web conference. In this case, the second robot reproduces the movements of the user 1 operating the remote control 2. Of course, the second robot may be configured as the remote control 2 described above. As a result, for example, when the user 1 moves the remote control 2 forward while displacing the legs 2L of the remote control 2 back and forth, the second robot reproduces this movement and moves forward. Of course, the second robot may be configured as an avatar and displayed on a predetermined display device. In this way, using the remote control 2 of the first embodiment can improve the expressiveness of a presentation, for example. (Second embodiment)

[0092] A second embodiment of the present invention will be described below with reference to Figures 1, 3, and 4. In the first embodiment described above, when the movable part 2a of the remote control 2 is displaced, a part of the first avatar 41 corresponding to the movable part 2a of the remote control 2 is displaced in the virtual space VS. On the other hand, in the second embodiment, the movement of the movable part 2a of the remote control 2 is associated with other movements of the first avatar 41.

[0093] As described in the first embodiment, the first movement information detected by the first movement detection unit 2c of the remote control 2 is transmitted to the information terminal 3. The information terminal 3 can process the received first movement information by regarding it as input to the input unit 3d. In other words, the remote control 2 substitutes for input to the input unit 3d or extends the input function. The second control unit 3a can, for example, replace the movement of the movable unit 2a of the remote control 2 with a predetermined input made to the input unit 3d. Note that here, the server 30 may be configured for the purpose of managing a Web conference system. The information terminal 3 converts the operation of the remote control 2 by the user 1 (i.e., the first movement information and the second movement information) into, for example, the following operation content:

[0094] When the right arm 2AR is raised directly up: a microphone (not shown) provided in the information terminal 3 is turned on. When the right arm 2AR is lowered straight down: The microphone is turned off. When Remote Control 2 is held upright: Log in to the virtual space VS (enter a virtual conference room or virtual office). When Remote Control 2 is placed face down: Logs out of the virtual space VS (leaves the virtual conference room or virtual office). -Control the position of the laser pointer during a web conference according to the orientation of the entire remote control 2.

[0095] That is, the information terminal 3 treats a specific posture (configuration) of the remote control 2 as a command to put the first avatar 41 into a specific state (status) or as a command to make the information terminal 3 perform a specific function. Hereinafter, this mode may be referred to as a third operation mode. Note that the user 1 switches from the first operation mode or the second operation mode to the third operation mode by operating the input unit 3d of the information terminal 3.

[0096] Conversely, the attitude of the remote control 2 may be changed based on the virtual space-related information, or the light emission pattern of an LED or the like included in the first notification unit 14 may be changed, and a predetermined sound may be output from a speaker or the like included in the first notification unit 14. For example, based on the virtual space-related information, when a person who is planning to interact logs into the virtual space VS or when a new participant enters a virtual conference room, the relative positional relationship between the legs 2L and the main body 2BD may be changed to make the remote control 2 take a bowing pose. Of course, at this time, the user 1 may be notified using an LED or sound.

[0097] Furthermore, if the information terminal 3 is, for example, a smartphone, when it receives a voice call request or a text message from another device (not shown) connected to the network 50, this information is also transmitted to the remote control 2, and the remote control 2 can be controlled to take a specific pose, etc. The movement of the remote control 2 at this time is transmitted to the information terminal 3 and may be reflected in the movement of the first avatar 41 in the virtual space VS, a virtual conference room, a virtual office, etc.

[0098] Furthermore, when the user 1 is engaged in a text-based chat or the like with a third party using the information terminal 3, the information terminal 3 may convert the operation of the movable part 2a or the entire remote control 2 into text and send this as a message to the third party. For example, the operation of the remote control 2 may be converted into text as follows. In this case, it is preferable that the movement of the remote control 2 and the terms in the text are related to each other. Raise Remote Control 2's right arm 2AR: "Hello." Raise both arms 2A of Remote Control 2: "Hooray! This is fun!" - Remote 2 in a sitting position: "Come on. Let me hear more." Hold Remote Control 2 in your hand and move it left and right: "Well, bye then." Press the second switch 17 on the remote control 2: "Heart (emoji)" Of course, the message may be converted into voice and sent to a third party. This allows for simple communication with a third party even in a situation where the user 1 cannot input text into the input unit 3d of the information terminal 3.

[0099] The remote controller and avatar control system S1 according to the present invention have been described in detail above based on specific embodiments. However, these embodiments are merely examples, and the present invention is not limited to these embodiments. For example, the first control unit 10 of the remote control 2 may recognize the voice of the user 1 acquired via a microphone (not shown). Then, through voice recognition, "phonemes" are extracted from the acquired voice information, converted into text, and vocabulary information is identified. Based on this vocabulary information, the operation mode of the remote control 2 (first operation mode / second operation mode / third operation mode) may be switched.

[0100] 2, the second notification unit 15 may be provided on the front side of the remote control 2, or on the rear side (back). The information terminal 3 transmits an image generated by performing rendering or texture mapping to the remote control 2, and the remote control 2 displays the image on the second notification unit 15. This allows the user 1 to explore the virtual space VS using the remote control 2 alone. [Industrial Applicability]

[0101] The remote controller (remote control 2) and avatar control system S1 of the present invention can improve the operability of an avatar in a virtual space VS with a simple configuration, and can therefore be widely used in games, communication with third parties in social networking, education, training, virtual meetings, demonstrations, etc. [Explanation of symbols]

[0102] 1 User 2 Remote Control 2A Arm 2L legs 2a Moving part 2b Driving source 2c First motion detection unit 3. Information terminals 3D input section 10 First control section 16 First Switch 18 First inertial sensor 30 servers 41 First Avatar 50 Network S1 Avatar Control System VS Virtual Space

Claims

1. a movable part corresponding to a part of the first avatar that is displaced in the virtual space; a main body to which the movable part is connected; a first movement detection unit that detects movement of the movable part; a transmitter that transmits first motion information based on an output of the first motion detection unit to an external device; A remote controller comprising:

2. a second motion detection unit that detects a motion of the main body; The remote controller according to claim 1 , wherein the transmitting section transmits second movement information based on the output of the second movement detecting section to the outside.

3. Equipped with a switch section, 3. The remote controller according to claim 2, wherein whether or not the second movement information is to be transmitted to the outside is determined based on an operation state of the switch unit by a user.

4. the main body and the movable part constitute a robot, 2. The remote controller according to claim 1, wherein the movable part is an arm or a leg of the robot.

5. a drive source that displaces the movable portion relative to the main body; 2. The remote controller according to claim 1, wherein the remote controller is configured to be switchable between a first operating mode in which the drive source is controlled based on the output of the first movement detection unit, and a second operating mode in which the first movement information is transmitted to the outside.

6. an instruction unit that instructs switching between the first operation mode and the second operation mode, When an instruction to switch from the first operation mode to the second operation mode is given, 6. The remote controller according to claim 5, wherein the drive source is driven to position the movable portion at a predetermined position relative to the main body.

7. 6. The remote controller according to claim 5, wherein the drive source is controlled based on the external information to displace the movable part.

8. The transmission unit 3. The remote controller according to claim 2, wherein the first movement information and the second movement information are transmitted to a predetermined information terminal interposed between the transmitting unit and a management unit that manages the virtual space.

9. a management department that manages the virtual space; The remote controller according to claim 1, The management unit an avatar control system that displaces a part of the first avatar corresponding to the movable part based on the first movement information output from the remote controller;

10. a management department that manages the virtual space; The remote controller according to claim 2, The management unit an avatar control system that controls the position or orientation of the first avatar in the virtual space based on the second movement information output from the remote controller;

11. the second movement information includes information regarding acceleration; The avatar control system according to claim 10 , wherein the management unit displaces the first avatar by a displacement greater than a displacement based on the second movement information when the acceleration is greater than a predetermined value.

12. The avatar control system of claim 10, characterized in that when the management unit detects that a specified event has occurred in the virtual space between the first avatar and a second avatar different from the first avatar or a specified virtual object, it sends event information corresponding to the event to the remote controller.

13. the remote controller includes a drive source that displaces the movable part, The avatar control system according to claim 12, wherein the driving source displaces the movable part based on the event information.

Images