Telexistence Implementation Method and System

Abstract

To enable a plurality of users to continuously remotely operate / control a humanoid.SOLUTION: A method for performing telexistence according to the present invention includes: receiving, by a processor, a request to control a humanoid from a remote user; determining acceptance of the request by a host; for the request being determined as accepted, verifying, by the processor, receipt of a set of initiating signals; for the set of initiating signals being received: receiving a humanoid mapping method chosen by the remote user, and controlling the humanoid on the basis of the humanoid mapping method determined by the remote user; and for the set of initiating signals not being received, terminating, by the processor, the request to control the humanoid.SELECTED DRAWING: Figure 4

Description

[Technical Field]

[0001] The present disclosure relates to methods and systems for implementing telexistence. [Background technology]

[0002] In the information technology (IT) field, collaboration with people across different parts of the world is now possible using collaboration software. Collaboration software allows users to share, review, and modify materials in real time. However, such interactive collaboration software or hardware is not available in fields that involve physical interaction. Traditional collaboration methods require participants to be physically present in a single location in real time. Travel to a meeting location tends to incur additional operational costs and cause delays, which can lead to reduced customer satisfaction.

[0003] Telexistence is a concept that allows users to remotely control a humanoid or robot and perform actions with real-world objects, thereby allowing users to interact in physical space. However, collaboration through telexistence for multiple users is limited, as control of a humanoid is limited to a single user at a single event. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Japanese Patent Publication No. 2020-40155 Summary of the Invention [Problem to be solved by the invention]

[0005] Related art discloses a method for remotely controlling a humanoid by one person through a virtual reality (VR) headset and mobile hardware, but the method does not allow multiple users to remotely operate / control the humanoid in succession for a single function / event, nor does it allow a remotely connected viewer to remotely view the actions of the humanoid.

[0006] Related art discloses a method for controlling a humanoid through a stationary control system. The stationary control system allows the humanoid to be controlled by mapping / imitating the user's actions through a wearable control device of the control system. However, the stationary control system itself can be expensive, and multiple users cannot remotely operate / control the humanoid consecutively. [Means for solving the problem]

[0007] One aspect of the present disclosure involves an innovative method for implementing telexistence, the method including: receiving, by a processor, a request from a remote user to control a humanoid; determining, by the processor, acceptance of the request by the host; if it is determined that the request is accepted, verifying, by the processor, receipt of a set of activation signals; and if the set of activation signals is received, verifying receipt of the set of activation signals by the remote user. Either mapping from the humanoid to the user or mapping from the user to the humanoid Humanoid Mapping Method Selection of received by the remote user choice Based on the proposed humanoid mapping method, Allowing a remote user to control the humanoid, mapping the posture or orientation of either the remote user's body or the humanoid to the posture or orientation of the other, and handing over control of the humanoid to the remote user. A request to control the humanoid is terminated by the processor if the set of activation signals is not received. [Brief explanation of the drawings]

[0008] [Figure 1] FIG. 1 illustrates an example system for a humanoid 100, according to one embodiment. [Figure 2]FIG. 2 illustrates an example of a remote configuration 200 for a remote user to control a humanoid 100, according to one embodiment. [Figure 3] FIG. 3 illustrates an example of a remote audience configuration 300, according to one embodiment. [Figure 4] FIG. 4 illustrates an example process flow 400 for implementing telexistence, according to one embodiment. [Figure 5] FIG. 5 illustrates an example process flow 500 for implementing telexistence after a remote user has been handed control of a humanoid 100, according to one embodiment. [Figure 6] FIG. 1 illustrates an example computing environment having an example computing device suitable for use in some embodiments. DETAILED DESCRIPTION OF THE INVENTION

[0009] A general architecture for implementing various features of the present disclosure will now be described with reference to the drawings. The drawings and associated description are provided to illustrate examples of the present disclosure and are not intended to limit the scope of the disclosure. Reference numbers are re-used throughout the drawings to indicate correspondence between referenced elements.

[0010] The following detailed description provides details of the figures and examples of the present application. Reference numbers and descriptions of elements that are duplicated between figures are omitted for clarity. Terms used throughout the description are provided by way of example and are not intended to be limiting. For example, use of the term "automatic" can include a fully automatic implementation or a semi-automatic implementation requiring user or administrator control over certain aspects of the implementation, depending on the desired implementation of those skilled in the art practicing the examples of the present application. Selection can be performed by a user through a user interface or other input means, or can be achieved through a desired algorithm. The examples as described herein can be utilized alone or in combination, and the functionality of the examples can be achieved through any means depending on the desired implementation.

[0011] The present embodiment relates to a method and system for implementing multi-user telexistence through multi-user collaboration. The embodiment provides multi-user collaborative telexistence with limited hardware while ensuring safe subsequent handover of the humanoid by a remote user. The user's body movements are predicted using a camera utilizing machine learning algorithms. The camera can be a built-in camera associated with a computing device such as a laptop, tablet, etc. In some embodiments, an external camera may be used instead of a built-in camera. If the user wishes to control the humanoid, a VR headset would be required to provide additional movement signals to the system.

[0012] FIG. 1 illustrates an example system of a humanoid 100, according to one embodiment. As shown in FIG. 1, the humanoid 100 may include components such as a sensing system 101, a control system 102, an actuation system 103, and a camera 104. The sensing system 101 may include components such as, but not limited to, an audio sensor, a motion sensor, a load sensor, and a touch sensor. The sensing system 101 may be used to detect a combined weight load and issue a combined weight signal representing the detected combined weight load. The control system 102 is used to control the behavior / movement of the humanoid 100 and may receive signals from other components of the humanoid 100 and a remote user to implement control of the humanoid 100. The actuation system 103 implements the movement of the humanoid 100 and may involve at least one of a hydraulic actuator, a pneumatic actuator, or an electric actuator. Control signals are sent from the control system 102 to the actuation system 103 to provide instructions for movement control. The camera 104 allows a remote user to view the humanoid's environment and actions as perceived from the humanoid's 100 perspective over a communications network.

[0013] In some embodiments, the humanoid 100 may also include a screen display 105. The screen display 105 can be used for viewing or screen sharing of the environment by the user or other viewers / participants. The humanoid 100 remotely replicates the user's actions from anywhere on Earth. In some embodiments, immediate customer assistance can be provided through the use of the humanoid 100.

[0014] FIG. 2 illustrates an example remote configuration 200 for a remote user to control a humanoid 100, according to one embodiment. The remote configuration 200 communicates with the humanoid 100 through a network, not shown in the drawing. As shown in FIG. 2, the remote configuration 200 may include devices such as, but not limited to, virtual reality (VR) equipment 201 and a camera 202. The VR equipment 201 can be a VR headset that allows the remote user to view the humanoid's environment as perceived through the humanoid's 100's camera 104. The camera 202 may be a built-in camera of a computing device (e.g., laptop, tablet, smartphone, etc.) or an external camera connected to the computing device (e.g., personal computer, laptop, etc.). The camera 202 is pointed at the remote user and tracks / captures the remote user's body movements. In some embodiments, the camera 202 may send a captured feed over the network for display on the humanoid's 100's screen display 105.

[0015] In some embodiments, the remote configuration 200 may further include an optional display device 203, such as a monitor, that allows the remote user to view and display the humanoid's environment as perceived through the humanoid's 100 camera 104. Information received from the humanoid 100, such as warning messages or notifications, may be displayed on the VR equipment 201 or the display device 203.

[0016] Figure 3 shows an example remote viewer arrangement 300, according to one embodiment, where the remote viewer is a participant in a humanoid control session in which the humanoid 100 is controlled by a remote user. The remote viewer arrangement 300 communicates with the humanoid 100 through a network, which is not shown in the drawing. As shown in Figure 3, the remote viewer arrangement 300 may include devices such as, but not limited to, a display device 301. Actions performed by the humanoid 100 or the humanoid's environment as perceived through the humanoid's 100's camera 104 can be visualized on the display device 301.

[0017] In some embodiments, the remote viewer arrangement 300 may further include VR equipment 302 for visualizing actions performed by the humanoid 100 or the humanoid's environment as perceived through the humanoid's 100's camera 104. In some embodiments, the remote viewer arrangement 300 may further include a camera 303. The camera 303 is similar to the camera 202 of FIG. 2 and may be a built-in camera of a computing device (e.g., laptop, tablet, smartphone, etc.) or an external camera connected to a computing device (e.g., personal computer, laptop, etc.). The camera 303 may transmit a captured feed over a network for display on the humanoid's 100's screen display 105.

[0018] Any one or more remote viewers may be host-authenticated users. Like remote users, host-authenticated users may also be given access to control the humanoid 100 if they have the necessary devices to control the humanoid 100.

[0019] Figure 4 shows an example process flow 400 for implementing multi-user telexistence, according to one embodiment. The process begins in step S401, where a request to control the humanoid 100 is sent by a remote user. In step S402, a determination is made whether the host or host-authenticated user has accepted the remote user's request. The right to provide control of the humanoid 100 to the remote user is granted to the host as well as the host-authenticated user. If the request is not accepted in step S402, the remote user's control request is denied in step S403.

[0020] In step S404, a movement / input signal is sent from the remote user's VR equipment 201 (e.g., VR headset). In step S405, a movement detection signal, such as a feed signal, is received from the camera 202. In step S406, a combined weight signal, indicative of the combined weight load, is transmitted from the sensing system 101 of the humanoid 100. The three signals of steps S404-S406, i.e., the activation signal set, must be received in order for the remote user to receive control of the humanoid 100. In step S407, a verification or determination of the reception of the activation signal set is performed.

[0021] If any signal from the set of activation signals is not received in step S407, control of the humanoid 100 is disallowed in step S408. If the set of activation signals is received in step S407, the process proceeds to step S409, where the remote user selects either humanoid-to-user mapping or user-to-humanoid mapping as the humanoid mapping method. The remote user is given a choice of two methods for arriving at a common initial pose for themselves and the humanoid 100 before assuming control of the humanoid 100. The two options are humanoid-to-user mapping, shown as Method 1 in FIG. 4, and user-to-humanoid mapping, shown as Method 2 in FIG. 4. In humanoid-to-user mapping, the humanoid 100 arrives at / reproduces the remote user's body pose or orientation before handing over control. In user-to-humanoid mapping, the remote user takes over from the humanoid 100 by reaching / recreating the pose or orientation of the humanoid 100 from the orientation / configuration left over from the previous, terminated telexistence session associated with the previous remote user. If, in step S409, the remote user selected user-to-humanoid mapping as the humanoid mapping method, the process continues to step S410, where the remote user is granted control of the humanoid 100.

[0022] If the remote user selects humanoid-to-user mapping as the humanoid mapping method, the process proceeds to step S411, where a determination is made based on the pose or orientation of the humanoid 100 as to whether the combined weight load is significant. A significant combined weight load indicates that the humanoid 100 may be holding a weight / item. The combined weight load is determined from the combined weight signal received from the sensing system 101 of the humanoid 100 in step S406. If the combined weight load is determined to be not significant, the process continues to step S410, and the remote user is granted control of the humanoid 100.

[0023] If the combined weight load is determined to be significant, in step S412, a first warning message is sent to the remote user alerting the remote user to a potential safety concern that may arise from the humanoid-to-user mapping. The first warning message may indicate the possibility of a weight / item falling and the potential damage that may be caused by the weight / item falling. In some embodiments, the remote user may receive a request to change the humanoid mapping method as part of the first warning message, which leads to a determination in step S413 whether the remote user agrees to the request to change the humanoid mapping method.

[0024] If, in response to the first warning message, the remote user chooses to change the humanoid mapping method and requests the change in step S413, the user is granted control of the humanoid 100 in step S410. If the remote user chooses to proceed with humanoid-to-user mapping as the humanoid mapping method, the process continues to step S414, where a second warning message is sent to the remote user warning of a possible hazard that may occur. Upon issuance of the second warning message, the user is granted control of the humanoid 100 in step S410. In some embodiments, the remote user is required to respond to the second warning message, which may be a request for the remote user to confirm / reconfirm the humanoid mapping method. Such a response may include confirming the humanoid mapping method by clicking an accept button through an input device. The first and second warning messages are sent to the remote user and displayed on the VR equipment 201 or any display device 203. In step S415, the camera 104 of the humanoid 100 displays the humanoid's environment and the humanoid's 100 movements on the VR device 201 or any display device 203.

[0025] To pass control of the humanoid 100 from a current remote user to a subsequent remote user, the subsequent remote user must follow the steps shown in Figure 4. When passing control, control of the humanoid 100 by the current remote user, who becomes the previous remote user, is terminated and the subsequent remote user is granted control of the humanoid 100.

[0026] 5 shows an example process flow 500 for implementing telexistence after a remote user is handed control of the humanoid 100, according to one embodiment. The process begins in step S501, where movement / input signals are sent from the remote user's VR equipment 201 (e.g., VR headset), in step S502, where a trained machine learning (ML) model generates movement predictions as signals for controlling the humanoid 100, which are sent to the control system 102, and in step S503, where a host or host-authenticated user receives continued permission to control the humanoid 100. In step S502, the remote user's body movement / tracked movement as observed by the camera 202 is fed into the trained ML model to generate movement predictions / motion mapping, and the predicted movement is sent as signals to the control system 102 for controlling the humanoid 100.

[0027] Signals and permissions such as those obtained from steps S501-S503 must continue to be received in order for the remote user to maintain control of the humanoid 100. In step S504, the humanoid 100 performs the predicted movement based on the signal received in step S502. The process then continues to step S505, where the camera 104 of the humanoid 100 broadcasts the humanoid's environment and the movements / behaviors of the humanoid 100 over the network to the display device 301 or optional VR equipment 302 for viewing by the remote viewer.

[0028] The above-described embodiments may have various benefits and advantages. For example, embodiments may enable instant access to a physical environment for multiple users to collaborate with limited hardware capabilities through multi-user telexistence. Embodiments may be used to perform, but are not limited to, remote security inspections, audits, maintenance, manufacturing, consultations, and the like. Remote maintenance / troubleshooting may provide instant access to support during manufacturing while reducing costs and wait times.

[0029] 6 illustrates an example computing environment having an example computing device suitable for use in some embodiments. The computing device 605 of the computing environment 600 can include one or more processing units, cores, or processors 610, memory 615 (e.g., RAM, ROM, and / or other), internal storage 620 (e.g., magnetic, optical, solid-state storage, and / or organic), and / or IO interface 625, any of which can be coupled by a communication mechanism or bus 630 for communicating information or embedded in the computing device 605. The IO interface 625 is also configured to receive images from a camera or provide images to a projector or display, depending on the desired implementation.

[0030] Computing device 605 can be communicatively coupled to input / user interface 635 and output device / interface 640. Either or both of input / user interface 635 and output device / interface 640 can be wired or wireless interfaces and can be detachable. Input / user interface 635 can include any device, component, sensor, or interface, physical or virtual, that can be used to provide input (e.g., buttons, touchscreen interface, keyboard, pointing / cursor control, microphone, camera, Braille, motion sensor, accelerometer, optical reader, and / or the like). Output device / interface 640 can include a display, television, monitor, printer, speakers, Braille, etc. In some embodiments, input / user interface 635 and output device / interface 640 can be embedded in or physically coupled to computing device 605. In other embodiments, other computing devices may function as or provide the functionality of input / user interface 635 and output device / interface 640 of computing device 605.

[0031] Examples of computing devices 605 may include, but are not limited to, highly mobile devices (e.g., smartphones, automobiles and other mechanical devices, devices carried by people and animals, etc.), mobile devices (e.g., tablets, notebooks, laptops, personal computers, portable televisions, radios, etc.), and devices not designed for mobility (e.g., desktop computers, other computers, information kiosks, televisions with and / or coupled to one or more processors, radios, etc.).

[0032] Computing device 605 may be communicatively coupled (e.g., via IO interface 625) to external storage 645 and network 650 for communicating with any number of networked components, devices, and systems, including one or more computing devices of the same or different configurations. Computing device 605, or any connected computing device, may function as, provide services for, or be referred to as a server, client, thin server, general-purpose machine, special-purpose machine, or another label.

[0033] IO interface 625 can include, but is not limited to, wired and / or wireless interfaces using any communication or IO protocol or standard (e.g., Ethernet, 802.11x, Universal Serial Bus, WiMAX, modem, cellular network protocols, etc.) for communicating information to and from at least all connected components, devices, and networks of computing environment 600. Network 650 can be any network or combination of networks (e.g., the Internet, a local area network, a wide area network, a telephone network, a cellular network, a satellite network, etc.).

[0034] The computing device 605 can use and / or communicate using computer-usable or computer-readable media, including transitory and non-transitory media. Transitory media include transmission media (e.g., metallic cables, fiber optics), signals, carrier waves, etc. Non-transitory media include magnetic media (e.g., disks and tape), optical media (e.g., CD ROM, digital video disks, Blu-ray disks), solid media (e.g., RAM, ROM, flash memory, solid-state storage), and other non-volatile storage or memory.

[0035] The computing device 605 can be used to implement techniques, methods, applications, processes, or computer-executable instructions in some example computing environments. The computer-executable instructions can be retrieved from a transitory medium or stored on and retrieved from a non-transitory medium. The executable instructions can be in one or more of any programming, scripting, and machine language (e.g., C, C++, C#, Java, Visual Basic, Python, Perl, JavaScript, etc.).

[0036] The processor 610 can run under any operating system (OS) (not shown) in a native or virtual environment. One or more applications can be deployed, including a logic unit 660, an application programming interface (API) unit 665, an input unit 670, an output unit 675, and an inter-unit communication mechanism 695 through which different units communicate with each other, the OS, and other applications (not shown). The described units and elements can vary in design, function, configuration, or implementation and are not limited to the provided description. The processor 610 can be in the form of a hardware processor, such as a central processing unit (CPU), or a combination of hardware and software units.

[0037] In some embodiments, once information or instructions to execute are received by API unit 665, they may be communicated to one or more other units (e.g., logic unit 660, input unit 670, output unit 675). In some examples, logic unit 660 may be configured to control the flow of information between units and direct the services provided by API unit 665, input unit 670, and output unit 675 in some embodiments described above. For example, the flow of one or more processes or implementations may be controlled solely by logic unit 660 or in combination with API unit 665. Input unit 670 may be configured to obtain inputs for calculations described in embodiments, and output unit 675 may be configured to provide outputs based on calculations described in embodiments.

[0038] The processor 610 may be configured to receive a request to control a humanoid from a remote user, as shown in FIG. 4. The processor 610 may also be configured to determine acceptance of the request by the host, as shown in FIG. 4. For a request determined to be accepted, the processor 610 may also be configured to verify receipt of a set of activation signals, as shown in FIG. 4. For a received set of activation signals, the processor 610 may also be configured to receive a humanoid mapping method selected by the remote user, as shown in FIG. 4, and control the humanoid based on the humanoid mapping method determined by the remote user. For a set of activation signals not received, the processor 610 may also be configured to terminate the request to control the humanoid, as shown in FIG. 4. The processor 610 may also be configured to broadcast an environment perceived from a first camera coupled to the humanoid in the remote user's VR equipment, as shown in FIG. 4.

[0039] Some portions of the detailed descriptions are presented in terms of algorithms and symbolic representations of operations within a computer. These algorithms and symbolic representations are the means used by those skilled in the data processing arts to convey the essence of their innovations to others skilled in the art. An algorithm is a sequence of prescribed steps leading to a desired end state or result. In the illustrative examples, the steps performed require physical manipulations of tangible quantities to achieve a tangible result.

[0040] Unless otherwise specifically indicated, as will be apparent from the discussion, it will be recognized that throughout the description, discussion utilizing terms such as "processing," "computing," "calculating," "determining," "displaying," and the like can include operations and processes of a computer system or other information processing device that manipulate and convert data represented as physical (electronic) quantities in the computer system's registers and memory into other data that is similarly represented as physical quantities in the computer system's memory or registers or other information storage, transmission, or display device.

[0041] Examples may also relate to an apparatus for performing the operations herein. This apparatus may be specially constructed for the required purposes, or it may include one or more general-purpose computers selectively activated or reconfigured by one or more computer programs. Such computer programs may be stored on a computer-readable medium, such as a computer-readable storage medium or a computer-readable signal medium. Computer-readable storage media may include tangible media, such as, but not limited to, optical disks, magnetic disks, read-only memory, random-access memory, solid-state devices and drives, or any other type of tangible or non-transitory medium suitable for storing electronic information. Computer-readable signal media may include media such as carrier waves. The algorithms and displays presented herein are not inherently related to any particular computer or other apparatus. A computer program may include a pure software implementation containing instructions that perform the operations of a desired implementation.

[0042] Various general-purpose systems may be used with the programs and modules according to the examples herein, or it may prove convenient to construct more specialized apparatus to perform the desired method steps. Additionally, the examples are not described with reference to any particular programming language. It will be appreciated that various programming languages ​​may be used to implement the teachings of the implementations as described herein. Instructions in the programming language may be executed by one or more processing devices, such as a central processing unit (CPU), processor, or controller.

[0043] As is known in the art, the operations described above can be implemented by hardware, software, or some combination of software and hardware. Various aspects of the embodiments may be implemented using circuits and logic devices (hardware), while other aspects may be implemented using instructions stored on a machine-readable medium (software) that, when executed by a processor, cause the processor to perform methods that implement the examples of the present application. Furthermore, some embodiments of the present application may be implemented exclusively by hardware, while other embodiments may be implemented exclusively by software. Furthermore, the various functions described may be implemented in a single unit or may be spread across multiple components in various ways. When implemented by software, the methods may be executed by a processor, such as a general-purpose computer, based on instructions stored on a machine-readable medium. If desired, the instructions may be stored on the medium in compressed and / or encrypted format.

[0044] That is, aspects of the present disclosure can involve an innovative non-transitory computer-readable medium storing instructions for implementing telexistence. The instructions may include receiving, by a processor, a request to control a humanoid from a remote user, determining, by the processor, acceptance of the request by the host, verifying, by the processor, receipt of a set of activation signals if it is determined that the request is accepted, receiving, by the processor, a humanoid mapping method selected by the remote user if the set of activation signals is received, and controlling the humanoid based on the humanoid mapping method determined by the remote user, and terminating, by the processor, the request to control the humanoid if the set of activation signals is not received.

[0045] Aspects of the present disclosure may also involve an innovative server system for implementing telexistence. The server system may include receiving, by a processor, a request to control a humanoid from a remote user, determining, by the processor, acceptance of the request by the host, verifying, by the processor, receipt of a set of activation signals if it is determined that the request is accepted, receiving, by the processor, a humanoid mapping method selected by the remote user if the set of activation signals is received, and controlling the humanoid based on the humanoid mapping method determined by the remote user, and terminating, by the processor, the request to control the humanoid if the set of activation signals is not received.

[0046] Yet another aspect of the present disclosure involves an innovative system for implementing telexistence, which may include means for receiving a request to control a humanoid from a remote user, means for determining acceptance of the request by the host, means for verifying receipt of a set of activation signals if the request is determined to be accepted, means for receiving a humanoid mapping method selected by the remote user if the set of activation signals is received and controlling the humanoid based on the humanoid mapping method determined by the remote user, and means for terminating the request to control the humanoid if the set of activation signals is not received.

[0047] Moreover, other implementations of the present application will be apparent to those skilled in the art from consideration of the specification and practice of the teachings of the present application. Various aspects and / or components of the described embodiments may be used alone or in any combination. It is intended that the specification and examples be considered as exemplary only, with the true scope and spirit of the present application being indicated by the following claims. [Explanation of symbols]

[0048] 100:Humanoid 101: sensing system, 102: control system, 103: actuation system, 104: camera, 105: screen display, 200: remote configuration, 201: VR equipment, 202: camera, 203: display device, 300: remote viewer configuration, 301: display device, 302: VR equipment, 303: camera, 600: computing environment, 605: computing device, 610: processor, 615: memory, 620: internal storage, 625: IO interface, 630: bus, 635: user interface, 640: interface, 645: external storage, 650: network, 660: logic unit, 665: API unit, 670: input unit, 675: output unit, 695: inter-unit communication mechanism

Claims

1. receiving, by a processor, a request from a remote user to control the humanoid; determining, by the processor, acceptance of the request by the host; if it is determined that the request has been accepted, verifying, by the processor, receipt of a set of activation signals; receiving a selection by the remote user of a humanoid mapping method, either humanoid-to-user mapping or user-to-humanoid mapping, when the set of activation signals is received; Based on the humanoid mapping method selected by the remote user, permitting the remote user to control the humanoid and mapping the posture or orientation of either the remote user's body or the humanoid to the posture or orientation of the other; Handing over control of the humanoid to the remote user to control the humanoid; terminating, by the processor, the request to control the humanoid if the set of activation signals is not received. How to implement telexistence.

2. 2. The method of claim 1, wherein the set of activation signals includes input signals associated with the remote user's virtual reality equipment, motion detection signals of the remote user, and combined weight signals transmitted by the humanoid.

3. 3. The method of claim 2, further comprising: broadcasting the perceived environment from a first camera coupled to the humanoid in the virtual reality device of the remote user.

4. 3. The method of claim 2, wherein the motion detection signal is a feed obtained from a second camera pointed at the remote user.

5. The control of the humanoid is using the second camera to track the movements of the remote user; generating a motion prediction using a trained machine learning model in which the tracked motion of the remote user is used as input; and performing control of the humanoid based on the generated motion prediction.

5. The method for implementing telexistence according to claim 4, comprising:

6. The posture or orientation mapping comprises: If the humanoid-to-user mapping is selected as the humanoid mapping method, determining, by the processor, a combined weight load associated with the humanoid; if the combined weight load is determined to be a significant combined weight load indicating that the humanoid may be carrying a weight / item, the processor generates a first safety alert to the remote user, detects a humanoid mapping method change request made by the remote user in response to the first safety alert, and grants control of the humanoid to the remote user if the humanoid mapping method change request is detected; if the combined weight load is not determined to be the significant combined weight load, allowing control of the humanoid to the remote user; 2. The method of claim 1, comprising:

7. The posture or orientation mapping comprises: If the request to change the humanoid mapping method is not detected, the processor further: generating a second safety alert to the remote user confirming the humanoid mapping method; and granting control of the humanoid to the remote user if a humanoid mapping method is confirmed in response to the second safety alert.

7. The method of claim 6, comprising:

8. A method for implementing telexistence as described in claim 7, wherein the mapping of posture or orientation includes allowing the remote user to control the humanoid by the processor when mapping from the user to the humanoid is selected as the humanoid mapping method.

9. The posture or orientation mapping comprises: the request to control the humanoid is received after a previous remote user has ended control of the humanoid in a previous telexistence session; the orientation of the humanoid after the end of the previous telexistence session remains in a first state; if user-to-humanoid mapping is selected as the humanoid mapping method, mapping the body of the remote user to the orientation of the humanoid in the first state; if humanoid-to-user mapping is selected as the humanoid mapping method and the joint weight load is not determined to be significant, changing the orientation of the humanoid to a second state by mapping the humanoid onto the body of the remote user; If the humanoid-to-user mapping is selected as the humanoid mapping method and a request to change the humanoid mapping method is detected, mapping the body of the remote user to the orientation of the humanoid in the first state; If the mapping from the humanoid to the user is selected as the humanoid mapping method and a request to change the humanoid mapping method is not detected, changing the orientation of the humanoid to the second state.

9. The method for implementing telexistence of claim 8, comprising:

10. Humanoids and a processor in communication with the humanoid, receiving a request from a remote user to control the humanoid; determining acceptance of the request by the host; If it is determined that the request has been accepted, verifying receipt of a set of activation signals; If the set of activation signals is received, receiving a selection by the remote user of a humanoid mapping method, either humanoid-to-user mapping or user-to-humanoid mapping; Based on the humanoid mapping method selected by the remote user, permitting the remote user to control the humanoid and mapping the posture or orientation of either the remote user's body or the humanoid to the posture or orientation of the other; Handing over control of the humanoid to the remote user to control the humanoid; a processor configured to terminate the request to control the humanoid if the set of activation signals is not received; A system for implementing telexistence, comprising:

11. The system of claim 10 , wherein the set of activation signals includes input signals associated with the remote user's virtual reality equipment, motion detection signals of the remote user, and combined weight signals transmitted by the humanoid.

12. 12. The system of claim 11, wherein the processor is further configured to broadcast an environment perceived from a first camera coupled to the humanoid in the virtual reality device of the remote user.

13. 12. The system of claim 11, wherein the motion detection signal is a feed signal obtained from a second camera pointed at the remote user.

14. the processor: using the second camera to track the movements of the remote user; generating a motion prediction using a trained machine learning model in which the tracked motion of the remote user is used as input; The system of claim 13 , configured to control the humanoid by implementing control of the humanoid based on the generated motion predictions.

15. If the humanoid-to-user mapping is selected as the humanoid mapping method, the processor: determining a combined weight load associated with said humanoid; If the combined weight load is determined to be a significant combined weight load indicating that the humanoid may be carrying a weight / item, generating a first safety alert for the remote user; detecting a humanoid mapping method change request made by the remote user in response to the first safety alert; and granting control of the humanoid to the remote user if the humanoid mapping method change request is detected; If the combined weight load is not determined to be the significant combined weight load, then granting control of the humanoid to the remote user. The system of claim 10 configured to:

16. If the request to change the humanoid mapping method is not detected, the processor further: generating a second safety alert to the remote user confirming the humanoid mapping method; and granting control of the humanoid to the remote user if a humanoid mapping method is confirmed in response to the second safety alert. The system of claim 15 configured to:

17. 17. The system of claim 16, wherein the processor is configured to grant control of the humanoid to the remote user if the user-to-humanoid mapping is selected as the humanoid mapping method.

18. the request to control the humanoid is received after a previous remote user has ended control of the humanoid in a previous telexistence session; the orientation of the humanoid after the end of the previous telexistence session remains in a first state; if user-to-humanoid mapping is selected as the humanoid mapping method, mapping the body of the remote user to the orientation of the humanoid in the first state; if humanoid-to-user mapping is selected as the humanoid mapping method and the joint weight load is not determined to be significant, the processor is configured to change the orientation of the humanoid to a second state by mapping the humanoid to the body of the remote user; If the humanoid-to-user mapping is selected as the humanoid mapping method and a request to change the humanoid mapping method is detected, mapping the body of the remote user to the orientation of the humanoid in the first state; When the humanoid-to-user mapping is selected as the humanoid mapping method and a request to change the humanoid mapping method is not detected, the processor is configured to change the orientation of the humanoid to the second state.

20. The system of claim 17.

Images