Power feeding apparatus and power feeding system

Abstract

To provide a power feeding apparatus and a power feeding system that further improve convenience.SOLUTION: In an XR system 101 that blends the real world with a virtual world, such as VR (virtual reality), AR (augmented reality), MR (mixed reality), and SR (alternative reality), a power feeding dock 501 includes a first connection unit 513-1 connected to a terminal device 112 that presents an XR space to a user, a second connection unit 513-2 connected to an information processing device 111 that performs information processing to display virtual objects in the XR space, a third connection unit 513-3 connected to a power supply device 502, and a circuit that supplies power from the power supply device to the terminal device and at the same time enables communication between the terminal device and the information processing device.SELECTED DRAWING: Figure 5

Description

Technical Field

[0001] The present disclosure relates to power supply equipment and a power supply system, and more particularly to power supply equipment and a power supply system that can improve convenience.

Background Art

[0002] In recent years, the development of XR systems that realize XR, which is a technology that fuses the real world and the virtual world such as VR (Virtual Reality), AR (Augmented Reality), MR (Mixed Reality), and SR (Substitute Reality), has been underway. In an XR system, a terminal device that presents a space (hereinafter referred to as an XR space) in which the real space and the virtual space are fused is used.

[0003] For example, Patent Document 1 discloses a power supply system that uses a power supply terminal for power supply as a transmission path of a serial interface and performs data communication via the power supply terminal for power supply.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0005] By the way, when the terminal device has only one connection part for a cable, it is impossible to perform communication and power supply simultaneously by wire via one cable, and the convenience is reduced. For example, a terminal device during charging cannot perform communication by wire, and a terminal device performing communication by wire cannot be charged.

[0006] The present disclosure has been made in view of such a situation, and aims to improve convenience.

Means for Solving the Problems

[0007] The power supply device according to one aspect of the present disclosure includes a first connection portion connected to a terminal device that presents an XR space to a user, and an application based on input information that at least indicates an operation input to an input device used for operation input in the XR space. A second connection portion connected to an information processing device that performs information processing for executing and displaying a virtual object in the XR space, and a third connection portion connected to a power supply device capable of supplying power at a voltage required for charging and driving the terminal device. And a circuit that supplies power from the power supply device to the terminal device and enables communication between the terminal device and the information processing device at the same time.

[0008] The power supply system according to one aspect of the present disclosure includes a terminal device that presents an XR space to a user, and an application based on input information that at least indicates an operation input to an input device used for operation input in the XR space. An information processing device that performs information processing for executing and displaying a virtual object in the XR space, a power supply device capable of supplying power at a voltage required for charging and driving the terminal device, a first connection portion connected to the terminal device, and a second connection portion connected to the information processing device. A third connection portion connected to the power supply device, and a power supply device that supplies power from the power supply device to the terminal device and includes a power supply device having a circuit that enables communication between the terminal device and the information processing device at the same time.

[0009] In one aspect of the present disclosure, a terminal device that presents an XR space to a user is connected to a first connection portion, and an application is executed based on input information that at least indicates an operation input to an input device used for operation input in the XR space. An information processing device that performs information processing for displaying a virtual object in the XR space is connected to the second connection portion, and a power supply device capable of supplying power at a voltage required for charging and driving the terminal device is connected to the third connection portion. And while power from the power supply device is supplied to the terminal device, communication between the terminal device and the information processing device is enabled.

Brief Description of the Drawings

[0010]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Embodiments for Carrying Out the Invention

[0011] Hereinafter, specific embodiments to which the present technology is applied will be described in detail with reference to the drawings.

[0012] <Configuration Example of XR System> FIG. 1 shows a configuration example of an XR (Cross Reality) system 101 which is an embodiment of an information processing system to which the present technology is applied.

[0013] The XR system 101 is a system that realizes XR, which is a technology that fuses the real world and the virtual world such as VR (Virtual Reality), AR (Augmented Reality), MR (Mixed Reality), and SR (Substitute Reality). The XR system 101 is a system that presents a space (hereinafter referred to as an XR space) in which the real space and the virtual space are fused to the user. The XR system 101 can present a virtual object (hereinafter referred to as a virtual object or a virtual body) that does not exist in reality, such as a model created by CAD (Computer Aided Design) (hereinafter referred to as a CAD model), to the user as if it were actually present.

[0014] The XR system 101 includes an information processing device 111, a terminal device 112, and a controller device 113.

[0015] The information processing device 111 and the terminal device 112 can communicate wirelessly or by wire and transmit and receive data to and from each other. The terminal device 112 and the controller device 113 can communicate wirelessly or by wire and transmit and receive data to and from each other. The information processing device 111 and the controller device 113 communicate via the terminal device 112 and transmit and receive data to and from each other.

[0016] The information processing device 111 can, for example, independently receive operations by a user and present various types of information such as visual information and auditory information to the user.

[0017] Also, the information processing device 111 controls the terminal device 112 and controls the presentation of the XR space to the user by the terminal device 112 by executing a predetermined application (hereinafter referred to as an XR application), for example. For example, the information processing device 111 controls the output of various types of information such as visual information and auditory information in the terminal device 112 by executing the XR application, and constructs the XR space presented by the terminal device 112.

[0018] In FIG. 1, an example is shown in which the information processing device 111 is configured by a PC (Personal Computer) including an operation input unit including a mouse and a keyboard. For example, the information processing device 111 may be configured by other information processing devices such as a smartphone or a tablet terminal. For example, the information processing device 111 may be configured by a plurality of information processing devices. For example, the information processing device 111 may be configured by a system constructed by cloud computing via a network.

[0019] The terminal device 112 is a device that presents an XR space to the user.

[0020] In FIG. 1, an example is shown in which the terminal device 112 is a head-mounted display device that can be worn on the user's head and is a device that presents an XR space to the user, i.e., an HMD (Head Mounted Display). More specifically, an example is shown in which the terminal device 112 is a non-transmissive HMD that covers the user's field of view.

[0021] For example, the terminal device 112 is configured by a video see-through type HMD that has an imaging function capable of imaging the real space based on the user's viewpoint, and can present to the user a composite image obtained by synthesizing a real image of the imaged real space and an image of a virtual space such as computer graphics (CG) (hereinafter referred to as a virtual image).

[0022] For example, the terminal device 112 includes left and right imaging units respectively corresponding to the user's left and right eyes, and left and right display units respectively corresponding to the user's left and right eyes.

[0023] For example, the left and right imaging units constitute a stereo camera and image images in the user's line-of-sight direction (hereinafter referred to as field-of-view images) from a plurality of viewpoints corresponding to the user's left and right eyes. That is, the left and right imaging units respectively image images of objects in the real space (hereinafter referred to as real objects or real objects) visible from the user's viewpoint.

[0024] The left and right display units can display different images for the left and right eyes, and can present a three-dimensional virtual object by displaying images with a parallax for the left and right eyes. For example, the left and right display units respectively display the left and right field-of-view images captured by the left and right imaging units.

[0025] Note that the terminal device 112 may be configured by other XR terminal devices such as AR glasses or a smartphone used by being set in goggles. Further, for example, instead of the terminal device 112, a display device such as a spatial reproduction display may be used.

[0026] The controller device 113 is used for operations and inputs (hereinafter referred to as operation inputs) on the XR space presented to the user by the terminal device 112. For example, the user can use the controller device 113 to perform various operations on the virtual objects displayed by the terminal device 112.

[0027] For example, the controller device 113 detects at least one of the operation inputs by the user and the user's behavior (e.g., gestures) through at least one of operation members such as buttons and sensors. The controller device 113 transmits a signal (hereinafter referred to as a controller signal) including at least one of an operation input signal indicating the user's operation input and a behavior signal indicating the user's behavior to the information processing device 111 via the terminal device 112.

[0028] Also, for example, the controller device 113 includes a tactile device that presents tactile stimuli such as vibrations, and presents tactile stimuli to the user under the control of the information processing device 111 or the terminal device 112.

[0029] The controller device 113 includes, for example, one or more types of input devices among a controller, a ring-type device, a pointing device, and a 6DoF (6 Degrees of Freedom) input device.

[0030] The controller is, for example, an input device held by the user's hand. The controller may include, for example, operation members such as buttons operable by the user. For example, the user can perform selection operations, determination operations, scroll operations, etc. on the virtual objects displayed by the terminal device 112 by pressing the buttons of the controller. Also, the controller may include, for example, a touch sensor and a motion sensor.

[0031] Note that the controller is not limited to being held by the user's hand, and may be, for example, attached to a part of the user's body such as the elbow, arm, knee, ankle, or thigh.

[0032] The ring-shaped device is a ring-shaped input device worn on the user's finger. The ring-shaped device may include an operation member such as a button operable by the user. For example, by operating the ring-shaped device, the user can change the position and orientation of a virtual object (e.g., a 3D model) in the XR space in 6DoF (6 degrees of freedom).

[0033] The pointing device is an input device capable of indicating any position in the XR space. For example, by a tracking method such as a bright point tracking method, a magnetic tracking method, an ultrasonic tracking method, etc., the 6DoF position and orientation of the pointing device are recognized by the information processing device 111 via the terminal device 112.

[0034] The 6DoF input device is, for example, an input device capable of 6DoF operation.

[0035] The user can perform operation inputs with the controller device 113 while looking at various objects (display objects) displayed on the information processing device 111 or the terminal device 112.

[0036] Note that the type and number of the controller device 113 are not particularly limited. For example, as the controller device 113, an input device other than the types described above may be used, or an input device combining a plurality of types of input devices may be used.

[0037] For example, the XR system 101 can be applied to various fields such as the manufacturing field and the medical field.

[0038] For example, in the manufacturing field, the XR system 101 can perform product design support and assembly support. For example, at the product design stage, the user can freely edit a three-dimensional object, which is a virtual object, using the XR system 101, or compare it with the real world to grasp the design result and design in advance before prototyping.

[0039] For example, the XR system 101 can be used to assist in surgery and education in the medical field. For example, a user can use the XR system 101 to display the internal conditions on the body surface of a patient to grasp the surgical site in advance or conduct training.

[0040] When the XR space is shared by multiple users, for example, in the XR system 101, the terminal device 112 and the controller device 113 are provided for each user.

[0041] <Display example of XR system 101> Here, with reference to FIGS. 2 and 3, a display example of a display object in the XR system 101 will be described.

[0042] FIGS. 2 and 3 show display examples of display objects in the XR system 101 when creating a CAD model.

[0043] For example, as shown in A of FIG. 2, a two-dimensional CAD model is displayed by the information processing device 111, and the user can edit the two-dimensional CAD model.

[0044] For example, as shown in B of FIG. 2, a three-dimensional CAD model is displayed by the terminal device 112, and the user can edit the three-dimensional CAD model.

[0045] For example, as shown in C of FIG. 2, a two-dimensional object such as a design drawing or a specification is displayed by the terminal device 112, and the user can view the design drawing or the specification.

[0046] FIG. 3 shows a display example of the XR space by the terminal device 112.

[0047] The display 151, keyboard 152, and mouse 153 of the information processing apparatus 111, as well as the desk 154, are displayed as video see-through with a real image obtained by imaging the real space. On the other hand, a two-dimensional image from the terminal device 112 is superimposed on the display 151 as a virtual monitor. For example, a two-dimensional CAD model that is the design target is displayed on the virtual monitor. The two-dimensional CAD model displayed by the virtual monitor is suitable for operation with the keyboard 152 and mouse 153, for example, because of the high accuracy of position detection and the ease of position holding.

[0048] Also, in this example, a three-dimensional CAD model 155 that is the design target is displayed in front of the display 151 by the terminal device 112.

[0049] The CAD model 155 is operated by, for example, a controller device 113a held by the user's dominant hand (the right hand in this example) and a controller device 113b that is a ring-shaped device worn on the index finger of the user's non-dominant hand (the left hand in this example).

[0050] For example, the information processing apparatus 111 executes hand tracking based on an image captured by an imaging unit included in the terminal device 112, thereby recognizing the position, posture, and behavior of the hand holding the controller device 113a and the hand of the user wearing the controller device 113b. Also, for example, the information processing apparatus 111 receives a controller signal from the controller device 113a and the controller device 113b via the terminal device 112, and recognizes an operation on the CAD model 155 by the controller device 113a and the controller device 113b based on the controller signal.

[0051] For example, the user can grasp, release, move, and rotate the CAD model 155 in 6DoF using the controller device 113a or the controller device 113b.

[0052] For example, when the hand wearing the controller device 113a or the controller device 113b is moved without pinching the CAD model 155, the CAD model 155 may be prevented from moving, or the CAD model 155 may be moved so as to move a virtual point.

[0053] For example, the user can point to any point, line, plane, etc. of the CAD model 155 by using the controller device 113a with a ray (virtual light ray) or the like. For example, the user can perform line drawing to draw a line on the CAD model 155 by using the controller device 113a.

[0054] For example, the user can edit (for example, model, wire, disassemble, etc.) the CAD model 155 by using the controller device 113a or the controller device 113b.

[0055] <Configuration example of information processing device 111 and terminal device 112> FIG. 4 is a block diagram showing a functional configuration example of the information processing device 111 and the terminal device 112 of the XR system 101.

[0056] The information processing device 111 includes an operation input unit 201, a control unit 202, a display unit 203, a storage unit 204, and a communication unit 205.

[0057] The operation input unit 201 includes input devices such as a keyboard and a mouse, for example. The operation input unit 201 receives a user's operation input and supplies an operation input signal indicating the content of the user's operation input to the control unit 202.

[0058] The control unit 202 includes an electronic circuit such as a CPU and a microprocessor, for example. The control unit 202 may also include a ROM that stores programs and calculation parameters to be used, etc., and a RAM that temporarily stores parameters that change as appropriate, etc.

[0059] For example, the control unit 202 functions as an arithmetic processing unit and a control device, and controls the overall operation of the information processing device 111 and executes various processes according to various programs.

[0060] For example, the control unit 202 realizes the information processing unit 211 by executing an XR application that enables user experience and virtual object editing in the information processing device 111 and the XR space. The information processing unit 211 includes a recognition unit 221, an operation control unit 222, a space control unit 223, an audio control unit 224, a tactile presentation control unit 225, and a learning unit 226. That is, the recognition unit 221, the operation control unit 222, the space control unit 223, the audio control unit 224, the tactile presentation control unit 225, and the learning unit 226 are realized by the control unit 202 executing the XR application. In addition, the input and output of each part of the information processing unit 211, that is, the recognition unit 221, the operation control unit 222, the space control unit 223, the audio control unit 224, the tactile presentation control unit 225, and the learning unit 226, are executed via the XR application.

[0061] The recognition unit 221 recognizes the state of the information processing device 111, the state of the terminal device 112, the state of the surroundings of the terminal device 112, the state of the controller device 113, the state of the user, the user operation, and the state of the XR space, etc., based on at least one of the operation input signal from the operation input unit 201, the information from the control unit 202, the information from the display unit 203, the information of the communication unit 205, the sensing data transmitted from the terminal device 112, the controller signal transmitted from the controller device 113, the information from the operation control unit 222, and the information from the space control unit 223.

[0062] The state of the information processing device 111 to be recognized includes, for example, at least one of the states of each part of the information processing device 111, the states of each application such as an XR application, the communication state between the information processing device 111 and other devices, and various setting information (for example, setting values of various setting items, etc.). The state of each part of the information processing device 111 includes, for example, at least one of the operating state of each part, the presence or absence of an abnormality, and the content of the abnormality. The state of each application includes, for example, at least one of the startup, termination, operating state, presence or absence of an abnormality, and the content of the abnormality of each application. The communication state between the information processing device 111 and other devices includes, for example, the communication state with the terminal device 112 and the communication state with the controller device 113 via the terminal device 112.

[0063] The state of the terminal device 112 to be recognized includes, for example, at least one of the position, posture, behavior of the terminal device 112, and various setting information (for example, setting values of various setting items, etc.). For example, when the terminal device 112 is worn by a user, the position, posture, and behavior of the terminal device 112 indirectly represent the position, posture, and behavior of the part of the user on which the terminal device 112 is worn.

[0064] The state of the surroundings of the terminal device 112 to be recognized includes, for example, at least one of the type, position, posture, behavior, size, shape, appearance, and feature amount of the real objects around the terminal device 112 (user).

[0065] The state of the controller device 113 to be recognized includes, for example, at least one of the position, posture, behavior of the controller device 113, and various setting information (for example, setting values of various setting items, etc.).

[0066] The state of the user to be recognized includes, for example, at least one of the position, posture, overall behavior, behavior of body parts, and line of sight direction of the user.

[0067] The user operations to be recognized include, for example, at least one of operation inputs by the operation input unit 201, operation inputs by the controller device 113, operation inputs by the user's gestures, and operation inputs by virtual tools or the like in the XR space.

[0068] The state of the XR space to be recognized includes, for example, at least one of the type, position, orientation, behavior, size, shape, appearance, and feature amount of virtual objects in the XR space.

[0069] The recognition unit 221 supplies information regarding the recognition result to each part of the information processing device 111.

[0070] In addition, the recognition unit 221 transmits information regarding the recognition result to the terminal device 112 via the communication unit 205, or transmits it to the controller device 113 via the communication unit 205 and the terminal device 112. For example, when the recognition unit 221 detects a change or abnormality in the state of the terminal device 112 or the controller device 113, it transmits information indicating the detected content to the terminal device 112 via the communication unit 205, or transmits it to the controller device 113 via the communication unit 205 and the terminal device 112. For example, when the recognition unit 221 detects a change (e.g., startup, stop, etc.) or abnormality in the state of an application such as an XR application, it transmits information indicating the detected content to the terminal device 112 via the communication unit 205, or transmits it to the controller device 113 via the communication unit 205 and the terminal device 112.

[0071] Note that, for the recognition processing of various recognition targets by the recognition unit 221, it is possible to use any method such as image recognition and object recognition, for example.

[0072] Also, when the XR space is shared by multiple users, for example, the recognition unit 221 executes recognition processing for each user. For example, the recognition unit 221 recognizes the state of each user's terminal device 112, the state around each user's terminal device 112, the state of each user's controller device 113, the state of each user, and the user operations of each user. The results of the recognition processing for each user may be shared among the users by being transmitted to, for example, each user's terminal device 112 or controller device 113.

[0073] The operation control unit 222 controls the operation processing by the controller device 113 based on at least one of the recognition result by the recognition unit 221 and the controller signal transmitted from the controller device 113.

[0074] For example, the operation control unit 222 controls the operation processing by the controller device 113 based on the position and orientation of the controller device 113 and at least one of the controller signals. For example, the operation control unit 222 controls the activation or deactivation of each operation member provided in the controller device 113, the function assigned to each operation member, the operation method of the function assigned to each operation member, etc., based on the wearing method, gripping method, usage method, etc. of the controller device 113.

[0075] The operation control unit 222 supplies information regarding the control of the operation processing by the controller device 113 to each part of the information processing device 111.

[0076] The space control unit 223 controls the presentation of the two-dimensional space or three-dimensional space by the display unit 203 and the presentation of the XR space by the terminal device 112 based on at least a part of the recognition result by the recognition unit 221.

[0077] For example, based on at least a part of the recognition result by the recognition unit 221, the space control unit 223 generates a display object to be displayed in a two-dimensional space or a three-dimensional space, and performs various operations necessary for constructing and displaying the two-dimensional space or the three-dimensional space, such as the behavior of the display object. The space control unit 223 generates display control information for controlling the display of the two-dimensional space or the three-dimensional space based on the operation result, and supplies it to the display unit 203, thereby controlling the display of the two-dimensional space or the three-dimensional space by the display unit 203. Note that the display control information may include, for example, information for using the two-dimensional space or the three-dimensional space (such as an operation menu, guidance, a message, etc.) and information for notifying the state of the information processing apparatus 111 (such as setting information, battery remaining amount, error display, etc.).

[0078] For example, based on at least a part of the recognition result by the recognition unit 221, the space control unit 223 generates a virtual object to be displayed in the XR space, and performs various operations necessary for constructing and displaying the XR space, such as the behavior of the virtual object. The recognition result by the recognition unit 221 includes, for example, the operation content for the controller device 113a recognized by the recognition unit 221 based on a controller signal including an operation input signal from the controller device 113a. The space control unit 223 generates display control information for controlling the display of the XR space based on the operation result, and transmits it to the terminal device 112 via the communication unit 205, thereby controlling the display of the XR space by the terminal device 112. Note that the display control information may include, for example, information for using the XR space (such as an operation menu, guidance, a message, etc.) and information for notifying the state of the XR system 101 (such as setting information, battery remaining amount, error display, etc.).

[0079] The space control unit 223 supplies information regarding the two-dimensional space, three-dimensional space, and XR space to each part of the information processing apparatus 111.

[0080] The voice control unit 224 controls the voice output by the terminal device 112 based on at least one of the recognition result by the recognition unit 221 and the information from the space control unit 223. For example, the space control unit 223 generates voice control information for outputting voice in the terminal device 112. The voice control information includes information related to at least one of, for example, the type, content, frequency, amplitude, and waveform of the voice to be output. The voice control unit 224 controls the voice output by the terminal device 112 by transmitting the voice control information to the terminal device 112 via the communication unit 205.

[0081] The tactile presentation control unit 225 controls the presentation of tactile stimuli to the user based on at least one of the recognition result by the recognition unit 221 and the information from the space control unit 223. For example, the tactile presentation control unit 225 generates tactile control information for presenting tactile stimuli in the controller device 113. The tactile control information includes information related to at least one of, for example, the type, pattern, strength, and length of the tactile sensation to be presented. The tactile presentation control unit 225 controls the presentation of tactile stimuli by the controller device 113 by transmitting the tactile control information to the controller device 113 via the communication unit 205 and the terminal device 112.

[0082] The learning unit 226 executes a learning process related to the processing of the XR system 101 based on at least one of the recognition result by the recognition unit 221 and the learning data given from the outside. For example, the learning unit 226 learns the user's preferences and behavior patterns, etc., and based on the learning results, adjusts various processes and parameters of the XR system 101 so as to appropriately respond to the user's preferences and behavior patterns, etc. For example, the learning unit 226 learns the differences between the XR space and the real space, and based on the learning results, adjusts design data, etc. so that the characteristics and behaviors of virtual objects in the XR space are closer to those of real objects.

[0083] The learning unit 226 causes the storage unit 204 to store information indicating the learning results (for example, a learning model, etc.), for example.

[0084] Note that the control unit 202 may execute not only XR applications but also other applications.

[0085] The storage unit 204 includes, for example, a ROM (Read Only Memory) that stores programs, arithmetic parameters, etc. used in the processing of the control unit 202, and a RAM (Random Access Memory) that temporarily stores parameters that change as appropriate.

[0086] The communication unit 205 communicates with an external device and transmits and receives data. For example, the communication unit 205 communicates with the terminal device 112 and transmits and receives data. For example, the communication unit 205 transmits display control information, audio control information, and tactile control information to the terminal device 112. For example, the communication unit 205 receives sensing data and controller signals from the terminal device 112.

[0087] The communication method of the communication unit 205 may be either wired or wireless. For example, a wired LAN (Local Area Network), a wireless LAN, Wi-Fi, Bluetooth (registered trademark), etc. are used. Also, the communication unit 205 may support two or more types of communication methods.

[0088] The terminal device 112 includes an operation input unit 251, a sensing unit 252, a control unit 253, a display unit 254, an audio output unit 255, and a communication unit 256.

[0089] The operation input unit 251 includes, for example, an operation input device such as a button. The operation input unit 201 receives a user's operation input and supplies an operation input signal indicating the content of the user's operation input to the control unit 253. For example, the operation input unit 251 receives operation inputs such as turning on or off the power of the terminal device 112 by the user and adjusting the brightness of the display unit 254.

[0090] The sensing unit 252 includes various sensors for sensing the terminal device 112, the surroundings of the terminal device 112, and the state of the user. For example, the sensing unit 252 includes a camera or a depth sensor for imaging the surroundings of the terminal device 112. For example, the sensing unit 252 includes a camera or a depth sensor for imaging both eyes of the user. For example, the sensing unit 252 includes an IMU (Inertial Measurement Unit) for detecting the acceleration, angular velocity, etc. of the terminal device 112. For example, the sensing unit 252 includes a GNSS (Global Navigation Satellite System) receiver for detecting the current position of the terminal device 112 (user). The sensing unit 252 supplies sensing data indicating the detection results of at least one or more of the various sensors to the control unit 253.

[0091] The control unit 253 includes, for example, electronic circuits such as a CPU and a microprocessor. The control unit 253 may also include a ROM that stores programs, arithmetic parameters, etc. to be used, and a RAM that temporarily stores parameters that change as appropriate.

[0092] For example, the control unit 253 functions as an arithmetic processing device and a control device, and according to various programs, based on the operation input signal from the operation input unit 251, the sensing data from the sensing unit 252, the display control information and audio control information from the information processing device 111, and the controller signal from the controller device 113, etc., controls the overall operation of the terminal device 112 or executes various processes. For example, the control unit 253 controls the display of the XR space, etc. by the display unit 254 based on the display control information. For example, the control unit 253 controls the output of audio by the audio output unit 255 based on the audio control information.

[0093] The display unit 254 includes various display devices. For example, when the terminal device 112 is an HMD, the display unit 254 includes displays fixed to the user's left and right eyes respectively, and displays the left-eye image and the right-eye image. The display is constituted by, for example, a display panel such as a liquid crystal display, an organic EL (Electro Luminescence) display, or a laser scanning type display such as a retinal scanning display. Further, the display unit 254 may include, for example, an imaging optical system that enlarges and projects a display screen to form a magnified virtual image with a predetermined angular field of view on the user's pupil. For example, the display unit 254 displays an XR space including virtual objects under the control of the control unit 253.

[0094] The audio output unit 255 includes, for example, an audio output device such as headphones, earphones, or a speaker. The audio output unit 255 outputs audio under the control of the control unit 253.

[0095] The communication unit 256 communicates with an external device and performs data transmission and reception. For example, the communication unit 256 communicates with the terminal device 112 and the controller device 113 and performs data transmission and reception. For example, the communication unit 256 transmits sensing data and a controller signal to the information processing device 111. For example, the communication unit 256 receives display control information, audio control information, and tactile control information from the information processing device 111. For example, the communication unit 256 transmits tactile control information to the controller device 113. For example, the communication unit 256 receives a controller signal from the controller device 113.

[0096] The communication method of the communication unit 256 may be either wired or wireless. For example, a wired LAN, a wireless LAN, Wi-Fi, Bluetooth (registered trademark), etc. are used. Further, the communication unit 256 may support two or more types of communication methods. Furthermore, the communication unit 256 may communicate using different communication methods between the information processing device 111 and the controller device 113.

[0097] The following is an example of the processing of the information processing device 111 using an XR application.

[0098] For example, the communication unit 205 receives input information indicating at least one of the state of the terminal device 112, the state around the terminal device 112, the state of the user, the behavior of the user, and the operation input to the controller device 113 from the terminal device 112 or from the controller device 113 via the terminal device 112, and supplies it to the control unit 202. Based on this input information, the control unit 202 executes the XR application, generates output information for controlling the display of virtual objects including CAD information related to CAD in the XR space, and outputs it to the terminal device 112. The communication unit 205 transmits this output information to the terminal device 112.

[0099] Also, for example, the control unit 202 executes the XR application and outputs output information indicating a change or abnormality in the state of the XR application to the terminal device 112 or the controller device 113. The communication unit 205 transmits this output information to the terminal device 122 or transmits it to the controller device 113 via the terminal device 112.

[0100] On the other hand, for example, the terminal device 112 notifies a change or abnormality in the state of the XR application based on the output information by means of an image, a message, a sound, vibration, or the like. For example, the controller device 113 notifies a change or abnormality in the state of the XR application based on the output information by means of vibration or the like.

[0101] Hereinafter, when each part of the information processing apparatus 111 communicates with the outside via the communication unit 205, the description of the communication unit 205 may be omitted. For example, when the space control unit 223 of the information processing apparatus 111 communicates with the terminal device 112 via the communication unit 205, it may be simply described that the space control unit 223 of the information processing apparatus 111 communicates with the terminal device 112.

[0102] Hereinafter, when each part of the terminal device 112 communicates with the outside via the communication unit 256, the description of the communication unit 256 may be omitted. For example, when the control unit 253 of the terminal device 112 communicates with the information processing device 111 via the communication unit 256, it may simply be described that the control unit 253 of the terminal device 112 communicates with the information processing device 111.

[0103] For example, in the XR system 101, the space control unit 223 of the information processing device 111 generates display control information, transmits it to the terminal device 112 via the communication unit 205, and the control unit 253 of the terminal device 112 receives the display control information via the communication unit 256 and controls the display unit 254 based on the display control information. Hereinafter, the description of this series of processes is simplified, and for example, it may be described that the space control unit 223 of the information processing device 111 controls the display unit 254 of the terminal device 112.

[0104] For example, in the XR system 101, the audio control unit 224 of the information processing device 111 generates audio control information, transmits it to the terminal device 112 via the communication unit 205, and the control unit 253 of the terminal device 112 receives the audio control information via the communication unit 256 and controls the audio output unit 255 based on the audio control information. Hereinafter, the description of this series of processes is simplified, and for example, it may be described that the audio control unit 224 of the information processing device 111 controls the audio output unit 255 of the terminal device 112.

[0105] For example, in the XR system 101, the tactile presentation control unit 225 of the information processing device 111 generates tactile control information, transmits it to the controller device 113 via the communication unit 205 and the terminal device 112, and the controller device 113 presents a tactile stimulus based on the tactile control information. Hereinafter, the description of this series of processes is simplified, and for example, it may be described that the tactile presentation control unit 225 of the information processing device 111 controls the controller device 113 via the terminal device 112.

[0106] <Configuration Example of the Power Supply System of the XR System> Referring to FIGS. 5 and 6, a configuration example of the power supply system of the XR system 101 will be described.

[0107] As shown in FIG. 5, in the power supply system of the XR system 101, a power supply dock 501, a power supply device 502, and a cable 503 capable of communication and power supply are used. The power supply system of the XR system 101 is configured to connect the terminal device 112 to the power supply dock 501 via the cable 503-1, connect the information processing device 111 to the power supply dock 501 via the cable 503-2, and connect the power supply device 502 to the power supply dock 501 via the cable 503-3.

[0108] The power supply dock 501 has a hub function that supplies the power supplied from the power supply device 502 to the terminal device 112 and relays the wired communication between the information processing device 111 and the terminal device 112. For example, when using the terminal device 112 while supplying the power necessary for charging and driving, power is supplied from the power supply device 502 to the terminal device 112 via the power supply dock 501, and at the same time, data is transmitted and received between the information processing device 111 and the terminal device 112.

[0109] The power supply device 502 has a power supply ability to supply power with a voltage required for charging and driving the terminal device 112. For example, it converts an AC 100V voltage into a voltage required for charging and driving the terminal device 112 (for example, DC 9V, 12V, 20V, etc.) and outputs it via the cable 503-3.

[0110] For example, in the XR system 101, the information processing device 111 can output a DC 5V voltage, but there is a power shortage for charging and driving the terminal device 112. Therefore, in the XR system 101, when using the terminal device 112 while supplying power, the power required for charging and driving the terminal device 112 is supplied from the power supply device 502.

[0111] The power supply dock 501 includes a device charging unit 511 where the controller device 113a is set during charging, a device charging unit 512 where the controller device 113b is set during charging, a cable connection unit 513-1 to which the cable 503-1 is connected, a cable connection unit 513-2 to which the cable 503-2 is connected, and a cable connection unit 513-3 to which the cable 503-3 is connected. The cable connection unit 513-1 is connected to the terminal device 112 via the cable 503-1, the cable connection unit 513-2 is connected to the information processing device 111 via the cable 503-2, and the cable connection unit 513-3 is connected to the power supply device 502 via the cable 503-3.

[0112] The device charging unit 511 is provided with a placement part 521, charging pins 522, and a charging lamp 523. The power supplied from the power supply device 502 to the cable connection unit 513-3 via the cable 503-3 is branched and supplied inside the power supply dock 501.

[0113] The placement part 521 is formed in a convex shape that follows the concave shape of the charging surface (the surface where the charging pads 541-1 and 541-2 are provided) of the controller device 113a so that the controller device 113a can be stably placed during charging.

[0114] The charging pins 522 supply the power for charging the controller device 113a in a state where the controller device 113a is placed on the placement part 521. The charging pins 522 are located at the central position in the longitudinal direction of the placement part 521 and are in the vicinity of one of the two side surfaces (the lower side surface in the example shown in FIG. 5) along the longitudinal direction of the placement part 521.

[0115] As shown in the figure, on the controller device 113a, charging pads 541-1 and 541-2 are provided at two positions that are the central positions in the longitudinal direction of the charging surface and are near both side surfaces along the longitudinal direction of the charging surface, respectively. That is, the device charging unit 511 mounts the controller device 113a on the mounting unit 521 so that the concave shape of the charging surface faces the convex shape of the mounting unit 521, and thus either one of the charging pads 541-1 and 541-2 is configured to contact the charging pin 522. That is, the device charging unit 511 can charge the controller device 113a as long as the controller device 113a is mounted on the mounting unit 521 with their longitudinal directions aligned, even if the orientation of the controller device 113a is different by 180°.

[0116] The charging lamp 523 lights up according to the charging status of the controller device 113a. For example, the charging lamp 523 lights up when the controller device 113a is being charged and goes out when the controller device 113a is not being charged. Alternatively, the charging lamp 523 may change the color of the light according to the charging status of the controller device 113a.

[0117] The device charging unit 512 is provided with a mounting unit 531, a charging pin 532, and a charging lamp 533, and the power supplied from the power supply device 502 to the cable connection unit 513-3 via the cable 503-3 is branched and supplied inside the power supply dock 501.

[0118] The placement part 531 is formed in a concave shape that follows the convex shape of the charging surface (the surface where the charging pad 551-1 is provided) of the controller device 113b so that the controller device 113b can be stably placed during charging. Also, the placement part 531 has a concave shape formed so that the controller device 113b is always placed in a fixed direction. In the example shown in FIG. 5, the upper surface of the controller device 113b is formed flat, and the concave shape of the placement part 531 is formed according to the shape of the upper surface of the controller device 113b so that the upper surface is placed in the direction facing the right side (the side where the charging lamp 533 is provided) of the placement part 531.

[0119] The charging pin 532 supplies power for charging the controller device 113b in a state where the controller device 113b is placed on the placement part 531. The charging pin 532 is arranged at a position shifted from the center in the longitudinal direction of the placement part 531 to one side in the longitudinal direction (in the example shown in FIG. 5, a position shifted to the right side from the center in the longitudinal direction).

[0120] As shown in the figure, on the controller device 113b, a charging pad 551 is provided at a position shifted from the center in the longitudinal direction of the charging surface to one side in the longitudinal direction (in the example shown in FIG. 5, a position shifted to the upper surface side from the center in the longitudinal direction). Therefore, by placing the controller device 113b on the placement part 531 according to the concave shape of the placement part 531, the charging pad 551 is always configured to contact the charging pin 532. In the example shown in FIG. 5, the concave shape of the placement part 531 is formed so that the upper surface of the controller device 113b is placed facing the right side, and by placing the controller device 113b on the placement part 531 according to this concave shape, the charging pad 551 and the charging pin 532 are arranged so that the charging pad 551 contacts the charging pin 532.

[0121] The charging lamp 533 lights up according to the charging status of the controller device 113b. For example, the charging lamp 533 lights up when the controller device 113b is being charged and goes out when the controller device 113b is not being charged. Alternatively, the charging lamp 533 may change the color of the light according to the charging status of the controller device 113a.

[0122] The power supply system of the XR system 101 configured as described above supplies power from the power supply device 502 to the terminal device 112 via the power supply dock 501, and at the same time, can transmit and receive data between the information processing device 111 and the terminal device 112. That is, in the power supply system of the XR system 101, via a single cable 503-1 connected to the cable connection part 513-1 of the power supply dock 501, the terminal device 112 receives the supply of power necessary for charging and driving, and can communicate with the information processing device 111.

[0123] In this way, the XR system 101 can perform power supply and communication wired by simply connecting a single cable 503-1 to the terminal device 112, which can improve convenience.

[0124] And in the XR system 101, while the terminal device 112 is being powered, the CAD screen being operated by the information processing device 111 is transmitted to the terminal device 112 wired via the power supply dock 501, and the movements of the controller device 113a and the controller device 113b from the terminal device 112 are transmitted to the information processing device 111. The amount of data for the transmission and reception of data between the information processing device 111 and the terminal device 112 is the same whether wired or wireless, and data can be transmitted and received more stably when communicating wired. For example, compared with a configuration where power is supplied wired and data is transmitted and received wirelessly, the XR system 101 can achieve more stable communication. Thereby, in the XR system 101, a higher-definition and higher refresh rate CAD screen can be stably displayed on the terminal device 112, and a higher level of user experience can be provided.

[0125] In addition, when the terminal device 112 is being powered, for example, a charging lamp (not shown) provided in the terminal device 112 can be turned on, and the color of the lighting can be changed according to the power supply situation (for example, red when charging, green when being driven by the power supplied even after charging is completed, etc.).

[0126] FIG. 6 is a block diagram showing a functional configuration example of the power supply dock 501.

[0127] As shown in FIG. 6, the power supply dock 501 includes a MIX circuit 601 having a switch 611, a switch 612, and a switch control unit 613.

[0128] In the MIX circuit 601, a power line 621-1 connected to the cable connection part 513-1 is connected to one terminal of the switch 611, a power line 621-3 connected to the cable connection part 513-3 is connected to the other terminal of the switch 611, and a power line 621-2 connected to the cable connection part 513-2 is connected to the switch control unit 613. Then, the switch 611 turns on / off the connection between the power line 621-1 and the power line 621-3.

[0129] Also, in the MIX circuit 601, a data line 622-1 connected to the cable connection part 513-1 is connected to one terminal of the switch 612, a data line 622-2 connected to the cable connection part 513-2 is connected to the other terminal of the switch 612, and a data line 622-3 connected to the cable connection part 513-3 is connected to the switch control unit 613. Then, the switch 612 turns on / off the connection between the data line 622-1 and the data line 622-2.

[0130] The switch control unit 613 is driven by the power supplied via the power line 621-2 and controls the on / off states of the switch 611 and the switch 612. Also, when the power supply device 502 is connected to the cable connection unit 513-3 via the cable 503-3, the switch control unit 613 can communicate with the power supply device 502 via the data line 622-3.

[0131] For example, when the switch control unit 613 communicates with the power supply device 502 and recognizes that the power supply device 502 can output the voltage required for charging and driving the terminal device 112, the switch control unit 613 controls the switch 611 and the switch 612 to be turned on. As a result, the power line 621-1 and the power line 621-3 are connected via the switch 611, and the data line 622-1 and the data line 622-2 are connected via the switch 612. At the same time as the power from the power supply device 502 is supplied to the terminal device 112, wired communication between the information processing device 111 and the terminal device 112 becomes possible.

[0132] On the other hand, when the switch control unit 613 communicates with the power supply device 502 and cannot recognize that the power supply device 502 can output the voltage required for charging and driving the terminal device 112, the switch control unit 613 controls the switch 611 and the switch 612 to be turned off. Of course, the switch control unit 613 also controls the switch 611 and the switch 612 to be turned off when the connection of the power supply device 502 is not detected. Therefore, in this case, power is not supplied to the terminal device 112, and wired communication between the information processing device 111 and the terminal device 112 is not performed.

[0133] In this way, the MIX circuit 601 can recognize the power supply ability of the power supply device 502 and supply the power supplied from the power supply device 502 via the cable connection unit 513-3 to the terminal device 112 via the cable connection unit 513-1, and at the same time, enable communication between the information processing device 111 and the terminal device 112.

[0134] The power supply dock 501 configured as described above can perform power supply and communication wiredly by simply connecting one cable 503-1 to the terminal device 112.

[0135] In the power supply system of the XR system 101, for example, when the controller device 113a is correctly set in the device charging unit 511, the user can be presented with the fact that the controller device 113a has entered the charging state by vibrating the tactile device of the controller device 113a. Similarly, for example, when the controller device 113g is correctly set in the device charging unit 512, the user can be presented with the fact that the controller device 113b has entered the charging state by vibrating the tactile device of the controller device 113b.

[0136] Also, in the power supply system of the XR system 101, for example, the charging status (such as charging start, charging in progress, charging end, charging capacity, etc.) of the controller device 113a or the controller device 113b may be displayed on the display unit of the terminal device 112.

[0137] <Configuration example of a computer> Next, the above series of processes can be performed by hardware or by software. When the series of processes are performed by software, the program constituting the software is installed in a general-purpose computer or the like.

[0138] FIG. 7 is a block diagram showing a configuration example of the hardware of a computer that executes the above series of processes by a program.

[0139] In a computer, a CPU (Central Processing Unit) 1001, a ROM (Read Only Memory) 1002, a RAM (Random Access Memory) 1003, and an EEPROM (Electronically Erasable and Programmable Read Only Memory) 1004 are interconnected by a bus 1005. An input / output interface 1006 is further connected to the bus 1005, and the input / output interface 1006 is connected to the outside.

[0140] In the computer configured as described above, the CPU 1001 loads and executes, for example, the programs stored in the ROM 1002 and the EEPROM 1004 into the RAM 1003 via the bus 1005, whereby the above-described series of processes are performed. Also, the program executed by the computer (CPU 1001) can be pre-written in the ROM 1002, or can be installed or updated from the outside to the EEPROM 1004 via the input / output interface 1006.

[0141] Here, in this specification, the processes performed by the computer according to the program do not necessarily have to be performed in time series in the order described as a flowchart. That is, the processes performed by the computer according to the program also include processes that are executed in parallel or individually (for example, parallel processing or object-based processing).

[0142] Also, the program may be processed by one computer (processor), or may be distributedly processed by a plurality of computers. Further, the program may be transferred to a remote computer and executed.

[0143] Furthermore, in this specification, a system means a collection of a plurality of components (devices, modules (parts), etc.), regardless of whether all the components are in the same housing. Therefore, a plurality of devices housed in separate housings and connected via a network, and a single device in which a plurality of modules are housed in one housing are both systems.

[0144] Also, for example, the configuration described as a single device (or processing unit) may be divided and configured as a plurality of devices (or processing units). Conversely, the configurations described as a plurality of devices (or processing units) above may be combined and configured as a single device (or processing unit). Of course, configurations other than those described above may be added to the configuration of each device (or each processing unit). Furthermore, if the overall configuration and operation of the system are substantially the same, a part of the configuration of a certain device (or processing unit) may be included in the configuration of another device (or another processing unit).

[0145] Also, for example, the present technology can adopt a cloud computing configuration in which a single function is shared and jointly processed by a plurality of devices via a network.

[0146] Also, for example, the above-described program can be executed on any device. In that case, it suffices that the device has the necessary functions (function blocks, etc.) and can obtain the necessary information.

[0147] Also, for example, each step described in the above flowchart can be executed by a single device or shared and executed by a plurality of devices. Furthermore, when a single step includes a plurality of processes, the plurality of processes included in that single step can be executed by a single device or shared and executed by a plurality of devices. In other words, the plurality of processes included in a single step can be executed as processes of a plurality of steps. Conversely, the processes described as a plurality of steps can be combined and executed as a single step.

[0148] Note that the program executed by the computer may be such that the processing of the steps of describing the program is executed in time series along the order described in this specification, or may be executed in parallel, or may be executed individually at a necessary timing such as when a call is made. That is, as long as there is no contradiction, the processing of each step may be executed in an order different from the above-described order. Furthermore, the processing of the steps of describing this program may be executed in parallel with the processing of other programs, or may be executed in combination with the processing of other programs.

[0149] Note that the present technology described multiple times in this specification can be implemented independently and individually as long as there is no contradiction. Of course, any plurality of the present technologies can also be implemented in combination. For example, part or all of the present technology described in any one of the embodiments can also be implemented in combination with part or all of the present technology described in other embodiments. Also, part or all of any of the above-described present technologies can also be implemented in combination with other technologies not described above.

[0150] <Example of Configuration Combination> Note that the present technology can also adopt the following configuration. (1) A first connection part connected to a terminal device that presents an XR space to a user, A second connection part connected to an information processing device that executes an application based on input information indicating at least an operation input to an input device used for operation input in the XR space and performs information processing for displaying a virtual object in the XR space, A third connection part connected to a power supply device capable of supplying power of a voltage necessary for charging and driving the terminal device, A circuit that supplies power from the power supply device to the terminal device and at the same time enables communication between the terminal device and the information processing device A power supply device comprising the same. (2) A device charging part that charges the input device further comprising the power supplied to the third connection part is branched and supplied to the first connection part and the device charging part The power supply device according to (1) above. (3) The first connection part is connected to the terminal device via a single cable capable of communication and power supply The power supply device according to (1) or (2) above. (4) The circuit a first switch for turning on / off the connection of the power line between the first connection part and the third connection part, a second switch for turning on / off the connection of the data line between the first connection part and the second connection part, a switch control part that communicates with the power supply device connected to the third connection part and controls the first switch and the second switch having The power supply device according to any one of (1) to (3) above. (5) When the switch control part recognizes that the power supply device can supply power of a voltage necessary for charging and driving the terminal device, it controls the first switch and the second switch to turn on the connection of the power line between the first connection part and the third connection part and turn on the connection of the data line between the first connection part and the second connection part The power supply device according to (4) above. (6) a terminal device that presents an XR space to a user, an information processing device that executes an application based on input information indicating at least an operation input to an input device used for operation input in the XR space and performs information processing for displaying a virtual object in the XR space, a power supply device capable of supplying power of a voltage necessary for charging and driving the terminal device, A power supply device having a first connection part connected to the terminal device, a second connection part connected to the information processing device, a third connection part connected to the power supply device, and a circuit that supplies power from the power supply device to the terminal device and enables communication between the terminal device and the information processing device at the same time A power supply system comprising the same.

[0151] Note that the present embodiment is not limited to the above-described embodiment, and various modifications are possible without departing from the gist of the present disclosure. Also, the effects described in this specification are merely examples and are not limiting, and there may be other effects.

Explanation of Reference Numerals

[0152] 101 XR system, 111 information processing device, 112 terminal device, 113, 113a, 113b controller device, 202 control unit, 203 display unit, 211 information processing unit, 221 recognition unit, 222 operation control unit, 223 space control unit, 224 voice control unit, 225 tactile presentation control unit, 226 learning unit, 252 sensing unit, 253 control unit, 254 display unit, 255 voice output unit, 501 power supply dock, 502 power supply device, 503 cable, 511 and 512 device charging parts, 513 cable connection part, 521 placement part, 522 charging pin, 523 charging lamp, 531 placement part, 532 charging pin, 533 charging lamp, 541 and 551 charging pads, 601 MIX circuit, 611 and 612 switches, 613 switch control unit, 621 power line, 622 data line

Claims

1. A first connection part connected to a terminal device that presents an XR space to a user, An information processing device that executes an application based on input information indicating at least an operation input to an input device used for operation input in the XR space and performs information processing for displaying a virtual object in the XR space, and a second connection part connected to the information processing device, A third connection part connected to a power supply device capable of supplying power of a voltage required for charging and driving the terminal device, A circuit that supplies power from the power supply device to the terminal device and enables communication between the terminal device and the information processing device A power supply device comprising.

2. A device charging part for charging the input device Further comprising, The power supplied to the third connection part is branched and supplied to the first connection part and the device charging part The power supply device according to claim 1.

3. The first connection part is connected to the terminal device via a single cable capable of communication and power supply The power supply device according to claim 1.

4. The circuit is, A first switch for turning on / off the connection of the power line between the first connection part and the third connection part, A second switch for turning on / off the connection of the data line between the first connection part and the second connection part, A switch control part that communicates with the power supply device connected to the third connection part and controls the first switch and the second switch Having The power supply device according to claim 1.

5. When the switch control part recognizes that the power supply device can supply power of a voltage required for charging and driving the terminal device, it controls the first switch and the second switch to turn on the connection of the power line between the first connection part and the third connection part and turn on the connection of the data line between the first connection part and the second connection part The power supply device according to claim 4.

6. A terminal device that presents an XR space to a user, An information processing device that executes an application based on input information indicating at least an operation input to an input device used for operation input in the XR space and performs information processing for displaying a virtual object in the XR space, A power supply device capable of supplying power of a voltage required for charging and driving the terminal device, A power supply device having a first connection portion connected to the terminal device, a second connection portion connected to the information processing device, a third connection portion connected to the power supply device, and a circuit that supplies power from the power supply device to the terminal device and enables communication between the terminal device and the information processing device A power supply system comprising the same.

Images