Information processing apparatus, method for controlling information processing apparatus, and program

Abstract

To provide an information processing apparatus, a method for controlling an information processing apparatus, and a program that can smoothly assign a function intended by a user to an operation terminal.SOLUTION: An information processing apparatus 101 is communicably connected to an operation terminal 102 having an input unit (operation unit 212) that performs an input operation to an image in a virtual space and exerts a predetermined function according to the input operation. The information processing apparatus 101 comprises: position acquisition means (photographing unit 208) that acquires position information related to the position of the operation terminal 102; and changing means (assignment determination means 302, assigning means 303) that can change the function in the input unit that is exerted according to the input operation, according to the position information acquired by the position acquisition means.SELECTED DRAWING: Figure 6

Description

[Technical field]

[0001] The present invention relates to an information processing device, a control method for an information processing device, and a program. [Background technology]

[0002] In recent years, the innovation of "VR (Virtual Reality)" technology has been remarkable. With this technological innovation, VR devices, such as HMDs (Head Mounted Displays), are becoming more and more popular. In the virtual space displayed on the VR device, various contents, such as games and photography, can be executed or used. When executing or using the contents, an operation terminal, such as a controller operated by hand, is used. Patent Document 1 discloses a game system having an HMD and a controller communicably connected to the HMD. In the game system described in Patent Document 1, a pose of a user holding a controller is detected. Then, when a pose in which the user brings the controller close to the face is detected as this pose, an object on a line extending from the end of the barrel of a weapon held by the user in the virtual space can be enlarged and displayed. Patent Document 2 discloses that a device other than a dedicated VR controller can be used as a controller for the HMD. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2023-31290 A [Patent Document 2] JP 2016-81408 A Summary of the Invention [Problem to be solved by the invention]

[0004] In an HMD, a user may change the position of the user's own avatar in the virtual space by operating a controller while holding it. A camera can also be used as a controller. In this case, the camera is used to take pictures, so a separate controller must be used to change the avatar position, i.e., the user must switch between holding the camera and the separate controller. For this reason, it is desirable for one controller to be able to perform multiple functions.

[0005] The present invention has been made in view of the above problems, and aims to provide an information processing device, a control method for the information processing device, and a program that enable a user to smoothly assign functions intended by the user to an operation terminal. [Means for solving the problem]

[0006] In order to achieve the above-mentioned object, the information processing device of the present invention is an information processing device that is communicatively connected to an operation terminal having an input unit that performs input operations on images in a virtual space and performs a predetermined function through the input operations, and is characterized in that it comprises a position acquisition means that acquires position information regarding the position of the operation terminal, and a change means that is capable of changing the function of the input unit that is performed through the input operation in accordance with the position information acquired by the position acquisition means. Effect of the Invention

[0007] According to the present invention, functions intended by a user can be smoothly assigned to an operation terminal. [Brief description of the drawings]

[0008] [Figure 1] FIG. 2 is a diagram showing an example of a usage state of the information processing device according to the first embodiment. [Diagram 2] FIG. 2 is a block diagram showing an example of a hardware configuration of an information processing device and an operation terminal. [Diagram 3] FIG. 2 is a block diagram showing an example of a software configuration (functional configuration) of the information processing device. [Figure 4]11 is a diagram showing an example of data acquired by an operation terminal position information acquisition unit of the information processing device. FIG. [Diagram 5] 11 is a diagram showing an example of assignment of functions to an operation unit of an operation terminal according to a result of determination by an assignment determination unit of the information processing device. FIG. [Figure 6] 4 is a flowchart showing a process executed by the information processing device. [Figure 7] FIG. 11 is a block diagram showing an example of a software configuration (functional configuration) of an information processing device according to a second embodiment. [Figure 8] 4 is a flowchart showing a process executed by the information processing device. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] Each embodiment of the present invention will be described in detail below with reference to the drawings. However, the configurations described in each of the following embodiments are merely examples, and the scope of the present invention is not limited by the configurations described in each embodiment. For example, each part constituting the present invention can be replaced with any configuration that can exert a similar function. In addition, any configuration may be added. In addition, any two or more configurations (features) of each embodiment can be combined.

[0010] First Embodiment Hereinafter, the first embodiment will be described with reference to FIG. 1 to FIG. 6. FIG. 1 is a diagram showing an example of a usage state of an information processing device according to the first embodiment. FIG. 1(a) is a diagram showing a state in which an operation terminal is located within the angle of view of the information processing device. FIG. 1(b) is a diagram showing a state in which an operation terminal is located within the angle of view of the information processing device, and a user is looking into the viewfinder of the operation terminal. FIG. 1(c) is a diagram showing a state in which an operation terminal is located outside the angle of view of the information processing device. The information processing device 101 is an HMD (head mounted display) that is wearably attached to the head of a user 103. This information processing device 101 can be used by being communicatively connected to an operation terminal 102. Hereinafter, a state in which the information processing device 101 and the operation terminal 102 are communicatively connected may be referred to as a "communication state". The operation terminal 102 is a camera device such as a single-lens reflex camera or a mirrorless camera, and in this embodiment, has a viewfinder shooting function and a live view shooting function. Note that the operation terminal 102 is not limited to a camera, and may be, for example, a smartphone or a mobile controller. As shown in FIG. 1(a), the user 103 wears the information processing device 101 on his head (hereinafter referred to as the "wearing state") and places the operation terminal 102 in front of his eyes. At this time, the operation terminal 102 is located within the angle of view of the information processing device 101. As shown in FIG. 1(b), the user 103 in the wearing state looks into the finder of the operation terminal 102. At this time, the operation terminal 102 is located within the angle of view of the information processing device 101. As shown in FIG. 1(c), the user 103 in the wearing state places the operation terminal 102 in front of his chest. At this time, the operation terminal 102 is located outside the angle of view of the information processing device 101.

[0011] FIG. 2 is a block diagram showing an example of the hardware configuration of an information processing device and an operation terminal. FIG. 2(a) is a block diagram showing an example of the hardware configuration of an information processing device. FIG. 2(b) is a block diagram showing an example of the hardware configuration of an operation terminal. As shown in FIG. 2(a), the information processing device 101 has a CPU 201, a ROM 202, a RAM 203, a sensor 204, an input detection unit 205, a communication I / F 206, a recording unit 207, an imaging unit (imaging means) 208, a display unit (display means) 209, and an operation unit 210. These hardware components of the information processing device 101 are connected to each other via a bus 211 so as to be able to communicate with each other. The CPU 201 is a system control unit (computer) that controls the entire information processing device 101. The ROM 202 is a read-only memory that stores programs and parameters that do not require modification, such as basic programs and initial data. The RAM 203 is a memory for temporarily storing input information, calculation results in information processing and image processing, and the like. The sensor 204 detects the position and orientation of the information processing device 101. The sensor 204 is not particularly limited, and for example, a gyro or the like can be used. The input detection unit 205 accepts required data input. The required data is not particularly limited, and for example, an operation on the operation unit 212 of the operation terminal 102 received by the communication I / F 206 can be cited. The communication I / F 206 is an interface unit capable of transmitting and receiving data to and from the operation terminal 102, the cloud, and the like. The connection form of input / output by the communication I / F 206 includes a local connection by USB, Bluetooth (registered trademark), or the like, an Internet connection by Ethernet or Wi-Fi (registered trademark), and the like.

[0012] The recording unit 207 is a device capable of writing and reading various information. The recording unit 207 is not particularly limited, and may be, for example, a hard disk or a memory card built into or external to the information processing device 101, or a memory card, a removable disk, an IC card, or the like that is detachable from the information processing device 101. The recording unit 207 also includes an information processing program for causing the CPU 201 to execute each unit and each means (control method of the information processing device) of the information processing device 101. This information processing program is read from the recording unit 207, expanded in the RAM 203, and executed by the CPU 201. Note that the information processing program may be stored in the ROM 202. The recording unit 207 can record required data used by the information processing program. The photographing unit 208 can photograph an image. This photographing unit 208 can perform image recognition on the photographed real-life video to track the joints and hand movements of the user 103. Further, the photographing unit 208 photographs the operation terminal 102 and detects the position of the operation terminal 102 based on the photographed image. The display unit 209 is a stereo display corresponding to both eyes of the user 103, and displays an image of the virtual space. The operation unit 210 controls input to the information processing device 101. The operation unit 210 is not particularly limited, and examples thereof include a power button, a menu button, a selection button, and a decision button. In order to reduce the size and weight of the information processing device 101, it is preferable to separate the information processing system of the CPU 201 to the recording unit 207 and the operation unit 210 from the other imaging and display systems. The information processing system is arranged as an external configuration. The imaging and display system is built into the information processing device 101.

[0013] As shown in FIG. 2(b), the operation terminal 102 has an operation unit (input unit) 212, a sensor 213, an input detection unit 214, and a communication I / F 215. These hardware components of the operation terminal 102 are communicably connected to each other via a bus 216. The operation terminal 102 is provided with a plurality of operation units 212, and each operation unit 212 is composed of a mechanical button, a mechanical dial, a touch panel, or a touch pad. Operation instructions, commands, and the like are acquired from the user 103 by operating the operation units 212. Furthermore, a desired input operation is performed on an image of the virtual space displayed on the display unit 209 of the information processing device 101 by operating each operation unit 212 in a communication state. A predetermined function is exercised by this input operation.

[0014] For example, in the state shown in FIG. 1(a), a visual field image 104 similar to what the user 103 sees in real space is displayed on the display unit 209 of the information processing device 101. The visual field image 104 includes a virtual object 105 of the operation terminal 102 corresponding to the position, posture, and appearance of the operation terminal 102 held by the user 103 in the hand in real space. Then, when the user 103 releases the shutter of the operation terminal 102 in this state, a photograph or a video can be taken in the virtual space according to the position of the virtual object 105. When body tracking is performed in the information processing device 101, the hand 106 of the avatar of the user 103 is displayed in the visual field image 104 without any sense of incongruity so that the user 103 feels as if he or she is holding the operation terminal 102 in the virtual space. Also, the user 103 can change various settings such as shooting conditions on the touch panel of the operation terminal 102. In the state shown in FIG. 1(b), when the user 103 releases the shutter of the operation terminal 102, a photograph or a video can be taken in the virtual space. The visual field image 104 is displayed in full screen as if the user were looking through a viewfinder to take a picture. In the state shown in FIG. 1(c), the user 103 can move within the virtual space by operating the operation unit 212 of the operation terminal 102. The visual field image 108 includes a guidance display 109 for moving within the virtual space. The guidance display 109 shows the operation content within the virtual space when the user 103 operates the operation unit 212 of the operation terminal 102 held by the user 103. In this way, the information processing device 101 can assign functions to inputs from the operation terminal 102 according to the position of the operation terminal 102.

[0015] The operation terminal 102 is not limited to having a plurality of operation units 212, but may have at least one operation unit 212. The sensor 213 acquires the position and attitude of the operation terminal 102 and changes in the position and attitude. The sensor 213 is not particularly limited, and for example, an acceleration sensor or the like can be used. The input detection unit 214 accepts required data input. The required data is not particularly limited, and for example, an instruction by operation on the operation unit 212 can be cited. The communication I / F 215 is an interface unit capable of transmitting and receiving data to and from the information processing device 101. The connection form of input / output by the communication I / F 215 includes a local connection by USB, Bluetooth, etc., and an Internet connection by Ethernet or Wi-Fi, etc.

[0016] FIG. 3 is a block diagram showing an example of a software configuration (functional configuration) of an information processing device. As shown in FIG. 3, the information processing device 101 has an operation terminal position information acquisition means 301, an allocation determination means 302, an allocation means 303, and a display switching means 304. The operation terminal position information acquisition means 301 acquires position information on the position of the operation terminal 102 (position acquisition step). In this embodiment, the operation terminal position information acquisition means 301 can acquire the position information of the operation terminal 102 by using image recognition processing on an image captured by the imaging unit 208 of the information processing device 101. The operation terminal position information acquisition means 301 can also acquire the position information of the operation terminal 102 from the sensor 213 of the operation terminal 102. The operation terminal position information acquisition means 301 can also determine whether the operation terminal 102 is present within the angle of view of the imaging unit 208, that is, the position of the operation terminal 102, by using image recognition processing on an image captured by the imaging unit 208 of the information processing device 101. FIG. 4 is a diagram showing an example of data acquired by the operation terminal position information acquisition means of the information processing device. As shown in FIG. 4, the data acquired by the operation terminal position information acquisition means includes position information of the operation terminal 102 and information within the field of view as to whether the operation terminal 102 is located within the field of view of the imaging unit 208 of the information processing device 101, which is the HMD. The position information of the operation terminal 102 is expressed by (x, y, z) with the position of the imaging unit 208 as the reference point. This makes it possible to acquire the distance between the operation terminal 102 and the imaging unit 208 (information processing device 101). Note that x and y are positions in the horizontal direction, and z is a position in the vertical direction. In FIG. 4, (x, y, z)=(0, 100, 100) is shown as an example. The information within the field of view is shown as "◯" indicating that the operation terminal 102 is located within the field of view, or "×" indicating that the operation terminal 102 is not located within the field of view. In FIG. 4, "◯" is shown as an example. The information within the angle of view can be included in the position information of the operation terminal 102 as one of the position information.

[0017] The allocation determination means 302 can determine whether or not to change a function of the operation unit 212 that is exercised by an input operation on the operation unit 212, in other words, which function to assign to the operation unit 212, according to the position information of the operation terminal 102 (changing step). In this embodiment, the allocation determination means 302 determines which function to assign to the operation unit 212, according to the distance between the operation terminal 102 and the information processing device 101 and the presence or absence of the operation terminal 102 within the angle of view of the imaging unit 208.

[0018] The allocation means 303 allocates (changes) a function to the operation unit 212 according to the determination result by the allocation determination means 302. Note that the allocation determination means 302 and the allocation means 303 are separate from each other in this embodiment, but are not limited to this and may be one configuration (allocation change means). FIG. 5 is a diagram showing an example of function allocation to the operation unit of the operation terminal according to the determination result by the allocation determination means of the information processing device. FIG. 5(a) is a diagram showing an example of function allocation for shooting (for viewfinder shooting function). FIG. 5(b) is a diagram showing an example of function allocation for live view shooting (live view shooting function). FIG. 5(c) is a diagram showing an example of function allocation for moving the angle (for moving in virtual space). When the operation terminal 102 is within the angle of view of the shooting unit 208 and the distance between the operation terminal 102 and the information processing device 101 is equal to or less than a threshold (see FIG. 1(b)), the function of the operation unit 212 as an input unit is set to the function allocation for shooting shown in FIG. 5(a). As shown in Fig. 5(a), the operation unit 212 includes a button A, a button B, a dial A, etc. A function is assigned to button A to perform shooting in the same manner as shooting through a viewfinder when button A is operated. A function is assigned to button B to perform zooming during shooting when button B is operated. A function is assigned to dial A to perform setting change, for example, to change settings such as shooting conditions when dial A is operated.

[0019] When the operation terminal 102 is within the angle of view of the imaging unit 208 and the distance between the operation terminal 102 and the information processing device 101 is not equal to or less than a threshold (see FIG. 1(a)), the functions of the operation unit 212 are set to the function allocation for live view shooting shown in FIG. 5(b). As shown in FIG. 5(b), the operation unit 212 includes a button A, a button B, a dial A, a touch panel, and the like. The button A is assigned a function of performing live view shooting when an operation is performed on the button A. The button B is assigned a function of performing zooming during live view shooting when an operation is performed on the button B. The dial A is assigned a function of performing setting change, for example, changing settings such as the conditions for live view shooting, when an operation is performed on the dial A. The touch panel is assigned a function of performing live view shooting when an operation is performed on the touch panel.

[0020] When the operation terminal 102 is not within the angle of view of the imaging unit 208 (see FIG. 1(c)), the functions of the operation unit 212 are set to the function allocation for angle movement shown in FIG. 5(c). As shown in FIG. 5(c), the operation unit 212 includes a button A, a button B, a dial A, and the like. A function for moving to the right is assigned to button A when an operation is performed on button A. A function for moving to the left is assigned to button B when an operation is performed on button B. A function for changing the orientation is assigned to dial A when an operation is performed on dial A.

[0021] The display switching means 304 switches the display contents on the display unit 209 in accordance with the function allocation by the allocation means 303. As shown in Fig. 1(a), in the case of live view shooting, the virtual object 105 of the operation terminal 102 imaged by the shooting unit 208 is displayed on the image of the background virtual space. As shown in Fig. 1(b), in the case of shooting, an image of the background virtual space (field of view image 107) is displayed. As shown in Fig. 1(c), in the case of moving the angle, the operation unit 212 and the function (movement guidance) of the operation unit 212 set or changed by the allocation means 303 are displayed on the image of the background virtual space.

[0022] 6 is a flowchart showing the process executed by the information processing device 100. As shown in FIG.

[0023] In step S602, the allocation determination means 302 determines (judges) whether or not the operation terminal 102 is within the angle of view of the imaging unit 208, based on the position information of the operation terminal 102 acquired in step S601. If it is determined in step S602 that the operation terminal 102 is within the angle of view of the imaging unit 208, the process proceeds to step S603. On the other hand, if it is determined in step S602 that the operation terminal 102 is not within the angle of view of the imaging unit 208, the process proceeds to step S608.

[0024] In step S603, the allocation determination means 302 determines whether or not the distance between the operation terminal 102 and the image capture unit 208 is equal to or less than a threshold based on the position information of the operation terminal 102 acquired in step S601. If it is determined in step S603 that the distance is equal to the threshold, the process proceeds to step S604. On the other hand, if it is determined in step S603 that the distance is not equal to the threshold, the process proceeds to step S606. The threshold is preferably set in advance, and may be changeable as appropriate.

[0025] In step S604, the allocation means 303 allocates functions to the operation unit 212 of the operation terminal 102 as the function allocation for photographing shown in FIG. 5(a).

[0026] In step S605, the display switching means 304 switches the display content on the display unit 209 to the field of view image 107 (see FIG. 1(b)). The field of view image 107 is displayed in full screen. After step S605 is executed, the process ends.

[0027] In step S606, the allocation means 303 allocates functions to the operation unit 212 of the operation terminal 102 as the function allocation for live view shooting shown in FIG. 5(b).

[0028] In step S607, the display switching means 304 switches the display content on the display unit 209 to the field of view image 104 (see FIG. 1(a)). The field of view image 104 includes a background image. After step S607 is executed, the process ends.

[0029] In step S608, the allocation means 303 allocates functions to the operation unit 212 of the operation terminal 102 as the function allocation for angle movement shown in FIG. 5(c).

[0030] In step S609, the display switching means 304 switches the display content on the display unit 209 to the field of view image 108 (see FIG. 1(c)). The field of view image 108 includes a guidance display 109 for moving within the virtual space. After step S609 is executed, the process ends.

[0031] In the information processing device 101 configured as above, functions intended by the user 103 can be smoothly assigned to the operation terminal 102 according to the position of the operation terminal 102 relative to the user 103 while the operation terminal 102 remains available for photographing. In other words, a variety of functions can be achieved with one operation terminal 102 without the user having to switch the operation terminal 102 to another operation terminal. This allows the user 103 to, for example, photograph an image or change the position of the user 103's own avatar in the virtual space by operating the operation terminal 102 while holding it.

[0032] <Second embodiment> The second embodiment will be described below with reference to Fig. 7 and Fig. 8, focusing on the differences from the above-mentioned embodiment, and omitting the description of the similarities. This embodiment is similar to the first embodiment, except that functions are assigned to the operation unit 212 of the operation terminal 102 according to the line of sight of the user 103.

[0033] FIG. 7 is a block diagram showing an example of a software configuration (functional configuration) of an information processing device according to the second embodiment. As shown in FIG. 7, the information processing device 101 has an operation terminal position information acquisition means 701, a user line of sight information acquisition means (line of sight acquisition means) 702, an allocation determination means 703, and an allocation means 704. The operation terminal position information acquisition means 701 acquires position information on the position of the operation terminal 102, similar to the operation terminal position information acquisition means 301. The user line of sight information acquisition means 702 acquires line of sight information on the line of sight of the user 103 who is wearing the operation terminal 102 and who operates the operation terminal 102. There is no particular limitation on the method of acquiring this line of sight information, and examples of the method include eye tracking, which detects (tracks) the movement of the eyeball by a camera or an infrared sensor built into the information processing device 101 and uses the detection result. The allocation determination means 703 determines which function to assign to the operation unit 212 according to the position information of the operation terminal 102 and the line of sight information of the user 103. In this embodiment, the allocation determination means 703 determines which function to allocate to the operation unit 212 depending on the presence or absence of the operation terminal 102 within the angle of view of the imaging unit 208 and the presence or absence of the operation terminal 102 in the line of sight of the user 103. The allocation means 704 allocates a function to the operation unit 212 depending on the determination result by the allocation determination means 703. In this embodiment, when the operation terminal 102 is within the angle of view of the imaging unit 208 and is located in the line of sight of the user 103, the allocation means 704 allocates the function to the operation unit 212 as the function allocation for image capture shown in FIG. 5(a). Also, when the operation terminal 102 is within the angle of view of the imaging unit 208 and is not located in the line of sight of the user 103, the allocation means 704 allocates the function to the operation unit 212 as the function allocation for angle movement shown in FIG. 5(c).

[0034] 8 is a flow chart showing the process executed by the information processing device 701. As shown in FIG.

[0035] In step S802, the user line-of-sight information acquiring means 702 acquires line-of-sight information (line-of-sight position) of the user 103.

[0036] In step S803, the allocation determination means 703 determines whether or not the operation terminal 102 is within the angle of view of the imaging unit 208, based on the position information of the operation terminal 102 acquired in step S801. If it is determined in step S802 that the operation terminal 102 is within the angle of view of the imaging unit 208, the process proceeds to step S804. On the other hand, if it is determined in step S802 that the operation terminal 102 is not within the angle of view of the imaging unit 208, the process ends.

[0037] In step S804, the allocation determination means 703 determines whether or not the operation terminal 102 is located in the line of sight (the end of the line of sight) of the user 103. This determination is made based on the position information of the operation terminal 102 acquired in step S801 and the line of sight information of the user 103 acquired in step S802. Then, if it is determined in step S804 that the operation terminal 102 is located in the line of sight of the user 103, the process proceeds to step S805. On the other hand, if it is determined in step S804 that the operation terminal 102 is not located in the line of sight of the user 103, the process proceeds to step S806.

[0038] In step S805, the allocation means 704 allocates functions to the operation unit 212 of the operation terminal 102 as the function allocation for photographing shown in FIG. 5(a).

[0039] In step S806, the allocation means 704 allocates functions to the operation unit 212 of the operation terminal 102 as the function allocation for angle movement shown in FIG. 5(c).

[0040] As described above, in this embodiment, the information processing device 101 can change the function on the operation unit 212 in accordance with the position information of the operation terminal 102 and the line of sight information of the user 103. This allows the function intended by the user 103 to be smoothly assigned to the operation terminal 102, thereby improving the usability of the operation terminal 102.

[0041] Although the preferred embodiments of the present invention have been described above, the present invention is not limited to the above-mentioned embodiments, and various modifications and changes are possible within the scope of the gist of the present invention. The present invention can also be realized by supplying a program that realizes one or more functions of the above-mentioned embodiments to a system or device via a network or storage medium, and having one or more processors of a computer in the system or device read and execute the program. The present invention can also be realized by a circuit (e.g., ASIC) that realizes one or more functions.

[0042] The information processing device 101 is not limited to a device in which the CPU 201 to the operation unit 210 are incorporated into one device, that is, to a device that is unitized. For example, the CPU 201 to the RAM 203 may be configured as one unit (server), and the sensor 204 to the operation unit 210 may be configured as one unit. The information processing device 101 may also have a switching means capable of switching the operation mode of the information processing device 101 in the image of the virtual space to a plurality of types. The operation mode is not particularly limited, and may be, for example, a mode suitable for moving in a dark environment. In addition, the display unit 209 can display the image of the virtual space as an image including guidance, assistance messages, etc. according to each operation mode. This improves the usability of the information processing device 101.

[0043] The disclosure of each embodiment includes the following configurations, methods, and programs. (Configuration 1) An information processing device that is communicably connected to an operation terminal having an input unit that performs an input operation on an image in a virtual space and exerts a predetermined function in response to the input operation, a position acquisition means for acquiring position information relating to a position of the operation terminal; a change means for changing a function of the input unit to be exercised by the input operation in accordance with the location information acquired by the location acquisition means. (Configuration 2) The position acquisition means acquires a distance between the operation terminal and the information processing device as the position information, 2. The information processing device according to configuration 1, wherein the change means is capable of changing a function of the input unit depending on the magnitude of the distance. (Configuration 3) A camera having a viewfinder shooting function and a live view shooting function is used as the operation terminal, The information processing device according to configuration 2, wherein the change means changes the function of the input unit to the viewfinder shooting function when the distance is equal to or less than a threshold, and changes the function of the input unit to the live view shooting function when the distance is not equal to or less than the threshold. (Configuration 4) An imaging means for imaging the operation terminal is provided, the position acquisition means acquires, as the position information, a position of the operation terminal within an angle of view of the imaging means; 2. The information processing device according to configuration 1, wherein the change means is capable of changing a function of the input unit depending on a position of the operation terminal within an angle of view of the imaging means. (Configuration 5) A camera having a viewfinder shooting function and a live view shooting function is used as the operation terminal, The information processing device according to configuration 4, wherein the change means changes the function of the input unit to the viewfinder shooting function or the live view shooting function when the position of the operation terminal is within the angle of view of the imaging means, and changes the function of the input unit to movement within the virtual space when the position of the operation terminal is not within the angle of view of the imaging means. (Configuration 6) A line-of-sight acquiring unit for acquiring line-of-sight information regarding a line of sight of a user operating the operation terminal, The information processing device according to configuration 1, wherein the change means is capable of changing a function of the input unit in accordance with the position information and the line-of-sight information acquired by the line-of-sight acquisition means. (Configuration 7) A camera having a viewfinder shooting function and a live view shooting function is used as the operation terminal, The information processing device according to configuration 6, wherein the change means changes the function of the input unit to the viewfinder shooting function when the line of sight information indicates that the operation terminal is located in front of the user's line of sight, and changes the function of the input unit to movement within the virtual space when the line of sight information indicates that the operation terminal is not located in front of the user's line of sight. (Configuration 8) The information processing device according to any one of configurations 1 to 7, further comprising a display means for displaying an image of the virtual space. (Configuration 9) A switching means is provided for switching an operation mode of the information processing device within the image of the virtual space to a plurality of modes, 9. The information processing device according to configuration 8, wherein the display means displays an image of the virtual space according to each of the operation modes. (Configuration 10) An imaging means for imaging the operation terminal is provided, 10. The information processing device according to configuration 8 or 9, wherein the display means is capable of displaying a virtual object of the operation terminal imaged by the imaging means on an image of the virtual space. (Configuration 11) The information processing device according to any one of configurations 8 to 10, wherein the display means is capable of displaying the function of the input unit changed by the change means on an image of the virtual space. (Configuration 12) The information processing device according to any one of configurations 8 to 11, characterized in that it is a head-mounted display. (Configuration 13) The information processing device according to any one of configurations 1 to 12, wherein one of a camera, a smartphone, and a mobile controller is used as the operation terminal. (Configuration 14) The information processing device described in any one of configurations 1 to 13, characterized in that the operation terminal has a plurality of the input units, and at least one of the plurality of input units is composed of a mechanical button, a mechanical dial, a touch panel, or a touch pad. (Method 1) A method for controlling an information processing device communicably connected to an operation terminal having an input unit that performs an input operation on an image in a virtual space and exerts a predetermined function in response to the input operation, comprising: a position acquisition step of acquiring position information relating to a position of the operation terminal; a changing step of changing a function of the input unit to be exercised by the input operation in accordance with the location information acquired in the location acquisition step. (Program 1) A program for causing a computer to execute each means of the information processing device according to any one of configurations 1 to 13. [Explanation of symbols]

[0044] 101 Information processing device 102 Operation terminal 208 Photographing unit (imaging means) 209 Display section (display means) 212 Operation section (input section) 301 Operation terminal location information acquisition means 302 Allocation determination means 303 Allocation Means 304 Display switching means

Claims

1. An information processing device communicably connected to an operation terminal having an input unit that performs an input operation on an image in a virtual space and exerts a predetermined function in response to the input operation, a position acquisition means for acquiring position information relating to a position of the operation terminal; a change means for changing a function of the input unit to be exercised by the input operation in accordance with the location information acquired by the location acquisition means.

2. the position acquisition means acquires, as the position information, a distance between the operation terminal and the information processing device; 2. The information processing apparatus according to claim 1, wherein the change means is capable of changing a function of the input unit in accordance with the magnitude of the distance.

3. A camera having a viewfinder photographing function and a live view photographing function is used as the operation terminal, 3. The information processing device according to claim 2, wherein the change means changes the function of the input unit to the viewfinder shooting function when the distance is equal to or less than a threshold value, and changes the function of the input unit to the live view shooting function when the distance is not equal to or less than the threshold value.

4. an imaging means for imaging the operation terminal; the position acquisition means acquires, as the position information, a position of the operation terminal within an angle of view of the imaging means; The information processing apparatus according to claim 1 , wherein the change means is capable of changing the function of the input section in accordance with a position of the operation terminal within an angle of view of the imaging means.

5. A camera having a viewfinder photographing function and a live view photographing function is used as the operation terminal, The information processing device according to claim 4, characterized in that, when the position of the operation terminal is within the angle of view of the imaging means, the change means changes the function of the input unit to the viewfinder shooting function or the live view shooting function, and when the position of the operation terminal is not within the angle of view of the imaging means, the change means changes the function of the input unit to movement within the virtual space.

6. a line-of-sight acquiring means for acquiring line-of-sight information relating to a line of sight of a user operating the operation terminal, 2 . The information processing apparatus according to claim 1 , wherein the change means is capable of changing a function of the input unit in accordance with the position information and the line-of-sight information acquired by the line-of-sight acquisition means.

7. A camera having a viewfinder photographing function and a live view photographing function is used as the operation terminal, The information processing device according to claim 6, characterized in that the change means changes the function of the input unit to the viewfinder shooting function when the line of sight information indicates that the operation terminal is located in front of the user's line of sight, and changes the function of the input unit to movement within the virtual space when the line of sight information indicates that the operation terminal is not located in front of the user's line of sight.

8. 2. The information processing apparatus according to claim 1, further comprising display means for displaying an image of the virtual space.

9. a switching means for switching an operation mode of the information processing device within the image of the virtual space between a plurality of modes; 9. The information processing apparatus according to claim 8, wherein said display means displays an image of said virtual space according to each of said operation modes.

10. an imaging means for imaging the operation terminal; 9. The information processing apparatus according to claim 8, wherein the display means is capable of displaying a virtual object of the operation terminal imaged by the imaging means on the image of the virtual space.

11. 9. The information processing apparatus according to claim 8, wherein the display means is capable of displaying the function of the input unit changed by the change means on the image of the virtual space.

12. 9. The information processing device according to claim 8, which is a head-mounted display.

13. 2. The information processing apparatus according to claim 1, wherein the operation terminal is one of a camera, a smartphone, and a mobile controller.

14. 2 . The information processing apparatus according to claim 1 , wherein the operation terminal has a plurality of the input units, at least one of the plurality of input units being configured with a mechanical button, a mechanical dial, a touch panel, or a touch pad.

15. A method for controlling an information processing device communicably connected to an operation terminal having an input unit that performs an input operation on an image in a virtual space and exerts a predetermined function in response to the input operation, comprising: a position acquisition step of acquiring position information relating to a position of the operation terminal; a changing step of changing a function of the input unit to be exercised by the input operation in accordance with the location information acquired in the location acquisition step.

16. 2. A program for causing a computer to execute each of the means of the information processing apparatus according to claim 1.

Images