Imaging apparatus, control method, program product, storage medium, image generation unit, and system

Abstract

The present application relates to an image pickup apparatus, a control method, a program product, a storage medium, an image generation unit, and a system. An image pickup apparatus including an image pickup unit configured to perform image pickup of a subject includes a reception unit configured to receive an operation related to image pickup in a virtual space, and a transmission unit configured to transmit information related to the operation of image pickup in the virtual space using the image pickup apparatus to a processing processor configured to generate an image of the virtual space and output an image captured in the virtual space to a display.

Description

Technical Field

[0001] This disclosure relates to camera equipment, control methods, program products, storage media, image generation units, and systems. Background Technology

[0002] Avatars (icons representing users) are known to be used in virtual space communication systems such as the metaverse. These avatars are presented in virtual space using three-dimensional (3D) graphics. Users can then participate in various activities in virtual space through their avatars, such as communicating with other avatars (other users). For such virtual space communication systems, various technologies have been developed to enable interactions that connect with the real world, allowing users to realistically perceive the experiences gained through avatar actions as their own.

[0003] Specific examples include shopping in virtual space and receiving actual products, and being able to acquire images as a result of video recording using camera equipment. Regarding video recording using camera equipment, Japanese Patent Application Laid-Open No. 2013-243754 proposes a method for recording virtual space using a real camera as a technology for further linking virtual space with the real world. When a user holds a camera in the real world, video images of the virtual space are displayed, and the user can capture images within the virtual space.

[0004] When using real-world camera equipment in virtual space, there are unused functions in real space, such as moving the avatar or camera equipment significantly and switching from a subjective video image from the avatar's viewpoint to a top-down view that includes the avatar. Summary of the Invention

[0005] This disclosure has been made with the above-mentioned problems in mind, and relates to providing a camera device that enables users to easily and simply perform virtual space-specific operations when taking images in virtual space.

[0006] According to one aspect of this disclosure, a camera device includes: an image sensor for capturing images of a subject; a memory for storing instructions; and one or more processors configured, when executing the stored instructions, to receive instructions from a user regarding imaging in a virtual space, and to transmit the user-instructions regarding imaging in the virtual space using the camera device to an image generation unit configured to generate an image of the virtual space and output the image captured in the virtual space to a display.

[0007] The features of this disclosure will become apparent from the following description of embodiments with reference to the accompanying drawings. The following description of the embodiments is given by way of example. Attached Figure Description

[0008] Figure 1 The configuration of a system for image processing according to the first embodiment is illustrated.

[0009] Figure 2 The process of selecting the use of a real camera according to the first embodiment is illustrated.

[0010] Figure 3 An example of a virtual space according to the first embodiment is illustrated.

[0011] Figure 4 An example of the appearance of a digital camera according to the first embodiment is shown.

[0012] Figure 5 The process of moving the position of the virtual camera according to the first embodiment is illustrated.

[0013] Figure 6 An example of a perspective view prior to movement in virtual space using a camera, according to the first embodiment, is illustrated.

[0014] Figure 7 An example of the perspective after movement of a camera in virtual space according to the first embodiment is illustrated.

[0015] Figure 8 The process of moving the position of the virtual camera according to the second embodiment is illustrated.

[0016] Figure 9 An example is given of the process of selecting whether to link the tilt of the real camera and the virtual camera according to the second embodiment. Detailed Implementation

[0017] In the following description, embodiments will be described in detail with reference to the accompanying drawings.

[0018] <First Embodiment> Figure 1 A system configuration for image processing according to this embodiment is illustrated. The embodiments of this disclosure are mainly divided into four device configurations. The first device configuration is a camera device 100, which can be operated to capture images in the real world and in virtual space. The second device configuration is a computer graphics (CG) system unit 101, which generates virtual space video images through three-dimensional CG. The third device configuration is an operating device 102, which enables a user to issue operating commands in virtual space. The fourth device configuration is a virtual space display device 103, which enables a user to monitor within the virtual space.

[0019] These camera devices 100, CG system unit 101, operating device 102, and virtual space display device 103 are connected via a communication interface that enables high-speed processing to communicate video information in real time.

[0020] This embodiment will be described with reference to the following example, in which a camera identical to the camera device 100 (hereinafter referred to as a virtual camera) is displayed in a virtual space, and tilting the camera device 100 or moving its position causes the virtual camera to operate similarly. Objects different from the camera device 100 can be displayed in the virtual space as virtual cameras. Furthermore, the following embodiments will be described as examples of using a digital camera as a camera device with imaging capabilities. However, this is not a limitation; examples of camera devices include computer devices (personal computers, tablet computers, media players, and personal digital assistants (PDAs), etc.), cellular phones, smartphones, gaming devices, robots, and drones. These are merely examples, and this disclosure can also be implemented for other camera devices. Furthermore, the type of video image is not particularly limited in terms of analog or digital type, data signal type, and specifications and standards such as compression / decompression, recording device and recording medium, and recording time, and any type can be appropriately used according to the intended purpose. Furthermore, any type can also be appropriately used as the camera device body and imaging method, etc.

[0021] In real-world photography, camera device 100 can capture moving or still images.

[0022] On the other hand, when taking photos in virtual space, the user can capture moving or still images in virtual space by using the camera device 100 in an action that is as if taking images in real space while viewing video images of virtual space on the virtual space display device 103. Furthermore, when taking photos in virtual space, the necessary functions for taking photos in virtual space are available, thereby allowing the user to capture images using only the camera device 100 without using the operating device 102.

[0023] (Camera equipment configuration) Figure 1 The illustrated camera device 100 can capture images of the subject 104 in real-world photography according to instructions issued by the user. The camera device 100 includes a lens unit supporting focus and zoom control, an image sensor such as a complementary metal-oxide-semiconductor (CMOS) sensor, and a neutral density (ND) filter and aperture for adjusting exposure. Furthermore, the camera device 100 is a digital camera (hereinafter referred to as a real-world camera) equipped with known control systems, such as shutter speed and gain for adjusting the brightness of video images, and white balance (WB) for adjusting hue.

[0024] On the other hand, in the virtual space, control data such as the position, tilt, and settings of the camera device 100 are transmitted to the CG system unit 101, which will be described below. At this time, the real camera does not perform lens control, photography, image processing, or recording.

[0025] Figure 4 An example of what a digital camera looks like is given. It is assumed that the digital camera held by the user in real space is the same as the virtual camera held by the avatar.

[0026] (Configuration of CG system units) Next, we will describe Figure 1 The CG system unit 101 is enclosed by dotted lines. The CG system unit 101 includes a 3D CG program and a computer equipped with a processor for executing the 3D CG program. The CG system unit 101 has the function of creating CG video images in real time using the 3D CG program. The virtual space camera unit 105 and the virtual space video image generation unit 106, which are disposed in the CG system unit 101, are functional blocks whose functions are implemented by the computer.

[0027] The virtual space camera unit 105 acquires control data such as the position, tilt, and settings of the real camera. Viewpoint-related information from the acquired data (such as information about the position, zoom, and orientation of the real camera) is transmitted to the virtual space video image generation unit 106.

[0028] The virtual space video image generation unit 106 pre-stores information (hereinafter referred to as virtual space information) related to the position, orientation, color, and brightness of virtual mountains, virtual buildings, virtual roads, cameras, and avatars. Furthermore, the virtual space video image generation unit 106 displays a screen that sets the virtual space information. The virtual space information is directly changed based on control data from the camera device 100 or the operating device 102, which will be described below. Alternatively, the virtual space information can be changed by operating the camera device 100 or the operating device 102 to change the set screen. Then, the virtual space video image generation unit 106 processes a video image from a specific perspective at a specific viewpoint into data that can be displayed on the virtual space display device 103, which will be described below, based on the virtual space information, and transmits the video image.

[0029] In addition, the virtual space video image generation unit 106 also generates image data captured by the virtual camera. The virtual space video image generation unit 106 updates the virtual space information of the virtual camera based on viewpoint-related information already acquired from the virtual space camera unit 105. Based on the updated virtual space information, the virtual space video image generation unit 106 generates unprocessed image data of a virtual subject located in the direction the virtual camera is facing, as seen from the position of the virtual camera in three-dimensional virtual space, corresponding to the viewpoint related to information such as zoom position. The unprocessed image data is transmitted from the virtual space video image generation unit 106 to the virtual space camera unit 105, which will be described below. The virtual space camera unit 105 generates processed image data by performing image processing on the acquired unprocessed image data based on image quality-related information such as brightness and white balance from the control data acquired from the camera device 100. The processed image data is transmitted to the virtual space video image generation unit 106. The processed image data is combined with the virtual space according to the virtual space information. For example, the processed image data is combined as information displayed on the display unit (e.g., liquid crystal display) of the virtual camera. The combined image data is displayed along with other nearby virtual subjects, as long as the virtual subjects are within the display range on the virtual space display device 103. When an instruction to record a still image has been received via the camera device 100 or the operating device 102, the unprocessed or processed image data is stored in the storage device of the computer according to the settings. When an instruction to start video recording is received, image data begins to be stored in the storage device.

[0030] (Configuration of operating equipment) The operating device 102 is a remote controller or keyboard, etc., for users to experience the virtual space, and is used for, for example, changing the position or view of an avatar in the virtual space, performing operations for communicating with other avatars, and changing the settings of the virtual space. This is known technology, and therefore its detailed description will be omitted.

[0031] (Configuration of virtual space display devices) The virtual space display device 103 is a display used to display three-dimensional video images, such as a head-mounted display (hereinafter referred to as HMD). Wearing the HMD on the head allows the user to view virtual space video images generated by the CG system unit 101. The configuration of the virtual space display device 103 is known technology, and its detailed description will therefore be omitted. Displaying left and right images with parallax generated by the virtual space video image generation unit 106 on the virtual space display device 103 allows the user to view three-dimensional video images. While examining the video images in the virtual space displayed on the virtual space display device 103, the user can perform operations such as moving the avatar and virtual camera, and changing the viewing angle and brightness using the camera device 100.

[0032] (Change the position of the virtual camera in the virtual space) Next, an example of changing the position of a virtual camera in virtual space by using a digital camera as the imaging device 100 will be described.

[0033] first, Figure 2 The process of selecting and using a real camera is illustrated.

[0034] exist Figure 2 In the process, firstly, in step S201, the user selects whether to use the digital camera in virtual space. For example, the option to use the digital camera in virtual space is added to the digital camera's menu, and the use in virtual space is selected in the digital camera's control system by receiving a command from the user. More specifically, "Use in virtual space" is displayed on the digital camera's menu. When the user selects this option, a screen for selecting "valid" or "invalid" is output on the digital camera's display unit. If the user selects valid ("Yes" in step S201), the process proceeds to step S202. In step S202, the function for virtual space on the digital camera is enabled. If the user selects invalid ("No" in step S201), the process proceeds to step S203. In step S203, the function for virtual space is disabled. When the function is enabled, a function that is not needed for a regular digital camera but is available when using the virtual camera to photograph virtual space is enabled. When the use in the virtual space of the digital camera's control system is "valid", the camera device 100 and the CG system unit 101 communicate instruction information obtained via the digital camera's user input interface (e.g., operating element), thereby enabling the user to operate the digital camera in the virtual space.

[0035] This function can automatically change to "enabled" or "disabled" without user selection. For example, when a user is wearing the HMD and experiencing virtual space, the function for virtual space can become enabled if the digital camera is powered on. Alternatively, when the digital camera is powered on, the function for virtual space can become enabled if the user wears the HMD and begins experiencing virtual space.

[0036] Next, the functionality for virtual space will be described. In real space, when changing the position of a camera, a person moves while holding the camera; however, in virtual space, the position of a virtual camera can also be moved through operation. Typically, an operating device 102, such as a remote controller, is used to move the position of the virtual camera. However, switching to a remote controller while holding a digital camera is inconvenient, and therefore this embodiment enables the movement of the virtual camera's position through operation of the digital camera.

[0037] Figure 3 An example of a virtual space is illustrated. The user is represented by avatar 301. Suppose the avatar holds a virtual camera and is taking pictures of the virtual space. Suppose the user wants to move from the position of avatar 301 to the position of avatar 302 to change the composition of the camera shot.

[0038] In view of this, through such Figure 5 The illustrated process of moving the virtual camera's position achieves the movement of the location.

[0039] When the virtual space function of the camera device 100 is active, this allows the user to move the position of the virtual camera using the joystick 401 and dial 402. If the joystick 401 is tilted up or down ("Yes" in step S501), the process proceeds to step S505. In step S505, the avatar and virtual camera move forward or backward. If the joystick 401 is tilted left or right ("Yes" in step S502), the process proceeds to step S506. In step S506, the avatar and virtual camera move left or right. By using these operations to change the composition, the user can move the avatar and virtual camera from the position of avatar 301 to the position of avatar 302. The dial 402 is used when the user wants to move the position of the virtual camera up or down, but this... Figure 3 The example shown is unnecessary. If dial 402 is rotated clockwise ("Yes" in step S503), the process proceeds to step S507. In step S507, the avatar and virtual camera move downwards. If dial 402 is rotated counterclockwise ("Yes" in step S504), the process proceeds to step S508. In step S508, the avatar and virtual camera move upwards.

[0040] Figure 6 An example is shown of the perspective before the movement of the camera in virtual space. Figure 7 This example illustrates the perspective after the camera moves in a virtual space. Reflections of other avatars distinct from the main subject have been eliminated.

[0041] This embodiment has been described with reference to the example of using joystick 401 and dial 402; however, there is a possibility of using joystick 401 and dial 402 to operate the functions of a digital camera also used in virtual space. Alternatively, joystick 401 and dial 402 can be used in specific situations (such as when a face is detected or a menu is opened) even if they are not used in the initial setup. In such cases, one of the functions of moving up, down, left, right, forward, and backward can be directly assigned to the assignable button 403. Alternatively, the assignable button 403 can be assigned a function that allows movement in virtual space to be controlled by operating joystick 401 or dial 402 while the assignable button 403 is pressed, thereby enabling movement control without affecting other functions.

[0042] After the avatar and camera have been moved to the desired positions as described above, similar to taking photos in real space, operate the real camera to determine the zoom and angle of view and adjust image quality such as brightness and white balance. Thereafter, images or video images in virtual space can be recorded by pressing the shutter button to take a still image or by pressing the record (REC) button to record a moving image.

[0043] This embodiment has already been described using the example of avatar and camera movement as functions effective for virtual space. In addition, for example, as a function effective for virtual space, video images can be displayed from, for example... Figure 3 The illustrated panoramic video image switches to Figure 6 or Figure 7 The illustrated video image is taken by a virtual camera (a video image from the avatar's viewpoint). Alternatively, functions such as displaying and selecting menus for the virtual space or displaying and moving a pointer (indicator) can be enabled.

[0044] Using a real camera to take pictures, as described above, allows users to capture moving and still images even in virtual space using operations similar to those in the real world. Furthermore, virtual-space-specific operations that are useful when using a camera (such as moving an avatar or camera in virtual space or changing the viewpoint) can be performed using a real camera without the need for a remote controller for virtual space.

[0045] <Second Embodiment> The first embodiment has described an example of moving the avatar and virtual camera positions using a joystick 401 and a dial 402. However, operation of control components such as buttons may be inconvenient for the user. Therefore, the second embodiment will describe an example of moving the avatar and virtual camera positions using camera tilt. In this case, the camera device 100 and the CG system unit 101 communicate tilt information of the digital camera similarly to the first embodiment, thereby enabling the user to operate the digital camera in virtual space. In other words, an orientation detection sensor mounted on the real camera is used as the user input interface. If the user's intentional tilting of the device is determined as "input," the user input interface receives a user instruction related to the camera in virtual space and generates an input signal corresponding to that instruction. An example similar to the first embodiment is used as... Figures 1 to 7 Examples of system configurations, processes, the appearance of digital cameras, and virtual spaces are illustrated, and therefore detailed descriptions will be omitted.

[0046] (Change the position of the virtual camera in the virtual space) Figure 8The process of moving a virtual camera according to this embodiment is illustrated. As in the first embodiment, the function of the digital camera for virtual space is enabled, allowing the user to move the avatar and virtual camera positions based on the tilt of the real camera. When the real camera is tilted forward or backward ("Yes" in step S801), tilt information from the gyroscope mounted on the real camera is transmitted to the virtual space camera unit 105. The virtual space camera unit 105 calculates the movement speed based on the tilt angle. The calculated movement speed is transmitted to the virtual space video image generation unit 106. In step S803, the virtual space video image generation unit 106 changes and displays the positions of the avatar and virtual camera in the forward or backward direction based on the received movement speed. When the real camera is tilted left or right ("Yes" in step S802), similar information is transmitted, and the process proceeds to step S804. In step S804, the virtual space video image generation unit 106 changes and displays the positions of the avatar and virtual camera in the left or right direction. When the joystick 401 of the real camera is tilted up or down ("Yes" in step S501), the process proceeds to step S805. In step S805, the positions of the avatar and the virtual camera are moved vertically. In the first embodiment, the vertical movement of the avatar and the virtual camera is achieved by operating the dial 402. However, in the second embodiment, vertical movement is achieved by tilting the joystick 401 up or down, since up and down are not used for forward and backward movement. However, the operation that triggers vertical movement is not limited to this. For example, the positions of the avatar and the virtual camera can be changed using the dial 402 as in the first embodiment, or the positions of the avatar and the virtual camera can be moved by pressing the assignable button 403.

[0047] When a user wants to prevent the images or videos captured in virtual space from tilting when tilting the real camera, this can be addressed by adding a function that allows the user to choose whether to link the tilt of the virtual camera with the tilt of the real camera. Figure 9 The process of choosing whether to link the tilt of the real camera and the tilt of the virtual camera is illustrated.

[0048] A video image tilt fix button is assigned to an assignable button 403, etc., and is used to enable the user to notify the camera of the intention to move the virtual camera by tilting the real camera. When the video image tilt fix button is pressed ("Yes" in step S901), the process proceeds to step S902. In step S902, the tilt of the video image is fixed. Then, in step S903, the process begins... Figure 8The illustrated camera position movement. When the user stops pressing the camera movement button (No in step S901), the process proceeds to step S904. In step S904, the fixation of the video image tilt is released.

[0049] Typically, the tilt of the real camera, detected by a gyroscope or similar device, is transmitted from the real camera to the virtual space camera unit 105. The virtual space camera unit 105 calculates the angle information of the virtual camera based on the transmitted tilt information. This angle information can be calculated by directly setting the tilt of the real camera to an absolute tilt in the virtual space, or by adding the angle change to the relative tilt of the current tilt. The calculated angle information is transmitted from the virtual space camera unit 105 to the virtual space video image generation unit 106. The virtual space video image generation unit 106 then displays the virtual camera based on the angle information. Changes in the angle of the virtual camera are accompanied by changes in the video image captured by the virtual camera in the virtual space.

[0050] When the tilt of the video image is fixed in step S902, the virtual space video image generation unit 106 stops updating information related to pitch and roll. Therefore, even when the camera is tilted to move forward, backward, left, or right, the tilt of the virtual camera does not change, and the tilt of the video image no longer changes. The virtual space video image generation unit 106 can reflect the tilt only for the display of the virtual camera in virtual space and stop updating the camera tilt information when generating the video image to stop changes in the tilt of the video image alone.

[0051] When the tilt fixation of the video image is released in step S904, the virtual space video image generation unit 106 can release the fixation simply by restarting the update. When calculating the angle information of the virtual camera using an absolute method, the video image is switched from the angle at which the tilt is fixed to the angle at the instant the user stops pressing the button (step S901). When calculating the angle information of the virtual camera using a relative method, the angle of the video image is changed according to the change in tilt since the user stopped pressing the button (step S901).

[0052] In this way, the method of instruction in this embodiment allows the user to move the position of the avatar and the virtual camera by tilting the real camera, thereby helping to reduce the hassle of button operations, etc.

[0053] This disclosure has been described in detail based on typical embodiments thereof; however, this disclosure is not limited to these specific embodiments and also covers various embodiments within the scope of this disclosure without departing from its spirit. The above embodiments may be combined in part as needed.

[0054] According to the above embodiments, when taking images in a virtual space, users become able to easily and simply perform virtual space-specific operations.

[0055] Other embodiments The embodiments disclosed herein (one or more) can also be implemented by a computer that reads and executes computer-executable instructions (e.g., one or more programs) recorded on a storage medium (which may also be more fully referred to as a "non-transitory computer-readable storage medium") to perform the functions of one or more of the above embodiments and / or includes one or more circuits (e.g., application-specific integrated circuits (ASICs)) for performing the functions of one or more of the above embodiments, and by a method performed by a computer of the system or device by, for example, reading and executing computer-executable instructions from a storage medium to perform the functions of one or more of the above embodiments and / or controlling one or more circuits to perform the functions of one or more of the above embodiments. The computer may include one or more processors (e.g., a central processing unit (CPU), a microprocessor unit (MPU)) and may include a network of separate computers or separate processors for reading and executing the computer-executable instructions. The computer-executable instructions may be provided to the computer, for example, from a network or storage medium. The storage medium may include one or more of the following: a hard disk, random access memory (RAM), read-only memory (ROM), the storage unit of a distributed computing system, optical discs (such as CDs, DVDs, or Blu-ray Discs (BD)™), flash memory devices, and memory cards. Embodiments of the invention may also be implemented by providing software (including computer program products of computer programs) that performs the functions of the above embodiments to a system or device via a network or various storage media, wherein the computer (central processing unit (CPU), microprocessor unit (MPU) of the system or device) reads and executes the computer program.

[0056] While this disclosure has been described with reference to embodiments, it should be understood that this disclosure is not limited to the disclosed embodiments. The scope of the appended claims should be given the broadest interpretation to cover all such modifications and equivalent structures and functions.

Claims

1. A camera device, comprising a camera unit configured to capture images of a subject, the camera device comprising: A receiving unit configured to receive instructions from the user regarding images captured by a camera in virtual space; as well as A transmission unit is configured to transmit user instructions regarding the use of the camera device to capture images in the virtual space to an image generation unit, the image generation unit being configured to generate images of the virtual space and output the captured images to a display.

2. The camera device according to claim 1, wherein, User instructions regarding the camera in the virtual space include information about any one or more of the following operations: changing the position of the camera device in the virtual space, changing the position and extent of the virtual space, making selections in the menu display of the virtual space, and moving the pointer in the virtual space.

3. The camera device according to claim 1 or 2, wherein, User instructions regarding the camera in the virtual space include information relating to at least one or more of the operation of the camera device's operating components and the tilting of the camera device.

4. The camera device according to claim 3, wherein, When information related to the tilt of the camera device is used in operations within the virtual space, the tilt of the images captured in the virtual space remains unchanged.

5. A control method for a camera device, the camera device comprising a camera unit configured to capture images of a subject, the control method comprising: Receive instructions from the user regarding cameras in virtual space; as well as Instructions from the user regarding the use of the camera device to capture images in the virtual space are transmitted to the image generation unit, which is configured to generate images of the virtual space and output the images captured in the virtual space to a display.

6. A computer program product comprising a program that, when executed by a computer, causes the computer to perform the control method according to claim 5.

7. A non-transient computer-readable storage medium storing a program that, when executed by a computer, causes the computer to perform the control method according to claim 5.

8. An image generation unit, comprising: A generation unit, configured to generate an image of a virtual space; An output unit is configured to output images captured in the virtual space to a display. A receiving unit configured to receive instructions from a user regarding the use of the camera device in the virtual space from a camera device including a camera unit configured to capture images of a subject; as well as A control unit is configured to perform processing in the virtual space based on instructions received by the receiving unit.

9. The image generation unit according to claim 8, wherein, User instructions regarding the camera in the virtual space are information for any of the following operations: changing the position of the camera device in the virtual space, changing the position and range of the virtual space, making a selection in the menu display of the virtual space, and moving the pointer in the virtual space.

10. The image generation unit according to claim 8 or 9, wherein, The user's instructions regarding the camera in the virtual space are information relating to at least one of the operation of the camera device's operating components and the tilting of the camera device.

11. The image generation unit according to claim 10, wherein, When information related to the tilt of the camera device is used in operations within the virtual space, the tilt of the images captured in the virtual space remains unchanged.

12. A control method, comprising: Generate images of the virtual space; The images captured in the virtual space are output to the display. Receive instructions from the user regarding the use of the camera device in the virtual space, from a camera device including a camera unit configured to capture images of a subject; as well as Control of processing in the virtual space based on received instructions.

13. A computer program product comprising a program that, when executed by a computer, causes the computer to perform the control method according to claim 12.

14. A computer-readable storage medium storing a program that, when executed by a computer, causes the computer to perform the control method according to claim 12.

15. A system for image processing, comprising: Camera equipment; as well as An image generation unit is configured to acquire instructions from a user regarding image capture using the camera device in virtual space. The camera device includes: The camera unit is configured to capture images of the subject. A receiving unit configured to receive instructions from a user regarding images captured by cameras in the virtual space, and A transmission unit configured to transmit information relating to operations involving imaging in the virtual space using the camera device to the image generation unit, and The image generation unit includes: A generation unit is configured to generate an image of the virtual space. An output unit is configured to output images captured in the virtual space to a display. A receiving unit is configured to receive information transmitted from the transmission unit of the camera device, and A control unit is configured to perform processing in the virtual space based on information received by the receiving unit.

16. The system for image processing according to claim 15, wherein, User instructions regarding the camera in the virtual space are information for any one or more of the following operations: changing the position of the camera device in the virtual space, changing the position and extent of the virtual space, making selections in the menu display of the virtual space, and moving the pointer in the virtual space.

17. The system for image processing according to claim 15 or 16, wherein, The user's instructions regarding the camera in the virtual space are information relating to at least one of the operation of the camera device's operating components and the tilting of the camera device.

18. The system for image processing according to claim 17, wherein, When information related to the tilt of the camera device is used in operations within the virtual space, the tilt of the images captured in the virtual space remains unchanged.

Images