Electronic device

Abstract

The electronic device according to the present invention is characterized by comprising: an acquisition unit configured to acquire information specific to a virtual space; and a control unit configured to perform control to record information unique to the virtual space when the control to record the image of the virtual space is performed.

Description

Technical Field

[0001] The present invention relates to electronic devices, and more particularly, to a technology for managing a plurality of images including an image of a virtual space (or an augmented reality space). Background Art

[0002] Virtual reality (VR) is a technology that generates (simulates) an environment in which a user can interact with virtual objects. In this technology, a virtual space that is a three-dimensional (3D) space similar to a real space is provided to the user. In the virtual space, a pseudo-sensation is provided to the user through video, sound, and tactile feedback.

[0003] The user can view the virtual space by using a display device (eg, a head mounted display), and can interact with virtual objects arranged in the virtual space by using a motion sensor or a controller.

[0004] In a virtual space, a user can communicate with other users by using a virtual character called an avatar as his or her virtual self. In addition, a camera function capable of taking images of a virtual space has been proposed. By using this camera function, a user can take pictures in a virtual space in the same way as taking pictures in a real space. For example, a user can take pictures of an avatar of a friend or take pictures of a scene in a virtual space, and can leave the images obtained by taking pictures (images of a virtual space) as memories.

[0005] A technology called augmented reality (AR) is known. In this technology, a virtual object is displayed to be superimposed on a real space (an image of a real space). A three-dimensional (3D) space provided to a user in augmented reality is called an augmented reality space.

[0006] Patent Document 1 discloses a technology in which an image obtained by photographing a real space is displayed on a head-up display of a vehicle, and when the image is stored, position information in the real space is added to the image. Patent Document 2 discloses an example of a camera function in a virtual space.

[0007] [Citation list]

[0008] [Patent Document]

[0009] [Patent Document 1] US2017 / 0076415 A

[0010] [Patent Document 2] US10948993 Summary of the invention

[0011] Problem that the invention aims to solve

[0012] However, in the prior art, multiple images including images obtained by shooting in a virtual space (images of a virtual space) cannot be properly managed. For example, assume that multiple images include images obtained by shooting in a virtual space (images of a virtual space) and images obtained by shooting in a real space (images of a real space). In this case, if the authenticity of the image in the virtual space is high, the image in the virtual space and the image in the real space cannot be easily identified. Similarly, in the prior art, multiple images including images of an augmented reality space cannot be properly managed.

[0013] An object of the present invention is to provide an electronic device capable of appropriately managing a plurality of images including images in a virtual space (or an augmented reality space).

[0014] Solutions for solving problems

[0015] An electronic device according to the present invention includes: an acquisition unit configured to acquire information specific to a virtual space; and a control unit configured to perform control to record the information specific to the virtual space when performing control to record an image of the virtual space.

[0016] Effects of the Invention

[0017] According to the present invention, a plurality of images including images in a virtual space (or augmented reality space) can be appropriately managed. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] Figure 1 A and Figure 1 B is the appearance diagram of the electronic device. Figure 1 C is a block diagram of the electronic device, and Figure 1 The D is a picture of the appearance of VR goggles.

[0019] Figure 2 A and Figure 2 B is the appearance diagram of the controller.

[0020] Figure 3 This is a flowchart of OS mode processing.

[0021] Figure 4 It is a flow chart of virtual space application processing.

[0022] Figure 5 is a flowchart of the camera mode processing.

[0023] Figure 6 is a flowchart of playback mode processing.

[0024] Figure 7 is a schematic diagram showing an application selection screen.

[0025] Figure 8 A to Figure 8 F is a schematic diagram of a virtual space application screen.

[0026] Fig. 9 A and Fig. 9 B is a schematic diagram of a file display screen.

[0027] Fig.10 A to Fig.10 D is a schematic diagram of metadata in Exif format. DETAILED DESCRIPTION

[0028] Hereinafter, embodiments of the present invention are described with reference to the accompanying drawings. Figure 1 A is a front stereogram of the electronic device 100. The electronic device 100 is a display device such as a smart phone or a tablet terminal. The display 105 is a display unit that displays images and various types of information. The display 105 is configured integrally with the touch panel 106a, and a touch operation on the display surface of the display 105 can be detected. The electronic device 100 can perform VR display of VR images (VR content) on the display 105. The operating member 106b is a power button that receives an operation of turning the power of the electronic device 100 on and off. The operating member 106c and the operating member 106d are volume buttons for increasing or decreasing the volume of the sound output from the speaker 112b, the earphone connected to the sound output terminal 112a, or the external speaker. The operating member 106e is a home button for displaying the home screen on the display 105. The sound output terminal 112a is a headphone jack, and is a terminal for outputting an audio signal to the earphone or the external speaker. The speaker 112b is a built-in speaker that outputs sound.

[0029] Figure 1 B is a rear perspective view of the electronic device 100. The imaging unit 115 is a camera capable of imaging a real space.

[0030] Figure 1 1 is a block diagram showing the configuration of the electronic device 100. A CPU 101, a memory 102, a nonvolatile memory 103, an image processing unit 104, a display 105, an operation unit 106, a storage medium I / F 107, an external I / F 109, and a communication I / F 110 are connected to an internal bus 150. In addition, a sound output unit 112, a posture detection unit 113, a self-position / surrounding environment estimation unit 114, and a camera unit 115 are also connected to the internal bus 150. The units connected to the internal bus 150 can exchange data with each other via the internal bus 150.

[0031] The CPU 101 is a control unit that controls the entire electronic device 100, and includes at least one processor or circuit. The memory 102 is, for example, a RAM (volatile memory using a semiconductor element). For example, the CPU 101 controls each unit of the electronic device 100 using the memory 102 as a working memory according to a program stored in the nonvolatile memory 103. The nonvolatile memory 103 stores various information such as image data, audio data, other data, and various programs for operating the CPU 101. The nonvolatile memory 103 is, for example, a flash memory or a ROM.

[0032] Based on the control of the CPU 101, the image processing unit 104 performs various types of image processing on the image stored in the non-volatile memory 103 or the storage medium 108, the video signal obtained via the external I / F 109, or the image obtained via the communication I / F 110. Various types of image processing include A / D conversion processing, D / A conversion processing, image data encoding processing, image data compression processing, image data decoding processing, image data enlargement / reduction processing (resizing), image data noise reduction processing, and image data color conversion processing. In addition, various types of image processing also include panoramic expansion, mapping processing, and transformation of VR images as omnidirectional images or as wide-range images with wide-range video although not in all directions. The image processing unit 104 can be a dedicated circuit block for performing specific image processing. In addition, depending on the type of image processing, the image processing can be performed by the CPU 101 according to the program without using the image processing unit 104.

[0033] The display 105 displays an image and a GUI screen constituting a graphical user interface (GUI) based on the control of the CPU 101. The CPU 101 controls the various units of the electronic device 100 according to the program to generate a display control signal, generate a video signal to be displayed on the display 105, and output the video signal to the display 105. The display 105 displays a video based on the generated and output video signal. Note that the configuration of the electronic device 100 itself may be at most an interface for outputting a video signal to be displayed on the display 105, and the display 105 may be an external monitor (e.g., a television or a head-mounted display).

[0034] The operation unit 106 includes various input units for receiving user operations. For example, the operation unit 106 includes a character information input device (e.g., a keyboard), a pointing device (e.g., a mouse or a touch panel), a button, a dial, a joystick, a touch sensor, and a touch pad. In the present embodiment, the operation unit 106 includes a touch panel 106a, operation members 106b, 106c, 106d, and 106e, and a gesture detection unit 106f.

[0035] A storage medium 108 such as a memory card, a CD, or a DVD can be attached to the storage medium I / F 107 and can also be detached from the storage medium I / F 107. The storage medium I / F 107 reads data from the attached storage medium 108 under the control of the CPU 101 and writes data to the storage medium 108. The storage medium 108 is a storage unit that stores various data including an image to be displayed on the display 105. The external I / F 109 is an interface for connecting to an external device in a wired or wireless manner and performing input / output (data communication) of a video signal and an audio signal. The communication I / F 110 is an interface for communicating (wireless communication) with an external device or the Internet 111 to perform transmission and reception (data communication) of various data such as files and commands. The communication I / F 110 can also communicate (wireless communication) with the controller 116.

[0036] The sound output unit 112 outputs the sound of moving images or music data reproduced by the electronic device 100, operation sounds, ringtones, and various notification sounds. The sound output unit 112 includes a sound output terminal 112a and a speaker 112b to which headphones or an external speaker are connected, but the sound output unit 112 may output audio data to the external speaker through wireless communication.

[0037] The posture detection unit 113 detects the posture (tilt) of the electronic device 100 relative to the gravity direction or the posture of the electronic device 100 relative to each axis of the yaw direction, the pitch direction, and the roll direction, and notifies the posture information to the CPU 101. Based on the posture detected by the posture detection unit 113, it can be determined whether the electronic device 100 is held horizontally, held vertically, facing upward, facing downward, or in a tilted posture. In addition, it is possible to determine the presence or absence and size of the tilt of the electronic device 100 in a rotation direction such as the yaw direction, the pitch direction, and the roll direction, and whether the electronic device 100 has rotated in the rotation direction. One of an acceleration sensor, a gyro sensor, a geomagnetic sensor, a posture sensor, and an altitude sensor, or a combination of multiple sensors can be used as the posture detection unit 113.

[0038] The self-position / surrounding environment estimation unit 114 estimates the self-position and surrounding environment of the electronic device 100 or VR goggles 130 described below.

[0039] The self-position is the position of the electronic device 100 or the VR goggles 130 in a space within a predetermined range. For example, the self-position is represented by three parameters representing the position in a coordinate system defined by three axes of the X-axis, the Y-axis, and the Z-axis that are orthogonal to each other at a predetermined position in the space within the predetermined range, so that the predetermined position becomes the origin. The self-position can be represented by further using three parameters representing a posture (direction).

[0040] The surrounding environment includes an obstacle area. The obstacle area is an area of ​​objects that are obstacles to the user carrying the electronic device 100 or the user wearing the VR goggles 130 among the objects existing around the electronic device 100 or the VR goggles 130. For example, the obstacle area is represented by a plurality of sets of three parameters representing positions in a coordinate system defined by three axes of an X-axis, a Y-axis, and a Z-axis that are orthogonal to each other at a predetermined position in a space within a predetermined range, so that the predetermined position becomes the origin.

[0041] The imaging unit 115 is a camera capable of imaging the real space. The image obtained by imaging the real space can be used for various detection processes and is used by, for example, the gesture detection unit 106f and the self-position / surrounding environment estimation unit 114. In addition, the image obtained by imaging the real space can be displayed on the display 105.

[0042] As described above, the operation unit 106 includes the touch panel 106a. The touch panel 106a is an input device configured to overlap the display 105 in a planar manner and output coordinate information corresponding to a touched position. With the touch panel 106a, the CPU 101 can detect the following operations or states.

[0043] An operating body (for example, a finger or a pen) that has not been in contact with the touch panel 106a newly touches the touch panel 106a, that is, the start of touch (hereinafter referred to as touchdown).

[0044] A state in which the operating body is in contact with the touch panel 106a (hereinafter referred to as touch hold).

[0045] The operating body moves in contact with the touch panel 106a (hereinafter referred to as touch movement)

[0046] An operation in which the operating body in contact with the touch panel 106a is separated from the touch panel 106a, that is, the end of the touch (hereinafter referred to as touch-off).

[0047] A state where nothing is in contact with the touch panel 106a (hereinafter referred to as "not touched").

[0048] When a touch is detected, touch continuation is detected at the same time. After the touch, unless the touch stop is detected, the touch continuation is continuously detected. In addition, when the touch movement is detected, the touch continuation is detected at the same time. Even if the touch continuation is detected, the touch movement is not detected as long as the touch position does not move. After the touch stop of all operating bodies that have been in contact with the touch panel is detected, the untouched is established.

[0049] These operations and states and the position coordinates of the operating body in contact with the touch panel 106a are notified to the CPU 101 through the internal bus. Based on the notified information, the CPU 101 determines which operation (touch operation) is performed on the touch panel 106a. Regarding touch movement, the moving direction of the operating body moving on the touch panel 106a can be determined based on the change of the position coordinates for each vertical component and each horizontal component on the touch panel 106a. When a touch movement of a predetermined distance or greater is detected, it is determined that a sliding operation has been performed.

[0050] An operation in which the operating body quickly moves a certain distance while in contact with the touch panel 106a and separates is called a flick. In other words, a flick is an operation in which the operating body quickly slides on the touch panel 106a to flick the touch panel 106a. When a touch movement at a predetermined speed or higher and at a predetermined distance or more is detected and then a touch stop is detected, it can be determined that a flick has been performed (it can be determined that a flick has been performed after a sliding operation).

[0051] In addition, a touch operation in which multiple parts (for example, two parts) are touched at the same time and the touch positions are close to each other is called a pinch, and a touch operation in which the touch positions are far from each other is called a pinch. Pinch and pinch are collectively referred to as a pinch operation (or simply pinch). The method of the touch panel 106a can be any of various methods including resistance, capacitance, surface acoustic wave, infrared light, electromagnetic induction, image recognition, and optical sensor methods. There is a method of detecting touch based on contact with the touch panel and a method of detecting touch based on proximity of the operating body to the touch panel, but any method can be adopted.

[0052] As described above, the operation unit 106 includes the gesture detection unit 106f. The gesture detection unit 106f detects a user's gesture (e.g., a user's hand) from an image (an image obtained by photographing a real space) obtained by the imaging unit 115 based on the control of the CPU 101. The CPU 101 performs various types of processing (control) according to the detected gesture.

[0053] Figure 1D is an appearance diagram of a VR goggles (head-mounted adapter) 130 to which the electronic device 100 can be attached. The electronic device 100 can also be used as a head-mounted display by attaching to the VR goggles 130. The insertion port 131 is an insertion port into which the electronic device 100 is inserted. The entire electronic device 100 can be inserted into the VR goggles 130 with the display surface of the display 105 facing the headband 132 side (i.e., the user side) for fixing the VR goggles 130 to the user's head. The user can visually recognize the display 105 without holding the electronic device 100 with his / her hands while wearing the VR goggles 130 with the electronic device 100 attached on his / her head. In this case, when the user moves his / her head or the entire body, the posture of the electronic device 100 also changes. The posture detection unit 113 detects the change in the posture of the electronic device 100 at this time, and the CPU 101 performs processing of VR display (display in the display mode "VR view") based on the change in posture. In this case, detecting the posture of the electronic device 100 by the posture detection unit 113 is equivalent to detecting the posture of the user's head (the direction in which the user's line of sight is pointed). VR display (VR view) is a display method (display mode) for displaying a video in a field of view range corresponding to the posture of the display device in a VR image, which is capable of changing its display range.

[0054] Note that the electronic device 100 itself may be a head-mounted display that can be attached to the head even without VR goggles. The electronic device 100 may be capable of detecting the gaze or facial expression of the user, and the user may be able to operate the electronic device 100 with the gaze or facial expression.

[0055] Figure 2 A is an appearance diagram of the controller 116 as an example of controllers 240 and 250 that can communicate with the electronic device 100. The controller 240 is a grip-type controller operated by the user with the left hand. The user holds the holding portion 241 of the controller 240 with the left hand, and operates the operating member arranged on the operating surface 242 with the fingers of the left hand (for example, the thumb). The controller 240 notifies the electronic device 100 of the operation performed by the user. The controller 250 is a grip-type controller operated by the user with the right hand, and has the same configuration as the controller 240 (for example, the controller 240 is in a horizontally inverted form).

[0056] Can be used Figure 2 The controller 260 shown in B is used as the controller 116. The controller 260 is a ring controller that is operated by being worn on the user's finger. The controller 260 includes a ring portion 261 to be worn on the user's finger 263 and an operating member 262. The operating member 262 is, for example, a button, a rotary dial, or a light tracking board. The light tracking board is an operating member that can detect the contact or proximity of a finger.

[0057] In the following description, it is assumed that a user wears the VR goggles 130 to which the electronic device 100 is attached.

[0058] Figure 3 1 is a flowchart showing the OS mode processing of the electronic device 100. This processing is implemented by the CPU 101 loading the program stored in the non-volatile memory 103 into the memory 102 and executing the loaded program. When it is detected that the electronic device 100 is worn on the VR goggles 130, or when it is detected that a predetermined operation is performed, the CPU 101 executes Figure 3 OS mode processing.

[0059] In step S301 , the CPU 101 displays an application selection screen on the display 105 .

[0060] Figure 7 An application selection screen 701 is shown. The application selection screen 701 is displayed as being superimposed on the virtual space 700. A plurality of icons (icons 702 to 707) corresponding to a plurality of applications installed in the electronic device 100 are displayed on the application selection screen 701. When an operation of selecting an icon is performed, the CPU 101 starts the application corresponding to the selected icon. For example, when the icon 702 is selected, a virtual space application that provides a predetermined virtual space to the user is started, and when the icon 703 is selected, a photo application for reproducing an image stored in the electronic device 100 is started. Note that a plurality of virtual space applications may be installed in the electronic device 100.

[0061] Even in a state where the user wears the VR goggles 130 to which the electronic device 100 is attached, the user can use the controller 116 to select and move the GUI displayed on the display 105. For example, the user can select and move the GUI through the user's gesture, the direction of the line of sight, or the operation on the controller. Figure 7 The pointer 710 in the controller is moved to a selectable position. Then, the user can select an icon by bringing the pointer 710 close to (or superimposed on) a selectable icon and operating the operating member of the controller.

[0062] In step S302, the CPU 101 determines whether the icon 702 of the virtual space application is selected. If the CPU 101 determines that the icon 702 is selected, the process proceeds to step S303, and if not, the process proceeds to step S304.

[0063] In step S303, the CPU 101 performs virtual space application processing. Figure 4 Describes the details of virtual space application processing.

[0064] In step S304, the CPU 101 determines whether the photo application icon 703 is selected. If the CPU 101 determines that the icon 703 is selected, the process proceeds to step S305, and if not, the process proceeds to step S306.

[0065] In step S305, the CPU 101 performs playback mode processing (photo application processing). In the playback mode processing of step S305, all images stored in the storage medium 108 are set as candidates for playback targets (images to be reproduced). Figure 6 Describes the details of playback mode processing.

[0066] In step S306, the CPU 101 determines whether other operations have been performed. Other operations include, for example, an operation of pairing the electronic device 100 with an external device (e.g., a smartphone different from the electronic device 100) and an operation of enabling or disabling a function of automatically sending an image obtained by shooting (shot image) to a paired external device. If the CPU 101 determines that other operations have been performed, the process proceeds to step S307, and if not, the process proceeds to step S308.

[0067] In step S307 , the CPU 101 performs other processing (processing corresponding to the operation detected in step S306 ).

[0068] In step S308, the CPU 101 determines whether an operation to end the OS mode process has been performed. If it is determined that an end operation has been performed, the CPU 101 ends the process. Figure 3 OS mode processing, if not, the processing proceeds to step S302.

[0069] Figure 4 is a diagram showing the virtual space application processing of the electronic device 100 ( Figure 3 This process is realized by the CPU 101 loading the program stored in the nonvolatile memory 103 into the memory 102 and executing the loaded program.

[0070] In step S401, the CPU 101 performs a startup process of the virtual space application. For example, the CPU 101 expands the program of the virtual space application stored in the nonvolatile memory 103 in the memory 102 and executes the program. Then, the CPU 101 initializes control variables (e.g., flags) used in the virtual space application.

[0071] In step S402, the CPU 101 performs a login process on a server providing a service of a virtual space application based on the user's account information. Then, the CPU 101 loads user information (e.g., avatar information and attribute information) from the server. An avatar is a virtual character used by a user as his / her virtual self.

[0072] In step S403 , the CPU 101 displays the virtual space application screen on the display 105 .

[0073] Figure 8 A shows a virtual space application screen. A virtual space 800, a virtual person 801 and a virtual animal 802 are displayed on the Figure 8 The virtual space application screen of A. The virtual person 801 and the virtual animal 802 may be avatars of other users (virtual characters whose behaviors are controlled according to instructions from other users), or may be virtual characters whose behaviors are automatically controlled. Figure 8 The virtual space application screen in A is a first-person viewpoint screen that does not display the avatar of the user viewing the virtual space application screen. The virtual space application screen may be a third-person viewpoint screen that displays the avatar of the user viewing the virtual space application screen.

[0074] In step S404 , the CPU 101 displays a GUI for performing various operations on the virtual space application screen.

[0075] For example, CPU 101 displays Figure 8 A's CPU 803 is superimposed on the virtual space 800. GUI 803 includes a plurality of icons (icons 804 to 808) corresponding to a plurality of functions. Icon 804 corresponds to a chat function, and icon 805 corresponds to a motion function. Both the chat function and the motion function are functions for communicating with other users. Icon 806 corresponds to a camera function for shooting with a camera in a virtual space (virtual camera). Icon 807 is a switching button for switching the space to be displayed between a virtual space (virtual reality (VR) space) and an augmented reality (AR) space. Icon 807 is displayed so that the current space can be identified. Since in Figure 8 A of FIG. 8 shows a virtual space 800, so an item 807a indicating that the displayed space is a virtual space (virtual space display is being performed) is displayed. Then, an icon 808 is an end button for ending the virtual space application.

[0076] When the user selects (action) Figure 8 When icon 807 in A is displayed, CPU 101 changes the displayed virtual space application screen from Figure 8 The screen in A changes to Figure 8 The picture in D. Figure 8In D, not the virtual space 800 but the augmented reality space 850 is displayed as a background superimposed with the virtual person 801, the virtual animal 802, and the GUI 803. Therefore, in the icon 807, an item 807b indicating that the displayed space is the augmented reality space (augmented reality space display is performed) is displayed.

[0077] In step S405, CPU 101 determines whether icon 804, icon 805, or icon 807 is selected. If CPU 101 determines that icon 804, icon 805, or icon 807 is selected, the process proceeds to step S406, and if not, the process proceeds to step S407.

[0078] In step S406, the CPU 101 executes processing corresponding to the selected icon (icon 804, icon 805, or icon 807). For example, the CPU 101 performs processing for communicating with other users, or performs processing for switching the space to be displayed between the virtual space and the augmented reality space.

[0079] In step S407, the CPU 101 determines whether the camera function icon 806 is selected. If the CPU 101 determines that the icon 806 is selected, the process proceeds to step S408, and if not, the process proceeds to step S409.

[0080] In step S408, the CPU 101 executes camera mode processing. Figure 5 Describes the details of camera mode processing.

[0081] In step S409, the CPU 101 determines whether other operations have been performed. If the CPU 101 determines that other operations have been performed, the process proceeds to step S410, and if not, the process proceeds to step S411.

[0082] In step S410, the CPU 101 performs other processing (processing corresponding to the operation detected in step S409). For example, it is assumed that the user wearing the VR goggles 130 moves in the real space. Then, the CPU 101 changes the display range of the space (virtual space 800 or augmented reality space 850) displayed on the display 105 so that the position of the user in the virtual space changes according to the movement of the user in the real space.

[0083] In step S411, the CPU 101 determines whether an end operation (selection of icon 808) of the virtual space application process has been performed. If it is determined that an end operation has been performed, the CPU 101 ends the process. Figure 4 If no virtual application is processed, the process proceeds to step S405.

[0084] Figure 5 is a diagram showing the camera mode processing of the electronic device 100 ( Figure 4 This process is implemented by the CPU 101 loading the program stored in the nonvolatile memory 103 into the memory 102 and executing the loaded program.

[0085] In step S501, the CPU 101 performs camera mode initialization processing. For example, the CPU 101 reads various parameters set by the user when the camera mode was used last time.

[0086] In step S502 , the CPU 101 displays a virtual camera on the virtual space application screen.

[0087] In step S503 , the CPU 101 displays a virtual live view image on the display of the virtual camera.

[0088] In step S504 , the CPU 101 displays a GUI for operating the camera mode on the virtual space application screen.

[0089] Figure 8 B shows a virtual space application screen in camera mode. Figure 8 In the virtual space application screen of B, the virtual space is displayed. Figure 8 In FIG. 8B , a virtual camera 810 is displayed as being held by a virtual hand 811. A virtual camera name 812 and a virtual live view image 813 are superimposed and displayed on the virtual camera 810. Then, a plurality of GUIs corresponding to a plurality of functions of the camera mode are displayed around the virtual camera 810. Figure 8 In FIG. 8B , a shooting start button 814 , a camera mode end button 815 , a menu button 816 , and a playback mode start button 817 are displayed as a plurality of GUIs.

[0090] Figure 8 FIG. E shows a virtual space application screen in camera mode. Figure 8 In the virtual space application screen of E, the augmented reality space display is performed. Figure 8 In E, Figure 8 The virtual camera 810 and the virtual hand 811 are displayed as in FIG. Figure 8 In B, a virtual camera name 812, a virtual live view image 813, a shooting start button 814, a camera mode end button 815, a menu button 816, and a playback mode start button 817 are also displayed.

[0091] In step S505, the CPU 101 determines whether the menu button 816 has been operated. If the CPU 101 determines that the menu button 816 has been operated, the process proceeds to step S506, and if not, the process proceeds to step S507.

[0092] In step S506, the CPU 101 displays a menu screen on the display 105. The user can use the menu screen to make various settings related to the camera mode (virtual camera). For example, the user can use the menu screen to set the format of the captured image, the shooting parameters, and the format of the metadata to be added (associated) to the captured image. At least one of a still image, a moving image, a two-dimensional image, a three-dimensional image, a 360° image, and a VR180 image (VR180 standard image) is set as the format of the captured image. At least one of a shutter speed, an aperture, an ISO sensitivity, an exposure correction step value, a white balance, and a focus mode is set as a shooting parameter. Image processing such as background blur and skin beautification effects can be set as shooting parameters. The format of the metadata added to the captured image will be described later.

[0093] In step S507, the CPU 101 determines whether the shooting start button 814 has been operated. If the CPU 101 determines that the shooting start button 814 has been operated, the process proceeds to step S508, and if not, the process proceeds to step S513.

[0094] In step S508, the CPU 101 obtains a captured image (image to be recorded) of the virtual camera. For example, in the case of obtaining a two-dimensional image as the captured image, the CPU 101 obtains a captured image corresponding to the current virtual live view image. In the case of obtaining a 360° image as the captured image, the CPU 101 obtains a captured image representing a 360° view from the position of the virtual camera.

[0095] In step S509, the CPU 101 determines whether the current display is a virtual space display or an augmented reality space display. If the CPU 101 determines that the display is a virtual space display, the process proceeds to step S510, and if not (if the display is determined to be an augmented reality space display), the process proceeds to step S511.

[0096] In step S510 , the CPU 101 acquires information specific to the virtual space, and adds metadata including the information to the captured image acquired in step S508 .

[0097] In step S511 , the CPU 101 acquires information specific to the augmented reality space, and adds metadata including the information to the captured image acquired in step S508 .

[0098] Note that metadata may be generated so that at least one of the image of the virtual space and the image of the augmented reality space can be identified, and the format of the metadata is not particularly limited. In order to make the image of the virtual space recognizable, in step S510, information specific to the virtual space may be included in the metadata. In this case, even if the information specific to the augmented reality space is not acquired in step S511, the image of the virtual space and the image of the non-virtual space are recognizable. The non-virtual space is a space different from the virtual space, and is, for example, a real space or an augmented reality space. Similarly, in order to make the image of the augmented reality space recognizable, in step S511, information specific to the augmented reality space may be included in the metadata. In this case, even if the information specific to the virtual space is not acquired in step S510, the image of the augmented reality space and the image of the non-augmented reality space are recognizable. The non-augmented reality space is a space different from the augmented reality space, and is, for example, a real space or a virtual space.

[0099] Information specific to the virtual space includes, for example, a flag indicating the virtual space, position information in the virtual space, and time information in the virtual space. Information specific to the augmented reality space includes, for example, a flag indicating that the space is an augmented reality space. Although information specific to the augmented reality space can be used as position information in the augmented reality space, the position information in the augmented reality space is generally the same as the position information in the real space. Similarly, information specific to the augmented reality space can be used as time information in the augmented reality space, but the time information in the augmented reality space is generally the same as the time information in the real space.

[0100] The metadata may or may not be information (data) in the Exchangeable Image File Format (Exif). In the case of the Exif format, various parameters such as shutter speed, aperture, ISO sensitivity, and exposure correction step value at the time of shooting may be included in the metadata. In the case of obtaining a moving image as a captured image, one metadata may be added to the entire moving image, metadata may be added to each frame of the moving image, or metadata may be added to each scene of the moving image.

[0101] In step S512, the CPU 101 records (saves) the file of the captured image to which the metadata is added (image file) in the storage medium 108. The file of the captured image (captured image of the virtual camera) acquired in step S508 may be recorded in the same area as the files of other images (e.g., images of the real space acquired by the imaging unit 115), or may be recorded in a different area. The captured image acquired in step S508 may be recorded in an area specific to the virtual space application. The captured image acquired in step S508 may be directly stored in an external device or server.

[0102] In step S513, the CPU 101 determines whether the playback mode start button 817 has been operated. If the CPU 101 determines that the playback mode start button 817 has been operated, the process proceeds to step S514, and if not, the process proceeds to step S515.

[0103] In step S514, the CPU 101 performs playback mode processing. The playback mode processing in step S514 is different from the playback mode processing in step S305. For example, the playback mode processing in step S514 is processing specific to the virtual space application, and the playback mode processing in step S305 is processing of the photo application included in the OS. In the playback mode processing in step S514, among the images stored in the storage medium 108, the image recorded by the virtual space application (the captured image of the virtual camera) is set as a candidate for the playback target (the image to be played back). This will be referred to later. Figure 6 Describes the details of playback mode processing.

[0104] In step S515, the CPU 101 determines whether other operations have been performed. If the CPU 101 determines that other operations have been performed, the process proceeds to step S516, and if not, the process proceeds to step S517.

[0105] In step S516, the CPU 101 performs other processing (processing corresponding to the operation detected in step S515). For example, the CPU 101 changes the angle of view (subject range) of the virtual live view image according to the posture change of the VR goggles 130 or the operation on the controller 116.

[0106] In step S517, the CPU 101 determines whether an end operation of the camera mode processing (operation of the camera mode end button 815) has been performed. If it is determined that an end operation has been performed, the CPU 101 ends the process. Figure 5 If no, the process proceeds to step S505.

[0107] Figure 6 is a diagram showing the playback mode processing of the electronic device 100 ( Figure 3 Step S305 in or Figure 5 This process is implemented by the CPU 101 loading the program stored in the nonvolatile memory 103 into the memory 102 and executing the loaded program.

[0108] In step S601, the CPU 101 performs playback mode initialization processing. For example, the CPU 101 reads the index number of the image that the user has browsed when using the playback mode last time and various parameters related to browsing.

[0109] In step S602, the CPU 101 reads an image file stored (saved) in the storage medium 108. Figure 3 In the case of the playback mode processing in step S305, all image files stored in the storage medium 108 are read. Figure 5 In the case of the playback mode processing of step S514 , the image file recorded by the virtual space application is read out from the image files stored in the storage medium 108 .

[0110] In step S603 , the CPU 101 analyzes metadata of the image file read in step S602 .

[0111] In step S604, the CPU 101 displays the image file read in step S602 on the display 105. An image (video) of one image file may be displayed on the playback screen, or a list of a plurality of image files may be displayed on the file display screen. On the file display screen, a thumbnail obtained by compressing the image of the image file may be displayed as an icon indicating the image file.

[0112] In step S605 , the CPU 101 determines whether the image (image file) read in step S602 is an image of a virtual space or an image of a non-virtual space, and displays a GUI capable of distinguishing between images of a virtual space and images of a non-virtual space on the display 105 .

[0113] Figure 8 C shows the screen in playback mode. Figure 8 On the screen of C, GUI 820 (file display screen) in playback mode is displayed. A list of thumbnails 821 to 823 of the read images (image files) is displayed on GUI 820. Based on the analysis results of the metadata of each image, items 821a and 823a indicating images of the virtual space are superimposed and displayed on the thumbnails 821 and 823 of the images of the virtual space. Then, item 822a indicating an image of the non-virtual space is superimposed and displayed on the thumbnail 822 of the image of the non-virtual space. Figure 8 The screen of C is the virtual space application screen in the playback mode, that is, Figure 5 Therefore, the item indicating the image of the augmented reality space (the item describing "AR") is displayed as the item 822a indicating the image of the non-virtual space. However, in Figure 3In the case of playback mode processing of step S305, a thumbnail of an image of a real space may be displayed. Thus, for example, instead of an item describing "AR", an item describing "non-VR" may be displayed as an item indicating an image of a non-virtual space. An item indicating an image of a non-virtual space may not be displayed. In addition, since in Figure 8 The virtual space display is performed on the virtual application screen of C, so the GUI 820 is displayed as being superimposed on the virtual space 800.

[0114] The cursor 824 is superimposed and displayed on the thumbnail 821. In addition, detailed information (information display screen) of the image (image of the virtual space) corresponding to the thumbnail 821 on which the cursor 824 is superimposed is displayed on the right side of the thumbnails 821 to 823. Setting information 825 and shooting information 826 are displayed as detailed information. The setting information 825 includes information related to the camera settings at the time of shooting, and the shooting information 826 includes other information at the time of shooting. Since the image of the thumbnail 821 is an image of the virtual space, information related to the settings of the virtual camera at the time of shooting (for example, the format of the shot image and the shooting parameters) is displayed as the setting information 825. Then, the shooting information 826 includes the position information of the virtual camera (the person who shoots the image) in the virtual space at the time of shooting. The position information represents the position of the virtual camera (the person who shoots the image) in the virtual space by three parameters representing the position in the coordinate system defined by the three axes of the X-axis, the Y-axis and the Z-axis, wherein the X-axis, the Y-axis and the Z-axis are orthogonal to each other at a predetermined position in a space of a predetermined range, so that the predetermined position in the virtual space becomes the origin. In addition, the shooting information 826 includes the server name that the person who shot the image has logged in, the publishing IP address of the server, the virtual space name (world name), and the time information in the server (in the virtual space). The time information in the server can be substantially the same as the time information in the electronic device 100 (in the real space).

[0115] Note that an example has been described in which an image file of a virtual space is identifiably displayed on a file display screen by displaying information based on at least a portion of the information specific to the virtual space (e.g., item 822a and shooting information 826), but the present invention is not limited thereto. For example, control may be performed to display information based on at least a portion of the information specific to the virtual space on a playback screen of an image of the virtual space.

[0116] Figure 8 F shows the screen in playback mode (virtual application screen). Figure 8 The augmented reality space display is performed on the virtual application screen of F, so the GUI 820 (file display screen) is displayed as superimposed on the augmented reality space 850. Figure 8In F, the cursor 824 is displayed while being superimposed on the thumbnail 822. Therefore, detailed information (information display screen) of the image corresponding to the thumbnail 822 (the image of the augmented reality space) is displayed on the right side of the thumbnails 821 to 823. Setting information 825 and shooting information 827 are displayed as detailed information. In this embodiment, when recording an image of a virtual space, the CPU 101 records the position information and time information in the virtual space, and when recording an image of a non-virtual space, the position information and time information in the real space are recorded. Therefore, the shooting information 827 includes the position information of the virtual camera (the person who shoots the image) in the real space at the time of shooting. The position information represents the position of the virtual camera (the person who shoots the image) in the real space by latitude, longitude, and altitude. The position information in the real space may be the position information of the electronic device 100 or the VR goggles 130. In addition, the shooting information 827 includes the direction indicating the shooting direction and the time information in the electronic device 100 (in the real space).

[0117] In step S606, the CPU 101 determines whether an image feeding operation is performed. If the CPU 101 determines that an image feeding operation is performed, the process proceeds to step S607, and if not, the process proceeds to step S608.

[0118] In step S607 , the CPU 101 switches the image (one or more images) displayed on the display 105 to the image (one or more images) having the next index (image feed).

[0119] In step S608, the CPU 101 determines whether the image sharing and synchronization operation is performed. If the CPU 101 determines that the image sharing and synchronization operation is performed, the process proceeds to step S609, and if not, the process proceeds to step S610.

[0120] In step S609, the CPU 101 sends the image file to an external device or server. The external device is, for example, a smart phone paired with the electronic device 100. The external device may be a storage device (e.g., HDD) with a communication function. The server may be, for example, a server of a social network service (SNS). The server may be an online storage unit on the cloud.

[0121] In step S610, the CPU 101 determines whether other operations have been performed. If the CPU 101 determines that other operations have been performed, the process proceeds to step S611, and if not, the process proceeds to step S612.

[0122] In step S611, the CPU 101 performs other processing (processing corresponding to the operation detected in step S610). For example, the CPU 101 performs editing processing such as tone change and trimming on the image.

[0123] In step S612, the CPU 101 determines whether an operation to end the playback mode processing has been performed. If it is determined that an end operation has been performed, the CPU 101 ends the playback mode processing. Figure 6 If no shooting mode is selected, the process proceeds to step S606.

[0124] Note that although an example of displaying an image of a virtual space and an image of a non-virtual space that can be identified has been described, a display that can identify an image of an augmented reality space and an image of a non-augmented reality space may be performed. The three types of images, the image of a virtual space, the image of an augmented reality space, and the image of a real space, may be displayed in a recognizable manner.

[0125] Fig. 9 A shows a file display screen. Fig. 9 In A, an image (image file) is sent from the electronic device 100 to the smartphone 900 paired with the electronic device 100, and a file display screen is displayed on the display 901 of the smartphone 900. Fig. 9 On the file display screen of A, a plurality of thumbnails (thumbnails 902 to 907) respectively corresponding to a plurality of images including an image sent from the electronic device 100 are listed. Items 902a and 904a indicating an image of a virtual space are superimposed and displayed on thumbnails 902 and 904 of an image of a virtual space. Item 903a indicating an image of an augmented reality space is superimposed and displayed on thumbnail 903 of an image of an augmented reality space. Items 905a and 907a indicating an image of a real space are superimposed and displayed on thumbnails 905 and 907 of an image of a real space. According to this display, it is possible to identify three types of images, namely, images of a virtual space, images of an augmented reality space, and images of a real space.

[0126] In addition, the display can be performed so that the viewing angle of the image can be recognized. For example, the display can be performed so that an image with a normal viewing angle and a 360° image can be recognized. The display can be performed so that a two-dimensional image and a three-dimensional image can be recognized.

[0127] Fig. 9 B shows a file display screen. Fig. 9 In B, an image (image file) is sent from the electronic device 100 to the smart phone 900 paired with the electronic device 100, and a file display screen is displayed on the display 901 of the smart phone 900. Fig. 9A's file display screen, Fig. 9 The file display screen of B displays a list of multiple thumbnails (thumbnails 912 to 917) respectively corresponding to multiple images including the image sent from the electronic device 100. Items 912a and 914a indicating images of the virtual space are superimposed and displayed on the thumbnails 912 and 914 of the image of the virtual space. Item 913a indicating an image of the augmented reality space is superimposed and displayed on the thumbnail 913 of the image of the augmented reality space. Items 905a and 907a indicating an image of the real space are superimposed and displayed on the thumbnails 915 and 917 of the image of the real space. According to this display, it is possible to identify three types of images: images of the virtual space, images of the augmented reality space, and images of the real space.

[0128] In addition, items 912b, 913b, 915b, and 917b indicating two-dimensional images are displayed as being superimposed on thumbnails 912, 913, 915, and 917 of two-dimensional images having a normal viewing angle. Items 914b and 916b indicating 360° images are superimposed and displayed on thumbnails 914 and 916 of three-dimensional images of 360°. In addition, rotation display 914c and 916c of thumbnails 914 and 916 of 360° images are performed. According to this display, it is possible to identify an image of a normal viewing angle and a 360° image. It is possible to identify a two-dimensional image and a three-dimensional image.

[0129] Note that an item indicating a normal viewing angle may be displayed, or an item indicating a three-dimensional image may be displayed. Display may be performed so that a VR180 image can be recognized. For example, an item indicating a VR180 image may be superimposed and displayed on a thumbnail of a VR180 image. Rotational display of a thumbnail of a VR180 image may be performed.

[0130] Note that an example has been described in which position information in a virtual space is added to an image in a virtual space and position information in a real space is added to an image in a non-virtual space, but the present invention is not limited to this. For example, a user (a person who takes an image) can set in advance which of the position information in the real space and the position information in the virtual space is recorded (added). An administrator of a server or an administrator of a virtual space can make such settings jointly for multiple users. For example, position information in the real space can be added to an image of a virtual space that simulates a real space, and position information in the virtual space can be added to an image of a real space that simulates a virtual space. Position information in the virtual space can also be added to an image of a real space used to construct a virtual space (for example, an image of a real space used to arrange rooms in a real apartment as rooms in a virtual apartment). Both the position information in the virtual space and the position information in the real space can be added to an image. In this case, both the position information in the virtual space and the position information in the real space can be displayed on an information display screen (for example, Figure 8 The shooting information in C826 or Figure 8 Shooting information in F 827).

[0131] Not only can the position information in the virtual space be set, but also whether to record information unique to the virtual space can be set. For example, the CPU 101 sets whether to record information unique to the virtual space based on instructions from the person (user) who took the image, the administrator of the server, or the administrator of the virtual space.

[0132] Note that the position information in the virtual space may indicate the position of the virtual camera in the virtual space or the position of the person (avatar) who takes the image in the virtual space. The person who takes the image (user), the administrator of the server, or the administrator of the virtual space can set which of the position information of the virtual camera and the position information of the person who takes the image is added to the image. In addition, in the case where the space of the image is different from the space of the position information, information indicating that the space of the image is different from the space of the position information may be further added to the image. The case where the space of the image is different from the space of the position information is, for example, a case where the position information in the real space is added to the image in the virtual space or a case where the position information in the virtual space is added to the image in the real space.

[0133] Note that the virtual camera may be installed at a position away from the position of the person (avatar) taking the image. Then, in the case where the virtual camera is installed at a position away from the person taking the image, settings for adding the position information of the virtual camera to the image may be automatically made. For example, normally, the position information of the person taking the image is added to the image without adding the position information of the virtual camera. Then, when the virtual camera is installed at a position away from the person taking the image, the position information of the virtual camera is added to the image without adding the position information of the person taking the image. When the virtual camera is installed at a position away from the person taking the image, both the position information of the person taking the image and the position information of the virtual camera may be added to the image. Furthermore, in the case where a VR format such as a 360° image or a VR180 image is set as the format of the taken image, settings for adding the position information of the virtual camera to the image may be automatically made.

[0134] Note that the format of the position information in the virtual space is not particularly limited. The position information in the virtual space may include information of a polar coordinate system. For example, the position information in the virtual space may include the origin of the virtual space (three-dimensional space), the distance from the origin, the direction, the elevation angle, and the height. In the case of shooting on a virtual globe, the position information in the virtual space may include the latitude and longitude on the virtual globe. The position information in the virtual space may be information indicating an area in the virtual space. The position information in the virtual space may be information indicating a distance from a predetermined position. The position information in the virtual space may indicate a position or area in a two-dimensional space defined by an X-axis and a Y-axis.

[0135] In addition, in the case where there are multiple virtual space applications, the information specific to the virtual space may include information that enables identification of the virtual space (information that enables unique identification of which application the virtual space is in). For example, the information specific to the virtual space may include the IP address of the server that provides the virtual space. The number of servers that provide the virtual space may be one or more than one. The information specific to the virtual space may include a global IP address, or may include a public IP address. For example, among multiple public IP addresses assigned to multiple servers, the public IP address of the server to which the person who took the image has logged in may be added to the image of the virtual space. The information specific to the virtual space may include information on the directory configuration in the server. In the case where the virtual space is published on the Internet, the information specific to the virtual space may include a URL.

[0136] Note that the time information in the virtual space may indicate a time uniquely determined in the virtual space, or may indicate a time set for an area (world) in the virtual space. In addition, the time information in the virtual space may be information indicating a time interval (morning, daytime, or night) or information indicating a season. In addition, the time information in the virtual space may be information common to a plurality of virtual space applications.

[0137] Note that the location information in the virtual space can be stored in Exif format metadata in any manner. For example, Fig.10 As shown in A of FIG. 1 , the position information in the virtual space can be stored in the Maker Note. Fig.10 As shown in FIG. 1B , the metadata in the Exif format may include an area 1001 for storing position information in the real space. In this case, the position information in the virtual space may be stored in the area 1001. Fig.10 As shown in FIG. 10C, the metadata in the Exif format may include an area 1001 for storing position information in the real space and an area 1002 for storing position information in the virtual space. In this case, the position information in the virtual space may be stored in area 1002. Fig.10 As shown in D of FIG. 1 , position information in the real space may be stored in area 1001, and position information in the virtual space may be stored in area 1002. When two pieces of position information, position information in the real space and position information in the virtual space, are stored in metadata, information indicating which of the two pieces of position information is primary information (information used in playback mode processing (or processing by a playback device)) may be included in the metadata.

[0138] The time information in the virtual space can be stored in the Exif format metadata in any manner. Similar to the position information in the virtual space, the time information in the virtual space can be stored in the metadata.

[0139] Note that in the case of using a virtual camera that only exists in the virtual space, the virtual space-specific information may include the name of the virtual camera to be used. Similarly, when using a virtual camera that only exists in the augmented reality space, the augmented reality space-specific information may include the name of the virtual camera to be used.

[0140] The virtual space and the non-virtual space may be simultaneously photographed, and a composite image in which an image of the virtual space and an image of the non-virtual space are arranged may be recorded. For example, a composite image in which an image of the virtual space and an image of the non-virtual space are arranged in a picture-in-picture format may be recorded. A 360° image may be generated as a composite image by synthesizing an image of the virtual space and an image of the non-virtual space each having a 180° viewing angle.

[0141] Note that although an example of adding metadata to an image has been described, a metadata file may be generated separately from the image file in a format associated with the image and recorded. As a control for recording information specific to the virtual space, a process for determining the file name of the image of the virtual space according to a predetermined naming rule may be performed. For example, a character string "AppX_VR" indicating the virtual space of the virtual space application AppX, such as a file name "AppX_VR_001.JPEG", may be included in the file name. Similarly, as a control for recording information specific to the augmented reality space, a process for determining the file name of the image in the augmented reality space according to a predetermined naming rule may be performed. For example, a character string "AppX_AR_001.JPEG", such as a file name "AppX_AR_001.JPEG", may be included in the file name.

[0142] Note that when sending an image (image file) to an external device or server, the electronic device 100 (CPU 101) may not send (may delete) part or all of the metadata to protect privacy. For example, when sending an image of a virtual space to an external device or server, the electronic device 100 may not send information specific to the virtual space included in the metadata. When sending an image to a specific external device (for example, an external device paired with the electronic device 100), the electronic device 100 may send (not delete) metadata, and when sending the image to an external device other than the specific external device, the metadata may not be sent (deleted). Then, when the specific external device sends the image to the outside, the metadata may not be sent (deleted).

[0143] In addition, when the display of the virtual camera is shown to other users in the virtual space, information specific to the real space can be hidden from the partner user. At this time, for example, by selecting a menu to be disclosed to the partner user on the display of the virtual camera, the display of the virtual camera is operated to be shown to the other users. Alternatively, whether the state is displayed in the field of view of the partner user can be automatically calculated based on the position and sight direction of the partner user's avatar, the position of the virtual camera, and the direction of the display surface of the display, and if the state is visible to the partner user, the information specific to the real space can be automatically hidden.

[0144] In addition, when sharing an image with other users in a virtual space (when sending an image to other users), information specific to the real space may not be sent. For example, information specific to the real space may be deleted, and an image with only the information of the virtual space left may be generated and sent to other users.

[0145] In contrast, when an image is displayed in a real space or shared with other users, information specific to the virtual space may not be transmitted (information specific to the virtual space may be deleted). In addition, the real user may delete metadata in an optional timing and operation.

[0146] As described above, according to the present embodiment, when recording an image of a virtual space (or augmented reality space), information specific to the virtual space (or augmented reality space) is recorded. Then, based on the information specific to the virtual space (or augmented reality space), a display is performed that enables identification of the recorded image of the virtual space (or augmented reality space). This makes it possible to appropriately manage multiple images including images of the virtual space (or augmented reality space). Therefore, images can be easily searched, edited, and shared.

[0147] Note that the above-described various controls to be performed by the CPU 101 may be performed by one piece of hardware, or the processing may be shared among a plurality of pieces of hardware (eg, a plurality of processors or circuits) to control the entire apparatus.

[0148] In addition, the present invention is specifically described according to the preferred embodiments, but the present invention is not limited to these specific embodiments, and the present invention includes various aspects that do not depart from the scope of the present invention. The above-mentioned embodiments only illustrate embodiments of the present invention, and these embodiments can be combined as needed.

[0149] (Other embodiments)

[0150] The present invention can also be implemented by supplying a program for implementing one or more functions of the above-mentioned embodiments to a system or device via a network or storage medium and causing one or more processors in a computer of the system or device to read and execute the program. In addition, the present invention can also be implemented by a circuit (e.g., ASIC) for implementing one or more functions.

[0151] The disclosure of the present embodiment includes the following configurations, methods, programs, and media.

[0152] (Configuration 1)

[0153] An electronic device, comprising:

[0154] an acquisition unit configured to acquire information specific to the virtual space; and

[0155] A control unit is configured to perform control to record information specific to the virtual space when performing control to record the image of the virtual space.

[0156] (Configuration 2)

[0157] The electronic device according to configuration 1, wherein:

[0158] The information specific to the virtual space includes a flag indicating the virtual space.

[0159] (Configuration 3)

[0160] The electronic device according to configuration 1 or 2, wherein:

[0161] The virtual space-specific information includes position information in the virtual space.

[0162] (Configuration 4)

[0163] The electronic device according to any one of configurations 1 to 3, wherein:

[0164] The virtual space-specific information includes time information in the virtual space.

[0165] (Configuration 5)

[0166] The electronic device according to any one of configurations 1 to 4, wherein:

[0167] The control for recording the image of the virtual space is a control for photographing the virtual space using a virtual camera.

[0168] (Configuration 6)

[0169] The electronic device according to configuration 5, wherein:

[0170] The virtual space-specific information includes the name of the virtual camera.

[0171] (Configuration 7)

[0172] The electronic device according to any one of configurations 1 to 6, wherein:

[0173] The control for recording the information specific to the virtual space includes a process for determining a file name of an image of the virtual space according to a predetermined naming rule.

[0174] (Configuration 8)

[0175] The electronic device according to any one of configurations 1 to 7, wherein:

[0176] The control for recording the information specific to the virtual space includes control for recording the information in Exif format.

[0177] (Configuration 9)

[0178] The electronic device according to configuration 8, wherein:

[0179] The virtual space-specific information includes location information in the virtual space, and

[0180] The control unit stores the position information in the virtual space in a manufacturer note.

[0181] (Configuration 10)

[0182] The electronic device according to configuration 8, wherein:

[0183] The information in the Exif format includes an area for storing position information in real space, and

[0184] The virtual space-specific information includes location information in the virtual space, and

[0185] The control unit stores the position information in the virtual space in an area for storing the position information in the real space.

[0186] (Configuration 11)

[0187] The electronic device according to configuration 8, wherein:

[0188] The Exif format information includes a first area and a second area for storing location information, and

[0189] The virtual space-specific information includes location information in the virtual space, and

[0190] The control unit stores the position information in the virtual space in the second area.

[0191] (Configuration 12)

[0192] The electronic device according to configuration 11, wherein:

[0193] The control unit stores position information in the real space in the first area.

[0194] (Configuration 13)

[0195] An electronic device according to any one of configurations 8 to 12, wherein:

[0196] The virtual space-specific information includes time information in the virtual space, and

[0197] The control unit stores time information in the virtual space in a manufacturer note.

[0198] (Configuration 14)

[0199] An electronic device according to any one of configurations 8 to 12, wherein:

[0200] The information in the Exif format includes an area for storing time information in real space, and

[0201] The virtual space-specific information includes time information in the virtual space, and

[0202] The control unit stores the time information in the virtual space in the area for storing the time information in the real space.

[0203] (Configuration 15)

[0204] An electronic device according to any one of configurations 8 to 12, wherein:

[0205] The information in the Exif format includes a third area and a fourth area for storing time information, and

[0206] The virtual space-specific information includes time information in the virtual space, and

[0207] The control unit stores time information in the virtual space in the fourth area.

[0208] (Configuration 16)

[0209] The electronic device according to configuration 15, wherein:

[0210] The control unit stores time information in the real space in the third area.

[0211] (Configuration 17)

[0212] The electronic device according to any one of configurations 1 to 16, further comprising:

[0213] A setting unit is configured to set whether to record the information specific to the virtual space.

[0214] (Configuration 18)

[0215] The electronic device according to any one of configurations 1 to 17, wherein:

[0216] The control unit does not perform control to transmit information specific to the virtual space to the external device when performing control to transmit the image of the virtual space to the external device.

[0217] (Configuration 19)

[0218] The electronic device according to any one of configurations 1 to 17, wherein:

[0219] The control unit performs control for sending information specific to the virtual space to a specific external device when performing control for sending an image of the virtual space to the specific external device, and does not perform control for sending information specific to the virtual space to an external device that is not the specific external device when performing control for sending an image of the virtual space to the external device that is not the specific external device.

[0220] (Configuration 20)

[0221] The electronic device according to configuration 19, wherein:

[0222] The specific external device is an external device paired with the electronic device.

[0223] (Configuration 21)

[0224] The electronic device according to any one of configurations 1 to 20, wherein:

[0225] The virtual space-specific information includes information capable of identifying the virtual space.

[0226] (Configuration 22)

[0227] The electronic device according to any one of configurations 1 to 21, wherein:

[0228] The control unit performs control to display a file of an image of the virtual space on a file display screen in a recognizable manner based on information specific to the virtual space.

[0229] (Configuration 23)

[0230] The electronic device according to configuration 22, wherein:

[0231] The control unit controls to display the file of the image of the virtual space in a recognizable manner so that the viewing angle of the image of the virtual space can be recognized.

[0232] (Configuration 24)

[0233] The electronic device according to configuration 22, wherein:

[0234] The control unit controls to display the file of the image of the virtual space in a recognizable manner so that the image of the virtual space can be recognized as a two-dimensional image or a three-dimensional image.

[0235] (Configuration 25)

[0236] An electronic device according to any one of configurations 1 to 24, wherein:

[0237] The control unit performs control to display information based on at least a part of the information specific to the virtual space on the information display screen of the image of the virtual space.

[0238] (Configuration 26)

[0239] An electronic device according to any one of configurations 1 to 25, wherein:

[0240] The control unit performs control to display information based on at least a part of the information specific to the virtual space on a playback screen of an image of the virtual space.

[0241] (Configuration 27)

[0242] An electronic device according to any one of configurations 1 to 26, wherein:

[0243] The control unit performs control for recording position information in the virtual space when performing control for recording an image of the virtual space, and performs control for recording position information in the real space when performing control for recording an image of a space different from the virtual space.

[0244] (Configuration 28)

[0245] The electronic device according to configuration 27, wherein:

[0246] A space different from the virtual space is an augmented reality space.

[0247] (Configuration 29)

[0248] An electronic device, comprising:

[0249] an acquisition unit configured to acquire information specific to the augmented reality space; and

[0250] A control unit is configured to perform control to record information specific to the augmented reality space when performing control to record the image of the augmented reality space.

[0251] (Configuration 30)

[0252] An electronic device, comprising:

[0253] an acquisition unit configured to acquire information specific to a virtual space, the information being associated with a file of an image of the virtual space; and

[0254] A control unit is configured to perform control so that a file of an image of the virtual space is displayed on a file display screen in a recognizable manner based on information specific to the virtual space.

[0255] (Configuration 31)

[0256] An electronic device, comprising:

[0257] an acquisition unit configured to acquire information specific to an augmented reality space, wherein the information is associated with a file of an image of the augmented reality space; and

[0258] A control unit is configured to perform control so that a file of an image of the augmented reality space is displayed on a file display screen in a recognizable manner based on information specific to the augmented reality space.

[0259] (Method 1)

[0260] A control method for an electronic device, comprising:

[0261] Steps for obtaining information specific to the virtual space; and

[0262] A step for performing control for recording information specific to the virtual space when performing control for recording an image of the virtual space.

[0263] (Method 2)

[0264] A control method for an electronic device, comprising:

[0265] Steps for obtaining information specific to the augmented reality space; and

[0266] A step for performing control for recording information specific to the augmented reality space when performing control for recording an image of the augmented reality space.

[0267] (Method 3)

[0268] A control method for an electronic device, comprising:

[0269] A step for acquiring information specific to a virtual space, said information being associated with a file of an image of said virtual space; and

[0270] A step of performing control so as to display a file of an image of the virtual space on a file display screen in a recognizable manner based on information specific to the virtual space.

[0271] (Method 4)

[0272] A control method for an electronic device, comprising:

[0273] A step for obtaining information specific to an augmented reality space, said information being associated with a file of an image of said augmented reality space; and

[0274] A step for controlling to display a file of the image of the augmented reality space on a file display screen in a recognizable manner based on the information specific to the augmented reality space.

[0275] (program)

[0276] A program that causes a computer to function as each unit of the electronic device according to any one of configurations 1 to 31.

[0277] (medium)

[0278] A computer-readable medium storing a program for causing a computer to function as each unit of the electronic device according to any one of configurations 1 to 31.

[0279] The present invention is not limited to the above-described embodiments, and various variations and modifications may be implemented thereto without departing from the spirit and scope of the present invention. Therefore, the appended claims are attached to disclose the scope of the present invention.

[0280] This application claims priority based on Japanese Patent Application No. 2022-145046 filed on September 13, 2022, the disclosure of which is hereby incorporated by reference in its entirety.

[0281] [reference numerals list]

[0282] 100 Electronic devices

[0283] 101 CPU

Claims

1. An electronic device, comprising: an acquisition unit configured to acquire information specific to the virtual space; as well as A control unit is configured to perform control to record information specific to the virtual space when performing control to record the image of the virtual space.

2. The electronic device according to claim 1, wherein: The information specific to the virtual space includes a flag indicating the virtual space.

3. The electronic device according to claim 1, wherein: The virtual space-specific information includes position information in the virtual space.

4. The electronic device according to claim 1, wherein: The virtual space-specific information includes time information in the virtual space.

5. The electronic device according to claim 1, wherein: The control for recording the image of the virtual space is a control for photographing the virtual space using a virtual camera.

6. The electronic device according to claim 5, wherein: The virtual space-specific information includes the name of the virtual camera.

7. The electronic device according to claim 1, wherein: The control for recording the information specific to the virtual space includes a process for determining a file name of an image of the virtual space according to a predetermined naming rule.

8. The electronic device according to claim 1, wherein: The control for recording the information specific to the virtual space includes control for recording the information in Exif format.

9. The electronic device according to claim 8, wherein: The virtual space-specific information includes location information in the virtual space, and The control unit stores the position information in the virtual space in a manufacturer note.

10. The electronic device according to claim 8, wherein: The information in the Exif format includes an area for storing position information in real space, and The virtual space-specific information includes location information in the virtual space, and The control unit stores the position information in the virtual space in an area for storing the position information in the real space.

11. The electronic device according to claim 8, wherein: The Exif format information includes a first area and a second area for storing location information, and The virtual space-specific information includes location information in the virtual space, and The control unit stores the position information in the virtual space in the second area.

12. The electronic device according to claim 11, wherein: The control unit stores position information in the real space in the first area.

13. The electronic device according to claim 8, wherein: The virtual space-specific information includes time information in the virtual space, and The control unit stores time information in the virtual space in a manufacturer note.

14. The electronic device according to claim 8, wherein: The information in the Exif format includes an area for storing time information in real space, and The virtual space-specific information includes time information in the virtual space, and The control unit stores the time information in the virtual space in the area for storing the time information in the real space.

15. The electronic device according to claim 8, wherein: The information in the Exif format includes a third area and a fourth area for storing time information, and The virtual space-specific information includes time information in the virtual space, and The control unit stores time information in the virtual space in the fourth area.

16. The electronic device according to claim 15, wherein: The control unit stores time information in the real space in the third area.

17. The electronic device according to claim 1, further comprising: A setting unit is configured to set whether to record the information specific to the virtual space.

18. The electronic device according to claim 1, wherein: The control unit does not perform control to transmit information specific to the virtual space to the external device when performing control to transmit the image of the virtual space to the external device.

19. The electronic device according to claim 1, wherein: The control unit performs control for sending information specific to the virtual space to a specific external device when performing control for sending an image of the virtual space to the specific external device, and does not perform control for sending information specific to the virtual space to an external device that is not the specific external device when performing control for sending an image of the virtual space to the external device that is not the specific external device.

20. The electronic device according to claim 19, wherein: The specific external device is an external device paired with the electronic device.

21. The electronic device according to claim 1, wherein: The virtual space-specific information includes information capable of identifying the virtual space.

22. The electronic device according to claim 1, wherein: The control unit performs control to display a file of an image of the virtual space on a file display screen in a recognizable manner based on information specific to the virtual space.

23. The electronic device according to claim 22, wherein: The control unit controls to display the file of the image of the virtual space in a recognizable manner so that the viewing angle of the image of the virtual space can be recognized.

24. The electronic device according to claim 22, wherein: The control unit controls to display the file of the image of the virtual space in a recognizable manner so that the image of the virtual space can be recognized as a two-dimensional image or a three-dimensional image.

25. The electronic device according to claim 1, wherein: The control unit performs control to display information based on at least a part of the information specific to the virtual space on the information display screen of the image of the virtual space.

26. The electronic device according to claim 1, wherein: The control unit performs control to display information based on at least a part of the information specific to the virtual space on a playback screen of an image of the virtual space.

27. The electronic device according to claim 1, wherein: The control unit performs control for recording position information in the virtual space when performing control for recording an image of the virtual space, and performs control for recording position information in the real space when performing control for recording an image of a space different from the virtual space.

28. The electronic device according to claim 27, wherein: A space different from the virtual space is an augmented reality space.

29. An electronic device comprising: an acquisition unit configured to acquire information specific to the augmented reality space; as well as A control unit is configured to perform control to record information specific to the augmented reality space when performing control to record the image of the augmented reality space.

30. An electronic device comprising: an acquisition unit configured to acquire information specific to the virtual space, the information being associated with a file of an image of the virtual space; as well as A control unit is configured to perform control so that a file of an image of the virtual space is displayed on a file display screen in a recognizable manner based on information specific to the virtual space.

31. An electronic device comprising: an acquisition unit configured to acquire information specific to an augmented reality space, wherein the information is associated with a file of an image of the augmented reality space; as well as A control unit is configured to perform control so that a file of an image of the augmented reality space is displayed on a file display screen in a recognizable manner based on information specific to the augmented reality space.

32. A method for controlling an electronic device, comprising: Steps for obtaining information specific to the virtual space; as well as A step for performing control for recording information specific to the virtual space when performing control for recording an image of the virtual space.

33. A method for controlling an electronic device, comprising: Steps for obtaining information specific to the augmented reality space; as well as A step for performing control for recording information specific to the augmented reality space when performing control for recording an image of the augmented reality space.

34. A method for controlling an electronic device, comprising: A step for acquiring information specific to a virtual space, said information being associated with a file of an image of said virtual space; as well as A step of performing control so as to display a file of an image of the virtual space on a file display screen in a recognizable manner based on information specific to the virtual space.

35. A method for controlling an electronic device, comprising: A step for obtaining information specific to an augmented reality space, said information being associated with a file of an image of said augmented reality space; as well as A step for controlling to display a file of the image of the augmented reality space on a file display screen in a recognizable manner based on the information specific to the augmented reality space.

36. A program for causing a computer to function as each unit of the electronic device according to any one of claims 1 to 31.

37. A computer-readable medium storing a program for causing a computer to function as each unit of the electronic device according to any one of claims 1 to 31.

Images