Electronic device

GB2639137APending Publication Date: 2025-09-10CANON KK
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
GB2025004498
Authority / Receiving Office
GB · GB
Patent Type
Applications
Current Assignee / Owner
Priority Date
2022-09-13
Filing Date
2023-06-19
Publication Date
2025-09-10

AI Technical Summary

Technical Problem

Conventional technologies fail to effectively manage multiple images, particularly distinguishing between images captured in virtual space, real space, and augmented reality space, leading to difficulties in image organization and identification.

Method used

An electronic device equipped with an acquisition means for obtaining information unique to virtual or augmented reality spaces and a control means for recording metadata specific to these environments, allowing for the identification and management of images within these spaces.

Benefits of technology

Enables suitable management, identification, and differentiation of images captured in virtual, real, and augmented reality spaces, enhancing image organization, searchability, and sharing capabilities.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 00000000_0000_ABST
    Figure 00000000_0000_ABST
  • Figure 00000000_0001_ABST
    Figure 00000000_0001_ABST
Patent Text Reader

Abstract

The electronic device according to the present invention is characterized by including: an acquisition means that acquires information unique to a virtual space; and a control means that executes control such that the information unique to the virtual space is recorded when control is executed such that an image of the virtual space is recorded.
Need to check novelty before this filing date? Find Prior Art

Description

electronic equipment

[0001] The present invention relates to an electronic device, and more particularly to a technique for managing a plurality of images including images of a virtual space (or an augmented reality space).

[0002] Virtual reality (VR) is a computer-generated (simulated) environment in which users can interact with virtual objects. It provides users with a three-dimensional (3D) virtual space that resembles the real world. Visuals, sounds, and haptic feedback simulate the user's experience within the virtual space.

[0003] A user can view a virtual space using a display device (e.g., a head-mounted display), and can interact with virtual objects placed within the virtual space using a motion sensor or a controller.

[0004] In a virtual space, users can communicate with other users using virtual characters called avatars as their avatars. A camera function that allows users to capture images of the virtual space has also been proposed. Using this camera function, users can take pictures in the virtual space in the same way as they would in the real world. For example, users can take pictures of their friends' avatars or take pictures of the scenery in the virtual space, and keep the images (images of the virtual space) as memories.

[0005] A technology called augmented reality (AR) is also known. In this technology, virtual objects are displayed so as to be superimposed on real space (an image of real space). The three-dimensional (3D) space provided to a user by augmented reality is called an augmented reality space.

[0006] Patent Literature 1 discloses a technology for displaying an image captured in real space on a vehicle's head-up display and adding position information in real space to the image when saving the image. Patent Literature 2 discloses an example of a camera function in a virtual space.

[0007] US Patent Application Publication No. 2017 / 0076415 US Patent No. 10,948,993

[0008] However, conventional technologies are unable to appropriately manage multiple images including images captured in a virtual space (virtual space images). For example, assume that the multiple images include images captured in a virtual space (virtual space images) and images captured in a real space (real space images). In this case, if the virtual space images have a high level of realism, it is difficult to easily distinguish between the virtual space images and the real space images. Similarly, conventional technologies are unable to appropriately manage multiple images including images in an augmented reality space.

[0009] An object of the present invention is to provide an electronic device that can suitably manage a plurality of images including images of a virtual space (or an augmented reality space).

[0010] The electronic device of the present invention is characterized by having an acquisition means for acquiring information unique to a virtual space, and a control means for controlling the recording of the information unique to the virtual space when controlling the recording of an image of the virtual space.

[0011] According to the present invention, it becomes possible to suitably manage a plurality of images including images of a virtual space (or an augmented reality space).

[0012] Figures 1A and 1B are external views of an electronic device, Figure 1C is a block diagram of the electronic device, and Figure 1D is an external view of VR goggles. Figures 2A and 2B are external views of a controller. Figure 3 is a flowchart of OS mode processing. Figure 4 is a flowchart of virtual space application processing. Figure 5 is a flowchart of camera mode processing. Figure 6 is a flowchart of playback mode processing. Figure 7 is a schematic diagram of an application selection screen. Figures 8A to 8F are schematic diagrams of virtual space application screens. Figures 9A and 9B are schematic diagrams of file display screens. Figures 10A to 10D are schematic diagrams of metadata in Exif format.

[0013] Hereinafter, an embodiment of the present invention will be described with reference to the drawings. FIG. 1A is a front perspective view of an electronic device 100. The electronic device 100 is a display device such as a smartphone or a tablet terminal. The display 105 is a display unit that displays images and various information. The display 105 is integrally configured with a touch panel 106a, and is capable of detecting touch operations on the display surface of the display 105. The electronic device 100 is capable of VR display of VR images (VR content) on the display 105. The operation member 106b is a power button that accepts operations to turn the power of the electronic device 100 on and off. The operation members 106c and 106d are volume buttons for increasing or decreasing the volume of audio output from the speaker 112b or an earphone or external speaker connected to the audio output terminal 112a. The operation member 106e is a home button for displaying a home screen on the display 105. The audio output terminal 112a is an earphone jack that outputs an audio signal to an earphone or an external speaker. The speaker 112b is a built-in speaker that outputs audio.

[0014] 1B is a rear perspective view of electronic device 100. Imaging unit 115 is a camera capable of capturing an image of real space.

[0015] 1C is a block diagram showing the configuration of electronic device 100. A CPU 101, memory 102, nonvolatile memory 103, image processing unit 104, display 105, operation unit 106, storage medium I / F 107, external I / F 109, and communication I / F 110 are connected to an internal bus 150. An audio output unit 112, attitude detection unit 113, self-position / surrounding environment estimation unit 114, and imaging unit 115 are also connected to internal bus 150. The units connected to internal bus 150 are capable of exchanging data with each other via internal bus 150.

[0016] The CPU 101 is a control unit that controls the entire electronic device 100 and is composed of at least one processor or circuit. The memory 102 is, for example, a RAM (volatile memory using semiconductor elements). The CPU 101 controls each unit of the electronic device 100 using the memory 102 as a work memory in accordance with a program stored in the nonvolatile memory 103, for example. The nonvolatile memory 103 stores various information such as image data, audio data, other data, and various programs for the operation of the CPU 101. The nonvolatile memory 103 is, for example, a flash memory or a ROM.

[0017] Under the control of the CPU 101, the image processing unit 104 performs various image processing operations on images stored in the nonvolatile memory 103 or the storage medium 108, video signals acquired via the external I / F 109, or images acquired via the communication I / F 110. These operations include A / D conversion, D / A conversion, image data encoding, image data compression, image data decoding, image data enlargement / reduction (resizing), image data noise reduction, and image data color conversion. These operations also include panoramic expansion, mapping, and conversion of VR images, which are omnidirectional images or wide-area images that are not omnidirectional but have a wide range of video. The image processing unit 104 may be a dedicated circuit block for performing specific image processing operations. Depending on the type of image processing, the CPU 101 may perform the image processing operations according to a program without using the image processing unit 104.

[0018] Display 105 displays images and GUI screens constituting a GUI (Graphical User Interface) under the control of CPU 101. CPU 101 generates display control signals according to a program and controls each unit of electronic device 100 to generate video signals for display on display 105 and output them to display 105. Display 105 displays images based on the generated and output video signals. Note that the configuration of electronic device 100 itself is limited to an interface for outputting video signals for display on display 105, and display 105 may be an external monitor (e.g., a television or a head-mounted display).

[0019] The operation unit 106 includes various input units for receiving user operations. For example, the operation unit 106 includes a character information input device (e.g., a keyboard), a pointing device (e.g., a mouse or a touch panel), a button, a dial, a joystick, a touch sensor, and a touch pad. In this embodiment, the operation unit 106 includes a touch panel 106 a, operation members 106 b, 106 c, 106 d, and 106 e, and a gesture detection unit 106 f.

[0020] A storage medium 108 such as a memory card, CD, or DVD can be attached to or detached from the storage medium I / F 107. The storage medium I / F 107 reads data from and writes data to the attached storage medium 108 under the control of the CPU 101. The storage medium 108 is a storage unit that stores various data, including images to be displayed on the display 105. The external I / F 109 is an interface that connects to an external device via a wired or wireless connection and performs input / output (data communication) of video signals and audio signals. The communication I / F 110 is an interface that communicates (wirelessly) with an external device or the Internet 111 and transmits and receives (data communication) various data, such as files and commands. The communication I / F 110 can also communicate (wirelessly) with the controller 116.

[0021] The audio output unit 112 outputs the audio, operation sounds, ringtones, and various notification sounds of video or music data played back by the electronic device 100. The audio output unit 112 includes an audio output terminal 112a for connecting earphones or an external speaker, and a speaker 112b, but the audio output unit 112 may also output audio data to an external speaker via wireless communication.

[0022] The attitude detection unit 113 detects the attitude (tilt) of the electronic device 100 relative to the direction of gravity or the attitude of the electronic device 100 relative to each axis in the yaw, pitch, and roll directions, and notifies the CPU 101 of the attitude information. Based on the attitude detected by the attitude detection unit 113, it is possible to determine whether the electronic device 100 is held horizontally, vertically, facing up, facing down, or at an angle. It is also possible to determine the presence or absence and magnitude of tilt of the electronic device 100 in a rotational direction, such as the yaw, pitch, or roll direction, and whether the electronic device 100 has rotated in the rotational direction. The attitude detection unit 113 can use one or a combination of multiple sensors selected from an acceleration sensor, a gyro sensor, a geomagnetic sensor, a direction sensor, and an altitude sensor.

[0023] The self-position / surrounding environment estimation unit 114 estimates the self-position and surrounding environment of the electronic device 100 or the VR goggles 130 described below.

[0024] The self-position is the position of the electronic device 100 or the VR goggles 130 in a predetermined range of space. For example, the self-position is expressed by three parameters representing a position in a coordinate system defined by three axes, the X-axis, the Y-axis, and the Z-axis, which are orthogonal to each other at a predetermined position within the predetermined range of space, with the predetermined position being the origin. The self-position may also be expressed using three parameters representing the attitude (orientation).

[0025] The surrounding environment includes an obstacle region. The obstacle region is a region of objects present around the electronic device 100 or the VR goggles 130 that pose an obstacle to a user carrying the electronic device 100 or a user wearing the VR goggles 130. For example, the obstacle region is expressed by multiple sets of three parameters that represent a position in a coordinate system defined by three axes, an X-axis, a Y-axis, and a Z-axis, which are orthogonal to each other at a predetermined position within a predetermined range of space, with the predetermined position being the origin.

[0026] The imaging unit 115 is a camera capable of capturing images of real space. Images captured of real space can be used for various detection processes, such as by the gesture detection unit 106f and the self-position / surrounding environment estimation unit 114. In addition, images captured of real space can be displayed on the display 105.

[0027] As described above, the operation unit 106 includes the touch panel 106a. The touch panel 106a is a planar input device that is overlaid on the display 105 and outputs coordinate information according to the position of contact. The CPU 101 can detect the following operations or states on the touch panel 106a: - An operating object (for example, a finger or a pen) that was not touching the touch panel 106a now touches the touch panel 106a, i.e., the start of touching (hereinafter referred to as Touch-Down). - A state in which the operating object is touching the touch panel 106a (hereinafter referred to as Touch-On). - An operating object moving while still touching the touch panel 106a (hereinafter referred to as Touch-Move). - An operating object that was touching the touch panel 106a is released from the touch panel 106a, i.e., the end of touching (hereinafter referred to as Touch-Up). - A state in which nothing is touching the touch panel 106a (hereinafter referred to as Touch-Off).

[0028] When a touch-down is detected, a touch-on is also detected at the same time. After a touch-down, a touch-on will usually continue to be detected unless a touch-up is detected. If a touch-move is detected, a touch-on will also be detected at the same time. Even if a touch-on is detected, a touch-move will not be detected unless the touch position has moved. When it is detected that all operating objects that were touching have touched up, a touch-off is detected.

[0029] These operations and states, as well as the position coordinates of the touch panel 106a touched by the operating object, are notified to the CPU 101 via an internal bus. The CPU 101 determines what kind of operation (touch operation) has been performed on the touch panel 106a based on the notified information. Regarding touch-move, the direction of movement of the operating object moving on the touch panel 106a can also be determined for each of the vertical and horizontal components on the touch panel 106a based on changes in the position coordinates. If a touch-move of a predetermined distance or more is detected, it is determined that a slide operation has been performed.

[0030] An operation in which an operating object is touched to the touch panel 106a, quickly moved a certain distance, and then released is called a flick. In other words, a flick is an operation in which the operating object is quickly traced across the touch panel 106a as if flicking. When a touch-move of a predetermined distance or more at a predetermined speed or more is detected and a touch-up is then detected, it can be determined that a flick has been performed (it can be determined that a flick occurred following a slide operation).

[0031] Furthermore, a touch operation in which multiple points (e.g., two points) are simultaneously touched and the touch positions are brought closer together is called a pinch in, and a touch operation in which the touch positions are moved farther apart is called a pinch out. Pinch out and pinch in are collectively called a pinch operation (or simply a pinch). The touch panel 106a may be any of a variety of types, such as a resistive film type, a capacitance type, a surface acoustic wave type, an infrared type, an electromagnetic induction type, an image recognition type, and an optical sensor type. There are types that detect a touch by contact with the touch panel, and types that detect a touch by the approach of an operating object to the touch panel, and either type is acceptable.

[0032] As described above, the operation unit 106 includes the gesture detection unit 106f. The gesture detection unit 106f detects a gesture of the user (for example, the user's hand) from an image (an image of real space) acquired by the imaging unit 115 under the control of the CPU 101. The CPU 101 performs various processes (controls) in accordance with the detected gesture.

[0033] FIG. 1D is an external view of VR goggles (head-mounted adapter) 130 to which the electronic device 100 can be attached. The electronic device 100 can also be used as a head-mounted display by attaching it to the VR goggles 130. The insertion slot 131 is an insertion slot for inserting the electronic device 100. The entire electronic device 100 can be inserted into the VR goggles 130 with the display surface of the display 105 facing toward the headband 132 (i.e., toward the user) that secures the VR goggles 130 to the user's head. While wearing the VR goggles 130 with the electronic device 100 attached, the user can view the display 105 without holding the electronic device 100 in their hands. In this case, when the user moves their head or entire body, the posture of the electronic device 100 also changes. The posture detection unit 113 detects the posture change of the electronic device 100 at this time, and the CPU 101 performs processing for VR display (display in the "VR view" display mode) based on this posture change. In this case, detecting the orientation of the electronic device 100 by the orientation detection unit 113 is equivalent to detecting the orientation of the user's head (the direction in which the user's gaze is directed). VR display (VR view) is a display method (display mode) that displays an image of a VR image with a field of view corresponding to the orientation of the display device, and that allows the display range to be changed.

[0034] The electronic device 100 itself may be a head-mounted display that can be attached to the head without VR goggles. The electronic device 100 may be capable of detecting the user's line of sight or facial expression, and the user may be able to operate the electronic device 100 using the line of sight or facial expression.

[0035] 2A is an external view of controllers 240, 250, which are examples of controllers 116 capable of communicating with electronic device 100. Controller 240 is a grip-type controller that a user operates with their left hand. The user holds a holding portion 241 of controller 240 with their left hand and operates operation members arranged on an operation surface 242 with the fingers (e.g., thumb) of their left hand. Controller 240 notifies electronic device 100 of operations performed by the user. Controller 250 is a grip-type controller that a user operates with their right hand, and has a configuration similar to that of controller 240 (e.g., a configuration obtained by flipping controller 240 left and right).

[0036] Note that a controller 260 shown in FIG. 2B may be used as the controller 116. The controller 260 is a ring-type controller that is worn on the user's finger and operated. The controller 260 has a ring portion 261 to be worn on the user's finger 263, and an operation member 262. The operation member 262 is, for example, a push-button, a rotary dial, or an optical trackpad. The optical trackpad is a type of operation member that can detect contact with or proximity of a finger.

[0037] In the following description, it is assumed that a user is wearing VR goggles 130 equipped with electronic device 100 .

[0038] 3 is a flowchart showing the OS mode processing of the electronic device 100. This processing is realized by the CPU 101 expanding a program stored in the nonvolatile memory 103 into the memory 102 and executing it. The CPU 101 executes the OS mode processing of FIG. 3 when it detects that the electronic device 100 has been put on the VR goggles 130 or when it detects that a predetermined operation has been performed.

[0039] In step S301, the CPU 101 displays an application selection screen on the display 105.

[0040] 7 shows an application selection screen 701. The application selection screen 701 is displayed superimposed on a virtual space 700. The application selection screen 701 displays a plurality of icons (icons 702 to 707) corresponding to a plurality of applications installed in the electronic device 100. When an operation to select an icon is performed, the CPU 101 launches the application corresponding to the selected icon. For example, when the icon 702 is selected, a virtual space application that provides a predetermined virtual space to the user is launched, and when the icon 703 is selected, a photo application that plays images stored in the electronic device 100 is launched. Note that a plurality of virtual space applications may be installed in the electronic device 100.

[0041] Even while wearing the VR goggles 130 equipped with the electronic device 100, the user can use the controller 116 to select and move the GUI displayed on the display 105. For example, the user can move the pointer 710 in FIG. 7 to any position by changing the user's posture, the direction of their line of sight, or operating the controller. The user can then select an icon by moving the pointer 710 close to (or over) any icon and operating the operating members of the controller.

[0042] In step S302, the CPU 101 determines whether the virtual space application icon 702 has been selected. If the CPU 101 determines that the icon 702 has been selected, the process proceeds to step S303; otherwise, the process proceeds to step S304.

[0043] In step S303, the CPU 101 executes virtual space application processing, the details of which will be described later with reference to FIG.

[0044] In step S304, the CPU 101 determines whether or not the icon 703 of the photo application has been selected. If the CPU 101 determines that the icon 703 has been selected, the process proceeds to step S305; otherwise, the process proceeds to step S306.

[0045] In step S305, the CPU 101 executes a playback mode process (photo application process). In the playback mode process in step S305, all images stored in the storage medium 108 are set as candidates for playback (images to be played). Details of the playback mode process will be described later with reference to FIG. 6.

[0046] In step S306, CPU 101 determines whether another operation has been performed. The other operation includes, for example, an operation to pair electronic device 100 with an external device (e.g., a smartphone other than electronic device 100) and an operation to enable or disable a function to automatically transmit an image obtained by shooting (a captured image) to the paired external device. If CPU 101 determines that another operation has been performed, it proceeds to step S307; otherwise, it proceeds to step S308.

[0047] In step S307, the CPU 101 performs other processing (processing according to the operation detected in step S306).

[0048] In step S308, the CPU 101 determines whether an operation to end the OS mode process has been performed. If the CPU 101 determines that an operation to end the OS mode process has been performed, the CPU 101 ends the OS mode process of FIG. 3; if not, the process proceeds to step S302.

[0049] 4 is a flowchart showing the virtual space application process (step S303 in FIG. 3) of the electronic device 100. This process is realized by the CPU 101 loading a program stored in the nonvolatile memory 103 into the memory 102 and executing it.

[0050] In step S401, CPU 101 performs a process of starting up a virtual space application. For example, CPU 101 loads the virtual space application program stored in nonvolatile memory 103 into memory 102 and executes it. CPU 101 then initializes control variables (e.g., flags) used in the virtual space application.

[0051] In step S402, the CPU 101 performs a login process to a server that provides a virtual space application service based on the user's account information. The CPU 101 then loads user information (e.g., avatar information and attribute information) from the server. The avatar is a virtual character that the user uses as their own avatar.

[0052] In step S403, the CPU 101 displays the virtual space application screen on the display 105.

[0053] FIG. 8A shows a virtual space application screen. The virtual space application screen of FIG. 8A displays a virtual space 800, a virtual person 801, and a virtual animal 802. The virtual person 801 and the virtual animal 802 may be avatars of other users (virtual characters whose behavior is controlled in response to instructions from other users), or may be virtual characters whose behavior is controlled automatically. The virtual space application screen of FIG. 8A is a first-person perspective screen in which the avatar of the user viewing the virtual space application screen is not displayed. The virtual space application screen may also be a third-person perspective screen in which the avatar of the user viewing the virtual space application screen is displayed.

[0054] In step S404, the CPU 101 displays a GUI for performing various operations on the virtual space application screen.

[0055] For example, the CPU 101 displays the GUI 803 of FIG. 8A superimposed on the virtual space 800. The GUI 803 includes multiple icons (icons 804 to 808) corresponding to multiple functions. Icon 804 corresponds to a chat function, and icon 805 corresponds to an emotion function. Both the chat function and the emotion function are functions for communicating with other users. Icon 806 corresponds to a camera function for taking pictures with a camera (virtual camera) in the virtual space. Icon 807 is a switching button for switching the displayed space between a virtual space (virtual reality (VR) space) and an augmented reality (AR) space. Icon 807 displays the current space in a distinguishable manner. Since the virtual space 800 is displayed in FIG. 8A , an item 807a is displayed indicating that the displayed space is a virtual space (that is, a virtual space display is being performed). Finally, icon 808 is an exit button for exiting the virtual space application.

[0056] When the user selects (operates) icon 807 in Fig. 8A , CPU 101 transitions the displayed virtual space application screen from the screen in Fig. 8A to the screen in Fig. 8D . In Fig. 8D , an augmented reality space 850 is displayed as the background on which a virtual person 801, a virtual animal 802, and a GUI 803 are superimposed, instead of virtual space 800. Therefore, icon 807 displays item 807b indicating that the displayed space is an augmented reality space (that an augmented reality space display is being performed).

[0057] In step S405, the CPU 101 determines whether or not the icon 804, the icon 805, or the icon 807 has been selected. If the CPU 101 determines that the icon 804, the icon 805, or the icon 807 has been selected, the process proceeds to step S406; otherwise, the process proceeds to step S407.

[0058] In step S406, the CPU 101 executes processing corresponding to the selected icon (icon 804, icon 805, or icon 807). For example, the CPU 101 executes processing for communicating with other users, or processing for switching the displayed space between a virtual space and an augmented reality space.

[0059] In step S407, the CPU 101 determines whether or not the camera function icon 806 has been selected. If the CPU 101 determines that the icon 806 has been selected, the process proceeds to step S408; otherwise, the process proceeds to step S409.

[0060] In step S408, the CPU 101 executes camera mode processing, the details of which will be described later with reference to FIG.

[0061] In step S409, the CPU 101 determines whether or not another operation has been performed. If the CPU 101 determines that another operation has been performed, the process proceeds to step S410; otherwise, the process proceeds to step S411.

[0062] In step S410, the CPU 101 performs another process (processing corresponding to the operation detected in step S409). For example, assume that a user wearing the VR goggles 130 moves within the real space. In response to this, the CPU 101 changes the display range of the space (virtual space 800 or augmented reality space 850) displayed on the display 105 so that the user's position in the virtual space changes in accordance with the user's movement in the real space.

[0063] In step S411, the CPU 101 determines whether an operation to end the virtual space application process (selection of the icon 808) has been performed. If the CPU 101 determines that an operation to end the virtual space application process has been performed, the CPU 101 ends the virtual space application process of FIG. 4; if not, the CPU 101 proceeds to step S405.

[0064] 5 is a flowchart showing the camera mode process (step S408 in FIG. 4) of the electronic device 100. This process is realized by the CPU 101 loading a program stored in the nonvolatile memory 103 into the memory 102 and executing it.

[0065] In step S501, the CPU 101 performs initialization processing for the camera mode. For example, the CPU 101 reads various parameters that were set by the user the last time the camera mode was used.

[0066] In step S502, the CPU 101 displays a virtual camera on the virtual space application screen.

[0067] In step S503, the CPU 101 displays a virtual live view image on the display of the virtual camera.

[0068] In step S504, the CPU 101 displays a GUI for operating the camera mode on the virtual space application screen.

[0069] Fig. 8B shows a virtual space application screen in camera mode. The virtual space application screen in Fig. 8B displays a virtual space. In Fig. 8B, a virtual camera 810 is displayed as if it is being held by a virtual hand 811. A virtual camera name 812 and a virtual live view image 813 are displayed superimposed on the virtual camera 810. A plurality of GUIs corresponding to a plurality of functions in camera mode are displayed around the virtual camera 810. In Fig. 8B, a start shooting button 814, an end camera mode button 815, a menu button 816, and an start playback mode button 817 are displayed as the plurality of GUIs.

[0070] FIG. 8E also shows a virtual space application screen in camera mode. The virtual space application screen in FIG. 8E displays an augmented reality space. Similar to FIG. 8B, FIG. 8E also displays a virtual camera 810 and a virtual hand 811. Also similar to FIG. 8B, a virtual camera name 812, a virtual live view image 813, a start shooting button 814, a camera mode exit button 815, a menu button 816, and a playback mode start button 817 are also displayed.

[0071] In step S505, the CPU 101 determines whether or not the menu button 816 has been operated. If the CPU 101 determines that the menu button 816 has been operated, the process proceeds to step S506; otherwise, the process proceeds to step S507.

[0072] In step S506, the CPU 101 displays a menu screen on the display 105. The user can use the menu screen to configure various settings related to the camera mode (virtual camera). For example, the user can use the menu screen to configure the format of the captured image, the shooting parameters, and the format of the metadata to be added (linked) to the captured image. At least one of a still image, a video, a two-dimensional image, a three-dimensional image, a 360° image, and a VR180 image (an image conforming to the VR180 standard) is set as the format of the captured image. At least one of a shutter speed, an aperture, an ISO sensitivity, an exposure compensation step value, a white balance, and a focus mode is set as the shooting parameters. Image processing such as background blurring and skin softening effects may also be set as the shooting parameters. The format of the metadata to be added to the captured image will be described later.

[0073] In step S507, the CPU 101 determines whether or not the shooting start button 814 has been operated. If the CPU 101 determines that the shooting start button 814 has been operated, the process proceeds to step S508; otherwise, the process proceeds to step S513.

[0074] In step S508, the CPU 101 acquires a captured image (image to be recorded) by the virtual camera. For example, when a two-dimensional image is to be obtained as the captured image, the CPU 101 acquires a captured image corresponding to the current virtual live view image. When a 360-degree image is to be obtained as the captured image, the CPU 101 acquires a captured image that represents a 360-degree view from the position of the virtual camera.

[0075] In step S509, the CPU 101 determines whether the current display is a virtual space display or an augmented reality space display. If the CPU 101 determines that the current display is a virtual space display, the process proceeds to step S510. If the CPU 101 determines that the current display is a virtual space display, the process proceeds to step S511.

[0076] In step S510, the CPU 101 acquires information unique to the virtual space, and adds metadata including this information to the captured image acquired in step S508.

[0077] In step S511, the CPU 101 acquires information unique to the augmented reality space, and adds metadata including this information to the captured image acquired in step S508.

[0078] Note that the metadata may be generated in any format as long as it is capable of distinguishing at least one of an image in a virtual space and an image in an augmented reality space. To make an image in a virtual space identifiable, information specific to the virtual space may be included in the metadata in step S510. In this case, an image in a virtual space and an image in a non-virtual space may be distinguished even if information specific to the augmented reality space is not acquired in step S511. The non-virtual space is a space different from the virtual space, such as a real space or an augmented reality space. Similarly, to make an image in an augmented reality space identifiable, information specific to the augmented reality space may be included in the metadata in step S511. In this case, an image in an augmented reality space and an image in a non-augmented reality space may be distinguished even if information specific to the virtual space is not acquired in step S510. The non-augmented reality space is a space different from the augmented reality space, such as a real space or a virtual space.

[0079] The information unique to the virtual space includes, for example, a flag indicating that it is a virtual space, position information within the virtual space, and time information within the virtual space. The information unique to the augmented reality space includes, for example, a flag indicating that it is an augmented reality space. Although information unique to the augmented reality space may be used as position information within the augmented reality space, the position information within the augmented reality space is generally the same as the position information within real space. Similarly, information unique to the augmented reality space may be used as time information within the augmented reality space, but the time information within the augmented reality space is generally the same as the time information within real space.

[0080] The metadata may be information (data) in the Exchangeable Image File Format (Exif) format, or may not be in this format. In the case of the Exif format, the metadata can include various parameters such as the shutter speed, aperture, ISO sensitivity, and exposure compensation step value at the time of shooting. When a moving image is obtained as a captured image, one piece of metadata may be added to the entire moving image, metadata may be added to each frame of the moving image, or metadata may be added to each scene of the moving image.

[0081] In step S512, the CPU 101 records (saves) the file of the captured image (image file) with the metadata added to the storage medium 108. The file of the captured image (image captured by the virtual camera) acquired in step S508 may be recorded in the same area as files of other images (for example, images of real space acquired by the imaging unit 115), or may be recorded in a different area. The captured image acquired in step S508 may be recorded in an area unique to the virtual space application. The captured image acquired in step S508 may be saved directly to an external device or server.

[0082] In step S513, the CPU 101 determines whether or not the playback mode start button 817 has been operated. If the CPU 101 determines that the playback mode start button 817 has been operated, the process proceeds to step S514; otherwise, the process proceeds to step S515.

[0083] In step S514, CPU 101 executes playback mode processing. The playback mode processing in step S514 differs from the playback mode processing in step S305. For example, the playback mode processing in step S514 is processing unique to the virtual space application, while the playback mode processing in step S305 is processing of a photo application included in the OS. In the playback mode processing in step S514, images recorded by the virtual space application (images captured by the virtual camera) among images stored in storage medium 108 are selected as candidates for playback targets (images to be played). Details of the playback mode processing will be described later using FIG. 6.

[0084] In step S515, the CPU 101 determines whether or not another operation has been performed. If the CPU 101 determines that another operation has been performed, the process proceeds to step S516; otherwise, the process proceeds to step S517.

[0085] In step S516, the CPU 101 performs another process (processing corresponding to the operation detected in step S515). For example, the CPU 101 changes the angle of view (subject range) of the virtual live view image in response to a change in the posture of the VR goggles 130 or an operation on the controller 116.

[0086] In step S517, the CPU 101 determines whether or not an operation to end the camera mode process has been performed (operation of the camera mode end button 815). If the CPU 101 determines that an operation to end the camera mode process has been performed, the CPU 101 ends the camera mode process of FIG. 5; if not, the process proceeds to step S505.

[0087] 6 is a flowchart showing the playback mode process (step S305 in FIG. 3 or step S514 in FIG. 5) of electronic device 100. This process is realized by CPU 101 loading a program stored in nonvolatile memory 103 into memory 102 and executing it.

[0088] In step S601, the CPU 101 performs initialization processing for the playback mode. For example, the CPU 101 reads the index number of the image that was viewed the last time the user used the playback mode, and various parameters related to viewing.

[0089] In step S602, the CPU 101 reads out image files stored in the storage medium 108. In the playback mode process of step S305 in Fig. 3, all image files stored in the storage medium 108 are read out. In the playback mode process of step S514 in Fig. 5, of the image files stored in the storage medium 108, image files recorded by the virtual space application are read out.

[0090] In step S603, the CPU 101 analyzes the metadata of the image file read in step S602.

[0091] In step S604, the CPU 101 displays the image file read in step S602 on the display 105. An image (video) of one image file may be displayed on the playback screen, or a list of multiple image files may be displayed on the file display screen. The file display screen may display a thumbnail of a compressed image of the image file as an icon representing the image file.

[0092] In step S605, the CPU 101 determines whether the image (image file) read in step S602 is an image of a virtual space or an image of a non-virtual space, and displays on the display 105 a GUI that enables the image of a virtual space to be distinguished from the image of a non-virtual space.

[0093] FIG. 8C shows a screen in playback mode. The screen in FIG. 8C displays a GUI 820 (file display screen) for playback mode. The GUI 820 displays a list of thumbnails 821-823 of read images (image files). Based on the analysis results of the metadata for each image, items 821a and 823a indicating that the image is a virtual space are superimposed on the thumbnails 821 and 823 of the virtual space images. Furthermore, an item 822a indicating that the image is a non-virtual space is superimposed on the thumbnail 822 of the non-virtual space image. The screen in FIG. 8C is a virtual space application screen in playback mode, i.e., a screen displayed in the playback mode processing of step S514 in FIG. 5. Therefore, an item indicating that the image is an augmented reality space image (an item with "AR" written on it) is displayed as the item 822a indicating that the image is a non-virtual space image. However, in the playback mode processing of step S305 in FIG. 3, a thumbnail of the image in real space may also be displayed. Therefore, instead of an item with "AR" written on it, an item with "Non-VR" written on it may be displayed as an item indicating that it is an image of a non-virtual space. It is not necessary to display an item indicating that it is an image of a non-virtual space. Furthermore, since the virtual application screen in FIG. 8C displays a virtual space, GUI 820 is displayed superimposed on virtual space 800.

[0094] A cursor 824 is displayed superimposed on the thumbnail 821. Detailed information (information display screen) of the image (virtual space image) corresponding to the thumbnail 821 on which the cursor 824 is superimposed is displayed to the right of the thumbnails 821 to 823. Setting information 825 and shooting information 826 are displayed as the detailed information. The setting information 825 includes information about the camera settings at the time of shooting, and the shooting information 826 includes other information at the time of shooting. Because the image of the thumbnail 821 is an image in virtual space, the setting information 825 displays information about the virtual camera settings at the time of shooting (e.g., the format of the captured image and shooting parameters). The shooting information 826 includes position information of the virtual camera (photographer) in the virtual space at the time of shooting. This position information represents the position of the virtual camera (photographer) in the virtual space using three parameters representing a position in a coordinate system defined by three axes, the X-axis, the Y-axis, and the Z-axis, which are orthogonal to each other at a predetermined position in the virtual space, with the origin being the predetermined position in the virtual space. The photography information 826 also includes the name of the server to which the photographer logged in, the public IP address of the server, the name of the virtual space (world name), and time information within the server (virtual space). The time information within the server may be substantially the same as the time information within electronic device 100 (real space).

[0095] Although the example has been shown in which the virtual space image file is identifiably displayed on the file display screen by displaying information based on at least a portion of the information unique to the virtual space (e.g., item 822a and shooting information 826), the present invention is not limited to this. For example, the virtual space image playback screen may be controlled to display information based on at least a portion of the information unique to the virtual space.

[0096] FIG. 8F shows a screen (virtual application screen) in playback mode. Because the virtual application screen in FIG. 8F displays an augmented reality space, a GUI 820 (file display screen) is displayed superimposed on the augmented reality space 850. In FIG. 8F, a cursor 824 is displayed superimposed on a thumbnail 822. Therefore, detailed information (information display screen) of the image (augmented reality space image) corresponding to the thumbnail 822 is displayed to the right of the thumbnails 821 to 823. Setting information 825 and shooting information 827 are displayed as detailed information. In this embodiment, the CPU 101 records position information and time information within the virtual space when recording an image in a virtual space, and records position information and time information within real space when recording an image in a non-virtual space. Therefore, the shooting information 827 includes position information of the virtual camera (photographer) in real space at the time of shooting. This position information represents the position of the virtual camera (photographer) in real space using latitude, longitude, and altitude. The position information in real space may be position information of the electronic device 100 or the VR goggles 130. The shooting information 827 also includes a direction indicating the shooting direction and time information within the electronic device 100 (in real space).

[0097] In step S606, the CPU 101 determines whether an image forwarding operation has been performed. If the CPU 101 determines that an image forwarding operation has been performed, the process proceeds to step S607; otherwise, the process proceeds to step S608.

[0098] In step S607, the CPU 101 switches the image (one or more images) displayed on the display 105 to the image (one or more images) of the next index (advance image).

[0099] In step S608, the CPU 101 determines whether an image sharing / synchronization operation has been performed. If the CPU 101 determines that an image sharing / synchronization operation has been performed, the process proceeds to step S609; otherwise, the process proceeds to step S610.

[0100] In step S609, the CPU 101 transmits the image file to an external device or a server. The external device is, for example, a smartphone paired with the electronic device 100. The external device may be a storage device (e.g., a HDD) with a communication function. The server may be, for example, a server for a social networking service (SNS). The server may also be online storage on the cloud.

[0101] In step S610, the CPU 101 determines whether or not another operation has been performed. If the CPU 101 determines that another operation has been performed, the process proceeds to step S611; otherwise, the process proceeds to step S612.

[0102] In step S611, the CPU 101 performs other processing (processing corresponding to the operation detected in step S610). For example, the CPU 101 performs editing processing such as changing the color tone and trimming the image.

[0103] In step S612, the CPU 101 determines whether an operation to end the playback mode process has been performed. If the CPU 101 determines that an operation to end the playback mode process has been performed, the CPU 101 ends the shooting mode process of FIG. 6; if not, the process proceeds to step S606.

[0104] Although an example has been described in which images in a virtual space and images in a non-virtual space are displayed in a way that allows them to be distinguished, images in an augmented reality space and images in a non-augmented reality space may also be displayed in a way that allows them to be distinguished. Three types of images, images in a virtual space, images in an augmented reality space, and images in a real space, may also be displayed in a way that allows them to be distinguished.

[0105] FIG. 9A shows a file display screen. In FIG. 9A , an image (image file) is transmitted from the electronic device 100 to a smartphone 900 paired with the electronic device 100, and a file display screen is displayed on a display 901 of the smartphone 900. The file display screen of FIG. 9A displays a list of multiple thumbnails (thumbnails 902 to 907) corresponding to multiple images, including the image transmitted from the electronic device 100. Items 902a and 904a indicating that the image is a virtual space image are superimposed on the thumbnails 902 and 904 of the virtual space images. An item 903a indicating that the image is an augmented reality space image is superimposed on the thumbnail 903 of the augmented reality space image. Items 905a to 907a indicating that the image is a real space image are superimposed on the thumbnails 905 to 907 of the real space images. This display makes it possible to distinguish between three types of images: images of virtual space, images of augmented reality space, and images of real space.

[0106] Furthermore, the image may be displayed so that the angle of view of the image can be distinguished. For example, an image with a normal angle of view may be displayed so that the image can be distinguished from a 360° image. Alternatively, a two-dimensional image may be displayed so that the image can be distinguished from a three-dimensional image.

[0107] FIG. 9B shows a file display screen. In FIG. 9B , an image (image file) is transmitted from the electronic device 100 to the smartphone 900 paired with the electronic device 100, and the file display screen is displayed on the display 901 of the smartphone 900. Similar to the file display screen of FIG. 9A , the file display screen of FIG. 9B displays a list of multiple thumbnails (thumbnails 912 to 917) corresponding to multiple images, including the image transmitted from the electronic device 100. Items 912a and 914a indicating that the images are virtual space images are superimposed on the thumbnails 912 and 914 of the virtual space images. An item 913a indicating that the images are augmented reality space images is superimposed on the thumbnail 913 of the augmented reality space image. Items 905a to 907a indicating that the images are real space images are superimposed on the thumbnails 915 to 917 of the real space images. This display makes it possible to distinguish between three types of images: images of virtual space, images of augmented reality space, and images of real space.

[0108] Furthermore, items 912b, 913b, 915b, and 917b indicating that the images are two-dimensional are superimposed on thumbnails 912, 913, 915, and 917 of two-dimensional images with a normal angle of view. Items 914b and 916b indicating that the images are three-dimensional are superimposed on thumbnails 914 and 916 of three-dimensional 360-degree images. Furthermore, rotated displays 914c and 916c of the thumbnails 914 and 916 of the 360-degree images are also displayed. This display makes it possible to distinguish between images with a normal angle of view and 360-degree images. It also makes it possible to distinguish between two-dimensional and three-dimensional images.

[0109] Note that an item indicating that the image is a normal angle of view may be displayed, or an item indicating that the image is a three-dimensional image may be displayed. A display that makes the VR180 image identifiable may be performed. For example, an item indicating that the image is a VR180 image may be superimposed on a thumbnail of the VR180 image. A rotational display of the thumbnail of the VR180 image may be performed.

[0110] Although an example has been described in which location information within the virtual space is added to an image in a virtual space and location information within the real space is added to an image in a non-virtual space, this is not limiting. For example, a user (photographer) may be able to set in advance whether location information within the real space or location information within the virtual space is to be recorded (added). A server administrator or a virtual space administrator may be able to perform such setting for multiple users at once. For example, location information within the real space may be added to an image in a virtual space that simulates a real space, and location information within the virtual space may be added to an image in a real space that simulates a virtual space. Location information within the virtual space may also be added to an image in a real space used to construct a virtual space (e.g., an image in a real space used to place a room in a real apartment as a room in a virtual apartment). Both location information within the virtual space and location information within the real space may be added to an image. In this case, both location information within the virtual space and location information within the real space may be displayed on an information display screen (e.g., shooting information 826 in FIG. 8C or shooting information 827 in FIG. 8F).

[0111] It may be possible to set whether or not to record information unique to the virtual space, in addition to location information within the virtual space. For example, the CPU 101 sets whether or not to record information unique to the virtual space in accordance with instructions from the photographer (user), the server administrator, or the virtual space administrator.

[0112] The location information in the virtual space may indicate the location of the virtual camera in the virtual space, or may indicate the location of the photographer (avatar) in the virtual space. The photographer (user), server administrator, or virtual space administrator may be able to set whether to add the location information of the virtual camera or the location information of the photographer to the image. Furthermore, if the space of the image and the space of the location information are different, information indicating that the space of the image and the space of the location information are different may be further added to the image. An example of a case where the space of the image and the space of the location information are different is when location information in real space is added to an image in virtual space, or when location information in virtual space is added to an image in real space.

[0113] Note that the virtual camera may be installed at a position distant from the position of the photographer (avatar). When the virtual camera is installed at a position distant from the photographer, a setting for adding the position information of the virtual camera to the image may be automatically performed. For example, normally, the position information of the photographer is added to the image without the position information of the virtual camera being added. When the virtual camera is installed at a position distant from the photographer, the position information of the virtual camera is added to the image without the position information of the photographer being added. When the virtual camera is installed at a position distant from the photographer, both the position information of the photographer and the position information of the virtual camera may be added to the image. Furthermore, when a VR format such as a 360° image or a VR180 image is set as the format of the captured image, a setting for adding the position information of the virtual camera to the image may be automatically performed.

[0114] The format of the position information in the virtual space is not particularly limited. The position information in the virtual space may include information in a polar coordinate system. For example, the position information in the virtual space may include the origin of the virtual space (three-dimensional space), the distance from the origin, the direction, the elevation angle, and the altitude. When photographing on a virtual Earth, the position information in the virtual space may include latitude and longitude on the virtual Earth. The position information in the virtual space may be information indicating an area in the virtual space. The position information in the virtual space may be information indicating the distance from a predetermined position. The position information in the virtual space may indicate a position or area in a two-dimensional space defined by an X axis and a Y axis.

[0115] Furthermore, when multiple virtual space applications exist, the information unique to the virtual space may include information capable of identifying the virtual space (information capable of uniquely identifying which application the virtual space is in). For example, the information unique to the virtual space may include the IP address of the server providing the virtual space. The number of servers providing the virtual space may be one or more. The information unique to the virtual space may include a global IP address or a public IP address. For example, the public IP address of the server to which the photographer logged in may be added to an image of the virtual space, out of multiple public IP addresses assigned to multiple servers. The information unique to the virtual space may include information on the directory structure within the server. In the case of a virtual space made public on the Internet, the information unique to the virtual space may include a URL.

[0116] The time information in the virtual space may indicate a time that is uniquely determined within the virtual space, or may indicate a time set for an area (world) within the virtual space. The time information in the virtual space may also be information indicating a time period (morning, noon, or night) or information indicating a season. The time information in the virtual space may also be information common to multiple virtual space applications.

[0117] Note that the location information in the virtual space may be stored in any manner in the Exif format metadata. For example, as shown in FIG. 10A , the location information in the virtual space may be stored in a makernote. As shown in FIG. 10B , the Exif format metadata may include an area 1001 for storing location information in the real space. In that case, the location information in the virtual space may be stored in area 1001. As shown in FIG. 10C , the Exif format metadata may include an area 1001 for storing location information in the real space and an area 1002 for storing location information in the virtual space. In that case, the location information in the virtual space may be stored in area 1002. As shown in FIG. 10D , the location information in the real space may be stored in area 1001, and the location information in the virtual space may be stored in area 1002. When two pieces of location information, namely, the location information in the real space and the location information in the virtual space, are stored in the metadata, information indicating which of the two pieces of location information is main information (information used in playback mode processing (or processing by the playback device)) may be included in the metadata.

[0118] The time information in the virtual space may be stored in any way in the metadata in the Exif format, and may be stored in the metadata in the same way as the position information in the virtual space.

[0119] When a virtual camera that exists only in the virtual space is used, the information unique to the virtual space may include the name of the virtual camera to be used. Similarly, when a virtual camera that exists only in the augmented reality space is used, the information unique to the augmented reality space may include the name of the virtual camera to be used.

[0120] A virtual space and a non-virtual space may be simultaneously photographed, and a composite image in which an image of the virtual space and an image of the non-virtual space are arranged may be recorded. For example, a composite image in which an image of the virtual space and an image of the non-virtual space are arranged in a picture-in-picture format may be recorded. A 360° composite image may be generated by combining an image of the virtual space and an image of the non-virtual space, each with a 180° angle of view.

[0121] Although an example of adding metadata to an image has been described, a metadata file may be generated and recorded separately from the image file in a format linked to the image. To control the recording of information unique to the virtual space, a process of determining a file name for the image of the virtual space according to a predetermined naming rule may be performed. For example, the file name may include a string "AppX_VR" indicating that the file is a virtual space of the virtual space application AppX, such as the file name "AppX_VR_001.JPEG." Similarly, to control the recording of information unique to the augmented reality space, a process of determining a file name for the image of the augmented reality space according to a predetermined naming rule may be performed. For example, the file name may include a string "AppX_AR" indicating that the file is an augmented reality space of the virtual space application AppX, such as the file name "AppX_AR_001.JPEG."

[0122] Note that, when transmitting an image (image file) to an external device or a server, the electronic device 100 (CPU 101) may not transmit (may delete) some or all of the metadata to protect privacy. For example, when transmitting an image of a virtual space to an external device or a server, the electronic device 100 may not transmit information unique to the virtual space included in the metadata. The electronic device 100 may transmit (not delete) the metadata when transmitting the image to a specific external device (e.g., an external device paired with the electronic device 100), and may not transmit (delete) the metadata when transmitting the image to an external device other than the specific external device. Then, the specific external device may not transmit (delete) the metadata when transmitting the image to an external device.

[0123] Furthermore, when the virtual camera display is shown to another user in the virtual space, information unique to the real space may be hidden from the other user. In this case, for example, a menu for disclosing the virtual camera display to the other user is selected on the virtual camera display to allow the other user to see the virtual camera display. Alternatively, it may be possible to automatically calculate whether the virtual camera display is visible to the other user based on the position and line of sight of the other user's avatar, and the position of the virtual camera and the direction of the display screen, and automatically hide the information unique to the real space if it is visible to the other user.

[0124] Furthermore, when an image is shared with other users in a virtual space (when an image is sent to other users), information unique to the real space may not be sent. For example, information unique to the real space may be deleted, and an image may be generated that retains information about the virtual space, and sent to other users.

[0125] Conversely, when displaying or sharing an image with other users in real space, information unique to the virtual space may not be transmitted (information unique to the virtual space may be deleted). Furthermore, real users may be able to delete metadata at any time and by any operation.

[0126] As described above, according to this embodiment, when an image of a virtual space (or an augmented reality space) is recorded, information unique to the virtual space (or the augmented reality space) is recorded. Then, based on the information unique to the virtual space (or the augmented reality space), the recorded image of the virtual space (or the augmented reality space) is displayed in an identifiable manner. This makes it possible to suitably manage multiple images, including images of the virtual space (or the augmented reality space). This in turn makes it easier to search for, edit, and share images.

[0127] The various controls described above as being performed by CPU 101 may be performed by a single piece of hardware, or multiple pieces of hardware (e.g., multiple processors or circuits) may share the processing and control the entire device.

[0128] Furthermore, although the present invention has been described in detail based on preferred embodiments thereof, the present invention is not limited to these specific embodiments, and various forms within the scope of the gist of the present invention are also included in the present invention. Furthermore, each of the above-described embodiments merely represents one embodiment of the present invention, and each embodiment can be combined as appropriate.

[0129] The present invention can also be realized by a process in which a program that realizes one or more of the functions of the above-described embodiments is supplied to a system or device via a network or a storage medium, and one or more processors in a computer of the system or device read and execute the program. The present invention can also be realized by a circuit (e.g., an ASIC) that realizes one or more of the functions.

[0130] The disclosure of the present embodiments includes the following configurations, methods, programs, and media. (Configuration 1) An electronic device comprising: an acquisition unit for acquiring information unique to a virtual space; and a control unit for controlling the recording of the information unique to the virtual space when controlling the recording of an image of the virtual space. (Configuration 2) The electronic device according to Configuration 1, wherein the information unique to the virtual space includes a flag indicating that the information is the virtual space. (Configuration 3) The electronic device according to Configuration 1 or 2, wherein the information unique to the virtual space includes position information within the virtual space. (Configuration 4) The electronic device according to any one of Configurations 1 to 3, wherein the information unique to the virtual space includes time information within the virtual space. (Configuration 5) The electronic device according to any one of Configurations 1 to 4, wherein the control of recording the image of the virtual space is control of photographing the virtual space using a virtual camera. (Configuration 6) The electronic device according to Configuration 5, wherein the information unique to the virtual space includes the name of the virtual camera. (Configuration 7) The electronic device according to any one of Configurations 1 to 6, wherein the control of recording the information unique to the virtual space includes processing for determining a file name for the image of the virtual space according to a predetermined naming rule. (Configuration 8) The electronic device according to any one of configurations 1 to 7, wherein the control of recording information unique to the virtual space includes control of recording information in Exif format. (Configuration 9) The electronic device according to configuration 8, wherein the information unique to the virtual space includes position information within the virtual space, and the control means stores the position information within the virtual space in a makernote. (Configuration 10) The electronic device according to configuration 8, wherein the information in Exif format includes an area for storing position information within real space, the information unique to the virtual space includes position information within the virtual space, and the control means stores the position information within the virtual space in the area for storing position information within the real space.(Configuration 11) The electronic device of Configuration 8, wherein the information in Exif format includes a first area and a second area for storing position information, the information unique to the virtual space includes position information within the virtual space, and the control means stores the position information within the virtual space in the second area. (Configuration 12) The electronic device of Configuration 11, wherein the control means stores position information within real space in the first area. (Configuration 13) The electronic device of any of Configurations 8 to 12, wherein the information unique to the virtual space includes time information within the virtual space, and the control means stores the time information within the virtual space in a makernote. (Configuration 14) The electronic device of any of Configurations 8 to 12, wherein the information in Exif format includes an area for storing time information within real space, the information unique to the virtual space includes time information within the virtual space, and the control means stores the time information within the virtual space in the area for storing time information within the real space. (Configuration 15) The electronic device according to any one of Configurations 8 to 12, wherein the information in Exif format includes a third area and a fourth area for storing time information, the information unique to the virtual space includes time information within the virtual space, and the control means stores the time information within the virtual space in the fourth area. (Configuration 16) The electronic device according to Configuration 15, wherein the control means stores time information within the real space in the third area. (Configuration 17) The electronic device according to any one of Configurations 1 to 16, further comprising setting means for setting whether or not to record the information unique to the virtual space. (Configuration 18) The electronic device according to any one of Configurations 1 to 17, wherein the control means, when controlling the transmission of the image of the virtual space to an external device, does not control the transmission of the information unique to the virtual space to the external device.(Configuration 19) The electronic device according to any one of Configurations 1 to 17, wherein, when controlling the transmission of the image of the virtual space to a specific external device, the control means controls the transmission of information unique to the virtual space to the external device, and when controlling the transmission of the image of the virtual space to an external device other than the specific external device, the control means does not control the transmission of the information unique to the virtual space to the external device. (Configuration 20) The electronic device according to Configuration 19, wherein the specific external device is an external device paired with the electronic device. (Configuration 21) The electronic device according to any one of Configurations 1 to 20, wherein the information unique to the virtual space includes information that can identify the virtual space. (Configuration 22) The electronic device according to any one of Configurations 1 to 21, wherein the control means controls the display of files of the image of the virtual space on a file display screen in an identifiable manner based on the information unique to the virtual space. (Configuration 23) The electronic device according to Configuration 22, wherein the control means performs the control to display files of the image of the virtual space in an identifiable manner so that the angle of view of the image of the virtual space is identifiable. (Configuration 24) The electronic device according to Configuration 22, wherein the control means performs the control to identifiably display the file of the virtual space image so that it is possible to identify whether the image of the virtual space is a two-dimensional image or a three-dimensional image. (Configuration 25) The electronic device according to any one of Configurations 1 to 24, wherein the control means controls to display information based on at least a part of information unique to the virtual space on an information display screen of the image of the virtual space. (Configuration 26) The electronic device according to any one of Configurations 1 to 25, wherein the control means controls to display information based on at least a part of information unique to the virtual space on a playback screen of the image of the virtual space. (Configuration 27) The electronic device according to any one of Configurations 1 to 26, wherein the control means, when controlling to record the image of the virtual space, controls to record position information in the virtual space, and, when controlling to record an image of a space different from the virtual space, controls to record position information in real space.(Configuration 28) The electronic device according to Configuration 27, wherein the space different from the virtual space is an augmented reality space. (Configuration 29) An electronic device comprising: an acquisition means for acquiring information unique to the augmented reality space; and a control means for controlling, when controlling to record an image of the augmented reality space, to record the information unique to the augmented reality space. (Configuration 30) An electronic device comprising: an acquisition means for acquiring information unique to the virtual space linked to a file of an image of the virtual space; and a control means for controlling, based on the information unique to the virtual space, to display the file of the image of the virtual space in an identifiable manner on a file display screen. (Configuration 31) An electronic device comprising: an acquisition means for acquiring information unique to the augmented reality space linked to a file of an image of the augmented reality space; and a control means for controlling, based on the information unique to the augmented reality space, to display the file of the image of the augmented reality space in an identifiable manner on a file display screen. (Method 1) A control method for an electronic device comprising: a step of acquiring information unique to the virtual space; and a step of controlling, when controlling to record an image of the virtual space, to record the information unique to the virtual space. (Method 2) A control method for an electronic device comprising the steps of: acquiring information unique to an augmented reality space; and, when controlling to record an image of the augmented reality space, controlling to record the information unique to the augmented reality space. (Method 3) A control method for an electronic device comprising the steps of: acquiring information unique to the virtual space linked to a file of an image of a virtual space; and, controlling to display the file of the image of the virtual space in an identifiable manner on a file display screen based on the information unique to the virtual space. (Method 4) A control method for an electronic device comprising the steps of: acquiring information unique to the augmented reality space linked to a file of an image of the augmented reality space; and, controlling to display the file of the image of the augmented reality space in an identifiable manner on a file display screen based on the information unique to the augmented reality space. (Program) A program for causing a computer to function as each means of the electronic device described in any of configurations 1 to 31.(Medium) A computer-readable storage medium storing a program for causing a computer to function as each of the means of the electronic device according to any one of configurations 1 to 31.

[0131] The present invention is not limited to the above-described embodiments, and various modifications and variations can be made without departing from the spirit and scope of the present invention. Therefore, the following claims are appended to apprise the public of the scope of the present invention.

[0132] This application claims priority based on Japanese Patent Application No. 2022-145046, filed on September 13, 2022, the entire contents of which are incorporated herein by reference.

[0133] 100: Electronic equipment 101: CPU

Claims

1. An electronic device comprising: an acquisition means for acquiring information unique to a virtual space; and a control means for controlling the recording of the information unique to the virtual space when controlling the recording of an image of the virtual space.

2. The electronic device according to claim 1, wherein the information unique to the virtual space includes a flag indicating that the virtual space is the virtual space.

3. The electronic device according to claim 1, wherein the information unique to the virtual space includes position information within the virtual space.

4. The electronic device according to claim 1, wherein the information unique to the virtual space includes time information within the virtual space.

5. The electronic device according to claim 1, wherein the control to record an image of the virtual space is a control to photograph the virtual space using a virtual camera.

6. The electronic device according to claim 5, wherein the information unique to the virtual space includes the name of the virtual camera.

7. The electronic device according to claim 1, characterized in that the control for recording information unique to the virtual space includes a process for determining a file name for an image of the virtual space according to a predetermined naming rule.

8. The electronic device according to claim 1, wherein the control for recording information unique to the virtual space includes control for recording information in Exif format.

9. The electronic device according to claim 8, wherein the information unique to the virtual space includes location information within the virtual space, and the control means stores the location information within the virtual space in a makernote.

10. The electronic device described in claim 8, characterized in that the information in Exif format includes an area for storing position information within real space, the information unique to the virtual space includes position information within the virtual space, and the control means stores the position information within the virtual space in the area for storing position information within the real space.

11. The electronic device described in claim 8, characterized in that the information in Exif format includes a first area and a second area for storing location information, the information unique to the virtual space includes location information within the virtual space, and the control means stores the location information within the virtual space in the second area.

12. The electronic device according to claim 11, wherein the control means stores position information in real space in the first area.

13. The electronic device according to claim 8, wherein the information unique to the virtual space includes time information within the virtual space, and the control means stores the time information within the virtual space in a maker note.

14. The electronic device described in claim 8, characterized in that the information in Exif format includes an area for storing time information in real space, the information unique to the virtual space includes time information in the virtual space, and the control means stores the time information in the virtual space in the area for storing time information in the real space.

15. The electronic device described in claim 8, characterized in that the information in Exif format includes a third area and a fourth area for storing time information, the information unique to the virtual space includes time information within the virtual space, and the control means stores the time information within the virtual space in the fourth area.

16. The electronic device according to claim 15, wherein the control means stores time information in the real space in the third area.

17. The electronic device according to claim 1, further comprising a setting means for setting whether or not to record information unique to the virtual space.

18. The electronic device according to claim 1, characterized in that when the control means controls the transmission of an image of the virtual space to an external device, it does not control the transmission of information unique to the virtual space to the external device.

19. The electronic device described in claim 1, characterized in that when the control means controls the transmission of an image of the virtual space to a specific external device, it controls the transmission of information unique to the virtual space to the external device, and when the control means controls the transmission of an image of the virtual space to an external device other than the specific external device, it does not control the transmission of information unique to the virtual space to the external device.

20. The electronic device according to claim 19, wherein the specific external device is an external device paired with the electronic device.

21. The electronic device according to claim 1, characterized in that the information unique to the virtual space includes information that can identify the virtual space.

22. The electronic device according to claim 1, wherein the control means controls the display of the image files of the virtual space on the file display screen in an identifiable manner based on information unique to the virtual space.

23. The electronic device according to claim 22, wherein the control means performs the control to display the file of the image of the virtual space in an identifiable manner so that the angle of view of the image of the virtual space is identifiable.

24. The electronic device according to claim 22, characterized in that the control means performs the control to display the file of the image of the virtual space in an identifiable manner so that it is possible to distinguish whether the image of the virtual space is a two-dimensional image or a three-dimensional image.

25. The electronic device according to claim 1, characterized in that the control means controls the display of information based on at least part of the information unique to the virtual space on an information display screen of the image of the virtual space.

26. The electronic device according to claim 1, wherein the control means controls the display of information based on at least part of the information unique to the virtual space on the playback screen of the image of the virtual space.

27. The electronic device according to claim 1, characterized in that the control means, when controlling the recording of an image of the virtual space, controls the recording of position information within the virtual space, and, when controlling the recording of an image of a space different from the virtual space, controls the recording of position information within real space.

28. The electronic device according to claim 27, wherein the space different from the virtual space is an augmented reality space.

29. An electronic device comprising: an acquisition means for acquiring information unique to an augmented reality space; and a control means for controlling the recording of the information unique to the augmented reality space when controlling the recording of an image of the augmented reality space.

30. An electronic device characterized by having: an acquisition means for acquiring information unique to a virtual space that is linked to a file of an image of the virtual space; and a control means for controlling the file display screen to display the file of the image of the virtual space in an identifiable manner based on the information unique to the virtual space.

31. An electronic device comprising: an acquisition means for acquiring information unique to the augmented reality space linked to a file of an image of the augmented reality space; and a control means for controlling the file display screen to display the file of the image of the augmented reality space in an identifiable manner based on the information unique to the augmented reality space.

32. A method for controlling an electronic device, comprising: a step of acquiring information unique to a virtual space; and a step of controlling to record the information unique to the virtual space when controlling to record an image of the virtual space.

33. A control method for an electronic device, comprising: a step of acquiring information unique to an augmented reality space; and a step of controlling to record the information unique to the augmented reality space when controlling to record an image of the augmented reality space.

34. A method for controlling an electronic device, comprising: a step of acquiring information unique to the virtual space that is linked to a file of an image of the virtual space; and a step of controlling the file display screen to display the file of the image of the virtual space in an identifiable manner based on the information unique to the virtual space.

35. A control method for an electronic device, comprising: a step of acquiring information unique to the augmented reality space linked to a file of an image of the augmented reality space; and a step of controlling the file display screen to display the file of the image of the augmented reality space in an identifiable manner based on the information unique to the augmented reality space.

36. A program for causing a computer to function as each means of the electronic device described in any one of claims 1 to 31.

37. A computer-readable storage medium storing a program for causing a computer to function as each means of the electronic device described in any one of claims 1 to 31.

Citation Information

Patent Citations

  • Program, camera work data generation method, and electronic apparatus

    JP2020119335A

  • System And Method For Capturing And Sharing A Location Based Experience

    US20200218690A1