Electronic device including multiple cameras and method of controlling the same

Abstract

An electronic device according to one embodiment includes a display, a first camera, a second camera, a memory storing instructions, and at least one processor operatively connected to the display, the first camera, the second camera, and the memory, wherein the instructions, when executed by the at least one processor individually or collectively, can cause the electronic device to: acquire a first image through the first camera based on receiving a user input for capturing a stereoscopic image; acquire a second image through the second camera; and display, as a preview image, an image in which a viewpoint is moved from a first image set for a preview image among the first image and the second image in a first direction by a first set value through the display as the preview image.

Description

Technical Field

[0001] Various embodiments of this disclosure relate to an electronic device including multiple cameras and a method for controlling the same. Background Technology

[0002] The variety of services and additional functions offered through electronic devices (such as portable electronic devices like smartphones) is steadily increasing. To enhance the practical value of these devices and meet the diverse needs of users, communication service providers and electronic device manufacturers are racing to develop devices that offer a wide range of functions and differentiate themselves from other companies. Consequently, the functionality offered through electronic devices is also increasing.

[0003] Recently, technologies have been developed for electronic devices that include multiple cameras to capture images in various ways. Electronic devices can use multiple cameras to capture stereoscopic images. Stereoscopic image capture is a pair of 2D images that can be used to perceive three-dimensional depth (depth perception) using the visual differences between the two eyes. Stereoscopic images are essentially based on the principle that the images seen by each of the two eyes are different due to the parallax based on the distance between the eyes (e.g., binocular parallax), and depth perception is achieved by recognizing this difference. A stereoscopic image is represented as a pair of images, including a left image and a right image.

[0004] The above information is provided as background information to aid in understanding this disclosure. No assertion or determination is made as to whether any of the above content can be used as prior art in connection with this disclosure. Summary of the Invention

[0005] Technical solution According to an embodiment, an electronic device may include: a display; a first camera; a second camera; a memory, storing instructions; and at least one processor operatively connected to the display, the first camera, the second camera, and the memory. When executed individually or jointly by the at least one processor, the instructions may cause the electronic device to: acquire a first image via the first camera and acquire a second image via the second camera based on received user input for capturing stereoscopic video; and display an image as a preview image on the display, showing the viewpoint of the first image shifted by a first setting value along a first direction from the first image and the second image for a preview image.

[0006] According to an embodiment, a method for controlling an electronic device includes: identifying and receiving user input for capturing stereoscopic video; based on identifying the received user input for capturing stereoscopic video, acquiring a first image via a first camera and acquiring a second image via a second camera; and displaying an image whose viewpoint is moved from the first image to the second image along a first direction by a first set value as a preview image via a display.

[0007] According to an embodiment, an electronic device may include: a display; a first camera; a second camera; a memory, storage instructions; and at least one processor operatively connected to the display, the first camera, the second camera, and the memory. When executed individually or jointly by the at least one processor, the instructions cause the electronic device to: acquire a first image via the first camera and acquire a second image via the second camera based on received user input for capturing stereoscopic video; display the first image as a preview image via the display; and store an image in the memory as an image for stereoscopic video, in which the viewpoint is moved from each of the first and second images along a first direction by a first set value. Attached Figure Description

[0008] Figure 1 This is a block diagram illustrating an electronic device in a network environment according to an embodiment.

[0009] Figure 2 This is a view illustrating an example configuration of an electronic device including multiple cameras according to an embodiment of the present disclosure.

[0010] Figure 3 This is a block diagram illustrating an electronic device including multiple cameras according to an embodiment of the present disclosure.

[0011] Figure 4 This is a view illustrating the mismatch between the capture viewpoint and the playback viewpoint according to an embodiment of this disclosure.

[0012] Figure 5 This is a view illustrating the concept of a method for matching capture viewpoints and playback viewpoints according to embodiments of the present disclosure.

[0013] Figure 6 This is a view illustrating the calculation of setting values ​​for moving viewpoints according to embodiments of the present disclosure.

[0014] Figure 7 This is a view illustrating the calculation of setting values ​​for moving viewpoints according to embodiments of the present disclosure.

[0015] Figure 8 This is a view illustrating the matching between a capture viewpoint and a playback viewpoint according to an embodiment of this disclosure.

[0016] Figure 9 This is a view illustrating a method of displaying stereoscopic video in an electronic device according to an embodiment of the present disclosure.

[0017] Figure 10 This is a view illustrating an example of a data format for stereoscopic video according to an embodiment of the present disclosure.

[0018] Figure 11This is a view illustrating an example of the data format of a stereoscopic video with a preview image added, according to an embodiment of the present disclosure.

[0019] Figure 12 This is a view illustrating an example of a header configuration for storing setting values ​​related to viewpoint movement, according to an embodiment of this disclosure.

[0020] Figure 13 This is a view illustrating the concept of an image adjustment and viewpoint movement method according to an embodiment of the present disclosure.

[0021] Figure 14 This is a flowchart illustrating a method for matching captured viewpoints and playback viewpoints according to an embodiment of the present disclosure.

[0022] Figure 15 This is a flowchart illustrating a method for moving and storing viewpoints when capturing stereoscopic video according to an embodiment of the present disclosure. Detailed Implementation

[0023] In the following detailed description, embodiments of the present disclosure are given with reference to the accompanying drawings, which will enable those skilled in the art to readily practice them. However, the present disclosure may be implemented in various different forms and is not limited to the embodiments described herein. In the description of the drawings, the same or similar reference numerals may be used for the same or similar components. Furthermore, in the drawings and related descriptions, descriptions of well-known functions and configurations may be omitted for clarity and conciseness.

[0024] Figure 1 This is a block diagram illustrating an electronic device in a network environment according to an embodiment.

[0025] Reference Figure 1In network environment 100, electronic device 101 can communicate with electronic device 102 via a first network 198 (e.g., a short-range wireless communication network), or with at least one of electronic device 104 or server 108 via a second network 199 (e.g., a long-range wireless communication network). According to an embodiment, electronic device 101 can communicate with electronic device 104 via server 108. According to an embodiment, electronic device 101 may include a processor 120, a memory 130, an input module 150, a sound output module 155, a display module 160, an audio module 170, a sensor module 176, an interface 177, a connection terminal 178, a haptic module 179, a camera module 180, a power management module 188, a battery 189, a communication module 190, a user identification module 196, or an antenna module 197. In some embodiments, at least one of these components (e.g., connection terminal 178) may be omitted from electronic device 101, or one or more other components may be added. In some embodiments, some of these components (e.g., sensor module 176, camera module 180, or antenna module 197) may be integrated into a single component (e.g., display module 160).

[0026] Processor 120 may, for example, run software (e.g., program 140) to control at least one other component (e.g., hardware or software component) connected to electronic device 101, and may perform various data processing or operations. According to an embodiment, as at least part of the data processing or operations, processor 120 may store commands or data received from another component (e.g., sensor module 176 or communication module 190) in volatile memory 132, process the commands or data stored in volatile memory 132, and store the resulting data in non-volatile memory 134. According to an embodiment, processor 120 may include a main processor 121 (e.g., central processing unit or application processor) or an auxiliary processor 123 (e.g., graphics processing unit, neural processing unit (NPU), image signal processor, sensor central processor, or communication processor) that operates independently of or with the main processor 121. For example, when electronic device 101 includes a main processor 121 and an auxiliary processor 123, the auxiliary processor 123 may be configured to consume less power than the main processor 121 or be configured to be dedicated to a specific function. The auxiliary processor 123 may be implemented separately from the main processor 121 or as part of the main processor 121.

[0027] When the main processor 121 is inactive (e.g., in sleep) state, the auxiliary processor 123 (representing the main processor 121) may, for example, control at least some of the functions or states associated with at least one component of the electronic device 101 (e.g., display module 160, sensor module 176, or communication module 190), or when the main processor 121 is active (e.g., running) state, the auxiliary processor 123 may work with the main processor 121 to control at least some of the functions or states associated with at least one component of the electronic device 101 (e.g., display module 160, sensor module 176, or communication module 190). According to embodiments, the auxiliary processor 123 (e.g., an image signal processor or a communication processor) may be implemented as part of another functionally related component (e.g., camera module 180 or communication module 190). According to embodiments, the auxiliary processor 123 (e.g., a neural processing unit) may include hardware architectures dedicated to processing artificial intelligence models. Artificial intelligence models can be generated through machine learning. For example, such learning can be performed within the electronic device 101 that executes the artificial intelligence model or via a separate server (e.g., server 108). The learning algorithm can include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model can include multiple layers of artificial neural networks. The artificial neural network can be one of the following: deep neural network (DNN), convolutional neural network (CNN), recurrent neural network (RNN), restricted Boltzmann machine (RBM), deep belief network (DBN), bidirectional recurrent deep neural network (BRDNN), deep Q-network, or a combination of two or more of these, but is not limited to the examples described above. Additionally or optionally, the artificial intelligence model can include software structures in addition to hardware structures.

[0028] Memory 130 may store various data used by at least one component of electronic device 101 (e.g., processor 120 or sensor module 176). The data may include, for example, software (e.g., program 140) and input or output data for instructions associated therewith. Memory 130 may include volatile memory 132 or non-volatile memory 134.

[0029] The program 140 may be stored as software in the memory 130, and the program 140 may include, for example, an operating system 142, middleware 144, or application 146.

[0030] Input module 150 can receive instructions or data from outside electronic device 101 (e.g., a user) that will be used by components of electronic device 101 (e.g., processor 120). Input module 150 may include, for example, a microphone, mouse, keyboard, keys (e.g., buttons), or digital pen (e.g., stylus).

[0031] The sound output module 155 can output sound signals to the outside of the electronic device 101. The sound output module 155 may include, for example, a speaker or a receiver. The speaker can be used for general purposes such as multimedia playback or record playback. The receiver can be used to receive incoming calls. According to an embodiment, the receiver may be implemented separately from the speaker or as part of the speaker.

[0032] Display module 160 can visually provide information to the outside of electronic device 101 (e.g., to a user). Display module 160 may include, for example, a display, a holographic device, or a projector, and control circuitry for controlling the device. According to an embodiment, display module 160 may include a touch sensor configured to detect a touch or a pressure sensor configured to measure the intensity of the force generated by the touch.

[0033] The audio module 170 can convert sound into electrical signals, or conversely, convert electrical signals into sound. According to an embodiment, the audio module 170 can obtain sound through the input module 150, or output sound through the sound output module 155 or through an external electronic device (e.g., electronic device 102) (e.g., a speaker or headphones) directly or wirelessly connected to the electronic device 101.

[0034] Sensor module 176 can detect the operating state of electronic device 101 (e.g., power or temperature) or the environmental state outside electronic device 101 (e.g., user state), and generate an electrical signal or data value corresponding to the detected state. According to embodiments, sensor module 176 may include, for example, a gesture sensor, gyroscope sensor, atmospheric pressure sensor, magnetic sensor, accelerometer, grip sensor, proximity sensor, color sensor, infrared (IR) sensor, biometric sensor, temperature sensor, humidity sensor, or illuminance sensor.

[0035] Interface 177 may support one or more specific protocols that can be used to connect electronic device 101 directly or indirectly to an external electronic device (e.g., electronic device 102). According to embodiments, interface 177 may include, for example, a High Definition Multimedia Interface (HDMI), a Universal Serial Bus (USB) interface, an SD card interface, or an audio interface.

[0036] Connection end 178 may include a connector through which electronic device 101 can be physically connected to an external electronic device (e.g., electronic device 102). According to embodiments, connection end 178 may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).

[0037] The tactile module 179 can convert electrical signals into mechanical stimuli (e.g., vibration or movement) or electrical stimuli that a user can perceive through touch or kinesthesia. According to embodiments, the tactile module 179 may include, for example, a motor, a piezoelectric element, or an electrical stimulation device.

[0038] Camera module 180 can capture still images and video. According to an embodiment, camera module 180 may include one or more lenses, an image sensor, an image signal processor, or a flash.

[0039] The power management module 188 manages the power supply to the electronic device 101. According to an embodiment, the power management module 188 may be implemented as at least part of, for example, a power management integrated circuit (PMIC).

[0040] Battery 189 can power at least one component of electronic device 101. According to embodiments, battery 189 may include, for example, a non-rechargeable primary battery, a rechargeable accumulator, or a fuel cell.

[0041] Communication module 190 can support the establishment of a direct (e.g., wired) or wireless communication channel between electronic device 101 and external electronic devices (e.g., electronic device 102, electronic device 104, or server 108), and perform communication through the established communication channel. Communication module 190 may include one or more communication processors that operate independently of processor 120 (e.g., application processor) and support direct (e.g., wired) or wireless communication. According to embodiments, communication module 190 may include wireless communication module 192 (e.g., cellular communication module, short-range wireless communication module, or Global Navigation Satellite System (GNSS) communication module) or wired communication module 194 (e.g., local area network (LAN) communication module or power line communication module). The respective communication modules in these communication modules can communicate with external electronic devices 104 via a first network 198 (e.g., a short-range communication network such as Bluetooth, Wi-Fi Direct, or Infrared Data Association (IrDA)) or a second network 199 (e.g., a long-range communication network such as a traditional cellular network, 5G network, next-generation communication network, the Internet, or a computer network (e.g., a LAN or WAN)). These various types of communication modules can be integrated into a single component (e.g., a single chip), or they can be implemented as multiple separate components (e.g., multiple chips). The wireless communication module 192 can identify or verify electronic devices 101 within the communication network (such as the first network 198 or the second network 199) using user information (e.g., the International Mobile Subscriber Identity (IMSI)) stored in the user identification module 196.

[0042] Wireless communication module 192 can support 5G networks following 4G networks and next-generation communication technologies (e.g., new radio access technologies (NR access technologies)). NR access technologies can support high-speed transmission of high-capacity data (enhanced mobile broadband (eMBB)), minimization of terminal power and access for multiple terminals (massive machine-type communications (mMTC)), or high reliability and low latency (ultra-reliable low-latency communications (URLLC)). Wireless communication module 192 can support high-frequency bands (e.g., millimeter-wave bands) for achieving high data transmission rates. Wireless communication module 192 can support various technologies for ensuring performance in high-frequency bands, such as beamforming, massive MIMO, full-dimensional MIMO (FD-MIMO), array antennas, analog beamforming, or massive antennas. Wireless communication module 192 can support various requirements specified by electronic device 101, external electronic devices (e.g., electronic device 104), or network systems (e.g., second network 199). According to an embodiment, the wireless communication module 192 may support peak data rates (e.g., 20 Gbps or greater) for eMBB implementation, lost coverage (e.g., 164 dB or less) for mMTC implementation, or U-plane delay (e.g., 0.5 ms or less for each of the downlink (DL) and uplink (UL), or 1 ms or less round trip) for URLLC implementation.

[0043] Antenna module 197 can transmit or receive signals or power from an external source (e.g., an external electronic device). According to an embodiment, antenna module 197 may include an antenna comprising a radiator formed of a conductor or conductive pattern formed on a substrate (e.g., a PCB). According to an embodiment, antenna module 197 may include multiple antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication scheme used in a communication network (such as a first network 198 or a second network 199) can be selected from the multiple antennas by, for example, communication module 190. Signals or power can then be transmitted or received between communication module 190 and an external electronic device via the selected at least one antenna. According to an embodiment, other components besides the radiator (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as part of antenna module 197.

[0044] According to various embodiments, antenna module 197 may form a millimeter-wave antenna module. According to embodiments, the millimeter-wave antenna module may include a printed circuit board, an RFIC, and multiple antennas (e.g., an array antenna), wherein the RFIC is disposed on or adjacent to a first surface (e.g., a bottom surface) of the printed circuit board and is capable of supporting a specified high-frequency band (e.g., a millimeter-wave band), and the multiple antennas are disposed on or adjacent to a second surface (e.g., a top or side surface) of the printed circuit board and are capable of transmitting or receiving signals in the specified high-frequency band.

[0045] At least some of the components can be connected to each other and exchange signals (e.g., commands or data) via communication schemes between peripheral devices (e.g., buses, general purpose input / output (GPIO), serial peripheral interfaces (SPI), or mobile industrial processor interfaces (MIPI)).

[0046] According to an embodiment, instructions or data can be sent or received between electronic device 101 and external electronic device 104 via server 108 connected to the second network 199. Each of external electronic device 102 or external electronic device 104 may be a device of the same type as electronic device 101, or a device of a different type. According to an embodiment, all or some of the operations running in electronic device 101 may be run in one or more of external electronic devices 102, 104, or 108. For example, when electronic device 101 is required to automatically perform a predetermined function or service, or in response to a request from a user or another device to perform a predetermined function or service, electronic device 101 may request the one or more external electronic devices to perform at least a portion of the function or service, instead of running the function or service itself, or electronic device 101 may request the one or more external electronic devices to perform at least a portion of the function or service in addition to running the function or service. Upon receiving the request, the one or more external electronic devices may perform at least a portion of the requested function or service, or perform additional functions or services related to the request, and may send the result of the performance to electronic device 101. Electronic device 101 may provide the result as is or, after further processing, provide the result as a response to at least a portion of the request. For this purpose, technologies such as cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing may be used. Electronic device 101 may use, for example, distributed computing or mobile edge computing to provide ultra-low latency services. In another embodiment, external electronic device 104 may include an Internet of Things (IoT) device. Server 108 may be an intelligent server using machine learning and / or neural networks. According to an embodiment, external electronic device 104 or server 108 may be included in a second network 199. Electronic device 101 may be applied to intelligent services (e.g., smart homes, smart cities, smart cars, or healthcare) based on 5G communication technology and IoT-related technologies.

[0047] The artificial intelligence-related functions according to this disclosure are operated via a processor and memory. The processor may consist of one or more processors. In this case, the one or more processors may be general-purpose processors (such as central processing units (CPUs), application processors (APs), or digital signal processors (DSPs)), graphics-specific processors (such as graphics processing units (GPUs) or vision processing units (VPUs)), or artificial intelligence-specific processors (such as NPUs). The one or more processors control the processing of input data according to predefined operating rules or artificial intelligence models stored in memory. Optionally, when the one or more processors are artificial intelligence-specific processors, the artificial intelligence-specific processors may be designed with hardware architectures dedicated to processing specific artificial intelligence models.

[0048] The predefined operating rules or artificial intelligence models are characterized by being created through learning. Here, "created through learning" means using a learning algorithm to learn a basic artificial intelligence model from multiple learning data, thereby creating a predefined set of operating rules or artificial intelligence models to perform desired characteristics (or purposes). Such learning can be performed within the apparatus itself that performs artificial intelligence according to this disclosure, or it can be performed via a separate server and / or system. Examples of learning algorithms include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but are not limited to the examples described above.

[0049] Artificial intelligence models can consist of multiple neural network layers. Each of these layers has multiple weight values, and neural network operations are performed by operations between the results of the previous layer and these weight values. The weight values ​​of the multiple neural network layers can be optimized using the learning results of the artificial intelligence model. For example, multiple weight values ​​can be updated to reduce or minimize the loss or cost values ​​gained by the artificial intelligence model during the learning process. Artificial neural networks can include deep neural networks (DNNs), and examples include, but are not limited to, convolutional neural networks (CNNs), deep neural networks (DNNs), recurrent neural networks (RNNs), restricted Boltzmann machines (RBMs), deep belief networks (DBNs), bidirectional recurrent deep neural networks (BRDNNs), or deep Q-networks.

[0050] Figure 2 This is a view illustrating an example configuration of an electronic device including multiple cameras according to an embodiment of the present disclosure.

[0051] Reference Figure 2 According to the embodiment, the electronic device 201 (e.g., Figure 1 The electronic device 101 may include a camera 220 (e.g., Figure 1 (Camera module 190). Not limited thereto, the electronic device 101 according to the embodiment may also include a camera module 190. Figure 1Other components described.

[0052] According to an embodiment, the electronic device 201 may use camera 220 (e.g., multiple cameras 221 and 223) to capture stereoscopic video. According to an embodiment, a "stereoscopic image" is an image acquired by two or more cameras and can be used to represent a pair of 2D images capable of perceiving three-dimensional depth (depth perception) using the visual differences between the two eyes. For example, stereoscopic video may include a left-eye image corresponding to the left eye and a right-eye image corresponding to the right eye. According to an embodiment, stereoscopic video can be played back by an electronic device that can be developed in a form that can be worn by a user (e.g., wearable electronic devices, such as augmented reality (AR) glasses, video see-through (VST) devices, or head-mounted display (HMD) devices) and viewed by the user in the form of 3D images. Stereoscopic video may also be replaced by the term "spatial video," without limitation to the specific term.

[0053] According to an embodiment, camera 220 may include multiple cameras, and among the multiple cameras, a front-facing camera may be disposed on a first surface (e.g., the front surface) of the housing, and multiple rear-facing cameras among the multiple cameras may be disposed on a second surface (e.g., the rear surface) of the housing. For example, when electronic device 201 is placed in a horizontal direction (from... Figure 2 In a state where the vertical direction is rotated 90 degrees as shown, camera 220 can use at least two cameras (e.g., first camera 221 and second camera 223) arranged in a row along a first direction (e.g., the Y direction) from a plurality of rear cameras to capture stereoscopic video. According to an embodiment, camera 220 may include heterogeneous or homogeneous first camera 221 and second camera 223 for capturing stereoscopic video. The heterogeneous or homogeneous first camera 221 and second camera 223 may be rear cameras disposed on the rear surface of electronic device 201. For example, when first camera 221 and second camera 223 are heterogeneous cameras, first camera 221 may be a wide-angle camera, and second camera 223 may be an ultra-wide-angle camera.

[0054] According to an embodiment, when the electronic device 201 is foldable, the front camera (e.g., a front-cover camera) and the rear camera can face the same direction when the electronic device 201 is fully unfolded. Therefore, at least one camera located at the front and at least one camera located at the rear (e.g., a wide-angle camera or an ultra-wide-angle camera) can be used to capture stereoscopic video.

[0055] According to embodiments, in the embodiments described below, for ease of description, a first camera among a plurality of cameras used for capturing stereoscopic video may be configured as a camera corresponding to the left eye, and a second camera may be configured as a camera corresponding to the right eye. According to various embodiments, the first camera may be configured as a camera corresponding to the right eye, and the second camera may be configured as a camera corresponding to the left eye.

[0056] Figure 3 This is a block diagram illustrating an electronic device including multiple cameras according to an embodiment of the present disclosure.

[0057] Reference Figure 3 Electronic device 101 including multiple cameras (e.g., Figure 2 The electronic device 201 may include a processor 320 (e.g., Figure 1 The processor 120), memory 330 (e.g., Figure 1 The memory 130), the display 360 (e.g., Figure 1 The display module 160) and multiple cameras (e.g., Figure 1 The camera module 180). Multiple cameras may include a first camera 381 (e.g., Figure 2 First camera 221) and second camera 382 (e.g., Figure 2 The second camera (223). Figure 3 Two cameras are shown, but this is for ease of description and may include three or more cameras.

[0058] According to an embodiment, when a user inputs the runtime of an application related to capturing photos or videos into electronic device 101, processor 320 can run a program stored in memory 330 corresponding to the application related to capturing photos or videos (e.g., Figure 1 Program 140).

[0059] According to an embodiment, the processor 320 may display a preview image on the display 360 depending on the operation of an application related to capturing photos or videos. The preview image displayed on the display 360 may correspond to a first image (e.g., a left-eye image) acquired (or captured) by the first camera 381 or a second image (e.g., a right-eye image) acquired (or captured) by the second camera 382.

[0060] According to an embodiment, when the application receives user input to start capturing stereoscopic video and receives user input to end capturing after a predetermined time, the processor 320 can store a first image acquired by the first camera 381 and a second image acquired by the second camera 382 from the capture start time to the capture end time as stereoscopic video in the memory 330. According to an embodiment, the stereoscopic video stored in the memory 330 can be stored as a file compressed using a set encoding method (e.g., Multi-View High Efficiency Video Coding (HV-HEVC)). According to an embodiment, when the capture mode is set to stereoscopic video capture mode in the application, the user input to start capturing stereoscopic video can be set or recognized as input to a video capture start button, or it can be set or recognized as input to a separately set stereoscopic video capture start button.

[0061] Figure 4 This is a view illustrating the mismatch between the capture viewpoint and the playback viewpoint according to an embodiment of this disclosure.

[0062] Reference Figure 4 When the head-mounted display (HMD) device 410 captures object 400 as stereoscopic video, since the user views object 400 while wearing the HMD device 410, the viewpoint (angle of view) of space 411 perceived by the user through the screen can be a viewpoint where object 400 is located at the center. In the following description, viewpoint can be replaced by the term "picture composition (or photographic composition)" used in the field of photography. According to an embodiment, the screen actually displayed to the user may include a left-eye image 412a captured by a first camera and a right-eye image 412b captured by a second camera. Since the user views object 400 with both eyes through the first and second cameras of the HMD device 410, the left-eye image 412a can be an image that moves object 400 a predetermined distance to the right from the center, and the right-eye image 412b can be an image that moves object 400 a predetermined distance to the left from the center. The left-eye image 413a and right-eye image 413b captured by the user through the HMD device 410 may be stored in memory as stereoscopic video (e.g., in the form of a compressed file using a set encoding method (HV-HEVC)). According to an embodiment, when the user plays back the left-eye image 413a and right-eye image 413b stored in memory to view stereoscopic video while wearing the HMD device 410, the image 414 perceived by the user through the screen during playback may have an object 400 located at the center, the same as the image 411 perceived by the user through the screen during capture. Hereinafter, displaying the stereoscopic video (e.g., the left-eye image and right-eye image) stored in memory on the screen for the user to view is referred to as "playback of stereoscopic video" to distinguish it from the display of the preview image.

[0063] According to an embodiment, a user can capture stereoscopic video using an electronic device 101 that does not provide 3D display capabilities (e.g., a smartphone) instead of the HMD device 410. For example, as described above... Figure 2 and Figure 3 As described in the description, the first camera (e.g., one of a plurality of cameras disposed in the electronic device 101) can be used. Figure 3 The first camera (381) is set as the camera corresponding to the left eye and the second camera (e.g., Figure 3 The second camera 382 is configured to capture and store stereoscopic video corresponding to the right eye. When capturing object 400 as stereoscopic video using an electronic device 101 that does not provide 3D display capabilities (e.g., a smartphone), the electronic device 101 can display the image on a monitor (e.g., a digital display). Figure 3The display (360) will display either a first image captured by a first camera corresponding to the left eye or a second image captured by a second camera corresponding to the right eye as a preview image. For example, since the user is viewing the object while holding the electronic device 101 in their hand, the viewpoint (angle of view) of the space 421 perceived by the user through the screen can be a viewpoint where the object 400 is located at the center, such as... Figure 4 As shown in the illustration. According to an embodiment, the screen 422 actually displayed to the user as a preview image may correspond to one of the settings in the left-eye image 423a captured by the first camera and the right-eye image 423b captured by the second camera (e.g., right-eye image 423b). Since the user adjusts the viewpoint through the preview image 422 to center the object 400 in order to capture the object 400, the right-eye image 423b displayed as a preview image may have the object 400 centered. According to an embodiment, since the viewpoint of the left-eye image 423a is determined according to the relative positions of the first and second cameras, the left-eye image 423a may be an image in which the object 400 is moved a predetermined distance further to the right from the center compared to the left-eye image 413a captured by the MHD device 410. The left-eye image 423a and the right-eye image 423b captured by the user through the electronic device 101 may be stored in a memory as stereoscopic video. According to an embodiment, when a stereoscopic video stored in memory is played back for viewing on an HMD device 410, the image 424, perceived by the user through the screen during playback, may have a moving object 400 located on the right, unlike the image 421 perceived by the user through the screen during capture. For example, the viewpoint of the space perceived by the user when capturing the stereoscopic video via the electronic device 101 and the viewpoint of the screen perceived by the user when playing back the stereoscopic video via the HMD device 410 may not match each other.

[0064] In the following text, refer to Figures 5 to 8 Various embodiments are described for matching the viewpoint of the space perceived by the user when capturing stereoscopic video via electronic device 101 with the viewpoint of the screen perceived by the user when playing back stereoscopic video captured via electronic device 101 via HMD device 410.

[0065] Figure 5 This is a view illustrating the concept of a method for matching capture viewpoints and playback viewpoints according to embodiments of the present disclosure.

[0066] Reference Figure 5 According to an embodiment, a user can capture stereoscopic video using an electronic device 101 that does not provide 3D display capabilities (e.g., a smartphone) instead of the HMD device 410. For example, as described above... Figure 2 and Figure 3 As described in the description, the first camera (e.g., one of a plurality of cameras disposed in the electronic device 101) can be used. Figure 3The first camera (381) is set as the camera corresponding to the left eye and the second camera (e.g., Figure 3 The second camera 382 is configured to capture and store stereoscopic video corresponding to the right eye. When capturing object 400 as stereoscopic video using an electronic device 101 that does not provide 3D display capabilities (e.g., a smartphone), the electronic device 101 can display the image on a monitor (e.g., a digital display). Figure 3 The display (360) will display either a first image captured by a first camera corresponding to the left eye or a second image captured by a second camera corresponding to the right eye as a preview image. For example, since the user is viewing the object while holding the electronic device 101 in their hand, the viewpoint (angle of view) of the space perceived by the user through the screen could be a viewpoint where the object 400 is located at the center, such as... Figure 4 As shown in the illustration. According to an embodiment, the screen 521 that is actually displayed to the user as a preview image may correspond to one of the settings in the left-eye image 523a captured by the first camera and the right-eye image 523b captured by the second camera.

[0067] According to various embodiments, in order to match the captured viewpoint and the playback viewpoint, the processor (e.g., Figure 3 The processor 320 can move the viewpoint of one of the images, set in a first direction (e.g., left or right), from a left-eye image 523a captured by the first camera and a right-eye image 523b captured by the second camera by a first set value, and then display it as a preview image. For example, as Figure 5 As shown, when the right-eye image 523b is set as a preview image, the viewpoint of the right-eye image 523b can be moved to the right by a first setting value. Then, the right-eye image 523b with the viewpoint moved to the right by the first setting value can be displayed as a preview image. Since the user adjusts the viewpoint through the preview image to center the object 400 on the screen, it is more intuitive than other images. Figure 4 In comparison, the viewpoints of the left-eye image 523a and right-eye image 523b, which are actually stored as stereoscopic videos, are shifted to the left by a first setting value. The viewpoints of the left-eye image 523a and right-eye image 523b, which are shifted to the left by the first setting value, can become... Figure 4The left-eye image 413a and right-eye image 413b of the stereoscopic video stored in the HMD device 410 have the same viewpoint. Since the user adjusts the viewpoint of the preview image 521 by moving the viewpoint from the right-eye image 523b so that the object 400 is centered in order to capture the object 400, the preview image 521 may have the object 400 centered. The left-eye image 523a and right-eye image 523b captured by the user via the electronic device 101 can be stored in the memory as stereoscopic video. According to an embodiment, when the stereoscopic video stored in the memory is played back for viewing on the HMD device 410, the image 524 perceived by the user through the screen during playback may have the object 400 centered on the screen, the same as the preview image 521 perceived by the user through the screen during capture. For example, the viewpoint of the space perceived by the user when capturing the stereoscopic video via the electronic device 101 and the viewpoint of the screen perceived by the user when playing back the stereoscopic video via the HMD device 410 can be matched with each other.

[0068] Figure 6 This is a view illustrating the calculation of setting values ​​for moving viewpoints according to embodiments of the present disclosure.

[0069] As described above, in order to match the capture viewpoint and the playback viewpoint, the processor (e.g., Figure 3 The processor 320 can move the viewpoint of one of the images, set in a first direction (e.g., left or right), from a left-eye image 523a captured by the first camera and a right-eye image 523b captured by the second camera by a first setting value, and then display it as a preview image.

[0070] Reference Figure 6 The first setting value can be set based on the physical distance (B) between the first camera 381 and the second camera 382 (e.g., baseline), the focal length (f) of the first camera 381 or the second camera 382, ​​and the distance (Z) between the object 400 and the centers of the two cameras 381, 382. For example, the first setting value (Δx) can be set by the following Equation 1.

[0071] [Equation 1]

[0072] According to various embodiments, such as Figure 5 As shown, when the right-eye image 523b is moved by a first setting value and used as a preview image, the image in which the viewpoint of the right-eye image 523b is moved to the right by a first setting value can be displayed as a preview image. According to an embodiment, in order to move the viewpoint of the right-eye image 523b to the right by a first setting value, the processor ( Figure 3 The processor 320 can perform a cropping operation from the right eye image 523b to the left using a first setting value to generate a preview image. Below is... Figure 13 The description details the specific methods for moving and cropping.

[0073] According to various embodiments, when the left-eye image 523a is moved by a first setting value and used as a preview image, the image in which the viewpoint of the left-eye image 523a is moved to the left by a first setting value can be displayed as a preview image. According to an embodiment, in order to move the viewpoint of the left-eye image 523a to the left by a first setting value, the processor ( Figure 3 The processor 320 can perform a cropping operation by moving the left-eye image 523a to the right using a first setting value to generate a preview image. Below is... Figure 13 The description details the specific methods for moving and cropping.

[0074] Figure 7 This is a view illustrating the calculation of setting values ​​for moving viewpoints according to embodiments of the present disclosure.

[0075] Reference Figure 7 According to various embodiments, a second image captured from a second camera corresponding to the right eye can be displayed as a preview image. For example, since the user views the object while the second image corresponding to the right eye is displayed as a preview image, viewpoint mismatch may occur when capturing stereoscopic video. This is described below. Figure 8 In some embodiments, to match the viewpoint, an image in which the viewpoint is moved along a first direction (e.g., left or right) by a first set value from each of the left-eye image captured by the user via the first camera of the electronic device 101 and the right-eye image captured by the second camera can be stored in memory as an image for stereoscopic video. According to various embodiments, the first set value can be determined via the above-described Equation 1.

[0076] Figure 8 This is a view illustrating the concept of a method for matching capture viewpoints and playback viewpoints according to embodiments of the present disclosure.

[0077] Reference Figure 8 According to an embodiment, a user can capture stereoscopic video using an electronic device 101 that does not provide 3D display capabilities (e.g., a smartphone) instead of the HMD device 410. For example, as described above... Figure 2 and Figure 3 As described in the description, the first camera (e.g., one of a plurality of cameras disposed in the electronic device 101) can be used. Figure 3 The first camera (381) is set as the camera corresponding to the left eye and the second camera (e.g., Figure 3 The second camera 382 is configured to capture and store stereoscopic video corresponding to the right eye. When capturing object 400 as stereoscopic video using an electronic device 101 that does not provide 3D display capabilities (e.g., a smartphone), the electronic device 101 can display the image on a monitor (e.g., a digital display). Figure 3The display (360) will display either a first image captured by a first camera corresponding to the left eye or a second image captured by a second camera corresponding to the right eye as a preview image. For example, since the user is viewing the object while holding the electronic device 101 in their hand, the viewpoint (angle of view) of the space 821 perceived by the user through the screen can be a viewpoint where the object 400 is located in the center, such as... Figure 8 As shown in the illustration. According to an embodiment, the screen 822 that is actually displayed to the user as a preview image may correspond to one of the settings (e.g., the right-eye image) between a left-eye image captured by a first camera and a right-eye image captured by a second camera. Since the user adjusts the viewpoint through the preview image 822 so that the object 400 is centered in order to capture the object 400, the right-eye image displayed as a preview image may have the object 400 centered.

[0078] According to various embodiments, in order to match the captured viewpoint and the playback viewpoint, the processor (e.g., Figure 3 The processor 320 can store images in memory that have their viewpoint shifted by a first set value along a first direction (e.g., left or right) from each of the left-eye image 823a captured by the first camera and the right-eye image 823b captured by the second camera as images for stereoscopic video. For example, as Figure 8 As shown, when the right-eye image captured by the second camera is displayed as preview image 822, images in which the viewpoint is shifted to the left by a first set value from each of the left-eye image 823a captured by the first camera and the right-eye image 823b captured by the second camera can be stored in memory as images for stereoscopic video. For example, when the left-eye image captured by the first camera is displayed as preview image 822, images in which the viewpoint is shifted to the right by a first set value from each of the left-eye image 823a captured by the first camera and the right-eye image 823b captured by the second camera can be stored in memory as images for stereoscopic video. According to various embodiments, the first set value can be determined by <Equation 1>.

[0079] According to an embodiment, when playing back a stereoscopic video stored in memory for viewing on an HMD device, the image 824 perceived by the user through the screen during playback may have an object 400 located at the center of the screen, the same as the preview image 822 perceived by the user through the screen during capture. For example, the viewpoint of the space perceived by the user when capturing stereoscopic video through the electronic device 101 and the viewpoint of the screen perceived by the user when playing back stereoscopic video through the HMD device 410 may match each other.

[0080] Figure 9 This is a view illustrating a method of displaying stereoscopic video in an electronic device according to an embodiment of the present disclosure.

[0081] Reference Figure 9 According to an embodiment, a user can play back and watch stereoscopic videos using an electronic device 101 (e.g., a smartphone) that does not provide 3D display functionality, instead of the HMD device 410.

[0082] According to various embodiments, when user input for playing back stereoscopic video is received, the electronic device 101 can selectively output a left-eye image or a right-eye image stored in the memory via a display. The left-eye image or right-eye image is an image used for stereoscopic video, and a mismatch between the viewpoint and the preview image may occur.

[0083] According to various embodiments, the electronic device 101 may additionally store the preview image 822 in a memory. When user input for playback of stereoscopic video is received, the preview image 913 stored in the memory can be played back and output (or displayed) via a display. By storing the preview image 913 separately from the image for stereoscopic video and displaying the preview image 913 according to user input for playback of stereoscopic video, viewpoint mismatch can be avoided.

[0084] According to various embodiments, when user input for playing back stereoscopic video is received, electronic device 101 can selectively output a left-eye image or a right-eye image stored in memory via a display. In this case, electronic device 101 can output (or display) an image whose viewpoint of the left-eye image or right-eye image has shifted by a first set value. By shifting and displaying the viewpoint of the left-eye image or right-eye image according to the user input for playing back stereoscopic video, viewpoint mismatch can be avoided.

[0085] Figure 10 This is a view illustrating an example of a data format for stereoscopic video according to an embodiment of the present disclosure.

[0086] Reference Figure 10 According to various embodiments, the images described above for stereoscopic video can be compressed and stored in memory in the format of Multi-View High-Efficiency Video Coding (MV-HEVC). MV-HEVC can minimize memory storage space by utilizing redundant information between image data. For example, as... Figure 10 As shown, the left-eye image can be stored as a base frame 1010. The right-eye image can be stored as an auxiliary frame 1020. According to various embodiments, the auxiliary frame 1020 can minimize memory storage space by compressing it based on the base frame 1010. For example, the auxiliary frame 1020 can store only the difference between the right-eye image and the left-eye image.

[0087] Figure 11 This is a view illustrating an example of the data format of a stereoscopic video with a preview image added, according to an embodiment of the present disclosure.

[0088] Reference Figure 11 As shown above Figure 10 As described, in MV-HEVC, the left-eye image can be stored as a base frame 1110. The right-eye image can be stored as an auxiliary frame 1120. According to various embodiments, the auxiliary frame 1120 can minimize memory storage space by compressing based on the base frame 1110. For example, the auxiliary frame 1120 can store only the difference between the right-eye image and the left-eye image.

[0089] According to various embodiments, as referred to above Figure 9 As described, the preview image can be additionally stored in the stereoscopic video for viewpoint matching. For example, in the MV-HEVC format, the preview image can be stored as preview frame 1130, which is added to the base frame 1110 and the auxiliary frame 1120.

[0090] Figure 12 This is a view illustrating an example of a header configuration for storing setting values ​​related to viewpoint movement, according to an embodiment of this disclosure.

[0091] Reference Figure 12 As described above, the viewpoint movement amount (e.g., a first setting value) can be stored in the header area of ​​MV-HEVC for viewpoint matching. For example, as Figure 12 As shown, the MV-HEVC header may include a Video Parameter Set (VPS) area 1210, a Sequence Parameter Set (SPS) area 1220, a Picture Parameter Set (PPS) area 1230, and an ETC area 1240. The VPS area 1210 may correspond to the area defining the overall structure of the video stream in the MV-HEVC information stream. The VPS area 1210 may include a VPS fixed data area 1211 and a VPS extended data area 1212. According to various embodiments, viewpoint movement (e.g., a first set value) may be stored in the VPS extended data area 1212.

[0092] According to various embodiments, the storage period for viewpoint movement can be set in various ways. For example, viewpoint movement can be stored all at once in a stereoscopic video file. Viewpoint movement can also be stored for each frame of the stereoscopic video. Viewpoint movement can also be stored non-periodically. For example, when a depth change is detected in the stereoscopic video, viewpoint movement can be stored. According to various embodiments, viewpoint movement can also be stored as metadata in an additional track of MV-HEVC.

[0093] Figure 13 This is a view illustrating the concept of an image adjustment and viewpoint movement method according to an embodiment of the present disclosure.

[0094] Reference Figure 13Both the left-eye image 1301 captured by the first camera and the right-eye image 1302 captured by the second camera can be corrected. Correction may mean projecting the plane of either the left-eye or right-eye image onto a common line parallel to the line between the centers of the cameras. When the corrected left-eye image 1311 and the corrected right-eye image 1312 are images captured by a smartphone, differences in camera performance may occur. For example, the left-eye image 1311 may be an image captured by an ultra-wide-angle lens, and the right-eye image 1312 may be an image captured by a wide-angle lens. According to various embodiments, the electronic device 101 may additionally perform correction to match the resolution and / or viewing angle between the left-eye image 1311 and the right-eye image 1312.

[0095] According to various embodiments, in the correction step, the electronic device 101 can store an image in memory that shifts the viewpoint left by a first set value from each of the left-eye image 823a captured by the first camera and the right-eye image 823b captured by the second camera as an image for stereoscopic video. For example... Figure 13 As shown, the viewpoint of the image can be moved during the correction step by performing a moving cropping operation on the entire image captured by the camera.

[0096] In the following text, refer to Figure 14 and Figure 15 The operation of an electronic device for matching captured viewpoints and playback viewpoints according to various embodiments is described.

[0097] In the following embodiments, each operation may be performed sequentially, but not necessarily sequentially. For example, the order of each operation may be changed, and at least two operations may be performed in parallel.

[0098] Figure 14 This is a flowchart illustrating a method for matching captured viewpoints and playback viewpoints according to an embodiment of the present disclosure.

[0099] Reference Figure 14 Electronic device 101 including multiple cameras (e.g., Figure 2 The electronic device 201 may include a processor 320 (e.g., Figure 1 The processor 120), memory 330 (e.g., Figure 1 The memory 130), the display 360 (e.g., Figure 1 The display module 160) and multiple cameras (e.g., Figure 1 The camera module 180). Multiple cameras may include a first camera 381 (e.g., Figure 2 First camera 221) and second camera 382 (e.g., Figure 2 The second camera (223).

[0100] According to an embodiment, during operation 1402, the processor 320 may receive user input for capturing stereoscopic video.

[0101] According to an embodiment, in operation 1404, the processor 320 may acquire a first image through a first camera and a second image through a second camera based on receiving user input for capturing stereoscopic video.

[0102] According to an embodiment, in operation 1406, the processor 320 can display an image as a preview image by moving the viewpoint from the first image, which is set for the preview image, along a first direction (e.g., left or right) by a first setting value in the first image and the second image.

[0103] Figure 15 This is a flowchart illustrating a method for moving and storing viewpoints when capturing stereoscopic video according to an embodiment of the present disclosure.

[0104] Reference Figure 15 A foldable electronic device 101 including multiple cameras (e.g., Figure 2 The electronic device 201 may include a processor 320 (e.g., Figure 1 The processor 120), memory 330 (e.g., Figure 1 The memory 130), the display 360 (e.g., Figure 1 The display module 160) and multiple cameras (e.g., Figure 1 The camera module 180). Multiple cameras may include a first camera 381 (e.g., Figure 2 First camera 221) and second camera 382 (e.g., Figure 2 The second camera (223).

[0105] According to an embodiment, during operation 1502, the processor 320 in the foldable electronic device 101 can receive user input for capturing stereoscopic video.

[0106] According to an embodiment, in operation 1504, the processor 320 in the foldable electronic device 101 can acquire a first image via a first camera (e.g., a rear camera) and a second image via a second camera (e.g., a front-facing camera) based on receiving user input for capturing stereoscopic video.

[0107] According to an embodiment, during operation 1506, the processor 320 in the foldable electronic device 101 can display the first image as a preview image via a display.

[0108] According to an embodiment, in operation 1508, the processor 320 in the foldable electronic device 101 can store an image in memory as an image for stereoscopic video, in which the viewpoint is moved from each of the first and second images along a first direction by a first set value.

[0109] According to an embodiment, an electronic device may include: a display; a first camera; a second camera; a memory, storing instructions; and at least one processor operatively connected to the display, the first camera, the second camera, and the memory. When executed individually or jointly by the at least one processor, the instructions may cause the electronic device to: acquire a first image via the first camera and acquire a second image via the second camera based on received user input for capturing stereoscopic video; and display an image as a preview image on the display, showing the viewpoint of the first image shifted by a first setting value along a first direction from the first image and the second image for a preview image.

[0110] According to an embodiment, when the instructions are executed by at least one processor individually or jointly, the electronic device can perform the following operation: when the first image is an image corresponding to the left eye, display an image on the screen that moves the viewpoint from the first image to the left by a first set value as a preview image.

[0111] According to an embodiment, the first setting value (Δx) can be determined by the following equation.

[0112]

[0113] Here, B represents the physical distance between the first camera and the second camera, f represents the focal length of the first camera or the second camera, and z represents the distance between the object and the center of the first camera and the second camera.

[0114] According to an embodiment, when the instructions are executed by at least one processor individually or jointly, the electronic device can perform the following operations: storing a first image and a second image in a memory as images for stereoscopic video; and displaying an image on a screen, based on user input received for playing back the stereoscopic video, in which the viewpoint moves from the first image or the second image stored in the memory along a first direction by a first set value.

[0115] According to an embodiment, the images used for stereoscopic video can be compressed in the format of Multi-View High-Efficiency Video Coding (MV-HEVC) and stored in memory.

[0116] According to an embodiment, the first setting value can be stored in the header area of ​​MV-HEVC.

[0117] According to an embodiment, the first setting value can be stored as metadata in an additional track of MV-HEVC.

[0118] According to an embodiment, the instructions, when executed by at least one processor individually or jointly, enable an electronic device to perform the following operations: store a preview image in a memory; and display the preview image stored in the memory on a display based on user input received for playback of stereoscopic video.

[0119] According to an embodiment, a method for controlling an electronic device includes: identifying and receiving user input for capturing stereoscopic video; based on identifying the received user input for capturing stereoscopic video, acquiring a first image via a first camera and acquiring a second image via a second camera; and displaying an image whose viewpoint is moved from the first image to the second image along a first direction by a first set value as a preview image via a display.

[0120] According to an embodiment, the method may include: when the first image is an image corresponding to the left eye, displaying an image on a monitor in which the viewpoint is moved to the left by a first set value from the first image as a preview image.

[0121] According to an embodiment, the first setting value (Δx) can be determined by the following equation.

[0122]

[0123] Here, B represents the physical distance between the first camera and the second camera, f represents the focal length of the first camera or the second camera, and z represents the distance between the object and the center of the first camera and the second camera.

[0124] According to an embodiment, the method may include: storing a first image and a second image in a memory as images for stereoscopic video; and displaying an image on a screen, based on user input received for playing back the stereoscopic video, in which the viewpoint moves from the first image or the second image stored in the memory along a first direction by a first set value.

[0125] According to an embodiment, the images used for stereoscopic video can be compressed in the format of Multi-View High-Efficiency Video Coding (MV-HEVC) and stored in memory.

[0126] According to an embodiment, the first setting value can be stored in the header area of ​​MV-HEVC.

[0127] According to an embodiment, the first setting value can be stored as metadata in an additional track of MV-HEVC.

[0128] According to an embodiment, the method may include: storing a preview image in a memory; and displaying the preview image stored in the memory on a display based on user input received for playing back stereoscopic video.

[0129] According to an embodiment, an electronic device may include: a display; a first camera; a second camera; a memory, storage instructions; and at least one processor operatively connected to the display, the first camera, the second camera, and the memory. When executed individually or jointly by the at least one processor, the instructions cause the electronic device to: acquire a first image via the first camera and acquire a second image via the second camera based on received user input for capturing stereoscopic video; display the first image as a preview image via the display; and store an image in the memory as an image for stereoscopic video, in which the viewpoint is moved from each of the first and second images along a first direction by a first set value.

[0130] According to an embodiment, when the instructions are executed by at least one processor individually or jointly, the electronic device can perform the following operation: when the first image is an image corresponding to the left eye, the image in which the viewpoint is shifted to the left by a first set value from each of the first and second images is stored in memory as an image for stereoscopic video.

[0131] According to an embodiment, the first setting value (Δx) can be determined by the following equation.

[0132]

[0133] Here, B represents the physical distance between the first camera and the second camera, f represents the focal length of the first camera or the second camera, and z represents the distance between the object and the center of the first camera and the second camera.

[0134] According to an embodiment, the images used for stereoscopic video can be compressed in the format of Multi-View High-Efficiency Video Coding (MV-HEVC) and stored in memory.

[0135] The electronic devices according to the various embodiments disclosed in this disclosure can be of various types. Electronic devices may include, for example, portable communication devices (e.g., smartphones), computer devices, portable multimedia devices, portable medical devices, cameras, wearable devices, or home appliances. The electronic devices according to embodiments of this disclosure are not limited to those described above.

[0136] The various embodiments of this disclosure and the terminology used therein are not intended to limit the technical features described herein to specific embodiments, but should be understood to include various modifications, equivalents, or alternatives to the respective embodiments. In the description of the drawings, similar reference numerals may be used to refer to similar or related elements. Singular nouns corresponding to items may include one or more items unless the relevant context clearly indicates otherwise. In this disclosure, each of the phrases such as “A or B,” “at least one of A and B,” “at least one of A or B,” “A, B, or C,” “at least one of A, B, and C,” and “at least one of A, B, or C” may include any one of the items listed together in the corresponding phrase or all possible combinations thereof. Terms such as “first” or “second” may be used only to distinguish one component from another and do not limit the corresponding component in other respects (e.g., importance or order). When the terms “functionally” or “communically” are used, or when the terms “functionally” or “communically” are not used, when a predetermined (e.g., first) component is referred to as “connected” or “linked” to another (e.g., second) component, it may mean that the predetermined component can be directly (e.g., wired) connected to the other component, wirelessly connected to the other component, or connected to the other component via a third component.

[0137] The term "module" as used in the various embodiments of this disclosure may include a unit implemented as hardware, software, or firmware, and may be used interchangeably with terms such as, for example, logic, logic block, component, or circuit. A module may be a component of an integrated configuration that performs one or more functions, or the smallest unit or part of such a component. For example, according to an embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).

[0138] Various embodiments of this disclosure can be implemented as software (e.g., program 140) including one or more instructions stored in a storage medium (e.g., internal memory 136 or external memory 138) readable by a machine (e.g., electronic device 101). For example, a processor (e.g., processor 120) of the machine (e.g., electronic device 101) can invoke and execute at least one of the stored instructions from the storage medium. This enables the machine to operate to perform at least one function according to the invoked at least one instruction. The one or more instructions may include code generated by a compiler or code executable by an interpreter. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. Here, "non-transitory" simply means that the storage medium is a tangible device and does not include signals (e.g., electromagnetic waves), and the term does not distinguish between cases where data is semi-permanently stored in the storage medium and cases where data is temporarily stored.

[0139] According to embodiments, methods according to various embodiments disclosed herein may be included and incorporated into a computer program product. The computer program product may be traded as a commodity between a seller and a buyer. The computer program product may be distributed in the form of a machine-readable storage medium (e.g., a read-only optical disc (CD-ROM)) or through an app store (e.g., the Play Store). TM Online distribution (e.g., downloading or uploading) or direct distribution between two user devices (e.g., smartphones). In the case of online distribution, at least a portion of the computer program product may be temporarily stored or temporarily generated in a machine-readable storage medium (such as the memory of a manufacturer's server, an app store's server, or a relay server).

[0140] According to various embodiments, each component (e.g., a module or program) of the components described above may include a single entity or multiple entities, and some of the multiple entities may be separately located in another component. According to various embodiments, one or more components or operations in the corresponding components described above may be omitted, or one or more other components or operations may be added. Optionally or additionally, multiple components (e.g., modules or programs) may be integrated into a single component. In this case, the integrated component may perform one or more functions of the corresponding components in the multiple components in the same or similar manner as each of the multiple components performed its function before integration. According to various embodiments, operations performed by a module, program, or other component may be performed sequentially, in parallel, repeatedly, or heuristically, or may be run in a different order, omit one or more operations, or add one or more other operations.

Claims

1. An electronic device comprising: monitor; First camera; Second camera; Memory, storing instructions; as well as At least one processor is operatively connected to the display, the first camera, the second camera, and the memory, wherein the instructions, when executed individually or jointly by the at least one processor, cause the electronic device to perform the following operations: Based on the received user input for capturing stereoscopic video, a first image is acquired through the first camera and a second image is acquired through the second camera; as well as The display shows an image in which the viewpoint is moved along a first direction by a first setting value from the first image and the second image, which are set for a preview image.

2. The electronic device as claimed in claim 1, wherein, When the instructions are executed individually or jointly by the at least one processor, the electronic device performs the following operation: when the first image is an image corresponding to the left eye, the display shows an image whose viewpoint is shifted to the left of the first image by the first set value as a preview image.

3. The electronic device as claimed in claim 1, wherein, The first setting value Δx is determined by the following equation: Where B represents the physical distance between the first camera and the second camera, f represents the focal length of the first camera or the second camera, and z represents the distance between the object and the center of the first camera and the second camera.

4. The electronic device as claimed in claim 1, wherein, When the instructions are executed individually or jointly by the at least one processor, the electronic device performs the following operations: The first image and the second image are stored in the memory as images for stereoscopic video. Based on the user input received for playing back stereoscopic video, the display shows an image in which the viewpoint moves from the first image or the second image stored in the memory along a first direction by the first set value.

5. The electronic device as claimed in claim 4, wherein, Images used for stereoscopic video are compressed in the Multi-View High Efficiency Video Coding (MV-HEVC) format and stored in the memory.

6. The electronic device as claimed in claim 5, wherein, The first setting value is stored in the header area of ​​the MV-HEVC.

7. The electronic device as claimed in claim 5, wherein, The first setting value is stored as metadata in an additional track of the MV-HEVC.

8. The electronic device as claimed in claim 1, wherein, When the instructions are executed individually or jointly by the at least one processor, the electronic device performs the following operations: Store the preview image in the memory, and Based on the user input received for playing back the stereoscopic video, a preview image stored in the memory is displayed on the monitor.

9. A method for controlling an electronic device, comprising: Recognize and receive user input for capturing stereoscopic video; Based on the recognition of the received user input for capturing stereoscopic video, a first image is acquired through a first camera and a second image is acquired through a second camera; as well as The image is displayed as a preview image by moving the viewpoint from the first image (set to a first setting value for the preview image) along a first direction to the first image and the second image (set to a first setting value for the preview image).

10. The control method as described in claim 9, comprising: When the first image is the image corresponding to the left eye, the image whose viewpoint is moved to the left by the first setting value is displayed as a preview image on the display.

11. The control method as described in claim 9, wherein, The first setting value Δx is determined by the following equation: Where B represents the physical distance between the first camera and the second camera, f represents the focal length of the first camera or the second camera, and z represents the distance between the object and the center of the first camera and the second camera.

12. The control method as described in claim 9, comprising: The first image and the second image are stored in the memory as images for stereoscopic video; as well as Based on the user input received for playing back stereoscopic video, the display shows an image in which the viewpoint moves from the first image or the second image stored in the memory along a first direction by the first set value.

13. The control method as described in claim 12, wherein, Images used for stereoscopic video are compressed in the Multi-View High Efficiency Video Coding (MV-HEVC) format and stored in the memory.

14. The control method as described in claim 13, wherein, The first setting value is stored in the header area of ​​the MV-HEVC.

15. An electronic device comprising: monitor; First camera; Second camera; Memory, storing instructions; as well as At least one processor is operatively connected to the display, the first camera, the second camera, and the memory, wherein the instructions, when executed individually or jointly by the at least one processor, cause the electronic device to perform the following operations: Based on the received user input for capturing stereoscopic video, a first image is acquired through the first camera and a second image is acquired through the second camera; The first image is displayed as a preview image on the display; and Images whose viewpoints are moved along a first direction by a first set value from each of the first and second images are stored in the memory as images for stereoscopic video.

Images