Foldable electronic device for multi-view image capture

Abstract

Methods, systems, and devices are provided for automatically adjusting the positions of image sensors and generating a multi-view image based on image data captured from the image sensors. For example, an image capture device comprises a housing including a first housing portion and a second housing portion, wherein a first sensor is coupled to the first housing portion and a second sensor is coupled to the second housing portion. A coupling device, such as a hinge, couples the first housing portion to the second housing portion. The image capture device acquires image data from the first sensor and the second sensor and determines an object depth based on the acquired image data. The image capture device outputs an adjusted angle based on the object depth and acquires additional image data from the first sensor and the second sensor. The image capture device generates a multi-view image based on the additional image data.

Description

Technology Field

[0001] The present disclosure generally relates to imaging devices, and more specifically, to foldable display devices having image capture capabilities. Background Technology

[0002] Image capture devices, such as phones, tablets, and smart devices, may include an external facing camera to capture images. For example, the camera may be positioned on an external surface facing an inwardly facing surface, where the inwardly facing surface includes a display. Images captured from the camera on the externally facing surface are provided on the display. Image capture devices may also include a camera on the inwardly facing surface to enable, for example, the capture of "selfies." Some of these image capture devices include foldable displays. Each side of the foldable display includes an external surface and an inwardly facing surface. Image capture devices having foldable displays may include one or more cameras on each of the externally facing surfaces.

[0003] Additionally, image capture devices employ various signal-processing techniques in an attempt to render high-quality images. For example, image capture devices can automatically focus their lenses for image sharpness, automatically set exposure times based on light levels, and automatically adjust white balance to accommodate the color temperature of the light source. In some examples, an image capture device can generate a multi-view image based on images captured from multiple cameras. In some examples, image capture devices include facial detection technology. Facial detection technology enables the image capture device to identify faces within the field of view of the camera lens. Subsequently, the image capture device can apply various signal processing techniques based on the identified faces.

[0004] According to one aspect, a method for operating an image capture device includes the step of acquiring first image data from a first sensor coupled to a first housing portion of the housing of the image capture device. The method also includes the step of acquiring second image data from a second sensor coupled to a second housing portion of the housing. The method further includes the step of determining the depth of an object based on the first image data and the second image data. The method also includes the step of outputting an adjusted angle between the first housing portion and the second housing portion based on the determined depth. Additionally, the method includes the step of performing an image capture operation in response to the adjustment.

[0005] According to another aspect, the image capture device comprises a housing including a first housing portion and a second housing portion. The image capture device also comprises a non-transient machine-readable storage medium for storing commands, and at least one processor coupled to the non-transient machine-readable storage medium. The at least one processor is configured to execute commands to acquire first image data from a first sensor coupled to the first housing portion of the housing. The processor is also configured to execute commands to acquire second image data from a second sensor coupled to the second housing portion of the housing. Additionally, the processor is configured to execute commands to determine the depth of an object based on the first image data and the second image data. The processor is also configured to execute commands to output an adjusted angle between the first housing portion and the second housing portion based on the depth. The processor is further configured to execute commands to perform an image capture operation based on the adjusted angle.

[0006] According to another aspect, a non-transient machine-readable storage medium stores instructions, and when the instructions are executed by at least one processor, the at least one processor performs operations including: acquiring first image data from a first sensor coupled to a first housing portion of the housing of the image capture device; acquiring second image data from a second sensor coupled to a second housing portion of the housing; determining the depth of an object based on the first image data and the second image data; outputting an adjusted angle between the first housing portion and the second housing portion based on the depth; and performing an image capture operation based on the adjusted angle.

[0007] According to another aspect, an image capture device comprises: means for acquiring first image data from a first sensor coupled to a first housing portion of the housing of the image capture device; means for acquiring second image data from a second sensor coupled to a second housing portion of the housing; means for determining the depth of an object based on the first image data and the second image data; means for outputting an adjusted angle between the first housing portion and the second housing portion based on the depth; and means for performing an image capture operation based on the adjusted angle. Brief explanation of the drawing

[0008] FIG. 1 is a block diagram of an exemplary image capture device according to some implementations;

[0009] FIG. 2 is a block diagram illustrating exemplary components of an image capture device of FIG. 1 according to some implementations;

[0010] FIGS. 3A, 3B, 3C, and 3D are diagrams illustrating components of an exemplary image capture device according to some implementations;

[0011] FIGS. 4a, 4b, 4c, and 4d are diagrams illustrating an exemplary image capture device having a foldable display according to some implementations;

[0012] FIGS. 5 and 6 are flowcharts of exemplary processes for performing an image capture operation in an image capture device according to some implementations; and

[0013] FIG. 7 is a flowchart of an exemplary process for generating a user-composed image in an image capture device according to some implementations. Specific details for implementing the invention

[0014] Although the features, methods, devices, and systems described herein may be implemented in various forms, some exemplary and non-limiting embodiments are illustrated in the drawings and described below. Some of the components described in this disclosure are optional, and some implementations may include additional, different, or fewer components from those explicitly described in this disclosure.

[0015] In some implementations, the image capture device may be foldable and may include a foldable display along an inner surface. For example, the image capture device may be foldable along a central portion comprising one or more coupling devices (e.g., hinges), and the central portion may separate a first portion of the image capture device (e.g., left) from a second portion of the image capture device (e.g., right). Each of the first portion and the second portion may include an inner surface and an outer surface (e.g., a first inner surface and a second inner surface). For example, when the image capture device is shut (e.g., closed), the first portion and the second portion of the image capture device move toward each other, so that each of the inner surfaces may face each other. When blocked, the outer surfaces of the first and second parts face outward, and the inner surfaces of the first and second parts may define the boundaries of the cavity or void space or bound the cavity or void space (e.g., they may form a cavity). The foldable display may also include a corresponding portion along the respective inner surfaces of the first and second parts of the image capture device. The inner surfaces (and the foldable display) may be provided on the "user-facing" side of the image capture device.

[0016] The image capture device may include one or more cameras on the inner surface of a first part and one or more cameras on the inner surface of a second part. In some examples, the image capture device may include one or more cameras on the outer surface of the first part. In some examples, the image capture device may include one or more cameras on the outer surface of the second part.

[0017] The image capture device can capture image data from each of the cameras. For example, the image capture device can capture first image data from a first camera positioned on the inner surface of a first part (i.e., the first inner surface) and can also capture second image data from a second camera positioned on the inner surface of a second part (i.e., the second inner surface). The first camera and the second camera can collectively form a stereo camera (e.g., left and right cameras).

[0018] The image capture device can determine the depth of an object based on first image data and second image data. For example, the image capture device can identify an object in the respective field of view (FOV) of the first camera and the second camera, and select a lens position that provides a focus value for a region of interest (ROI) containing the object. Based on the determined depth, the image capture device can automatically adjust one or more coupling devices to change the angle separating the first part and the second part (i.e., the angle of one or more coupling devices). In response to the adjustment, the angle may increase (e.g., when the image capture device is opened) or decrease (e.g., when the image capture device is closed).

[0019] In some examples, the image capture device provides a visual or audible indication to the user of the image capture device to adjust the angle (e.g., by further closing or further opening the image capture device).

[0020] In some examples, the image capture device determines the current angle and adjusts the angle based on the depth value and the current angle.

[0021] In some examples, the image capture device determines the depth of objects based on camera parameters. The camera parameters may include intrinsic and extrinsic parameters for each camera. The intrinsic and extrinsic parameters may be predetermined and stored in a data storage maintained by the image capture device (e.g., in a non-transient memory of a certain type).

[0022] Intrinsic parameters can characterize the transformation from image plane coordinates to pixel coordinates for each of the first camera and the second camera. For example, intrinsic parameters may include focal length, image sensor format, and principal point for each of the first camera and the second camera. Extrinsic parameters characterize the relative position and orientation of each of the first camera or the second camera. For example, extrinsic parameters may include a rotation matrix and a translation matrix that characterize the relative position and orientation of one or more of the first camera and the second camera, respectively. For example, a translation matrix can identify the translation of a reference frame from one camera to a reference frame for the other camera. For example, a first translation matrix can identify the translation of a reference frame from the first camera to the second camera, and a second translation matrix can identify the translation of a reference frame from the second camera to the first camera. A rotation matrix can identify the rotation of a reference frame from one camera to a reference frame for the other camera. For example, the first rotation matrix can identify the rotation of a reference frame from the first camera to the second camera, and the second rotation matrix can identify the rotation of a reference frame from the second camera to the first camera.

[0023] Additionally, extrinsic parameters may include baseline lengths for the first camera and the second camera. The baseline length may define the distance between the optical centers of the first camera and the second camera. In some examples, the greater the angle between the first inner surface and the second inner surface, the greater the baseline length between the first camera and the second camera. For example, a first angle between the first inner surface and the second inner surface of the image capture device may set a first baseline length between the first camera and the second camera, and a second angle between the first inner surface and the second inner surface of the image capture device may set a second baseline length between the first camera and the second camera. For instance, if the first angle happens to exceed the second angle, the set first baseline length may also exceed the corresponding second baseline length and be greater than the corresponding second baseline length.

[0024] An image capture device can align first image data from a first camera with second image data from a second camera based on rotation matrices, translation matrices, and additionally or alternatively, baseline lengths. For example, for a given angle between a first inner surface and a second inner surface, external parameters can specify rotation matrices and translation matrices for each of the first camera and the second camera, as well as corresponding baseline lengths. The image capture device can determine a current angle and align first image data from the first camera with second image data from the second camera based on rotation matrices, translation matrices, and additionally or alternatively, baseline lengths corresponding to the current angle. In some examples, the image capture device can determine external parameters during calibration of each of the first camera and the second camera prior to use.

[0025] The image capture device may also identify features (e.g., objects) in each of the first image data and the second image data. According to some examples, pixels having features (e.g., edges, brightness, color) in the first image data are matched with pixels having corresponding features in the second image data. Based on the matched pixels in the first and second image data, the image capture device may generate a disparity map (e.g., a stereoscopic depth map) using any technique known in the art. The disparity map may, for example, encode the difference in the horizontal coordinates of the corresponding features and may include disparity values, each of which is inversely proportional to the scene depth at the corresponding pixel location.

[0026] The image capture device can compute depth values ​​based on the intrinsic parameters of the first camera and the second camera, respectively. For example, the image capture device can determine depth values ​​based on the focal length, image sensor format, and principal point of the first camera and the second camera, respectively. In some examples, the image capture device can compute depth values ​​based on rotation matrices for the first camera and the second camera. In some examples, the image capture device computes depth values ​​based on features classified within the first image data acquired from the first camera and within the second image data acquired from the second camera, and based on parts of a disparity map. The image capture device can also compute depth values ​​based, among others, the focal length of the first camera, the focal length of the second camera, a combination of the focal lengths of the first camera and the second camera, the corresponding baseline length, and parts of a disparity map.

[0027] In some examples, the computing device includes a housing having a first part and a second part, wherein the first part forms a certain angle with respect to the second part. Additionally, the first part of the housing may include a first sensor, and the second part of the housing may include a second sensor. The computing device determines a first angle between the first part and the second part of the housing, and additionally, may determine a baseline length between the first sensor and the second sensor based on the first angle. Additionally, the computing device may determine the focal length of at least one of the first sensor and the second sensor. The computing device may generate depth values ​​based on the baseline length, the focal length, and parts of a disparity map.

[0028] Additionally, the image capture device can adjust the angle between the first inner surface and the second inner surface based on the computed depth values. For example, the image capture device can identify an object based on classified features as described above and compute depth values ​​for the object. The image capture device can compute the object depth for the object based on the depth values. Additionally, the image capture device can determine a desired baseline length between the first camera and the second camera for capturing an image of the identified object based on the object depth. For example, the image capture device can compute a larger baseline length for an object with a larger object depth and a smaller baseline length for an object with a smaller object depth. In some examples, the image capture device maintains one or more tables in the memory device that identify the matching of desired baseline lengths to object depths for a specific object. For example, the first table can identify a desired baseline length for each of multiple object depths for an object classified as a "face," and the second table can identify a desired baseline length for each of multiple object depths for an object classified as a "tree."

[0029] Based on a desired baseline length, the image capture device can determine an adjustment for the angle between a first inner surface and a second inner surface. For example, the image capture device can determine a current baseline length between a first camera and a second camera, and determine an angle adjustment amount by comparing the current baseline length with a desired baseline length. The image capture device can adjust the angle based on the determined angle adjustment amount.

[0030] In some examples, after the angle is adjusted, the image capture device captures third image data from the first camera and fourth image data from the second camera, and generates a multi-view image based on the third image data and the fourth image data. For example, the image capture device may identify features in the third image data and the fourth image data and generate a second disparity map based on the identified features. The image capture device may generate a multi-view image based on the third image data, the fourth image data, and parts of the second disparity map using any known technique. The multi-view image may include, for example, a three-dimensional (3D) image. In additional examples, the multi-view image may include a "high dynamic range" image or a "non-high dynamic range" image.

[0031] In some examples, the image capture device may periodically determine whether the angle needs to be adjusted while the user is capturing an image of the scene. For example, the image capture device may periodically acquire image data from each of the first camera and the second camera, and may adjust the angle as described herein up to a predetermined amount of time before the image data is captured to generate a multi-view image.

[0032] In some embodiments, the image capture device may determine an ROI after adjusting the angle for improved automatic focus (AF), automatic exposure (AE), automatic gain (AG), or automatic white balance (AWB) control. For example, the image capture device may adjust the angle as described herein, identify a feature that is a subject (e.g., within the third image data and additional image data), and determine an ROI that includes the face of the subject. Subsequently, the image capture device may determine (e.g., adjust, apply) one or more of AF, AE, AG, or AWB control based on the image data within the ROI.

[0033] In some examples, the image capture device may provide automated image capture enhancements (e.g., 3D image enhancements) to the multi-view image generated in response to angle adjustment. For example, the image capture device may generate a user-configured image by applying light effects to the multi-view image. The user may select light effects for image capture, for example. Examples of light effects include color shifts, segmentation effects (e.g., depth of field effects), bokeh effects, blue screening, object filters, such as face filters, augmented reality (AR), virtual reality (VR), and averaging effects. An averaging effect may, for example, average the color channel values ​​of all or a selected group of pixels within two different images. A depth of field effect (e.g., bokeh effect) may depend on the color channel values ​​of the pixels of the third image data and the pixels of the fourth image data.

[0034] FIG. 1 is a block diagram of an exemplary image capture device (100). The functions of the image capture device (100) may be implemented with one or more processors, one or more field-programmable gate arrays (FPGAs), one or more application-specific integrated circuits (ASICs), one or more state machines, digital circuitry, any other suitable circuitry, or any suitable hardware.

[0035] In this example, the image capture device (100) includes at least one processor (160) operably coupled (e.g., communicating with) the camera optical and sensor (115A) and the camera optical and sensor (115B) to capture corresponding images. The camera optical and sensor (115A and 115B) may each include one or more image sensors and one or more lenses to capture images. The camera optical and sensor (115A) may be placed in a first part (117A) of the image capture device (100), and the camera optical sensor (115B) may be placed in a second part (117B) of the image capture device (100). Each of the camera optical and sensor (115A and 115B) may be based on, for example, a time-of-flight (TOF) or structured light (e.g., infrared, random dot projection) image capture system. The processor (160) is also operably coupled to a hinge control unit (119) capable of enabling control (e.g., mechanical adjustment) of the hinge angle of the hinge connecting the first part (117A) to the second part (117B). For example, the processor (160) can control the hinge control unit (119) to adjust the hinge angle from 0 degrees to 180 degrees (including these).

[0036] The processor (160) may also be operably coupled to the instruction memory (130), working memory (105), input device (170), transceiver (111), foldable display (125), and storage medium (110). The input device (170) may be, for example, a keyboard, touchpad, stylus, touchscreen, or any other suitable input device.

[0037] The image capture device (100) may be implemented as a computer having image capture capabilities, a special-purpose camera, a multi-purpose device capable of performing imaging and non-imaging applications, or any other suitable device. For example, the image capture device (100) may include a portable personal computing device, such as a mobile phone (e.g., a smartphone), a tablet, a personal digital assistant, or any other suitable device.

[0038] The processor (160) may also include one or more processors. For example, the processor (160) may include one or more central processing units (CPUs), one or more graphics processing units (GPUs), one or more digital signal processors (DSPs), one or more image signal processors (ISPs), one or more device processors, and / or any other suitable processors. The processor (160) may also perform various image capture operations on the received image data to execute AF, AG, AE, and / or AWB. Additionally, the processor (160) may perform various management tasks, such as controlling the foldable display (125) to display the captured images, or writing data to the working memory (105) or storage medium (110), or reading data from the working memory (105) or storage medium (110). For example, the processor (160) can obtain intrinsic parameters (167) and extrinsic parameters (169) for each camera from the storage medium (110). The storage medium (110) can also store image capture parameters for image capture operations, such as AF, AE, and / or AWB parameters. The processor (160) can apply AF, AE, and / or AWB based on the image capture parameters.

[0039] The processor (160) can store the captured images in the storage medium (110). For example, the processor (160) can acquire image sensor data (165) from camera optics and sensors (115A, 115B) and can store the acquired image sensor data (165) in the storage medium (110).

[0040] In some examples, the processor (160) can apply light effects to the captured images. For example, the processor (160) can apply color shifts, depth of field (e.g., bokeh effects), augmented reality (AR), virtual reality (VR), and averaging effects to the captured images.

[0041] In some instances, the transceiver (111) may enable communication between the image capture device (100) and one or more network-connected computing systems or devices across a communication network using any suitable communication protocol. Examples of these communication protocols include, but are not limited to, cellular communication protocols, such as CDMA® (code-division multiple access), GSM® (Global System for Mobile Communication) or WCDMA® (Wideband Code Division Multiple Access), and / or wireless local area network protocols, such as WiFi® (IEEE 802.11) or WiMAX® (Worldwide Interoperability for Microwave Access).

[0042] The processor (160) can control each of the camera optical device and sensor (115A, 115B) to capture images. For example, the processor (160) can command the camera optical device and sensor (115A) to initiate the capture of an image and to capture corresponding image data (e.g., to take a photograph), and the processor (160) can receive the captured image data from the camera optical device and sensor (115A). Similarly, the processor (160) can command the camera optical device and sensor (115B) to initiate the capture of an additional image and to capture corresponding image data, and the processor (160) can receive the captured image data from the camera optical device and sensor (115B).

[0043] In some examples, the camera optical unit and sensor (115A), the storage medium (110), and the processor (160) provide means for capturing first image data from a first front-facing camera disposed within a first internal portion (e.g., the first portion (117A)) of a foldable display (e.g., the foldable display (125)). In some examples, the camera optical unit and sensor (115B), the storage medium (110), and the processor (160) provide means for capturing second image data from a second front-facing camera disposed within a second internal portion (e.g., the second portion (117B)) of a foldable display (e.g., the foldable display (125)).

[0044] The instruction memory (130) can store instructions that can be accessed (e.g., read) and executed by the processor (160). For example, the instruction memory (130) may include ROM (read-only memory), such as EEPROM (electrically erasable programmable read-only memory), flash memory, removable disk, CD-ROM, any non-volatile memory, or any other suitable memory.

[0045] The processor (160) can store data in the working memory (105) and read data from the working memory (105). For example, the processor (160) can store instructions of a working set, such as instructions loaded from the instruction memory (130), in the working memory (105). The processor (160) can also use the working memory (105) to store dynamic data generated during the operation of the image capture device (100). The working memory (105) may be random access memory (RAM), such as static random access memory (SRAM) or dynamic random access memory (DRAM), or any other suitable memory.

[0046] In this example, the command memory (130) stores capture control commands (135), autofocus (AF) commands (140), automatic white balance (AWB) commands (141), automatic exposure (AE) commands (142), automatic gain (AG) commands (148), image processing commands (143), face detection engine (144), depth determination engine (146), hinge angle control engine (147), luminance detection engine (149), luminance-based dynamic range detection engine (151), light effects engine (153), and operating system commands (145). The command memory (130) may also include additional commands that configure the processor (160) to perform various image processing and device management tasks.

[0047] AF commands (140) may include commands that cause the lens of the camera optical unit and sensor (115A or 115B) to adjust the corresponding lens position when executed by the processor (160). For example, the processor (160) may cause the lens of the camera optical unit and sensor (115A) to be adjusted so that light from the ROI within the FOV of the imaging sensor is focused on the plane of the sensor. The selected ROI may correspond to one or more focus points of the AF system. AF commands (140) may include commands that cause the processor (160) to perform autofocus operations, such as finding the optimal lens position to focus light from the ROI on the plane of the sensor when executed by the processor (150). Autofocus may include, for example, phase detection autofocus (PDAF), contrast autofocus, or laser autofocus.

[0048] AWB commands (141) may include commands that, when executed by the processor (160), cause the processor (160) to determine color correction to be applied to the image. For example, the executed AWB commands (141) may cause the processor (160) to determine the average color temperature of the illumination light source—under which the camera optical device and sensor (115A) or the camera optical device and sensor (115B) has captured an image—and to scale the color components (e.g., R, G, and B) of the captured image so that they conform to the light on which the image will be displayed or printed. Additionally, in some examples, the executed AWB commands (141) may cause the processor (160) to determine the illumination light source in the ROI of the image. Next, the processor (160) can apply color correction to the image based on the determined color temperature of the lighting light source in the ROI of the image.

[0049] The AG commands (148) may include commands that cause the processor (160) to determine gain correction to be applied to an image when executed by the processor (160). For example, the executed AG commands (148) may cause the processor (160) to amplify a signal received from the lens of the camera optical device and sensor (115A) or the camera optical device and sensor (115B). The executed AG commands (148) may also cause the processor (160) to adjust pixel values ​​(e.g., digital gain).

[0050] AE commands (142), when executed by the processor (160), may include commands that cause the processor (160) to determine the length of time that one or more sensing elements, such as the imaging sensor of the camera optical sensor (115A) or the camera optical sensor (115B), incorporate light before capturing an image. For example, the executed AE commands (142) may cause the processor (160) to measure ambient light and select an exposure time for the lens based on the measurement of ambient light. As the ambient light level increases, the selected exposure time becomes shorter, and as the ambient light level decreases, the selected exposure time becomes longer. For example, in the case of a digital single-lens reflex (DSLR) camera, the executed AE commands (142) may cause the processor (160) to determine the exposure speed. In additional examples, the executed AE commands (142) may cause the processor (160) to measure ambient light in the ROI of the field of view of either the camera optical device and sensor (115A) or the camera optical device and sensor (115B).

[0051] The capture control commands (135), when executed by the processor (160), may include commands that cause the processor (160) to adjust the lens position, set the exposure time, set the sensor gain, and / or configure the white balance filter of the image capture device (100). The capture control commands (135) may further include commands that control the overall image capture functions of the image capture device (100) when executed by the processor (160). For example, the executed capture control commands (135) may cause the processor (160) to execute AF commands (140), which cause the processor (160) to calculate the lens or sensor movement to achieve a desired autofocus position and output a lens control signal to control the lens of the camera optical device and sensor (115A) or the camera optical device and sensor (115B).

[0052] The operating system (145) may include instructions that cause the processor (160) to implement the operating system when executed by the processor (160). The operating system may act as an intermediary between programs, such as user applications, and the processor (160). The operating system instructions (145) may include device drivers for managing hardware resources, such as camera optics and sensors (115A or 115B), a foldable display (125), or a transceiver (111). Additionally, one or more of the executed image processing instructions (143), as discussed herein, may interact indirectly with the hardware resources through standard subroutines or APIs (application programming interfaces) that may be included in the operating system instructions (145). Subsequently, the executed instructions of the operating system (145) may interact directly with these hardware components.

[0053] The face detection engine (144) may include commands that, when executed by the processor (160), cause the processor (160) to initiate facial detection on image data representing one or more subjects within the field of view of the image capture device (100). For example, the processor (160) may execute the face detection engine (144) to determine the ROI within the field of view of the lens of the camera optical device and sensor (115) that includes one or more faces of the corresponding subjects. In some instances, the face detection engine (144) may acquire raw image sensor data of an image within the field of view of the lens of the camera optical device and sensor (115A) or the camera optical device and sensor (115B) when executed by the processor (160). The executed face detection engine (144) may also initiate face detection and determine whether one or more faces of the subjects are in the field of view, for example, by performing facial detection operations locally within the processor (160). Facial detection operations may include, but are not limited to, performing computations to determine whether the field of view of the image capture device (100) includes one or more faces, and if so, to determine (e.g., and identify) an area (e.g., ROI) in the FOV that includes one or more faces.

[0054] The depth determination engine (146), when executed by the processor (160), may include instructions that cause the processor (160) to determine depth based on image data captured by the camera optical device and sensor (115A) or the camera optical device and sensor (115B). For example, the processor (160) may execute the depth determination engine (146) to identify features in the first image data captured by the camera optical device and sensor (115A) and the second image data captured by the camera optical device and sensor (115B). Additionally, based on the execution of the depth determination engine (146), the processor (160) generates a disparity map using any technique known in the art. The disparity map may include depth values ​​that identify the scene depth at each corresponding pixel location, such as at pixel locations corresponding to each identified feature.

[0055] Image processing commands (143) may include commands that, when executed, cause the processor (160) to perform one or more image processing operations involving captured image data, such as (but not limited to) demosaicing, noise reduction, cross-talk reduction, color processing, gamma adjustment, image filtering (e.g., spatial image filtering), lens artifact or defect correction, image sharpening, or other image processing functions. Additionally, the executed image processing commands (143) may generate a multi-view image, such as a 3D image, based on the first image data captured by the camera optical device and sensor (115A), the second image data captured by the camera optical device and sensor (115B), and the generated depth values.

[0056] The hinge angle control engine (147), when executed by the processor (160), may include commands that cause the processor (160) to adjust the hinge angle, such as the hinge angle of a hinge assembly connecting a first part (117A) of the image capture device (100) to a second part (117B) of the image capture device (100). For example, the processor (160) may execute the hinge angle control engine (147) to control a hinge control unit (119) which may include a hinge assembly operably coupled to the first part (117A) and the second part (117B). The processor (160) may issue commands to the hinge control unit (119) to increase or decrease the hinge angle, for example, by opening or closing the hinge assembly.

[0057] The luminance detection engine (149) may include instructions that, when executed by the processor (160), cause the processor (160) to determine values ​​such as luminance values ​​based on the pixel values ​​of the pixels of the captured image data and the pixel values ​​of the pixels within the detected ROI (e.g., the ROI detected by the processor (160) executing the face detection engine (144). For example, the luminance detection engine (149) may, when executed by the processor (160), determine a first value based on the luminance pixel values ​​of all pixels of the captured image, such as image data within the field of view of the lens of the camera optical device and sensor (115A) or the camera optical device and sensor (115B). The executed luminance detection engine (149) may also cause the processor (160) to determine a second value based on the luminance pixel values ​​of all pixels within the detected ROI containing the face of the subject. In some examples, one or more of the first value and the second value include the average luminance pixel values ​​of the corresponding pixel values. In other examples, one or more of the first value and the second value include the median luminance pixel values ​​of the corresponding pixel values. In other examples, the first value and the second value may be determined based on any suitable mathematical or statistical process or technique, such as (but not limited to) determining the total sum of squares.

[0058] The luma-based dynamic range detection engine (151) may include instructions that, when executed by the processor (160), cause the processor (160) to determine whether the captured image data (e.g., image sensor data) identifies a "high dynamic range" scene or a "non-high dynamic range" scene based on values ​​(e.g., a first value and a second value) determined by the executed luma detection engine (149). For example, when executed by the processor (160), the executed luma-based dynamic range detection engine (151) may compare the first value with the second value and, based on this comparison, determine whether the captured image data identifies a "high dynamic range" scene or a "non-high dynamic range" scene. In some instances, the executed luminance-based dynamic range detection engine (151) can determine the difference between a first value and a second value, and if the difference exceeds a threshold amount (e.g., a predetermined threshold), the executed luminance-based dynamic range detection engine (151) can determine that the captured image data identifies a "high dynamic range" scene. Alternatively, if the difference is less than or equal to the threshold, the executed luminance-based dynamic range detection engine (151) can determine that the captured image data identifies a "non-high dynamic range" scene. In other instances, the executed luminance-based dynamic range detection engine (151) can determine whether the captured image data identifies a "high dynamic range" scene or a "non-high dynamic range" scene based on applying any appropriate mathematical or statistical process or technique to the first value and the second value.

[0059] The light effect engine (153), when executed by the processor (160), may include commands that cause the processor (160) to apply one or more light effects to image data captured by the camera optical device and sensor (115A) or the camera optical device and sensor (115B). Examples of light effects include color shifts, depth of field (e.g., bokeh effects), AR, VR, and averaging effects. In some examples, the executed light effect engine (153) applies one or more light effects to a multi-view image generated by the executed image processing engine (143).

[0060] In FIG. 1, the processor (160) is located within the image capture device (100), but in some examples, the processor (160) may include one or more cloud-distributed processors. For example, one or more of the functions described herein in relation to the processor (160) may be performed (e.g., performed) by one or more remote processors, such as one or more cloud processors within corresponding cloud-based servers. The cloud processors may communicate with the processor (160) over a network, wherein the processor (160) is connected to the network via a transceiver (111). Each of the cloud processors may be colocated with the corresponding cloud processor or coupled to a non-transient cloud storage medium that may be remote from the corresponding cloud processor. The network may be any personal area network (PAN), local area network (LAN), wide area network (WAN), or the Internet.

[0061] FIG. 2 is a diagram illustrating exemplary components of the image capture device (100) of FIG. 1. As illustrated, a processor (160) is communicably coupled to each of the camera optical device and sensor (115A) and the camera optical device and sensor (115B). For example, the processor (160) may provide an image capture command (201A) to cause the camera optical device and sensor (115A) to capture first image data (203A). Similarly, the processor (160) may provide an image capture command (201B) to cause the camera optical device and sensor (115B) to capture second image data (203B). A camera optical device and sensor (115A) may be positioned (e.g., positioned on the first part (117A)) within a first part (117A) of the image capture device (100), and a camera optical device sensor (115B) may be positioned within a second part (117B) of the image capture device (100). The first part (117A) may include a first inner surface (e.g., user-facing surface) of a foldable display (e.g., foldable display (125)), and the second part (117B) may include a second inner surface of the foldable display. The image capture device (100) may be folded along a central portion separating the first part (117A) of the image capture device from the second part (117B).

[0062] In some examples, the image capture device (100) may include a timer (212). In some examples, the timer (212) may be an executable timer. A processor (160) may receive timestamp data (213) from the timer (212). The processor (160) may associate the timestamp with image data captured from the camera optical device and sensor (115A) and the camera optical device and sensor (115B). For example, when receiving the first image data (203A) from the camera optical device and sensor (115A), the processor (160) may request (e.g., read) the timestamp from the timer (212). The processor (160) may obtain timestamp data (213) identifying the timestamp and associate the timestamp with the first image data (203A). For example, the processor (160) may include a timestamp as metadata associated with the first image data (203A). Similarly, when receiving the second image data (203B) from the camera optical device and sensor (115B), the processor (160) may request and obtain timestamp data (213) from the timer (212) and associate the obtained timestamp with the second image data (203B).

[0063] Additionally, the processor (160) is operably coupled to the hinge control unit (119). In this example, the hinge control unit (119) includes a motor (208), a position sensor (210), and a hinge assembly (206). The hinge assembly (206) may include one or more hinges connecting a first part (117A) of the image capture device (100) to a second part (117B) of the image capture device (100). The motor (208) is operably coupled to the hinge assembly (206) and is operable to adjust one or more hinges (e.g., open or close). For example, the processor (160) may provide motor commands (225) to the motor (208). In response, the motor (208) can cause the hinge assembly (206) to adjust one or more hinges to increase or decrease the hinge angle between the first part (117A) and the second part (117B). For example, the motor (208) can rotate in one direction (e.g., clockwise) to open one or more hinges and can rotate in another direction (e.g., counterclockwise) to close one or more hinges.

[0064] Additionally, the processor (160) may receive position data (227) from the position sensor (210), wherein the position data (227) identifies the hinge angles of one or more hinges of the hinge assembly (206). In some examples, to adjust the hinge angle, the processor (160) obtains the position data (227) to determine a first hinge angle. To adjust the hinge angle to a second hinge angle, the processor (160) may compare the second hinge angle with the first hinge angle. Based on the comparison, the processor (160) may generate and provide a motor command (225) for adjusting the hinge angle. For example, the processor (160) may determine the difference between the second hinge angle and the first hinge angle. Next, the processor (160) can generate a motor command (225) that identifies a determined difference and provides the motor command (225) to the motor (208).

[0065] In some examples, the image capture device (100) can adjust the hinge angle based on receiving user input, such as user input received through an input device (170). For example, the image capture device (100) can display a graphical user interface (GUI) that allows the user to provide user input (e.g., through a foldable display (125)). Based on the user input, the processor (160) generates motor commands (225) and provides the motor commands (225) to the motor (208) to adjust the hinge angle. In some examples, the GUI informs the user whether to adjust the hinge angle (e.g., open or close) to optimize image effects (e.g., scene maximization, various features for multi-view compositing, bokeh, etc.). For example, an image capture device (100) can determine an object depth for an object within the captured image data as described herein. Based on the determined object depth, the image capture device (100) may notify the user through one or more GUI elements to provide input for adjusting the hinge angle (e.g., open or closed) to optimize the image effect. In some examples, the image capture device (100) outputs GUI elements on a display, such as a foldable display (125), based on the adjusted angle.

[0066] FIGS. 3A, 3B, 3C, and 3D illustrate exemplary camera configurations of the camera optical device and sensor (115A) and the camera optical device and sensor (115B), respectively. For example, FIG. 3A illustrates a single camera (302) for the camera optical device and sensor (115A) and a single camera (304) for the camera optical device and sensor (115B). FIG. 3B illustrates a camera optical device and sensor (115A) having a first camera (302A) and a second camera (302B), and a camera optical device and sensor (115B) having a first camera (304A) and a second camera (304B). Although the cameras (302A and 302B) and the cameras (304A and 304B) are illustrated horizontally, they may be positioned vertically or in any suitable configuration.

[0067] Additionally, FIG. 3c illustrates a camera optical device and sensor (115A) having a first camera (302A), a second camera (302B), and a third camera (302C). The camera optical device and sensor (115B) includes a first camera (304A), a second camera (304B), and a third camera (304C). Although the cameras (302A, 302B, 302C) and cameras (304A, 304B, 304C) are illustrated vertically, they may be positioned horizontally or in any suitable configuration. For example, FIG. 3d illustrates the cameras (302A, 302B, 302C) of the camera optical device and sensor (115A) in a "Y" formation (e.g., an inverted triangle formation). FIG. 3d also illustrates cameras (304A, 304B, 304C) of a camera optical device and sensor (115B) having a similar "Y" shape.

[0068] FIGS. 4a, 4b, and 4c illustrate a foldable device (400) comprising an image capture device (100) and a foldable display (125). The foldable device (400) may be, for example, a foldable smartphone or tablet. The foldable device (400) may include a housing having a first portion (401) and a second portion (403). The first portion (401) may be folded relative to the second portion (403). Each of the first portion (401) and the second portion (403) may include one or more displays. For example, as illustrated, the foldable display (125) includes a first display portion (125A) that may be placed within the first portion (401) and a second display portion (125B) that may be placed within the second portion (403). The first display portion (125A) and the first display portion (125B) may be communicably coupled to a processor (160) (not shown in FIG. 4a, 4b and 4c). Each of the first portion (401) and the second portion (403) of the housing may also include one or more camera optical devices and sensors, such as camera optical devices and sensors (115A, 115B). Each of the camera optical devices and sensors (115A and 115B) may include any number of cameras arranged or positioned in any suitable configuration, such as the configurations illustrated in FIG. 3a, 3b, 3c and 3d.

[0069] Additionally, as illustrated in FIG. 4a, the camera optical device and sensor (115A) may be positioned along the first surface (402) of the first part (401) of the housing of the foldable device (400), while the camera optical device and sensor (115B) may be positioned along the second surface (404) of the second device part (403) of the housing of the foldable device (400). Additionally, and as an example, the camera optical device and sensor (115A) may be positioned on the first display part (125A) along the corresponding vertical axis (e.g., the "Y" axis in FIG. 4a), and the camera optical device and sensor (115B) may be positioned on the second display part (125B) along the corresponding vertical axis. In additional examples illustrated in FIG. 4b, the camera optical device and sensor (115A) may be positioned below the first display portion (125A) along a corresponding vertical axis, and the camera optical device and sensor (115B) may be positioned below the second display portion (125B) along a corresponding vertical axis.

[0070] In additional examples illustrated in FIG. 4c, the camera optical device and sensor (115A) may be positioned below the surface of the first display portion (125A), while the camera optical device and sensor (115B) may be positioned below the surface of the second display portion (125B). Since the camera optical device and sensor (115A) and the camera optical device and sensor (115B) are each positioned below the surface of the respective display portions of the first display portion (125A) and the second display portion, light may pass through the first display portion (125A) and the second display portion (125B) respectively before colliding with the corresponding sensor. Additionally, in FIG. 4c, the camera optical device and sensor (115A) and the camera optical device and sensor (115B) are each illustrated near the top portion of the first display portion (125A) and the second display portion (125B), respectively, but in some examples, the camera optical device and sensor (115A) and the camera optical device and sensor (115B) each may be placed completely or partially under any additional or alternating portion of the first display portion (125A) and the second display portion (125B), respectively.

[0071] The central portion (453) of the foldable device (400) may include one or more hinges, such as 450A, 450B, and 450C, that couple the first portion (401) to the second portion (403). The hinges (450A, 450B, 450C) enable the first portion (401) to be folded relative to the second portion (403) to enable, for example, the opening and closing of the foldable device (400). For example, the processor (160) may execute a hinge angle control engine (147) to adjust the hinge angle (406) formed between the first inner surface (402) of the first part (401) and the second inner surface (404) of the second part (403), based on commands generated and provisioned for a corresponding motor (e.g., motor (208)) coupled to one or more of the hinges (450A, 450B, or 450C). Additionally, in some examples, an operator or user of the foldable device (400) may manually adjust the hinge angle (406) based on a graphical user interface provided on parts of the display (125).

[0072] FIG. 4d illustrates a foldable device (400) that captures an image of a scene (475). The scene (475) includes, for example, a plurality of trees (476) and a balloon (477). In this example, the camera of the camera optical unit and sensor (115A), such as camera (302), has a focal length (477A) for the balloon (477) of the scene (475). Similarly, the camera of the camera optical unit and sensor (115A) has a focal length (477B) for the balloon (477) of the scene (475). Additionally, at the current hinge angle (406), the camera of the camera optical unit and sensor (115A) is at a baseline length (451) from the camera of the camera optical unit and sensor (115B). A baseline length (451) for each of the multiple ranges of hinge angles (406) can be determined during calibration of the image capture device (100) and can be stored in a non-volatile memory such as a storage medium (110). For example, the image capture device (100) can determine the current hinge angle (406) as described herein and determine the corresponding baseline length (451) based on a table stored in the storage medium (110) that maps the hinge angles (406) to baseline lengths (451) (e.g., from the camera of the camera optical device and sensor (115A) to the camera of the camera optical device and sensor (115B).

[0073] The processor (160) may execute capture control commands (135) to capture first image data of the scene (475) from the camera optical unit and sensor (115A) and to capture second image data of the scene (475) from the camera optical unit and sensor (115B). Additionally, the processor (160) may execute a depth determination engine (146) as described herein to identify features of the scene (475), such as a balloon (477), and to determine a disparity map based on the first image data and the second image data. Disparity may identify depth values ​​associated with corresponding pixels of the first image data and the second image data. For example, the disparity map may include depth values ​​corresponding to the depth (452) from the baseline length (451) to the balloon (477).

[0074] Subsequently, the processor (160) may adjust the hinge angle (406) based on extrinsic and intrinsic parameters corresponding to each of the cameras and a disparity map. The processor (160) may adjust the hinge angle (406) to align the image data captured by the camera optical device and sensor (115A) with the image data captured by the camera optical device and sensor (115B). For example, after adjusting the hinge angle (406), the processor (160) may execute capture control commands (135) to capture third image data of the scene (475) from the camera optical device and sensor (115A) and to capture fourth image data of the scene (475) from the camera optical device and sensor (115B). For example, the third image data may be aligned more with the fourth image data than with the first image data with respect to the second image data. The processor (160) can run a depth determination engine (146) to generate a second disparity map based on the third image data and the fourth image data.

[0075] The processor (160) may execute image processing commands (143) to generate a multi-view image, such as a 3D image, based on the third image data, the fourth image data, and the second disparity map. In some examples, the processor (160) may execute a face detection engine (144) to identify the face of a subject within the generated multi-view image.

[0076] In some examples, the processor (160) may execute a light effect engine (153) to apply one or more light effects to the generated multi-view image. For example, the executed light effect engine (153) may apply color shifts, depth of field (e.g., bokeh effects), AR, VR, averaging effects, or any other image capture enhancements to the multi-view image.

[0077] FIG. 5 is a flowchart of an exemplary process (500) for capturing an image based on an adjusted hinge angle according to one implementation. The process (500) may be performed by one or more processors that execute commands locally in an image capture device, such as the processor (160) of the image capture device (100) of FIG. 1. Accordingly, various operations of the process (500) may be represented by executable commands held in a storage medium of one or more computing platforms, such as the storage medium (110) of the image capture device (100).

[0078] Referring to block (502), the image capture device (100) can acquire first image data from a first sensor, such as image data from a camera optical unit and sensor (115A). The first sensor may be positioned on a first inner surface of the foldable display. For example, the camera optical unit and sensor (115A) may be positioned on the surface of a first display portion (125A) of the foldable display (125). In block (504), the image capture device (100) can acquire second image data from a second image sensor, such as image data from a camera optical unit and sensor (115B). The second sensor is positioned on a second inner surface of the foldable display. For example, the camera optical unit and sensor (115B) may be positioned on the surface of a second display portion (125B) of the foldable display (125).

[0079] In block (506), the image capture device (100) can determine the depth of an object based on the first image data and the second image data. For example, as described herein, the image capture device (100) can identify features (e.g., balloon (477)) in each of the first image data and the second image data. According to some examples, the image capture device (100) matches pixels having key items in the first image data with pixels having corresponding key items in the second image data. Subsequently, the image capture device (100) generates a disparity map using any technique known in the art. The disparity map can indicate the scene depth at each corresponding pixel location. The image capture device (100) can compute depth values ​​based on the focal length of each camera (e.g., 477A), baseline length (e.g., baseline length (451)), and the disparity map.

[0080] Proceeding to block (508), the image capture device (100) adjusts the hinge angle of the hinge coupling the first inner surface to the second inner surface based on a determined depth. For example, the image capture device (100) may increase or decrease the hinge angle, such as the hinge angle (406) of FIG. 4a, based on the determined depth. In block (510), the image capture device (100) performs an image capture operation in response to the adjustment. For example, the image capture device (100) may acquire third image data from the first sensor and fourth image data from the second sensor. The image capture device (100) may identify corresponding features within the third image data and the fourth image data and generate a second disparity map based on the identified features. Subsequently, the image capture device (100) may generate a multi-view image based on the third image data, the fourth image data, and the second disparity map.

[0081] FIG. 6 is a flowchart of an exemplary process (600) for performing an image capture operation according to one implementation. The process (600) may be performed by one or more processors that execute commands locally in an image capture device, such as the processor (160) of the image capture device (100) of FIG. 1. Accordingly, various operations of the process (600) may be represented by executable commands held in a storage medium of one or more computing platforms, such as the storage medium (110) of the image capture device (100).

[0082] Referring to block (602), the image capture device (100) can determine the hinge angle, such as the hinge angle (406), of the hinge, such as the hinge (450A). The hinge couples the first inner surface (e.g., the first inner surface (402)) having a first sensor (e.g., camera optical unit and sensor (115A)) of the foldable device (e.g., the foldable device (400)) to the second inner surface (e.g., the second inner surface (404)) having a second sensor (e.g., camera optical unit and sensor (115B)) of the foldable device. For example, the image capture device (100) can obtain position data (227) from the position sensor (210) to determine the hinge angle.

[0083] In block (604), the image capture device (100) can determine the values ​​of parameters corresponding to each of the first sensor and the second sensor based on the hinge angle. For example, the storage medium (110) can store intrinsic parameters (167) and extrinsic parameters (169) for each of the sensors. Additionally, the intrinsic parameters (167) and extrinsic parameters (169) may include parameters for a plurality of hinge range angles. For example, a first set of intrinsic parameters (167) and extrinsic parameters (169) may correspond to a first range of hinge angles (e.g., 0 degrees to a maximum of 5 degrees), and a second set of intrinsic parameters (167) and extrinsic parameters (169) may correspond to a first range of hinge angles (e.g., 5 degrees to a maximum of 10 degrees). In some examples, each hinge angle has corresponding intrinsic and extrinsic parameters. The image capture device (100) can acquire intrinsic parameters (167) and extrinsic parameters (169) corresponding to a determined hinge angle for each of the first sensor and the second sensor.

[0084] Proceeding to block (606), the image capture device (100) can acquire first image data from a first sensor and second image data from a second sensor. For example, the image capture device (100) can acquire image data (203A) from a camera optical unit and sensor (115A) and image data (203B) from a camera optical unit and sensor (115B). In block (608), the image capture device (100) can determine the disparity of an object based on the first image data, the second image data, and parameters. For example, the image capture device (100) can identify an object within the first image data and the second image data and, as described herein, generate a disparity map containing disparity values ​​for the object based on extrinsic and intrinsic parameters corresponding to each camera. The image capture device (100) can apply any known technique to the disparity values ​​to determine the disparity of the object. For example, the image capture device (100) can determine the average of the disparity values ​​to determine the disparity for the object.

[0085] In block (610), the image capture device (100) can determine whether the determined disparity is below a threshold. For example, the threshold disparity may include a predetermined threshold value that the image capture device (100) can maintain within the storage medium (110). If the disparity is not below the threshold, the method proceeds to block (612), and the image capture device (100) can adjust the hinge angle. For example, the image capture device (100) can provide a motor command (225) to the motor (208) to adjust the hinge angle (e.g., hinge angle (406)) of the hinge (e.g., 450A) of the hinge assembly (206). Subsequently, the method (600) proceeds back to block (602).

[0086] Referring again to block (610), if the determined disparity was less than the threshold disparity, the method proceeds to block (614), where the image capture device (100) performs an image capture operation using the first image sensor and the second image sensor. For example, the image capture device (100) may acquire third image data from the first sensor and additional image data from the second sensor. The image capture device (100) may determine a disparity map based on the third image data and the fourth image data (and corresponding camera parameters in some examples), and may generate a multi-view image based on the third image data, the fourth image data, and the disparity map using any process as described herein.

[0087] FIG. 7 is a flowchart of an exemplary process (700) for generating a user-configured image according to one implementation. The process (700) may be performed by one or more processors that execute commands locally in an image capture device, such as the processor (160) of the image capture device (100) of FIG. 1. Accordingly, various operations of the process (700) may be represented by executable commands held in storage media of one or more computing platforms, such as the storage media (110) of the image capture device (100).

[0088] In block (702), the image capture device (100) may receive an input for capturing an image of a scene. For example, a user may provide an input (e.g., via I / O (170)) to capture an image of a scene (e.g., scene (475)) (e.g., taking a picture). In block (704), in response to the input, the image capture device (100) obtains first image data from a first sensor positioned within a first inner surface of the foldable display. The image capture device also obtains second image data from a second sensor positioned within a second inner surface of the foldable display. For example, the camera optical device and sensor (115A) may be positioned within a first display portion (125A) of the display (125), and the camera optical device and sensor (115B) may be positioned within a second display portion (125B) of the display (125).

[0089] Proceeding to block (706), the image capture device (100) can detect the face of a subject based on the first image data and the second image data. For example, the image capture device (100) can detect the face of a subject within the ROI of the first image data and the second image data. Additionally, in block (708), the image capture device (100) can adjust the hinge angle based on the detected face. The hinge angle (e.g., hinge angle (406)) couples the first inner surface of the foldable display to the second inner surface of the foldable display. For example, the image capture device (100) can determine disparity values ​​for the face and can compute depth values ​​for the face based on the focal length of the first sensor, the baseline length between the first sensor and the second sensor, and the disparity values. Subsequently, the image capture device can adjust the hinge angle based on the depth values.

[0090] In block (710), the image capture device (100) can capture an image using the first sensor and the second sensor in response to the hinge angle adjustment. For example, the image capture device (100) can acquire third image data from the first sensor and fourth image data from the second sensor. As described herein, the image capture device (100) can determine a disparity map based on the third image data and the fourth image data, and generate a multi-view image based on the disparity map, the third image data, and the fourth image data.

[0091] Proceeding to block (712), the image capture device (100) can generate a user-configured image by applying a light effect to the captured image. For example, the image capture device (100) can generate a user-configured image by applying any light effect selected by the user, such as a bokeh effect, to the multi-view image. In block (714), the image capture device (100) can store the user-configured image in a non-transient memory of a corresponding type, such as a storage medium (110).

[0092] Implementation examples are further described in the following numbered clauses: 1. As an image capture device, Housing including a first housing portion and a second housing portion; A non-transient machine-readable storage medium for storing instructions; and It includes at least one processor coupled to a non-transient machine-readable storage medium, wherein the at least one processor, Acquiring first image data from a first sensor coupled to a first housing portion of the housing; Acquiring second image data from a second sensor coupled to a second housing portion of the housing; Determining the depth of an object based on first image data and second image data; Output an adjusted angle between the first housing part and the second housing part based on depth; and It is configured to execute commands to perform image capture operations based on the adjusted angle. 2. In the image capture device of Clause 1, at least one processor additionally, Based on the output of the adjusted angle, third image data from the first sensor and fourth image data from the second sensor are obtained; and It is configured to execute commands to generate a multi-view image based on third sensor data and fourth sensor data. 3. In the image capture device of Clause 2, at least one processor additionally, Generate a user-composed image based on the application of photoeffects to a multi-view image; and It is configured to execute commands to save a user-configured image to a non-transient machine-readable storage medium. 4. In the image capture device of Clause 3, at least one processor additionally, Segment the multi-view image; and It is configured to execute commands to apply light effects based on a divided multi-view image. 5. In the image capture device of Clause 4, the light effect includes a bokeh effect. 6. In an image capture device of any one of Clauses 1 to 5, The object includes a face; and At least one processor is additionally configured to execute instructions to detect the pace. 7. In an image capture device of any one of Clauses 1 to 6, at least one processor additionally, Determine the angle between the first housing part and the second housing part; and It is configured to execute commands to determine the depth of an object based on the angle. 8. In an image capture device of any one of provisions 1 through 7, at least one processor is further configured to execute instructions to generate disparity data based on the first image data and the second image data. 9. In the image capture device of Clause 8, at least one processor additionally, Determine the angle between the first housing portion and the second housing portion of the housing; Determine the baseline length between the first sensor and the second sensor based on the determined angle; Determining the focal length of at least one of the first sensor or the second sensor; and It is configured to execute commands to generate depth values ​​based on disparity data, baseline length, and focal length. 10. In the image capture device of Clause 8 or Clause 9, at least one processor additionally, Determine the object's disparity based on disparity data; and It is configured to execute commands to output an adjusted angle based on disparity and a disparity threshold. 11. In an image capture device of any one of Clauses 1 to 10, at least one processor additionally, Acquire position data from the position sensor; Determining the angle between the second housing part and the first housing part based on position data; and It is configured to execute commands to determine the adjusted angle based on the determined angle. 12. In an image capture device of any one of Clauses 1 to 11, at least one processor additionally, Determine the angle between the first housing part and the second housing part; Determine one or more camera parameters based on the determined angle; and It is configured to execute commands to output an angle adjusted based on one or more camera parameters. 13. In the image capture device of Clause 12, One or more camera parameters include a translation matrix; and At least one processor is additionally configured to execute instructions to translate the reference of the first sensor to the corresponding reference of the second sensor based on a translation matrix. 14. In an image capture device according to any one of Clauses 1 to 13, The first housing portion includes the first portion of the display; The second housing portion includes the second portion of the display; and The first sensor is placed below the first part of the display, and the second sensor is placed below the second part of the display. 15. An image capture device of any one of Clauses 1 to 14 further comprises a motor. 16. In the image capture device of Clause 15, the motor is configured to adjust the angle between the first housing part and the second housing part based on the adjusted angle. 17. In an image capture device of any one of Clauses 1 through 16, the processor is further configured to execute commands to output GUI elements on a display based on an adjusted angle. 18. A method for operating an image capture device, A step of acquiring first image data from a first sensor coupled to a first housing portion of the housing of an image capture device; A step of acquiring second image data from a second sensor coupled to a second housing portion of the housing; A step of determining the depth of an object based on first image data and second image data; A step of outputting an adjusted angle between a first housing part and a second housing part based on a determined depth; and It includes a step of performing an image capture operation based on an adjusted angle. 19. In the method of Clause 18, the step of performing an image capture operation is: A step of acquiring third image data from a first sensor and fourth image data from a second sensor based on the output of the adjusted angle; and It includes the step of generating a multi-view image based on third sensor data and fourth sensor data. 20. In the method of Clause 19, A step of generating a user-configured image based on the application of light effects to a multi-view image; and It further includes the step of saving the user-configured image to a memory device. 21. In the method of Clause 20, Step of splitting a multi-view image; and It further includes a step of applying light effects based on a divided multi-view image. 22. In the method of Clause 21, the light effect includes a bokeh effect. 23. In the method of any one of provisions 18 to 22, the object comprises a face, and the method further comprises the step of detecting the face. 24. In the method of any one of Articles 18 through 23, A step of determining the angle between the first housing portion and the second housing portion of the housing; and It further includes a step of determining the depth of the object based on the angle. 25. In the method of any one of provisions 18 to 22, the step of determining the depth of an object includes the step of generating disparity data based on first image data and second image data. 26. In the method of Clause 25, the step of determining the depth of an object is, A step of determining the angle between the first housing portion and the second housing portion; A step of determining the baseline length between the first sensor and the second sensor based on a determined angle; A step of determining the focal length of at least one of the first sensor or the second sensor; and It includes the step of generating depth values ​​based on disparity data, baseline length, and focal length. 27. In the method of Article 25 or Article 26, The method further includes the step of determining the disparity of an object based on disparity data; and the step of outputting an adjusted angle based on the disparity and a disparity threshold. 28. In the method of any one of Articles 18 through 27, A step of acquiring position data from a position sensor; A step of determining the angle between the second housing portion and the first housing portion; and It further includes a step of determining an adjusted angle based on a determined angle. 29. In the method of any one of Articles 18 through 28, A step of determining the angle between the first housing portion and the second housing portion; A step of determining one or more camera parameters based on a determined angle; and It further includes a step of outputting an angle adjusted based on one or more camera parameters. 30. In the method of Clause 29, One or more camera parameters include a translation matrix; and The method further includes the step of translating the reference of the first sensor to the corresponding reference of the second sensor based on a translation matrix. 31. The method of any one of clauses 18 to 30 further includes the step of outputting GUI elements on a display based on an adjusted angle. 32. A non-transient machine-readable storage medium for storing instructions, wherein the instructions, when executed by at least one processor, cause at least one processor, An operation of acquiring first image data from a first sensor coupled to a first housing portion of the housing of an image capture device; An operation of acquiring second image data from a second sensor coupled to a second housing portion of the housing; An operation to determine the depth of an object based on first image data and second image data; An operation to output an adjusted angle between a first housing part and a second housing part based on depth; and It enables the performance of actions including an action that performs an image capture action based on an adjusted angle. 33. In the non-transient machine-readable storage medium of Clause 32, performing at least one image capture operation is, Acquiring third image data from the first sensor and fourth image data from the second sensor based on the output of the adjusted angle; and It includes generating a multi-view image based on third sensor data and fourth sensor data. 34. In the non-transient machine-readable storage medium of Clause 33, when instructions are executed by at least one processor, at least one processor, An operation to generate a user-configured image based on the application of light effects to a multi-view image; and It enables additional operations, including the operation of saving a user-configured image to a memory device. 35. In the non-transient machine-readable storage medium of Clause 34, when instructions are executed by at least one processor, at least one processor, Operation of splitting a multi-view image; and It enables additional operations, including the operation of applying light effects based on a divided multi-view image. 36. In the non-transient machine-readable storage medium of Clause 35, the optical effect includes bokeh effect. 37. In a non-transient machine-readable storage medium of any one of provisions 32 through 36, the instructions, when executed by at least one processor, cause at least one processor to perform additional operations including an operation to detect a face, and the object includes the detected face. 38. In a non-transient machine-readable storage medium of any one of provisions 32 through 37, when instructions are executed by at least one processor, at least one processor, An operation to determine the angle between the first housing portion and the second housing portion of the housing; and It enables additional actions, including actions that determine the depth of an object based on the angle. 39. In a non-transient machine-readable storage medium of any one of provisions 32 through 38, determining the depth of an object includes generating disparity data based on first image data and second image data. 40. In a non-transient machine-readable storage medium of Clause 39, determining the depth of an object is, Determining the angle between the first housing part and the second housing part; Determining the baseline length between the first sensor and the second sensor based on a determined angle; Determining the focal length of at least one of the first sensor or the second sensor; and It includes generating depth values ​​based on disparity data, baseline length, and focal length. 41. In a non-transient machine-readable storage medium of Clause 39 or Clause 40, when instructions are executed by at least one processor, at least one processor, An operation to determine the disparity of an object based on disparity data; and It enables additional operations, including an operation to output an adjusted angle between the first housing part and the second housing part based on disparity and a disparity threshold. 42. In a non-transient machine-readable storage medium of any one of provisions 32 through 41, when instructions are executed by at least one processor, at least one processor, Operation of acquiring position data from a position sensor; An operation to determine the angle between the second housing portion and the first housing portion; and It causes additional actions to be performed, including the action of determining the adjusted angle based on the determined angle. 43. In a non-transient machine-readable storage medium of any one of provisions 32 through 42, determining the depth of an object is: Determining the angle between the first housing part and the second housing part; Determining one or more camera parameters based on a determined angle—outputting an adjusted angle based on one or more camera parameters—; and further including outputting an adjusted angle based on one or more camera parameters. 44. In the non-transient machine-readable storage medium of Clause 43, one or more camera parameters include a translation matrix, and commands, when executed by at least one processor, cause at least one processor to perform additional operations including translating a reference of a first sensor to a corresponding reference of a second sensor based on the translation matrix. 45. In a non-transient machine-readable storage medium of any one of provisions 32 through 44, the instructions, when executed by at least one processor, cause at least one processor to perform additional operations including the operation of outputting a GUI element on a display based on an adjusted angle. 46. ​​As a system, Means for acquiring first image data from a first sensor coupled to a first housing portion of the housing of an image capture device; Means for acquiring second image data from a second sensor coupled to a second housing portion of the housing; Means for determining the depth of an object based on first image data and second image data; Means for outputting an adjusted angle between a first housing portion and a second housing portion based on depth; and It includes means for performing an image capture operation based on an adjusted angle. 47. In the system of Clause 46, means for performing at least one image capture operation are, Means for acquiring third image data from a first sensor and fourth image data from a second sensor based on the output of an adjusted angle; and It includes means for generating a multi-view image based on third sensor data and fourth sensor data. 48. In the system of Clause 47, Means for generating a user-configured image based on the application of light effects to a multi-view image; and It further includes means for storing a user-configured image in a memory device. 49. In the system of Clause 48, Means for dividing a multi-view image; and It further includes means for applying light effects based on a divided multi-view image. 50. In the system of Clause 49, the light effect includes the bokeh effect. 51. A system of any one of provisions 46 to 50 further comprises means for detecting a face, and the object comprises a face. 52. In the system of any one of Articles 46 through 51, Means for determining the angle between the first housing portion and the second housing portion of the housing; and It further includes means for determining the depth of an object based on an angle. 53. In a system of any one of provisions 46 to 52, the means for determining the depth of an object includes means for generating disparity data based on first image data and second image data. 54. In the system of Clause 53, the means for determining the depth of an object is, Means for determining the angle between the first housing portion and the second housing portion; Means for determining the baseline length between the first sensor and the second sensor based on a determined angle; Means for determining the focal length of at least one of the first sensor or the second sensor; and It includes means for generating depth values ​​based on disparity data, baseline length, and focal length. 55. In the system of Clause 53 or Clause 54, It further includes means for determining the disparity of an object based on a disparity map; and means for outputting an adjusted angle based on the disparity and a disparity threshold. 56. In the system of any one of Articles 46 through 55, Means for acquiring position data from a position sensor; Means for determining the angle between the second housing portion and the first housing portion; and It further includes means for determining an adjusted angle based on a determined angle. 57. In the system of any one of Articles 46 through 55, Means for determining the angle between the first housing portion and the second housing portion; Means for determining one or more camera parameters based on a determined angle; and It further includes means for outputting an angle adjusted based on one or more camera parameters. 58. In the system of Clause 57, One or more camera parameters include a translation matrix; and The system further includes means for translating the reference of the first sensor to the corresponding reference of the second sensor based on a translation matrix. 59. In the system of any one of Articles 46 through 58, The first housing portion includes the first portion of the display; The second housing portion includes the second portion of the display; and The first sensor is placed below the first part of the display, and the second sensor is placed below the second part of the display. 60. In any one of provisions 46 to 59, the system further comprises means for adjusting the angle between the first housing part and the second housing part based on the adjusted angle. 61. A system of any one of provisions 46 to 60 further comprises means for outputting GUI elements on a display based on an adjusted angle.

[0093] While the methods described above refer to the illustrated flowcharts, many other ways of performing the actions associated with the methods may be used. For example, the order of some actions may be changed, and some embodiments may omit one or more of the described actions and / or include additional actions.

[0094] Additionally, the methods and systems described herein may be implemented at least partially in the form of computer-implemented processes and devices for carrying out such processes. The disclosed methods may also be implemented at least partially in the form of a non-transient machine-readable storage medium of a type encoded in computer program code. For example, the methods may be implemented in hardware, as executable instructions (e.g., software) executed by a processor, or as a combination of both. The medium may include, for example, RAMs, ROMs, CD-ROMs, DVD-ROMs, BD-ROMs, hard disk drives, flash memories, or any other non-transient machine-readable storage medium. When the computer program code is loaded into a computer and executed by the computer, the computer becomes a device for carrying out the methods. The methods may also be implemented at least partially in the form of a computer on which the computer program code is loaded or executed, so that the computer becomes a special-purpose computer for carrying out the methods. When implemented on a general-purpose processor, segments of the computer program code configure the processor to generate specific logic circuits. Alternatively, the methods can be implemented at least partially with custom integrated circuits for performing the methods.

Claims

Claim 1 An image capture device comprising: a housing including a first housing portion and a second housing portion; a non-transient machine-readable storage medium storing commands; and at least one processor coupled to the non-transient machine-readable storage medium, wherein the at least one processor: acquires first image data from a first sensor coupled to the first housing portion of the housing; acquires second image data from a second sensor coupled to the second housing portion of the housing; determines an angle between the first housing portion and the second housing portion; and determines one or more extrinsic parameters based on the determined angle — the one or more extrinsic parameters include at least one of a first translation matrix associated with the first sensor or a second translation matrix associated with the second sensor —; An image capture device configured to align the first image data with the second image data based on translating the reference of the first sensor to the corresponding reference of the second sensor based on at least one of the first translation matrix or the second translation matrix; determine the depth of an object based on the aligned first image data and second image data; output an adjusted angle between the first housing part and the second housing part based on the depth; and execute the commands to perform an image capture operation based on the adjusted angle. Claim 2 An image capture device according to claim 1, wherein the at least one processor further comprises: acquiring third image data from the first sensor and acquiring fourth image data from the second sensor based on the output of the adjusted angle; and executing the commands to generate a multi-view image based on the third image data and the fourth image data. Claim 3 An image capture device according to claim 2, wherein the at least one processor further comprises: generating a user-composed image based on the application of a photoeffect to the multi-view image; and executing the commands to store the user-composed image in the non-transient machine-readable storage medium. Claim 4 In claim 3, the image capture device is further configured such that at least one processor additionally: segments the multi-view image; and executes the commands to apply the light effect based on the segmented multi-view image. Claim 5 An image capture device according to claim 4, wherein the light effect includes a bokeh effect. Claim 6 An image capture device according to claim 1, wherein the object includes a face; and the at least one processor is further configured to execute the commands to detect the face. Claim 7 An image capture device according to claim 1, wherein the at least one processor is further configured to execute the commands to determine the depth of the object based further on the determined angle. Claim 8 An image capture device according to claim 1, wherein the at least one processor is further configured to execute the commands to generate disparity data based on the first image data and the second image data. Claim 9 An image capture device according to claim 8, wherein the at least one processor further comprises: determining a baseline length between the first sensor and the second sensor based on the determined angle; determining a focal length of at least one of the first sensor or the second sensor; and executing the commands to generate depth values ​​based on the disparity data, the baseline length and the focal length. Claim 10 An image capture device according to claim 8, wherein the at least one processor further comprises: determining the disparity of the object based on the disparity data; and executing the commands to output the adjusted angle based on the disparity and the disparity threshold. Claim 11 An image capture device according to claim 1, wherein the at least one processor further comprises: acquiring position data from a position sensor; determining an angle between the second housing portion and the first housing portion based on the position data; and executing the commands to determine the adjusted angle based further on the determined angle. Claim 12 An image capture device according to claim 1, wherein the first housing portion comprises a first portion of a display; the second housing portion comprises a second portion of the display; and the first sensor is disposed below the first portion of the display and the second sensor is disposed below the second portion of the display. Claim 13 An image capture device according to claim 1, further comprising a motor. Claim 14 An image capture device according to claim 13, wherein the motor is configured to adjust the angle between the first housing portion and the second housing portion based on the adjusted angle. Claim 15 An image capture device according to claim 1, wherein the at least one processor is further configured to execute the commands to output GUI elements on a display based on the adjusted angle. Claim 16 A method for operating an image capture device, comprising: acquiring first image data from a first sensor coupled to a first housing portion of the housing of the image capture device; acquiring second image data from a second sensor coupled to a second housing portion of the housing; determining an angle between the first housing portion and the second housing portion; determining one or more external parameters based on the determined angle — wherein the one or more external parameters include at least one of a first translation matrix associated with the first sensor or a second translation matrix associated with the second sensor —; aligning the first image data with the second image data based on translating the reference of the first sensor to a corresponding reference of the second sensor based on at least one of the first translation matrix or the second translation matrix; determining the depth of an object based on the aligned first image data and the second image data; and outputting an adjusted angle between the first housing portion and the second housing portion based on the determined depth. A method for operating an image capture device, comprising the step of performing an image capture operation based on the adjusted angle. Claim 17 A method for operating an image capture device, wherein the step of performing the image capture operation comprises: acquiring third image data from the first sensor and acquiring fourth image data from the second sensor based on the output of the adjusted angle; and generating a multi-view image based on the third image data and the fourth image data. Claim 18 A method for operating an image capture device, further comprising: a step of generating a user-configured image based on the application of a light effect to the multi-view image in claim 17; and a step of storing the user-configured image in a memory device. Claim 19 A method for operating an image capture device, wherein the step of generating the user-configurable image comprises: the step of dividing the multi-view image; and the step of applying the light effect based on the division. Claim 20 In claim 19, a method for operating an image capture device, wherein the light effect includes a bokeh effect. Claim 21 A method for operating an image capture device, wherein, in claim 16, the object comprises a face, and the method further comprises the step of detecting the face. Claim 22 A method for operating an image capture device according to claim 16, further comprising the step of determining the depth of the object based additionally on the determined angle. Claim 23 A method for operating an image capture device, wherein the step of determining the depth of the object comprises the step of generating disparity data based on the first image data and the second image data. Claim 24 A method for operating an image capture device, wherein the step of determining the depth of the object comprises: determining a baseline length between the first sensor and the second sensor based on the determined angle; determining a focal length of at least one of the first sensor or the second sensor; and generating depth values ​​based on the disparity data, the baseline length, and the focal length. Claim 25 A method for operating an image capture device according to claim 23, further comprising: a step of determining the disparity of the object based on the disparity data; and a step of outputting the adjusted angle based on the disparity and a disparity threshold. Claim 26 A method for operating an image capture device according to claim 16, further comprising: a step of acquiring position data from a position sensor; a step of determining an angle between the first housing portion and the second housing portion based on the position data; and a step of determining an adjusted angle based additionally on the determined angle. Claim 27 A method for operating an image capture device according to claim 16, wherein the first housing portion comprises a first portion of a display; the second housing portion comprises a second portion of the display; and the first sensor is disposed below the first portion of the display and the second sensor is disposed below the second portion of the display. Claim 28 A method for operating an image capture device according to claim 16, further comprising the step of using a motor to adjust the angle between the first housing portion and the second housing portion based on the adjusted angle. Claim 29 A method for operating an image capture device according to claim 28, further comprising the step of displaying a GUI element based on the adjusted angle. Claim 30 delete

Images