Capture landscape and portrait mode images simultaneously

Abstract

A video or image capture device and a method of operation of the capture device are described. One exemplary device includes a first sensor array comprising a first plurality of image sensors, a second sensor array comprising a second plurality of image sensors, a third sensor array comprising a third plurality of image sensors, a fourth sensor array comprising a fourth plurality of image sensors, and a fifth sensor array comprising a fifth plurality of image sensors. The second sensor array and the fourth sensor array are configured to be excluded from use for capturing images in portrait format. The third sensor array and the fifth sensor array are configured to be excluded from use for capturing images in landscape format. The first sensor array is configured to be used for capturing images in portrait format and landscape format.

Description

[Technical field]

[0001] CROSS-REFERENCE TO RELATED APPLICATIONS This application claims the benefit of priority to U.S. Provisional Patent Application No. 63 / 267,360, filed January 31, 2022, and further claims priority to U.S. Provisional Patent Application No. 17 / 822,658, filed August 26, 2022. The entire contents of the above documents are incorporated by reference into the disclosure of this specification.

[0002] This document relates to image and video capture technology using handheld electronic devices equipped with cameras. [Background technology]

[0003] Today, most handheld computing devices are equipped with cameras, and users use these devices to capture videos and images. Summary of the Invention

[0004] This document discloses a technique for using a camera to simultaneously capture video and images in landscape and portrait modes.

[0005] In an exemplary embodiment, a video capture device is disclosed. The video capture device includes a first sensor array comprising a first plurality of image sensors, a second sensor array comprising a second plurality of image sensors, a third sensor array comprising a third plurality of image sensors, a fourth sensor array comprising a fourth plurality of image sensors, and a fifth sensor array comprising a fifth plurality of image sensors. The second sensor array and the fourth sensor array are configured to be excluded from use for capturing images in portrait format. The third sensor array and the fifth sensor array are configured to be excluded from use for capturing images in landscape format. The first sensor array is configured to be used to capture images in portrait format and landscape format.

[0006] In another aspect, a method of camera operation is disclosed that includes initiating capture of an image or video capture based on a command received on a user interface of a camera comprising the disclosed apparatus, and storing the captured image or video in three or more of the first through fifth sensor arrays in accordance with the command.

[0007] In another exemplary aspect, a video capture device is disclosed that includes a processor configured to implement one of the methods described herein.

[0008] These and other features are described in this document. [Brief description of the drawings]

[0009] The drawings described herein are used to provide a further understanding and constitute a part of this application. The exemplary embodiments and their illustrations are used to explain the present technology, rather than to limit the scope of the present technology.

[0010] [Figure 1] 1 shows an example of a single camera integrated circuit.

[0011] [Diagram 2] An example of a sensor circuit configured in landscape format is shown.

[0012] [Diagram 3] An example of a sensor circuit configured in portrait format is shown below.

[0013] [Figure 4] An example of the camera's portrait mode operation is shown.

[0014] [Diagram 5] An example of the camera's landscape mode operation is shown below.

[0015] [Figure 6] An example of portrait mode preview generation is shown below.

[0016] [Figure 7] Here is an example of creating a landscape mode preview.

[0017] [Figure 8] Here is an example of 16:9 preview generation.

[0018] [Figure 9A] 1 shows a flowchart of an example of a camera operation method. [Figure 9B] 1 shows a flowchart of an example of a camera operation method. [Figure 9C] 1 shows a flowchart of an example of a camera operation method.

[0019] [Figure 10] 1 shows a flowchart of an exemplary method of operating a video capture device.

[0020] [Figure 11] FIG. 2 is a block diagram of a video capture device. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0021] In order to make the objectives, technical solutions and advantages of the present disclosure clearer, various embodiments are described in detail below with reference to the drawings. Unless otherwise specified, the embodiments and features in the embodiments of this document can be combined with each other.

[0022] Section headings are used herein, including the appendix, to improve readability of the invention and not to limit the discussion to the respective sections only. Additionally, throughout this specification, the term video is used for compactness, with the understanding that the described techniques are applicable to the capture and storage of both video (a sequence of pictures) or a single picture or image or photograph. Additionally, for ease of description, the terms "telephone," "mobile phone," or "cellular phone" are used to describe a variety of different handheld devices, including cameras. Such devices include handheld tablets, pads, laptops, e-readers, and the like.

[0023] Video / photo capture in landscape format, portrait format, or both formats simultaneously can be accomplished using one integrated circuit with a cross-pattern image sensor (Figure 1) with pixels organized into five blocks, 0, 1, 2, 3, and 4. Block 0 is common and is combined with blocks 1, 3 or blocks 2, 4 to configure the sensor as landscape or portrait format (Figures 2 and 3). Mode-configurable pixel blocks 1 and 3 are processor controlled or user selected in the default capture mode and are mapped and combined with common pixel block 0 to form the landscape image. Similarly, common pixel block 0 and mode-configurable pixel blocks 2 and 4 are mapped and combined to form the portrait image.

[0024] In some embodiments, the image sensor is fabricated as a cross pattern. Every pixel is XY addressable. The image sensor is a two-dimensional array of pixels. Each pixel has its own intensity value, a position address represented by X (row number) and Y (column number).

[0025] Pixel blocks 1, 2, 3, and 4 are remapped and reconfigured upon instruction by the processor to output an image that matches the format (landscape or portrait) selected by the user or by default.

[0026] Below are two handheld orientations with two capture modes each.

[0027] 1. When the default capture mode is landscape, the phone is held in portrait orientation, and the front-facing camera has pixel blocks 1 and 3 enabled and blocks 2 and 4 disabled (Figure 4). When the camera is turned on, block 0 is on. The top (upward-facing edges) of blocks 1, 0, and 3 are determined by input from the accelerometer.

[0028] - While the phone is held in portrait orientation, the capture mode is changed from landscape to portrait via on-screen touch selection: front-facing camera pixel blocks 2 and 4 are enabled and blocks 1 and 3 are disabled.

[0029] 2. When the default capture mode is landscape, the phone is held in landscape orientation, and the front-facing camera has pixel blocks 2 and 4 enabled and blocks 1 and 3 disabled (Figure 5). When the camera is turned on, block 0 is on. The top side of blocks 2, 0, and 4 is determined by input from the accelerometer.

[0030] - While the phone is held sideways, the capture mode is changed from landscape to portrait via on-screen touch selection. Front-facing camera pixel blocks 1 and 3 are enabled and blocks 2 and 4 are disabled.

[0031] 3. If the default capture mode is portrait, the phone is held in portrait orientation, and the front-facing camera has pixel blocks 2 and 4 enabled and blocks 1 and 3 disabled.

[0032] - While the phone is held in portrait orientation, the capture mode is changed from portrait to landscape by on-screen touch selection: front-facing camera pixel blocks 1 and 3 are enabled and blocks 2 and 4 are disabled.

[0033] 4. If the default capture mode is portrait, the phone is held in landscape orientation, and the front-facing camera has pixel blocks 1 and 3 enabled and blocks 2 and 4 disabled.

[0034] - While the phone is held sideways, the capture mode is changed from portrait to landscape via on-screen touch selection. The front-facing camera has pixel blocks 2 and 4 enabled and blocks 1 and 3 disabled.

[0035] Below are two handheld orientations where all five pixel blocks 0, 1, 2, 3, and 4 in each are turned on simultaneously for simultaneous landscape and portrait video / photo capture.

[0036] 1. When the mobile phone is held in portrait orientation, a video or photo is captured with all five pixel blocks enabled. For a photo session, the processor commands the integrated circuit to output two images, landscape and portrait, with the top side of all five pixel blocks determined by the accelerometer. In this case, a landscape photo is created by combining pixel blocks 1, 0, and 3, and a portrait photo is created by combining pixel blocks 2, 0, and 4. After capture, the user can select either the format, landscape, or portrait, to display on-screen.

[0037] For a video session, the processor instructs the integrated circuit to output two separate video files, a landscape mode file and a portrait mode file, for display and storage. In this case, pixel blocks 1, 0, and 3 are combined to create a landscape image, and pixel blocks 2, 0, and 4 are combined to create a portrait image. For display during recording, the user can choose to display either the landscape video or the portrait video on the screen, and for playback, the user can select either format for playback.

[0038] 2. When the mobile phone is held landscape, a video or photo is captured with all five pixel blocks enabled. For a photo session, the processor commands the integrated circuit to output two images, landscape and portrait, with the top side of all five pixel blocks determined by the accelerometer. In this case, a landscape photo is created by stitching together pixel blocks 2,0,4, and a portrait photo is created by stitching together pixel blocks 3,0,1. After capture, the user can select either the format, landscape, or portrait, for on-screen display.

[0039] For a video session, the processor instructs the integrated circuit to output two separate video files, a landscape mode file and a portrait mode file, for display and storage. In this case, pixel blocks 2,0,4 are combined to create a landscape image, and pixel blocks 3,0,1 are combined to create a portrait image. For display during recording, the user can choose to display either the landscape video or the portrait video on the screen, and for playback, the user can select either format for playback.

[0040] During a simultaneous capture session, the user can select either a landscape or portrait format display preview prior to capture via an on-screen touch icon. The integrated circuit not only functions as an image sensor, but also as a media processor providing simultaneous streaming of landscape and portrait video.

[0041] The sensor / media processor can generate a portrait preview (Figure 6), a landscape preview (Figure 7), or a combined preview of both landscape and portrait images by proportionally scaling both images to fit a screen of a given aspect ratio, e.g., 16:9 aspect ratio (Figure 8), before capture. Each preview screen has two icons that allow the user to select between the other two preview screens. In an alternative method, only one icon is used for preview selection, with the first touch selecting the second preview, the second touch selecting the third preview, and the third touch returning to the first preview.

[0042] In some embodiments, to provide 3D video / photo capture capability, two cameras are mounted, one in the top left corner and the other in the top right corner, emulating binocular vision resulting in 3D perception.

[0043] Because the disclosed integrated image sensor and media processor is distinguishable from conventional image sensor only devices, the landscape and portrait sensors are sometimes referred to as landport sensors or LP sensors for short.

[0044] There are many types of LiDAR sensors (Light Detection and Ranging) and choosing the right one is critical to a successful application. LiDAR sensors are mounted close to the camera so that when activated, a pulse of light is emitted towards a distant subject. The time it takes for the reflected light to return to the sensor is used to determine the distance from the camera to the subject. All five pixel blocks are independently controlled so each pixel block can be turned on separately and images captured one at a time, with distance measurements stored in the metadata or displayed on the screen. This is a useful feature for survey work or other special interest activities.

[0045] With the LP sensor mounted on a professional camera, photographers no longer need to tilt their camera to capture portrait images. Both formats can be previewed simultaneously or separately, so photographers can capture either format separately or both formats simultaneously. It helps to increase productivity.

[0046] 9A, 9B, and 9C are flow charts illustrating a general method 9000 for a mobile phone to capture an image or video. Method 9000 begins at start block 9006 with activating the camera. In step 9008, the mobile phone determines whether simultaneous capture mode is selected. If simultaneous capture mode is not selected, method 9000 proceeds to step 9100 of FIG. 9A. If simultaneous capture mode is selected, method 9000 proceeds to step 9200 of FIG. 9B.

[0047] In step 9100, the method 9000 determines whether the user presets portrait mode as the capture mode. If portrait mode is already a preset mode, then in step 9102, the mobile phone determines whether the orientation of the mobile phone is portrait. If the mobile phone is portrait, then the mobile phone enables pixel blocks 2 and 4 but disables pixel blocks 1 and 3 (9108). However, if the mobile phone is landscape, then the mobile phone enables pixel blocks 1 and 3 but disables pixel blocks 2 and 4 (9104). After enabling and disabling certain pixel blocks in steps 9108 or 9104, the mobile phone screen displays a portrait live view (9106). In step 9110, if the video session has not ended, then the method 9000 returns to step 9102 to determine whether the mobile phone is held in portrait orientation.

[0048] In step 9100, the method 9000 determines whether the user presets portrait mode as the capture mode. If portrait mode is not already a preset mode, in step 9112, the mobile phone determines whether the orientation of the mobile phone is portrait. If the mobile phone is in portrait orientation, the mobile phone enables pixel blocks 1 and 3 but disables pixel blocks 2 and 4 (9118). However, if the mobile phone is in landscape orientation, the mobile phone enables pixel blocks 2 and 4 but disables pixel blocks 1 and 3 (9114). After enabling and disabling certain pixel blocks in steps 9118 or 9114, the mobile phone screen displays a landscape live view (9116). In step 9120, if the video session has not ended, the method 9000 returns to step 9112 to determine whether the mobile phone is being held in portrait orientation.

[0049] If the method 9000 determines that the video session has ended in either step 9110 or 9120, the camera is turned off in step 9300 (see FIG. 9C). Then, in step 9302, the method 9000 determines whether the orientation of the mobile phone has changed during the session. If the orientation has not changed during the session, in step 9308, the method 9000 outputs either the video file of pixel blocks 1, 0, and 3 or the video file of pixel blocks 2, 0, and 4. If the orientation has changed, in step 9304, the method 9000 combines the video files of pixel blocks 1, 0, and 3, and the method 9000 further combines the video files of pixel blocks 2, 0, and 4. In step 9304, the method 9000 combines the files in chronological order. In step 9306, the method 9000 outputs the combined video file. In step 9600, the non-simultaneous capture mode is stopped.

[0050] In step 9008, after the method 9000 determines that the mobile phone is in a simultaneous capture mode, it continues to step 9200. In step 9200, the method 9000 determines whether the mobile phone is in portrait orientation. If the mobile phone is in portrait orientation, in step 9212, the method 9000 captures video from all five pixel blocks. Then, in step 9214, the method 9000 creates a landscape video by combining pixel blocks 1, 0, and 3. In step 9218, the method 9000 creates a portrait video by combining pixel blocks 2, 0, and 4. After steps 9214 and 9218, the method 9000 continues to step 9216. In step 9220, the method 9000 sends the landscape and portrait videos to a storage device.

[0051] Again, in step 9200, the method 9000 determines whether the mobile phone is in portrait orientation. If the mobile phone is not in portrait orientation, in step 9202, the method 9000 captures video from all five pixel blocks. Then, in step 9204, the method 9000 creates a landscape video by combining pixel blocks 2, 0, and 4. In step 9208, the method 9000 creates a portrait video by combining pixel blocks 3, 0, and 1. After steps 9204 and 9208, the method 9000 continues to step 9206. In step 9210, the method 9000 sends the landscape and portrait videos to a storage device. In step 9600, the simultaneous capture mode stops.

[0052] 9A-9C and 10, prior to image / video capture, the image capture device may provide a preview of both landscape and portrait modes on the user interface in a combined format (e.g., a display that looks like a "+" sign). In one mode of operation, it is possible for a user to simultaneously capture a combined format and play back video in portrait only, landscape only, or combined format.

[0053] According to various embodiments, the following technical solutions are provided to address, among other problems, various existing technical problems discussed in this specification.

[0054] 1. An image sensor device (e.g., Figures 1-5 and 11) comprising: a first sensor array having a first plurality of image sensors, a second sensor array having a second plurality of image sensors, a third sensor array having a third plurality of image sensors, a fourth sensor array having a fourth plurality of image sensors, and a fifth sensor array having a fifth plurality of image sensors, wherein the second sensor array and the fourth sensor array are configured to be excluded from use for capturing images in portrait format, and the third sensor array and the fifth sensor array are configured to be excluded from use for capturing images in landscape format, and the first sensor array is configured to be used for capturing images in portrait format and landscape format.

[0055] 2. The apparatus of claim 1, wherein the first sensor array is a rectangular array having a height of H pixels and a width of W pixels, the second sensor array and the fourth sensor array have a height of H pixels, and the third sensor array and the fifth sensor array have a width of W pixels.

[0056] 3. The apparatus of claim 1, wherein the second sensor array is configured to capture a left-most portion of the landscape format image and the fourth sensor array is configured to capture a right-most portion of the landscape format image.

[0057] 4. The apparatus of claim 1, wherein the third sensor array is configured to capture a top portion of the portrait format image and the fifth sensor array is configured to capture a bottom portion of the portrait format image.

[0058] In various embodiments, blocks 0-4 disclosed above may be organized in various ways. For example, in some embodiments, blocks 2 and 4 may have the same size. In some embodiments, blocks 1 and 3 may have the same size. Alternatively, blocks 2 and 4 may have different sizes and / or blocks 1 and 3 may have different sizes. This may result in a capture region that is asymmetric horizontally or vertically with respect to the central block 0 of common pixels. Additional pixels to the top (bottom, left, or right) may be used to insert metadata or fingerprinting information such as a date stamp, or may include a location identifier that may be included in the visible image at the user's option. In some embodiments, block 0 may be square. In some embodiments, block 0 may be rectangular. For example, block 0 may be wider in the horizontal (landscape) direction to provide a wider panoramic picture. In some embodiments, block 0 may be taller in the vertical (length) direction to provide a wider height image. In some implementations, blocks 1, 2, 3, and 4 may be used to capture three-dimensional information of the captured visual scene. For example, blocks 1 and 3 may hold left eye, right eye information for the block 0 image.

[0059] 5. The apparatus of claim 1, further comprising a media processor, said media processor electrically connected to said first, second, third, fourth, and fifth sensor arrays.

[0060] 6. The device of claim 1, further comprising a handheld structure housing the device.

[0061] 7. A method of capturing an image (e.g., flowchart 1000 of FIG. 10 ), comprising: initiating image or video capture based on a command received on a user interface of a camera comprising: a first sensor array comprising a first plurality of image sensors; a second sensor array comprising a second plurality of image sensors; a third sensor array comprising a third plurality of image sensors; a fourth sensor array comprising a fourth plurality of image sensors; a fourth sensor array comprising a fourth plurality of image sensors; and a fifth sensor array comprising a fifth plurality of image sensors, wherein the second sensor array and the fourth sensor array are configured to be excluded from use for capturing images in a portrait format; the third sensor array and the fifth sensor array are configured to be excluded from use for capturing images in a landscape format; and a first sensor array is configured to be used to capture images in both portrait and landscape formats; and further comprising storing the captured image or video in three or more of the first through fifth sensor arrays (1004).

[0062] 8. The method of claim 7, further comprising: generating one or more previews, including a portrait preview, a landscape preview, or a composite preview, prior to capturing; receiving at least one selection from the user interface to select between the portrait preview, the landscape preview, and the composite preview; and displaying the previews on a screen.

[0063] 9. The method of claim 7, further comprising: generating the composite preview of both landscape and portrait images; and scaling the composite preview to fit the screen of a given aspect ratio.

[0064] 10. The method of claim 7, further comprising: after storing the captured image or video, generating a first file in accordance with the landscape format and a second file in accordance with the portrait format.

[0065] 11. The method of claim 7, further comprising the steps of: generating a first file and a second file, such that a first portion of the first file is exclusive to the first file; a second portion of the first file is shared with the second file; a portion of the second file is exclusive to the second file; and storing the first file and the second file in memory.

[0066] 12. An image sensor device (e.g., FIGS. 1-5 and 11), comprising: a group of sensor arrays having non-overlapping sensor arrays including a first sensor array, a second sensor array, a third sensor array, a fourth sensor array, and a fifth sensor array; a processor coupled to the second sensor array, the third sensor array, the third sensor array, the fourth sensor array, and the fifth sensor array; the processor configured to: determine an orientation of the image sensor device; and perform a selective disabling operation based on the orientation, whereby if the orientation is a portrait format, a first subset of sensor arrays from the group of sensor arrays are disabled, if the orientation is a landscape format, a second subset of sensor arrays from the group of sensor arrays are disabled, and the second subset of sensor arrays is different from the first subset of sensor arrays. For example, the processor can be processor 1102 shown in FIG. 11. In one embodiment shown in Figures 1 to 5, the first sensor array is pixel block 0, the second sensor array is pixel block 1, the third sensor array is pixel block 2, the fourth sensor array is pixel block 3, and the fifth sensor array is pixel block 4.

[0067] 13. The image sensor unit of claim 12, wherein the first subset of sensor arrays comprises the second sensor array and the fourth sensor array.

[0068] 14. The image sensor unit of claim 12, wherein the second subset of sensor arrays comprises the third sensor array and the fifth sensor array.

[0069] 15. The image sensor device of claim 12, wherein the processor is configured to enable the first sensor array in the portrait format and the landscape format.

[0070] 16. The image sensor apparatus of claim 12, wherein the first sensor array is a rectangular array having a height of H pixels and a width of W pixels, the second sensor array and the fourth sensor array have a height of H pixels, and the third sensor array and the fifth sensor array have a width of W pixels.

[0071] 17. The image sensor unit of claim 12, wherein the second sensor array is configured to capture a left edge portion of the landscape format image and the fourth sensor array is configured to capture a right edge portion of the landscape format image.

[0072] 18. The bottom image sensor device of claim 12, wherein the third sensor array is configured to capture a top portion of the portrait format image and the fifth sensor array is configured to capture a bottom portion of the portrait format image.

[0073] 19. The image sensor unit of claim 12, further comprising a handheld structure housing the image sensor unit.

[0074] 20. The image sensor unit of claim 12, wherein the processor is configured to determine the orientation using input received at a user interface or using an orientation sensor.

[0075] In various embodiments, the arrays 0-4 described above may be organized in different ways. For example, in some embodiments, arrays 2 and 4 may have the same size. In some embodiments, arrays 1 and 3 may have the same size. Alternatively, arrays 2 and 4 may have different sizes and / or arrays 1 and 3 may have different sizes. This may result in a capture region that is horizontally or vertically asymmetrical with respect to the central array 0 of common pixels. Additional pixels to the top (bottom, left, or right) may be used to insert metadata or fingerprinting information such as a date stamp, or a location identifier that may be included in the visible image at the user's option. In some embodiments, array 0 may be square. In some embodiments, array 0 may be rectangular. For example, array 0 may be wider in the horizontal (landscape) direction to provide a wider panoramic image. In some embodiments, array 0 may be taller in the vertical (portrait) direction to provide a wider height image. In some implementations, arrays 1, 2, 3, and 4 may be used to capture three-dimensional information of the captured visual scene. For example, arrays 1 and 3 may hold left eye, right eye information for the array 0 image.

[0076] The entire preceding discussion also applies to user-facing cameras.

[0077] FIG. 11 illustrates an exemplary video capture device 1100. The device 1100 includes a processor 1102 configured to execute the methods disclosed herein. The device 1100 includes memory used to store processor executable code and / or image files. The memory can be located internal to the processor 1102. The device 1100 includes an orientation sensor configured to determine the tilt angle or orientation of the camera (e.g., portrait mode, landscape mode, or something in between). The device 1100 includes a camera with an image sensor as disclosed herein. The device 1100 includes a user interface 1110 configured to receive user input (e.g., buttons, touch screen, etc.) and / or display images and interactive menus to a user.

[0078] The disclosed and other embodiments, modules, and functional operations described herein may be implemented in digital electronic circuitry, or computer software, firmware, or hardware, including the structures disclosed herein and their structural equivalents, or a combination of one or more of them. The disclosed and other embodiments may be implemented as one or more computer program products, i.e., one or more modules of computer program instructions encoded on a computer-readable medium for execution by or to control the operation of a data processing device. The computer-readable medium may be a machine-readable storage device, a machine-readable storage substrate, a memory device, a composition of matter that provides a machine-readable propagated signal, or one or more combinations thereof. The term "data processing device" encompasses all apparatus, devices, and machines for processing data, including, by way of example, a programmable processor, a computer, or multiple processors or computers. In addition to hardware, an apparatus may include code that creates an execution environment for a computer program, such as code that constitutes a processor firmware, a protocol stack, a database management system, an operating system, or one or more combinations thereof. A propagated signal is an artificially generated signal, such as a machine-generated electrical, optical, or electromagnetic signal, that is generated to encode information for transmission to an appropriate receiving device.

[0079] A computer program (also known as a program, software, software application, script, or code) can be written in any form of programming language, including compiled or interpreted languages, and can be deployed in any form, including as a stand-alone program or as a module, component, subroutine, or other unit suitable for use in a computing environment. A computer program does not necessarily correspond to a file in a file system. A program can be stored as part of a file that holds other programs or data (e.g., one or more scripts stored in a markup language document), in a single file dedicated to the program in question, or in multiple cooperating files (e.g., files that store one or more modules, subprograms, or portions of code). A computer program can be deployed to be executed on one computer, or on multiple computers located at one site or distributed across multiple sites and interconnected by a communication network.

[0080] The processes and logic flows described herein may be performed by one or more programmable processors executing one or more computer programs to perform functions by operating on input data and generating output. The processes and logic flows may also be performed by, and an apparatus may be implemented as, special purpose logic circuitry, such as an FPGA (field programmable gate array) or an ASIC (application specific integrated circuit).

[0081] Processors suitable for executing computer programs include, by way of example, both general purpose and special purpose microprocessors, as well as any one or more processors of any kind of digital computer. Generally, a processor receives instructions and data from a read-only memory or a random access memory or both. The essential elements of a computer are a processor for executing instructions and one or more memory devices for storing instructions and data. Generally, a computer is also operatively coupled to receive data from or transfer data to, or both, one or more mass storage devices for storing data, e.g., magnetic, magneto-optical, or optical disks. However, a computer need not have such devices. Computer-readable media suitable for storing computer program instructions and data include, by way of example, all forms of non-volatile memory, media, and memory devices, including semiconductor memory devices, e.g., EPROM, EEPROM, and flash memory devices, magnetic disks, e.g., internal hard disks or removable disks, magneto-optical disks, and CD-ROM and DVD-ROM disks. The processor and memory may be supplemented by, or incorporated in, special purpose logic circuitry.

[0082] While this patent document contains many details, these should not be construed as limitations on the scope of the claimed invention or what may be claimed, but rather as descriptions of features specific to particular embodiments. Certain features described herein in the context of separate embodiments may also be implemented in combination in a single embodiment. Conversely, various features described in the context of a single embodiment may also be implemented in multiple embodiments separately or in any suitable combination. Furthermore, features may be described above as acting in a particular combination, and even as initially claimed, one or more features from a claimed combination may in some cases be separated from the combination, and the claimed combination may be directed to subcombinations or variations of the subcombination. Similarly, although operations are depicted in the figures in a particular order, this should not be understood as requiring such operations to be performed in the particular order shown, or in sequential order, or that all of the illustrated operations be performed, to achieve desired results.

[0083] Only some examples and implementations are disclosed. Variations, modifications, and extensions to the described examples and implementations, as well as other implementations, may be made based on what is disclosed.

Claims

1. 1. An image sensor device, comprising: a first sensor array having a first plurality of image sensors; a second sensor array having a second plurality of image sensors; a third sensor array having a third plurality of image sensors; a fourth sensor array having a fourth plurality of image sensors; a fifth sensor array having a fifth plurality of image sensors; Equipped with the second sensor array and the fourth sensor array are configured to be excluded from use for capturing images in a portrait format; the third sensor array and the fifth sensor array are configured to be excluded from use for capturing images in a landscape format; the first sensor array is configured to be used to capture images in the portrait format and the landscape format; Image sensor device.

2. 2. The apparatus of claim 1, wherein the first sensor array is a rectangular array having a height of H pixels and a width of W pixels, the second sensor array and the fourth sensor array have a height of H pixels, and the third sensor array and the fifth sensor array have a width of W pixels.

3. The apparatus of claim 1 , wherein the second sensor array is configured to capture a left edge portion of the landscape format image and the fourth sensor array is configured to capture a right edge portion of the landscape format image.

4. 2. The apparatus of claim 1, wherein the third sensor array is configured to capture a top portion of the portrait format image and the fifth sensor array is configured to capture a bottom portion of the portrait format image.

5. The apparatus of claim 1 , further comprising a media processor, the media processor electrically connected to the first, second, third, fourth, and fifth sensor arrays.

6. The device of claim 1 , further comprising a handheld structure housing the device.

7. 1. A method for capturing an image, comprising: Initiating image or video capture based on a command received on a user interface of the camera, the camera comprising: a first sensor array having a first plurality of image sensors; a second sensor array having a second plurality of image sensors; a third sensor array having a third plurality of image sensors; a fourth sensor array having a fourth plurality of image sensors; a fifth sensor array having a fifth plurality of image sensors; Equipped with the second sensor array and the fourth sensor array are configured to be excluded from use for capturing images in a portrait format; the third sensor array and the fifth sensor array are configured to be excluded from use for capturing images in a landscape format; the first sensor array is configured to be used to capture images in the portrait format and the landscape format; Steps: storing captured images or video in three or more of the first through fifth sensor arrays in accordance with the instructions; The method according to claim 1,

8. The method further comprises: generating one or more previews, including a portrait preview, a landscape preview, or a combined preview, prior to capture; receiving at least one selection from a user interface selecting between the portrait preview, the landscape preview, and the composite preview; displaying the preview on a screen; having The method of claim 7.

9. The method further comprises generating the composite preview of both landscape and portrait images; and scaling the composite preview to fit the screen of a given aspect ratio. The method of claim 7.

10. The method further comprises: generating a first file in accordance with the landscape format and a second file in accordance with the portrait format after storing the captured image or video; The method of claim 7.

11. The method further comprises: creating a first file and a second file, such that a first portion of the first file is exclusive to the first file, a second portion of the first file is shared with the second file, and a portion of the second file is exclusive to the second file; storing the first file and the second file in a memory; having The method of claim 7.

12. 1. An image sensor device, comprising: A group of sensor arrays including non-overlapping sensor arrays, a first sensor array; a second sensor array; a third sensor array; a fourth sensor array; A fifth sensor array; A group including: a processor coupled to the second sensor array, the third sensor array, the fourth sensor array, and the fifth sensor array; Equipped with The processor, determining an orientation of the image sensor device; performing a selective override operation based on said orientation; if the orientation is portrait format, a first subset of sensor arrays in the group of sensor arrays is disabled; if the orientation is a landscape format, a second subset of sensor arrays in the group of sensor arrays is disabled, the second subset being different from the first subset. so that; 4. The method according to claim 1, Image sensor device.

13. The image sensor unit of claim 12 , wherein the first subset of sensor arrays includes the second sensor array and the fourth sensor array.

14. The image sensor unit of claim 12 , wherein the second subset of sensor arrays includes the third sensor array and the fifth sensor array.

15. The image sensor unit of claim 12 , wherein the processor is configured to enable the first sensor array in the portrait format and the landscape format.

16. 13. The image sensor unit of claim 12, wherein the first sensor array is a rectangular array having a height of H pixels and a width of W pixels, the second sensor array and the fourth sensor array have a height of H pixels, and the third sensor array and the fifth sensor array have a width of W pixels.

17. The image sensor unit of claim 12 , wherein the second sensor array is configured to capture a left edge portion of the landscape format image and the fourth sensor array is configured to capture a right edge portion of the landscape format image.

18. The image sensor unit of claim 12 , wherein the third sensor array is configured to capture a top portion of the portrait format image and the fifth sensor array is configured to capture a bottom portion of the portrait format image.

19. The image sensor unit of claim 12 further comprising a handheld structure housing the image sensor unit.

20. The image sensor unit of claim 12 , wherein the processor is configured to determine the orientation using input received at a user interface or using an orientation sensor.

Images