Image sensor apparatus and image capture system

Abstract

The invention provides an image sensor apparatus and an image capture system. The image sensor apparatus includes: a plurality of image sensors organized into a plurality of portions including: a first portion, a second portion, and a third portion configured to capture an image in a lateral format in combination with each other; and a fourth portion and a fifth portion configured to capture an image in a longitudinal format in combination with the first portion.

Description

[0001] Cross - reference to related applications

[0002] This document claims the benefit of priority of U.S. Patent Application No. 18 / 506,865, filed on November 10, 2023, entitled "SIMULTANEOUSLY CAPTURING IMAGES IN LANDSCAPE AND PORTRAIT MODES", and is a partial continuation of U.S. Patent Application No. 18 / 506,865. U.S. Patent Application No. 18 / 506,865 is a continuation of U.S. Patent Application No. 17 / 822,658, filed on August 26, 2022 (now U.S. Patent No. 11,818,472, issued on November 14, 2023). U.S. Patent Application No. 17 / 822,658 claims the benefit of priority of U.S. Provisional Patent Application No. 63 / 267,360, filed on January 31, 2022. The entire content of the above - mentioned applications is incorporated by reference as part of the disclosure of this document. Technical field

[0003] This document relates to image and video capture technologies using handheld electronic devices with cameras. Background art

[0004] Today, most handheld computing devices are equipped with cameras. Users use these devices to capture videos and images. Summary of the invention

[0005] This document discloses technologies for simultaneously capturing videos and images in landscape and portrait modes using a camera.

[0006] In an example aspect, a video capture device is disclosed. The image sensor device includes: a plurality of image sensors, organized into a plurality of parts, wherein the plurality of parts include: a first part, a second part, and a third part, configured to capture images in a landscape format in combination with each other; and a fourth part and a fifth part, configured to capture images in a portrait format in combination with the first part.

[0007] In another exemplary aspect, a video capture device including one or more processors is disclosed. The video capture device includes: a plurality of sensors including non-overlapping portions. The non-overlapping portions include: a first portion; a second portion; a third portion; a fourth portion; a fifth portion; and a processor coupled to the second portion, the third portion, the fourth portion, and the fifth portion, wherein the processor is configured to: determine an orientation of an image sensor device and perform a selective disabling operation based on the orientation such that: in the case where the orientation is a portrait format, a first subset of sensors is disabled; and in the case where the orientation is a landscape format, a second subset of sensors is disabled, wherein the second subset of sensors is different from the first subset of sensors.

[0008] In yet another aspect, an image sensor device includes a plurality of image sensors organized into a plurality of portions, wherein the plurality of portions include: a first portion, a second portion, and a third portion configured to capture an image in a landscape format in combination with each other; and a fourth portion and a fifth portion configured to capture an image in a portrait format in combination with the first portion.

[0009] In yet another aspect, an image sensor device is disclosed, including: a plurality of sensors including non-overlapping portions, the non-overlapping portions including: a first portion; a second portion; a third portion; a fourth portion; a fifth portion; and a processor coupled to the second portion, the third portion, the fourth portion, and the fifth portion, wherein the processor is configured to: determine an orientation of the image sensor device and perform a selective disabling operation based on the orientation such that in the case where the orientation is a portrait format, a first subset of sensors is disabled; and in the case where the orientation is a landscape format, a second subset of sensors is disabled, wherein the second subset of sensors is different from the first subset of sensors.

[0010] In yet another aspect, an image capture system is disclosed, including a plurality of sensor arrays, the plurality of sensor arrays including: a first sensor array and a second sensor array configured to store portions of an image captured in a landscape format; a third sensor array and a fourth sensor array configured to store portions of an image captured in a portrait format; a fifth sensor array configured to store a portion of an image captured in a landscape format and a portion of an image captured in a portrait format; and a plurality of lenses including: a first lens arranged to direct incident light onto the first sensor array; a second lens arranged to direct incident light onto the second sensor array; a third lens arranged to direct incident light onto the third sensor array; a fourth lens arranged to direct incident light onto the fourth sensor array; and a fifth lens arranged to direct incident light onto the fifth sensor array.

[0011] In yet another aspect, a method of operating the above algorithm is disclosed.

[0012] In yet another aspect, a computer-readable storage medium is disclosed. The storage medium stores code that, when executed by one or more processors, causes the one or more processors to implement the methods described herein.

[0013] These and other features are described in this document. BRIEF DESCRIPTION OF THE DRAWINGS

[0014] Figure 1 An example of a single camera integrated circuit is shown.

[0015] Figure 2 An example of a sensor circuit configured in a landscape format is shown.

[0016] Figure 3 An example of a sensor circuit configured in a portrait format is shown.

[0017] Figure 4 An example of portrait mode operation of a camera is shown.

[0018] Figure 5 An example of landscape mode operation of a camera is shown.

[0019] Figure 6 An example of portrait mode preview generation is shown.

[0020] Figure 7 An example of landscape mode preview generation is shown.

[0021] Figure 8 An example of 16:9 preview generation is shown.

[0022] Figures 9A to 9C A flowchart of an example method of camera operation is shown.

[0023] Figure 10 A flowchart of an example method of operating a video capture device is shown.

[0024] Figure 11 A single camera integrated circuit with a movable frame and adjustable aspect ratio is shown.

[0025] Figure 12 Examples of a movable frame and adjustable aspect ratio are shown.

[0026] Figure 13 A movable captured landscape frame and adjustable aspect ratio are shown.

[0027] Figure 14 A movable captured portrait frame and adjustable aspect ratio are shown.

[0028] Figure 15 Is a block diagram of a video capture device.

[0029] Figure 16 Shows an example configuration of a multi-lens camera configuration.

[0030] Figure 17 Shows an example side view of a narrow capture angle multi-lens camera configuration.

[0031] Figure 18 Shows an example side view of a wide capture angle multi-lens camera configuration. Detailed Description

[0032] In this document including the appendix, chapter headings are used to improve the readability of the description and do not limit the discussion to the respective chapters in any way. Further, throughout this document, the term "video" is used for compactness and it will be understood that the described techniques are applicable to capturing and storing video (a series of pictures) or individual pictures or images or photographs. Additionally, for ease of description, the terms "telephone", "mobile telephone" or "cell phone" are used to describe various different handheld devices including a camera. Such devices include handheld tablets, small tablets, laptops, e-book readers, etc.

[0033] It is possible to implement capturing video / photos in landscape format, portrait format or both formats simultaneously using an integrated circuit ( Figure 1 ) having a cross-style image sensor, the pixels of which are organized into 5 blocks, namely, blocks 0, 1, 2, 3 and 4. Block 0 is common and is combined with block 1, 3 or with block 2, 4 to configure the sensor in landscape format or portrait format ( Figure 2 and Figure 3 ). In the default capture mode, the processor or a mode selectable by the user controls the pixel blocks 1 and 3 which are mapped and connected to the common pixel block 0 to form a landscape image. Similarly, the common pixel block 0 and the mode selectable pixel blocks 2 and 4 are mapped and combined to form a portrait image.

[0034] In some embodiments, the image sensor is fabricated in a cross-style. All pixels are X-Y addressable. The image sensor is a two-dimensional pixel array. Each pixel has its own intensity value and a position address represented by X (row number) and Y (column number).

[0035] In accordance with commands from the processor, the pixel blocks 1, 2, 3 and 4 are remapped and reconfigured to output an image matching the user-selected or default (landscape or portrait) format.

[0036] The following are 2 handheld orientations, each having 2 capture modes.

[0037] 1. If the default capture mode is landscape, a mobile phone held in the portrait orientation has a front camera, where pixel blocks 1 and 3 are enabled and blocks 2 and 4 are disabled ( Figure 4 ). Note that when the camera is turned on, block 0 is on. The upper side (which side is the upward direction) of blocks 1, 0, and 3 is determined by the input from the accelerometer.

[0038] - While the mobile phone is held in the portrait orientation, change the capture mode from landscape to portrait by touch selection on the screen. Pixel blocks 2 and 4 of the front camera are enabled and blocks 1 and 3 are disabled.

[0039] 2. If the default capture mode is landscape, a mobile phone held in the landscape orientation enables pixel blocks 2 and 4 of the front camera and disables blocks 1 and 3 ( Figure 5 ). Note that when the camera is turned on, block 0 is on. The upper side of blocks 2, 0, and 4 is determined by the input from the accelerometer.

[0040] - While the mobile phone is held in the landscape orientation, change the capture mode from landscape to portrait by touch selection on the screen. The front camera enables pixel blocks 1 and 3 and disables blocks 2 and 4.

[0041] 3. If the default capture mode is portrait, a mobile phone held in the portrait orientation enables pixel blocks 2 and 4 of the front camera and disables blocks 1 and 3.

[0042] - While the mobile phone is held in the portrait orientation, change the capture mode from portrait to landscape by touch selection on the screen. The front camera enables pixel blocks 1 and 3 and disables blocks 2 and 4.

[0043] 4. If the default capture mode is portrait, a mobile phone held in the landscape orientation enables pixel blocks 1 and 3 of the front camera and disables blocks 2 and 4.

[0044] - While the mobile phone is held in the landscape orientation, change the capture mode from portrait to landscape by touch selection on the screen. Pixel blocks 2 and 4 of the front camera are enabled and blocks 1 and 3 are disabled.

[0045] The following are 2 holding orientations, and on each holding orientation, all 5 pixel blocks 0, 1, 2, 3, and 4 are turned on simultaneously to capture landscape videos / photos and portrait videos / photos simultaneously.

[0046] 1. When the mobile phone is held in the portrait orientation, capture videos or photos with all 5 pixel blocks enabled. For a photo session, the processor commands the integrated circuit to output 2 kinds of images, landscape and portrait, where the upper sides of all 5 pixel blocks are determined by the accelerometer. In this case, the landscape photo is created by combining pixel blocks 1, 0, 3, and the portrait photo is created by combining pixel blocks 2, 0, 4. After capture, the user can select either the landscape or portrait format for display on the screen.

[0047] For a video session, the processor commands the integrated circuit to output 2 separate video documents, a landscape mode document and a portrait mode document, for display and storage. In this case, the landscape video is created by combining pixel blocks 1, 0, 3, and the portrait video is created by combining pixel blocks 2, 0, 4. For simultaneous display during recording, the user can choose to display the landscape video or the portrait video on the screen, and for playback, the user can choose either format for playback.

[0048] 2. When the mobile phone is held in the landscape orientation, capture videos or photos with all 5 pixel blocks enabled. For a photo session, the processor commands the integrated circuit to output 2 kinds of images, landscape and portrait, where the upper sides of all 5 pixel blocks are determined by the accelerometer. In this case, the landscape photo is created by combining pixel blocks 2, 0, 4, and the portrait photo is created by combining pixel blocks 3, 0, 1. After capture, the user can select either the landscape or portrait format for display on the screen.

[0049] For a video session, the processor commands the integrated circuit to output 2 separate video documents, a landscape mode document and a portrait mode document, for display and storage. In this case, the landscape video is created by combining pixel blocks 2, 0, 4, and the portrait video is created by combining pixel blocks 3, 0, 1. For simultaneous display during recording, the user can choose to display the landscape video or the portrait video on the screen, and for playback, the user can choose either format for playback.

[0050] During a simultaneous capture session, the user can select a display preview in either the landscape or portrait format via an on-screen touch icon before capture. The integrated circuit functions not only as an image sensor but also as a media processor that provides simultaneous streaming of landscape and portrait videos.

[0051] Before capture, the sensor / media processor can generate a portrait preview ( Figure 6 ), a landscape preview ( Figure 7 ) or a composite preview of both the landscape image and the portrait image by scaling both the landscape image and the portrait image proportionally to fit a screen with a given aspect ratio - for example, a 16:9 aspect ratio ( Figure 8). In each preview screen, there are 2 icons for the user to select the other two preview screens. In an alternative approach, only one icon is used for preview selection, the first touch selects the second preview, the second touch selects the third preview, and the third touch rotates back to the first preview.

[0052] In some embodiments, to provide 3D video / photo capture capabilities, two cameras are mounted, one in the upper left corner and the other in the upper right corner, to simulate binocular vision that creates a 3D perception.

[0053] Since the disclosed combined integrated image sensor and media processor is only distinguishable from conventional image sensor devices, the landscape and portrait sensors may be referred to as LandPortSensors or LPSensors for short.

[0054] There are many types of LiDAR (Light Detection and Ranging) sensors, and choosing the right one is critical to a successful application. The LiDAR sensor is mounted near the camera, and when the LiDAR sensor is activated, a pulse of light is emitted toward a distant object. The time it takes for the reflected light to return to the sensor is used to determine the distance from the camera to the object. Since all 5 pixel blocks are independently controlled, each pixel block can be turned on individually and an image captured at a time, with the distance measurement stored in the metadata or displayed on the screen. This is a useful feature for survey work or for other special interest activities.

[0055] Install LPSensor in professional cameras. Photographers no longer need to tilt the camera to capture portrait images. Since both formats can be previewed simultaneously or individually, it is possible to capture either format individually or both simultaneously. This helps improve productivity.

[0056] Figure 9A 、 Figure 9B and Figure 9C Together is a flow chart showing an overall method 9000 for a cell phone to capture images or videos. The method 9000 begins at a start block 9006 where the camera is activated. At step 9008, the cell phone determines whether a simultaneous capture mode is selected. If the simultaneous capture mode is not selected, the method 9000 continues to Figure 9A If the simultaneous capture mode is selected, the method 9000 continues to step 9100 of Figure 9C Step 9200 in .

[0057] ​In step 9100, method 9000 determines whether the user has preset the portrait mode as the capture mode. If the portrait mode is already the preset mode, then in step 9102, the mobile phone determines whether the orientation of the mobile phone is portrait. If the mobile phone is in the portrait orientation, the mobile phone enables pixel blocks 2 and 4, but disables pixel blocks 1 and 3 (9108). However, if the mobile phone is in the landscape orientation, the mobile phone enables pixel blocks 1 and 3, but disables pixel blocks 2 and 4 (9104). After enabling and disabling certain pixel blocks in step 9108 or 9104, the mobile phone screen displays a portrait live view (9106). In step 9110, if the video session has not ended, method 9000 continues to return to step 9102 to determine whether the mobile phone remains in the portrait orientation.

[0058] In step 9100, method 9000 determines whether the user has preset the portrait mode as the capture mode. If the portrait mode is not yet the preset mode, then in step 9112, the mobile phone determines whether the orientation of the mobile phone is portrait. If the mobile phone is in the portrait orientation, the mobile phone enables pixel blocks 1 and 3, but disables pixel blocks 2 and 4 (9118). However, if the mobile phone is in the portrait orientation, the mobile phone enables pixel blocks 2 and 4, but disables pixel blocks 1 and 3 (9114). After enabling and disabling certain pixel blocks in step 9118 or 9114, the mobile phone screen displays a portrait live view (9116). In step 9120, if the video session has not ended, method 9000 continues to return to step 9112 to determine whether the mobile phone remains in the portrait orientation.

[0059] When method 9000 determines that the video session has ended in step 9110 or 9120, method 9000 turns off the camera in step 9300 (see Figure 9C ). Then, in step 9302, method 9000 determines whether the mobile phone orientation has been changed during the session. If the orientation has not been changed during the session, then in step 9308, method 9000 outputs the video document of pixel blocks 1, 0, and 3 or the video document of pixel blocks 2, 0, and 4. If the orientation has been changed, then in step 9304, method 9000 combines the video document of pixel blocks 1, 0, and 3; method 9000 further combines the video document of pixel blocks 2, 0, and 4. In step 9304, method 9000 combines the documents in chronological order. In step 9306, method 9000 outputs the combined video document. In step 9600, the non-simultaneous capture mode stops.

[0060] In step 9008, after determining that the mobile phone is in the simultaneous capture mode, method 9000 proceeds to step 9200. In step 9200, method 9000 determines whether the mobile phone is in the portrait orientation. If the mobile phone is in the portrait orientation, then in step 9212, method 9000 captures video from all 5 pixel blocks. Then, in step 9214, method 9000 creates a landscape video by combining pixel blocks 1, 0, and 3. In step 9218, method 9000 creates a portrait video by combining pixel blocks 2, 0, and 4. After steps 9214 and 9218, method 9000 proceeds to step 9216. In step 9220, method 9000 sends the landscape video and the portrait video to the storage device.

[0061] Again, in step 9200, method 9000 determines whether the mobile phone is in the portrait orientation. If the mobile phone is not in the portrait orientation, then in step 9202, method 9000 captures video from all 5 pixel blocks. Then, in step 9204, method 9000 creates a landscape video by combining pixel blocks 2, 0, and 3. In step 9208, method 9000 creates a portrait video by combining pixel blocks 3, 0, and 1. After steps 9204 and 9208, method 9000 proceeds to step 9206. In step 9210, method 9000 sends the landscape video and the portrait video to the storage device. In step 9600, the simultaneous capture mode stops.

[0062] Reference Figures 9A to 9C and Figure 10 , before image / video capture, the image capture device can provide previews of both the landscape mode and the portrait mode in a composite format on the user interface (e.g., displaying something that looks like a "+" symbol). In one operating mode, the user is able to simultaneously capture in a composite format and play the video in portrait only, landscape only, or composite format.

[0063] In some embodiments, the image sensor has 5 individual pixel blocks arranged in a cross pattern. The central block (block 0) can be placed on a horizontal plane, while the other 4 blocks can be placed on an inclined plane. The corresponding image capture device can have 5 individual lenses. Each lens can be non-coplanar with respect to the other lenses. Each lens is configured to directly focus light onto each corresponding pixel block. In one case, for wide-angle panoramic image capture, the faces of block 1 and block 3 can be tilted downward at equal or unequal angles, while for narrow-angle image capture, the faces of block 2 and block 4 can be tilted upward at equal or unequal angles. In another case, all 4 blocks - blocks 1, 2, 3, and 4 - can be tilted downward or upward.

[0064] To enable an image sensor to capture a complete image, each pixel block is associated with a corresponding lens to focus light onto that pixel block. This is because the inclined plane of the pixel block means that light from the scene will not be evenly distributed across the sensor. If only one lens is used, some of the pixel blocks will receive too much light while some others will receive too little light. This will result in image distortion and inaccuracy.

[0065] For example, the image sensor configuration can be as follows: The image sensor is divided into 5 separate pixel blocks. These blocks are arranged in a cross pattern. The central block is placed on a horizontal plane. The other four blocks are placed on inclined planes.

[0066] For example, the camera lens system configuration can be as follows. There are at least 5 separate lenses, each corresponding to one of the pixel blocks in the pixel blocks on the sensor. Each lens focuses light directly onto the corresponding pixel block of that lens.

[0067] The above multi-camera lens system is designed to capture information from multiple perspectives simultaneously, thereby potentially improving the overall image quality, depth perception, or providing some unique imaging capabilities. The following are some potential reasons for such a configuration:

[0068] Security cameras and unmanned aerial vehicles (UAVs): The multi-camera lens system can be used to provide a wider field of view than a single camera. This helps to monitor a larger area or helps to capture multiple angles of a scene.

[0069] Medical imaging: The multi-camera lens system can be used to create 3D images of the human body. This can help in diagnosing and treating diseases.

[0070] Robots: The multi-camera lens system can be used to provide a more complete view of the surrounding environment for robots. This can help the multi-camera lens system to navigate in their environment and avoid obstacles.

[0071] Depth sensing: The arrangement of the inclined pixel blocks can facilitate depth sensing or 3D imaging by capturing different perspectives of a scene.

[0072] Panoramic imaging: The cross pattern arrangement can be used to capture a wider field of view by combining information from multiple lenses.

[0073] Professional applications: Depending on the specific requirements of the application, such a configuration can be beneficial for certain imaging tasks. It is worth noting that such a design may also introduce challenges, such as ensuring the precise alignment of the lenses and maintaining image consistency across the sensor.

[0074] According to various embodiments, the following technical solutions are provided to solve various existing technical problems discussed in this document and other problems.

[0075] A1. An image sensor device ( Figure 15 ), comprising: a first sensor array including a first plurality of image sensors; a second sensor array including a second plurality of image sensors; a third sensor array including a third plurality of image sensors; a fourth sensor array including a fourth plurality of image sensors; and a fifth sensor array including a fifth plurality of image sensors; wherein the second sensor array and the fourth sensor array are configured not to be used for capturing images in a portrait format; wherein the third sensor array and the fifth sensor array are configured not to be used for capturing images in a landscape format; and wherein the first sensor array is configured to be used for capturing images in both portrait and landscape formats.

[0076] A2. The device according to aspect A1, wherein the first sensor array is a rectangular array having a height of H pixels and a width of W pixels, and wherein the second sensor array and the fourth sensor array have a height of H pixels, and the third sensor array and the fifth sensor array have a width of W pixels.

[0077] A3. The device according to aspect A1, wherein the second sensor array is configured to capture the left end portion of an image in a landscape format, and the fourth sensor array is configured to capture the right end portion of an image in a landscape format.

[0078] A4. The device according to aspect A1, wherein the third sensor array is configured to capture the top portion of an image in a portrait format, and the fifth sensor array is configured to capture the bottom portion of an image in a portrait format.

[0079] In various embodiments, the above-disclosed blocks 0 to 4 can be organized in different ways. For example, in some embodiments, blocks 2 and 4 can have the same size. In some embodiments, blocks 1 and 3 can have the same size. Alternatively, blocks 2 and 4 can have different sizes and / or blocks 1 and 3 can have different sizes. This may result in the capture area being horizontally or vertically asymmetric with respect to the central block 0 of the common pixels. Additional pixels at the top (bottom, left, or right) can be used to insert metadata or fingerprint information, such as a date stamp or a location identifier, which can be optionally included in the visible image by the user. In some embodiments, block 0 can be square. In some embodiments, block 0 can be rectangular. For example, block 0 can be wider in the horizontal (landscape) direction to provide a wider panoramic picture. In some embodiments, block 0 can be taller in the vertical (portrait) direction to provide a wide height image. In some implementations, blocks 1, 2, 3, and 4 can be used to capture three-dimensional information of the captured visual scene. For example, blocks 1 and 3 can hold the left-eye and right-eye information of the block 0 image.

[0080] The device according to Solution A1 further includes a media processor, wherein the media processor is electrically connected to the first sensor array, the second sensor array, the third sensor array, the fourth sensor array, and the fifth sensor array.

[0081] The device according to Solution A1 further includes: a handheld structure for accommodating the device.

[0082] A method of capturing an image (e.g., Figure 10 flowchart 1000), includes: starting (1002) image capture or video capture based on an instruction received on a user interface of a camera, the camera including: a first sensor array including a first plurality of image sensors; a second sensor array including a second plurality of image sensors; a third sensor array including a third plurality of image sensors; a fourth sensor array including a fourth plurality of image sensors; a fifth sensor array including a fifth plurality of image sensors; wherein the second sensor array and the fourth sensor array are configured not to capture images in a portrait format; wherein the third sensor array and the fifth sensor array are configured not to capture images in a landscape format; and wherein the first sensor array is configured to capture images in both portrait and landscape formats; and storing (1004) the captured image or video in three or more of the first sensor array to the fifth sensor array according to the instruction.

[0083] The method according to Solution A7 further includes: generating one or more previews before capture, the one or more previews including a portrait preview, a landscape preview, or a composite preview; receiving at least one selection from the user interface to select among the portrait preview, the landscape preview, and the composite preview; and displaying the preview on a screen.

[0084] The method according to Solution A7 further includes: generating a composite preview of both the landscape image and the portrait image, and scaling the composite preview to fit a screen with a given aspect ratio.

[0085] The method according to Solution A7 further includes: after storing the captured image or video, generating a first file according to the landscape format and a second file according to the portrait format.

[0086] The method according to Solution A7 further includes: generating the first file and the second file such that a first part of the first file is exclusive to the first file; a second part of the first file is shared with the second file; a part of the second file is exclusive to the second file; and storing the first file and the second file in a memory.

[0087] An image sensor device (e.g., Figures 1 to 5 and Figure 11),including: a sensor array group including non - overlapping sensor arrays, the non - overlapping sensor arrays including: a first sensor array, a second sensor array; a third sensor array; a fourth sensor array; a fifth sensor array; a processor coupled to the second sensor array, the third sensor array, the fourth sensor array, and the fifth sensor array, wherein the processor is configured to: determine the orientation of the image sensor device and perform a selective disabling operation based on the orientation such that: in the case of a portrait format orientation, disable a first subset of the sensor arrays in the sensor array group; and in the case of a landscape format orientation, disable a second subset of the sensor arrays in the sensor array group, where the second subset of the sensor arrays is different from the first subset of the sensor arrays. For example, the processor can be Figure 11 the processor 1102 shown in Figures 1 to 5 shows an embodiment where the first sensor array is pixel block 0, the second sensor array is pixel block 1, the third sensor array is pixel block 2, the fourth sensor array is pixel block 3, and the fifth sensor array is pixel block 4.

[0088] A13. The image sensor device according to scheme A12, wherein the first subset of the sensor arrays includes the second sensor array and the fourth sensor array.

[0089] A14. The image sensor device according to scheme A12, wherein the second subset of the sensor arrays includes the third sensor array and the fifth sensor array.

[0090] A15. The image sensor device according to scheme A12, wherein the processor is configured to enable the first sensor array in both portrait format and landscape format.

[0091] A16. The image sensor device according to scheme A12, wherein the first sensor array is a rectangular array having a height of H pixels and a width of W pixels, and wherein the second sensor array and the fourth sensor array have a height of H pixels, and the third sensor array and the fifth sensor array have a width of W pixels.

[0092] A17. The image sensor device according to scheme A12, wherein the second sensor array is configured to capture the left - hand portion of an image in landscape format, and the fourth sensor array is configured to capture the right - hand portion of the image in landscape format.

[0093] A18. The image sensor device according to scheme A12, wherein the third sensor array is configured to capture the top portion of an image in portrait format, and the fifth sensor array is configured to capture the bottom portion of the image in portrait format.

[0094] The image sensor device according to Solution A12 further includes: a handheld structure for accommodating the device.

[0095] The image sensor device according to Solution A12, wherein the processor is configured to determine the orientation using the input received at the user interface or using the orientation sensor.

[0096] In various embodiments, the above-disclosed arrays 0 to 4 can be organized in different ways. For example, in some embodiments, arrays 2 and 4 can have the same size. In some embodiments, arrays 1 and 3 can have the same size. Alternatively, arrays 2 and 4 can have different sizes and / or arrays 1 and 3 can have different sizes. This may result in the capture area being horizontally or vertically asymmetric with respect to the central array 0 of common pixels. Additional pixels at the top (bottom, left, or right) can be used to insert metadata or fingerprint information, such as a date stamp or a location identifier, which can be selected by the user to be included in the visible image. In some embodiments, array 0 can be square. In some embodiments, array 0 can be rectangular. For example, array 0 can be wider in the horizontal (landscape) direction to provide a wider panoramic picture. In some embodiments, array 0 can be taller in the vertical (portrait) direction to provide a wide-height image. In some implementations, arrays 1, 2, 3, and 4 can be used to capture three-dimensional information of the captured visual scene. For example, arrays 1 and 3 can hold the left-eye and right-eye information of the array 0 image.

[0097] All of the above descriptions also apply to cameras facing the user.

[0098] Figure 15 An example video capture device 1100 is shown. Device 1100 includes: a processor 1102 configured to execute the methods disclosed in this document. Device 1100 includes a memory for storing processor-executable code and / or image documents. The memory can be internal to the processor 1102. Device 1100 includes an orientation sensor configured to determine the tilt angle or orientation of the camera (e.g., portrait mode, landscape mode, or a mode in between). Device 1100 includes: a camera incorporating the image sensor disclosed herein. Device 1100 includes a user interface 1110 that can be configured to receive user input (e.g., buttons, touchscreens, etc.) and / or display images and interactive menus to the user.

[0099] Example embodiments of flexible image edge adjustment

[0100] With the advancement of image sensor technology, it is possible to not only enable or disable each row pixel and column pixel independently, but also to independently disable or enable each individual pixel of the image sensor. Thus, an image sensor can be created with horizontally and vertically active movable frames and the ability to select a pre - set aspect ratio or adjust the aspect ratio before capturing an image. In most modern image sensors, each individual pixel of the image sensor can be independently enabled or disabled. This level of control is very useful for capturing accurate and detailed images as it allows precise control over exposure, noise reduction, and other image - processing techniques. Since each individual pixel of the image sensor can be independently enabled or disabled, a technique called pixel binning is enabled. In pixel binning, multiple pixels are grouped together and their signals are combined to create a single output pixel. This can increase the sensitivity of the image sensor in low - light conditions or reduce the noise in the image. It can also be used by some of the techniques of the disclosed horizontally and vertically captured frames and adjust the aspect ratio before capturing an image. The disclosed embodiments not only allow the user to physically center an object within the frame by moving the camera, but also allow the user to electronically center the object within the frame.

[0101] The image sensor / processor (or one or more processors) allows the user to: center an object within the horizontal and vertical frames; select a pre - set horizontal and vertical aspect ratio or adjust the horizontal and vertical aspect ratio before simultaneously capturing both a horizontal image and a vertical image or simultaneously capturing a horizontal video and a vertical video. Alternatively or additionally, machine - learning algorithms can be implemented on the processor to detect an object in the field of view of the image sensor, determine the object with respect to orientation based on the object orientation, detect whether the horizontal mode is appropriate or the vertical mode is appropriate, set the correct capture orientation mode based on the detection and / or automatically move the left / right or top / bottom boundaries of the image being captured so as to capture the object within the active capture area of the image - capturing device.

[0102] Reference Figure 11 、 Figure 12 、 Figure 13 and Figure 14, the user operating the camera decides to center the object within the frame. This operation requires moving the entire length of each of the two lateral edges per frame (formed by blocks 1, 0, and 3) up or down. The frame is indicated by six bidirectional vertical arrows, with three bidirectional vertical arrows per edge. Similarly, the three horizontal arrows indicating the longitudinal edges are each moved left or right by a possibly equal number of row pixels and column pixels (initially defined by blocks 0, 2, and 4), then the captured lateral frame is moved vertically up or down, and / or then the captured longitudinal frame is moved horizontally left or right. For example, when capturing a lateral image, if the user decides to move 10 row pixels in the upward direction, the 10 row pixels in the upward direction will be activated or enabled, while the 10 row pixels in the downward direction will be deactivated or disabled. Similarly, when capturing a longitudinal image, if the user decides to move 10 column pixels in the rightward direction, the 10 column pixels in the rightward direction will be activated or enabled, while the 10 column pixels in the leftward direction will be deactivated or disabled. Alternatively or additionally, the horizontal or vertical movement of the pixel positions can be automatically performed by an algorithm implemented by a processor on the camera processor.

[0103] In some embodiments, after centering the object within the lateral and longitudinal frames, the user proceeds to select a presettable lateral and longitudinal aspect ratio from a plurality of presettable lateral and longitudinal aspect ratios, or adjusts the lateral and longitudinal aspect ratios by moving the entire length of the upper or lower edge of the lateral frame vertically up or down, or by moving the entire length of the left or right edge of the longitudinal frame horizontally left or right.

[0104] Alternatively, the user can choose to perform the operations in the reverse order as described in the previous two paragraphs. That is, first set the aspect ratio and then move the captured frame.

[0105] If the user moves the top and bottom edges of the captured lateral frame to cover the entire image sensor, the user will utilize the entire image sensor area to capture a single image. This is the same as: if the user moves the left and right edges of the captured longitudinal frame to cover the entire image sensor, the user will utilize the entire image sensor area to capture a single image.

[0106] Refer to Figure 11 , to produce a lateral image, the image sensor / processor combines the images of blocks 1, 0, and 3; and to produce a longitudinal image, the image sensor / processor combines the images of blocks 2, 0, and 4. The "upward" side of each block (see Figure 13 and Figure 14 ) is determined by the input of an accelerometer mounted on the image capture device.

[0107] As the horizontal and vertical frames move, the previously inactive pixels in blocks A, B, C, and D become active, while the previously active pixels become inactive. For example, if the horizontal frame moves up by 10 rows of pixels, the corresponding 10 previously inactive rows of pixels among the upper edges of the frames in blocks A and B become active, while the corresponding 10 previously active rows of pixels among the lower edges of the frames in blocks C and D become inactive. As a result, pixel blocks 1, 0, and 3 move up by 10 rows of pixels.

[0108] Similarly, if the horizontal frame moves right by 10 columns of pixels, the corresponding 10 previously inactive columns of pixels among the right edges of the frames in blocks B and C become active, while the corresponding 10 previously active columns of pixels among the left edges of the frames in blocks A and D become inactive. As a result, pixel blocks 2, 0, and 4 move right by 10 columns of pixels.

[0109] In some embodiments, the edges of the horizontal and vertical frames can be moved synchronously as in a moving frame, or can be moved independently as in an adjusted aspect ratio.

[0110] In various embodiments, the shape of the total area of the image sensor size can be square or rectangular.

[0111] For example, during a capture session, the user views an object through a viewfinder or on a preview screen, selects the vertical frame as the reference frame, and while keeping the vertical frame stable, continues to electronically center the object within the horizontal frame and capture images of both simultaneously.

[0112] By default settings or by user selection, the camera can activate the unused corner pixels in blocks A, B, C, and D to improve the image. The corner pixels of the image sensor typically receive less incident light than the central pixels. This is due to many factors, including:

[0113] Lens vignetting: Vignetting is a phenomenon where the corners of an image are darker than the center. This is because the lens cannot focus light evenly across the entire image plane. The corners of the image plane are typically the farthest from the center of the lens, so the corners receive less light.

[0114] Lens hood: If a lens hood is used, it partially blocks light from entering the corners of the sensor, resulting in reduced illumination in these areas.

[0115] Sensor geometry: The pixels at the corners of the image sensor are typically arranged in a way that is less sensitive to light. In some cases, the sensor size may not perfectly match the image circle projected by the lens. This can result in less light reaching the corners of the sensor.

[0116] Optical Design: The optical design of the lens and sensor stack (glass layers, filters, and microlenses) affects the uniform distribution of light across the sensor surface.

[0117] The image sensor / processor can apply correction techniques to compensate for vignetting and ensure more uniform illumination across the sensor. This can involve post-processing in the camera or software correction during image processing.

[0118] Techniques for centering the image within the frame can be implemented by leveraging artificial intelligence (AI). AI can be used to improve the performance of the image sensor by identifying and processing different objects within the image - such as people, animals, and landscapes. This can improve tasks such as image classification, object detection, and even image enhancement, thus helping the camera and sensor to capture better-quality images in various scenarios.

[0119] In addition, AI can improve image quality by processing the processed image itself. Deploying AI-based algorithms directly on the sensor data provides additional degrees of freedom that can be utilized to unlock the hidden potential for improving image quality.

[0120] Some embodiments can allow the user to dynamically move the captured frame to adjust the aspect ratio of the captured image before simultaneously capturing landscape and portrait images. It also eliminates the need to rotate the camera when capturing portrait images. Thus, convenience, flexibility, productivity are provided, and "rotating the camera" becomes a thing of the past.

[0121] The second set of technical solutions can include the following.

[0122] 1. An image sensor device, comprising: a plurality of image sensors organized into a plurality of parts, wherein the plurality of parts include: a first part, a second part, and a third part configured to capture an image in a landscape format in combination with each other; and a fourth part and a fifth part configured to capture an image in a portrait format in combination with the first part. Figures 1 to 5 and Figures 11 to 14 And related descriptions disclose some embodiments of such an image sensor device. For example, the first part, the second part, and the third part can be Figure 1 or Figure 11 the blocks 0, 1, and 3 shown in Figure 1 or the blocks 2 and 4 of

[0123] 2. The image sensor device according to solution 1, further comprising: a first corner part and a second corner part configured to adjust the capture of the image in the landscape format according to the vertical position during capture. For example, referring to Figures 11 to 14, the first corner part and the second corner part may include A and B, or C and D, depending on whether the image is vertically centered or moved up or down according to a user decision or a machine automatic decision. A and B, or C and D may be used to capture a landscape image.

[0124] 3. The image sensor device according to aspects 1 to 2, further comprising: a third corner part and a fourth corner part configured to capture an image in a portrait format during capture according to a horizontal position adjustment. For example, referring to Figures 11 to 14 , the first corner part and the second corner part may include corner parts A and D, or B and C, depending on whether the image is horizontally centered or moved left or right according to a user decision or a machine automatic decision. Corner parts A and D, or B and C may be used to capture a portrait image.

[0125] 4. The device according to aspects 1 to 3, further comprising: a first corner part and a second corner part configured to capture an image in a landscape format during capture according to a vertical position adjustment; and a third corner part and a fourth corner part configured to capture an image in a portrait format during capture according to a horizontal position adjustment. Figures 11 to 14 The corner parts A, B, C, and D respectively depicted in

[0126] 5. The device according to aspects 1 to 4, wherein the second part is configured to capture the left end part of the image in a landscape format, and the third part is configured to capture the right end part of the image in a landscape format (e.g., block 3). In this case, for example, the left end part may correspond to block 1.

[0127] 6. The device according to aspects 1 to 5, wherein the third part is configured to capture the top part of the image in a portrait format, and the fourth part is configured to capture the bottom part of the image in a portrait format (e.g., block 4). In this case, for example, the top part may correspond to block 2.

[0128] 7. The device according to aspects 1 to 6, further comprising a media processor, wherein the media processor is electrically connected to the first part, the second part, the third part, the fourth part, and the fifth part of the plurality of image sensors.

[0129] 8. The device according to aspects 1 to 7, wherein the plurality of sensor image sensors are arranged in a square shape.

[0130] 9. The device according to aspects 4 to 8, further comprising: one or more processors configured to control the activation or deactivation of the image sensors of the first corner part, the second corner part, the third corner part, and the fourth corner part in response to a vertical position adjustment and / or a horizontal position adjustment.

[0131] 10. The apparatus according to aspect 9, wherein the vertical position adjustment and / or the horizontal position adjustment is responsive to an input on a user interface.

[0132] 11. The apparatus according to aspect 9, wherein the vertical position adjustment and / or the horizontal position adjustment is responsive to a pose determination algorithm executed by one or more processors.

[0133] 12. An image sensor device, comprising: a plurality of sensors, including non-overlapping portions, the non-overlapping portions including: a first portion; a second portion; a third portion; a fourth portion; a fifth portion; and a processor, coupled to the second portion, the third portion, the fourth portion, and the fifth portion, wherein the processor is configured to: determine an orientation of the image sensor device and perform a selective disabling operation based on the orientation such that, when the orientation is in a portrait format, a first subset of sensors is disabled; and when the orientation is in a landscape format, a second subset of sensors is disabled, wherein the second subset of sensors is different from the first subset of sensors. As described in this document, the orientation sensor 1106 can be used to provide orientation input to one or more sensors. Alternatively, user input can provide orientation input to the processor.

[0134] 13. The image sensor device according to aspect 12, wherein the first subset of sensors includes at least some sensors in the second portion and the fourth portion.

[0135] 14. The image sensor device according to aspects 12 to 13, wherein the second subset of sensors includes at least some sensors in the third portion and the fifth portion.

[0136] 15. The image sensor device according to aspects 12 to 13, wherein the processor is configured to determine the orientation using an input received at a user interface or using an orientation sensor.

[0137] 16. The image sensor device according to aspects 12 to 13, wherein the processor is further configured to: move an upper edge or a lower edge or a left edge or a right edge of the sensors activated during image capture among the plurality of sensors based on a vertical position adjustment or a horizontal position adjustment.

[0138] 17. The image sensor device according to aspect 16, wherein the vertical position adjustment or the horizontal position adjustment is performed by an artificial intelligence algorithm.

[0139] 18. An image capture system (e.g., Figure 16 system 1600 in Figure 17(in the additional view), including: a plurality of sensor arrays, the plurality of sensor arrays including: a first sensor array (1612) and a second sensor array (1616), configured to store portions of images captured in a landscape format; a third sensor array (1614) and a fourth sensor array (1618), configured to store portions of images captured in a portrait format; a fifth sensor array (1620), configured to store a portion of an image captured in a landscape format and a portion of an image captured in a portrait format; and a plurality of lenses, including: a first lens (1602), arranged to direct incident light onto the first sensor array; a second lens (1606), arranged to direct incident light onto the second sensor array; a third lens (1604), arranged to direct incident light onto the third sensor array; a fourth lens (1608), arranged to direct incident light onto the fourth sensor array; and a fifth lens (1610), arranged to direct incident light onto the fifth sensor array.

[0140] Figure 16 Shows a view of the image capture system from the light incident direction, slightly viewed from the upper left perspective, where the sensor arrays are shown as dashed lines to indicate that the sensor arrays are located behind (or below) the lenses. Although the lenses and arrays are partially shown as rectangular or square, different shapes, such as circular shapes, can be used in various embodiments. Additionally, in various embodiments, the lenses and the corresponding sensor arrays can have a one-to-one size correspondence or can have different coverage areas. For example, some or all of the lenses can be configured to allow some overlap between the captured images to allow for seamless image generation.

[0141] Figure 17 Shows a side view from the perspective of the A-A symmetry line and another side view from the perspective of the B-B symmetry line. Although the distances between the lenses and the sensor arrays are shown to be relatively uniform, typically these distances may not be the same. Since the sensor arrays and the lenses are tilted away from the light source and tilted away from the object from which the image or video is being captured, Figure 17 the configuration shown can be adapted to capture narrow-angle images.

[0142] Figure 18 Shows a side view from the perspective of the A-A symmetry line and another side view from the perspective of the B-B symmetry line. Although the distances between the lenses and the sensor arrays are shown to be relatively uniform, typically these distances may not be the same. Since the sensor arrays and the lenses are tilted away from the light source and tilted away from the object from which the image or video is being captured, Figure 18The configuration shown can be adapted to capture wide-angle images. Those skilled in the art will understand that such an outward-opening wing-shaped lens structure and the corresponding sensor array will allow for a wider-angle capture within the angular range of the captured image. For example, the lens can be arranged to be nearly orthogonal to the middle lens, thereby allowing a 180-degree view to be captured in a single image.

[0143] 19. The image capture system according to claim 18, wherein the first lens, the second lens, the third lens, and the fourth lens are inclined with respect to the plane of the fifth lens.

[0144] 20. The image capture system according to claim 18 or 19, wherein the first sensor array, the second sensor array, the third sensor array, and the fourth sensor array are inclined with respect to the plane of the fifth sensor array. In some embodiments, the inclination angles of the left lens and the right lens can be the same. Thus, such an arrangement can allow for symmetric coverage of the captured viewpoints. In some embodiments, the two inclination angles can be different. For example, if the left lens is inclined at a larger obtuse angle, the camera can be adapted to capture left-hand side visual information at a wider angle. Similarly, in some cases, the right lens can be inclined at a more obtuse angle. Such an asymmetric arrangement of the lens and the corresponding image sensor array can be adapted for applications where the field of view may be asymmetric, such as a camera deployed at a corner of a room building and having different angular field of view coverage. For the top and bottom sensor array / lens combinations, the asymmetry of the inclination angles can also function similarly.

[0145] 21. The image capture system according to claims 18 to 20, wherein the first lens and the first sensor array are disposed in parallel planes having a first distance, the second lens and the second sensor array are disposed in parallel planes having a second distance, the third lens and the third sensor array are disposed in parallel planes having a third distance, the fourth lens and the fourth sensor array are disposed in parallel planes having a fourth distance, and the fifth lens and the fifth sensor array are disposed in parallel planes having a fifth distance. In some embodiments, the spacing between the lens and the image array can be the same, for example, when all the lenses have similar focal length / aperture characteristics. Alternatively, in some embodiments, lenses with different focal lengths or apertures can be used, such that the corresponding distances between the image sensor array and the lens can be different. Such an arrangement can be advantageously used to allow for different densities of image capture. For example, the overlapping portions of the horizontal / vertical images can be captured at a higher sensor density than the non-overlapping portions.

[0146] Additional technical solutions may include:

[0147] - wherein the sensor arrays are not in the same plane to provide depth information,

[0148] - wherein the spectral response of the sensor array or sensor section varies based on the position of the sensor array or sensor section within the array (to give a multi - spectral image),

[0149] - wherein the resolution of the side sensors (e.g., sensor sections dedicated to lateral or longitudinal capture) is different from that of the central sensor, or is different between different wings,

[0150] - wherein, for the side sensor sections, the color configuration is different from that of the central (common) array,

[0151] - wherein blocks 0, 1, 3 are for one sensor, and blocks 2 and 4 are additional,

[0152] - wherein the capture speed of each sensor array is different, allowing different exposure pans and tilt visual effects for video capture,

[0153] - wherein different lenses have different optical characteristics, such as focal length, aperture, etc.

[0154] In this document, the terms "sensor" and "image sensor" may include embodiments that capture light in the visible spectrum. In some embodiments, the sensor or image sensor may use light energy above or below the visible spectrum wavelengths to capture an image and reproduce the image electronically.

[0155] In this document, the term "array" is used to denote capturing an image using sensors in two dimensions (e.g., height and width), and does not necessarily mean a uniform physical layout of sensors evenly separated within the array.

[0156] In some embodiments, a method of operating an image capture system includes operating image processing as described by the above - mentioned scheme to capture an image or video.

[0157] In some embodiments, software algorithms may be executed on one or more processors included in the image capture system, wherein the software algorithms are configured to control image capture using one or more of the sensor arrays or sensor sections disclosed above. Additionally, in some embodiments, video capture may be performed. In some embodiments, one or more processors may also control one or more flashlights, causing the flashlights to be activated - one at a time or sequentially - to illuminate the surrounding area to capture an image or video.

[0158] It will also be understood that the disclosed sensor arrays and sections, as well as lenses, may be provided within a mobile phone, a camera, an unmanned aerial vehicle such as a drone. Additionally, it should be understood that the disclosed image capture system may support various video or image capture operations, such as panning or tilting.

[0159] It will also be understood that the disclosed image capture system may include a user interface, such as a display, on which a user may provide input regarding setting the camera to portrait (capture height > capture width) or landscape (capture width > capture height) format for image capture.

[0160] The disclosed and other embodiments, modules, and functional operations described in this document can be implemented in digital electronic circuitry, or in computer software, firmware, or hardware, including the structures disclosed in this document and their structural equivalents, or in combinations of one or more of them. The disclosed and other embodiments can be implemented as one or more computer program products, i.e., one or more modules of computer program instructions encoded on a computer-readable medium for execution by, or to control the operation of, a data processing apparatus. The computer-readable medium can be a machine-readable storage device, a machine-readable storage substrate, a memory device, a composition of matter that generates a machine-readable propagated signal, or a combination of one or more of them. The term "data processing apparatus" encompasses all devices, apparatuses, and machines for processing data, such as including programmable processors, computers, or multiple processors or computers. In addition to hardware, the device may also include code that creates an execution environment for the relevant computer program, e.g., code that constitutes processor firmware, a protocol stack, a database management system, an operating system, or a combination of one or more of them. A propagated signal is an artificially generated signal, e.g., a machine-generated electrical, optical, or electromagnetic signal that is generated for encoding information to be transmitted to a suitable receiver device.

[0161] A computer program (also referred to as a program, software, software application, script, or code) can be written in any form of programming language, including compiled or interpreted languages, and can be deployed in any form, including as a stand-alone program or module, component, subroutine, or other unit suitable for use in a computing environment. A computer program does not necessarily correspond to a document in a document system. The program can be stored in a part of a document that holds other programs or data (e.g., one or more scripts in a markup language file), in a single document dedicated to the relevant program, or in multiple coordinated documents (e.g., files that store one or more modules, subroutines, or portions of code). A computer program can be deployed to execute on one computer, or on multiple computers located at one site or distributed across multiple sites and interconnected by a communication network.

[0162] The processes and logical flows described in this document can be performed by one or more programmable processors that execute one or more computer programs to perform functions by operating on input data and generating output. The processes and logical flows can also be performed by special-purpose logic circuitry, such as an FPGA (Field Programmable Gate Array) or ASIC (Application Specific Integrated Circuit), and the apparatus can also be implemented as such special-purpose logic circuitry.

[0163] Processors suitable for the execution of a computer program include, by way of example, both general and special purpose microprocessors, and one or more processors of any type of digital computer. Generally, a processor will receive instructions and data from a read only memory or a random access memory or both. Elements of a computer are a processor for executing instructions and one or more memory devices for storing instructions and data. Generally, a computer will also include one or more mass storage devices for storing data, such as magnetic disks, magneto-optical disks, or optical disks, or operatively coupled to receive data from or transfer data to one or more mass storage devices for storing data, or a computer includes one or more mass storage devices for storing data, such as magnetic disks, magneto-optical disks, or optical disks, and operatively coupled to receive data from or transfer data to both one or more mass storage devices for storing data. However, a computer need not have such devices. Computer-readable media suitable for storing computer program instructions and data include all forms of non-volatile memory, media, and memory devices, including by way of example: semiconductor memory devices, such as EPROM, EEPROM, and flash memory devices; magnetic disks, such as internal hard disks or removable disks; magneto-optical disks; and CD-ROM and DVD-ROM disks. The processor and the memory can be supplemented by, or incorporated in, special-purpose logic circuitry.

[0164] Although this patent document contains many details, these details should not be construed as limiting the scope of the claimed invention or of inventions that may be claimed, but rather as descriptions of features of particular embodiments. Certain features that are described in this document in the context of separate embodiments can also be implemented in combination in a single embodiment. Conversely, various features that are described in the context of a single embodiment can also be implemented separately in multiple embodiments or in any suitable sub-combination. Moreover, although features may be described as acting in certain combinations and even initially claimed as such, in some cases, one or more features from a claimed combination can be deleted from the combination, and the claimed combination can be directed to a sub-combination or a variant of a sub-combination. Similarly, although operations are depicted in the figures in a particular order, this should not be understood as requiring that the operations be performed in the particular order shown or in sequential order, or that all illustrated operations be performed, to achieve desirable results.

[0165] Only a few examples and implementations are disclosed. Variations, modifications, enhancements, and other implementations can be formed based on the disclosed content for the examples and implementations.

Claims

1. A device comprising: A plurality of image sensors are organized into a plurality of sections, wherein the plurality of sections include: The first portion, the second portion, and the third portion are configured to capture an image in a landscape format in combination with one another; and The fourth and fifth sections are configured to capture images in a portrait format in combination with the first section.

2. The device according to claim 1, further comprising: a first corner portion and a second corner portion configured to capture an image in the landscape format based on a vertical position adjustment during capture; The third corner portion and the fourth corner portion are configured to capture an image in the portrait format according to a horizontal position adjustment during capturing.

3. The device according to claim 1, further comprising: a first corner portion and a second corner portion configured to capture an image in the landscape format based on a vertical position adjustment during capture; as well as The third corner portion and the fourth corner portion are configured to capture an image in the portrait format according to a horizontal position adjustment during capturing.

4. The device according to claim 2 or 3, wherein: The second portion is configured to capture a left portion of an image in the landscape format, and the third portion is configured to capture a right portion of an image in the landscape format; or The third portion is configured to capture a top portion of an image in the portrait format, and the fourth portion is configured to capture a bottom portion of an image in the portrait format.

5. The device according to claim 1, further comprising a media processor, wherein: The media processor is electrically connected to the first portion, the second portion, the third portion, the fourth portion, and the fifth portion of the plurality of image sensors.

6. The device according to claim 3, further comprising: One or more processors are configured to control activation or deactivation of the image sensors of the first corner segment, the second corner segment, the third corner segment, and the fourth corner segment in response to the vertical position adjustment and / or the horizontal position adjustment.

7. The device according to claim 6, wherein: The vertical position adjustment and / or the horizontal position adjustment is responsive to an input on a user interface or a gesture determination algorithm.

8. The device according to claim 6, wherein: The vertical position adjustment and / or the horizontal position adjustment is responsive to a posture determination algorithm executed by the one or more processors.

9. The device according to claim 5, wherein: The media processor is configured to: determining the orientation of the device, and A selective disabling operation is performed based on the orientation such that: disabling a first subset of sensors when the orientation is in a portrait format; as well as disabling a second subset of sensors in a case where the orientation is in landscape format, The second subset of sensors is different from the first subset of sensors.

10. The device according to claim 9, wherein: The first subset of sensors includes at least some of the sensors in the second portion and the fourth portion, or The second subset of sensors includes at least some sensors in the third portion and the fifth portion.

11. The device according to claim 9, wherein: The media processor is further configured to implement an artificial intelligence algorithm to move a sensor at an upper edge or a lower edge or a left edge or a right edge among the plurality of image sensors activated during image capture based on a vertical position adjustment or a horizontal position adjustment.

12. An image capture system comprising: Multiple sensor arrays, including: a first sensor array and a second sensor array configured to store portions of an image captured in a landscape format; a third sensor array and a fourth sensor array configured to store portions of an image captured in a portrait format; and a fifth sensor array configured to store a portion of the image captured in the landscape format and a portion of the image captured in the portrait format; and Multiple lenses, including: a first lens, configured to make incident light fall on the first sensor array; a second lens, configured to make the incident light fall on the second sensor array; a third lens, configured to make the incident light fall on the third sensor array; a fourth lens, configured to make the incident light fall on the fourth sensor array; and The fifth lens is configured to make the incident light fall on the fifth sensor array.

13. The image capture system of claim 12, wherein: The first lens, the second lens, the third lens and the fourth lens are tilted relative to a plane of the fifth lens.

14. The image capture system of claim 13, wherein: The first sensor array, the second sensor array, the third sensor array, and the fourth sensor array are tilted relative to a plane of the fifth sensor array.

15. The image capture system of claim 14, wherein: The first lens and the first sensor array are arranged in parallel planes at a first distance, The second lens and the second sensor array are arranged in parallel planes at a second distance, The third lens and the third sensor array are arranged in parallel planes at a third distance, The fourth lens and the fourth sensor array are arranged in parallel planes at a fourth distance, and The fifth lens and the fifth sensor array are arranged in parallel planes at a fifth distance.

Images