Optical image stabilization with asymmetric travel for camera devices

Abstract

Embodiments of the present disclosure relate to an image pickup apparatus with optical image stabilization (OIS) having a range of motion that is asymmetric along two spatial dimensions. The image pickup apparatus includes an image sensor, a lens assembly optically in series with the image sensor, and an OIS assembly. The OIS assembly initiates a first movement of at least one of the image sensor and the lens assembly in a first direction parallel to the first axis, the first movement having a first range. The OIS assembly also initiates a second movement of at least one of the image sensor and the lens assembly in a second direction parallel to a second axis, the second axis being orthogonal to the first axis, the second movement having a second range different from the first range.

Description

Technical Field

[0001] The present disclosure relates generally to imaging devices, and more particularly to optical image stabilization with asymmetric travel for imaging devices. Background Art

[0002] Optical image stabilization applied to a camera device requires a trade-off between power consumption and performance of the camera device. Better performance of the camera device requires a longer stroke. However, with a longer stroke, the power consumption of the camera device may increase. In addition, one or more module sizes (i.e., footprint) associated with one or more optical image stabilization components of the camera device may also increase with a longer stroke. Allowing the lens of the camera device to droop completely due to gravity (e.g., in a horizontal posture of the camera device) can save power, but may not leave enough stroke, which can negatively affect the performance of the camera device, especially for longer exposures of the camera device.

[0003] Generally speaking, the camera lens is first installed in the lens barrel, and then the optical axis of the camera lens is aligned in a passive manner, wherein the alignment is determined by the size and tolerance control of the lens barrel and the camera lens. If multiple lenses are to be installed in the lens barrel, active optical alignment is usually applied. In addition, some types of lenses can be embedded in the lens barrel or integrated with the lens barrel by using an actuator. However, when the actuator is turned on and off, the lens performance may be different. For example, when the tunable lens is powered off (that is, when the tunable lens is in an idle state), the tunable lens is flat, and the optical axis of the tunable lens cannot be aligned in the power-off state. Therefore, aligning the tunable lens in the lens barrel requires activating the tunable lens, which also requires an external power supply unit (for example, a driver different from a camera device) and a temporary electrical connection (for example, wire bonding). In some cases, the design of the lens barrel design can be modified to facilitate the alignment of the lens and the lens assembly. All of these make the lens installation and alignment process more complicated.

[0004] The lens barrel is a key component of a compact camera device because multiple lenses can be installed in the lens barrel. Electrical contacts can be integrated into the lens barrel for actuators (e.g., voice coil motors), tunable lenses, optical image stabilization (OIS) actuators, sensors, etc. Metal insert molding is widely used to implement wires and electrical contacts inside the body of the lens barrel. Metal inserts represent very thin sheets or wires embedded in the body of the lens barrel. The critical size of the metal insert can be, for example, less than 0.1 mm, and the metal insert can be very soft. The body of the lens barrel provides sufficient mechanical support for the metal insert to prevent the metal insert from moving or deforming. When the metal insert is embedded in the lens barrel, the large mismatch of the coefficients of thermal expansion (CTE) of the metal insert, the lens barrel, and the electrical contacts may cause large thermal stress at the electrical contacts, thereby causing reliability issues. Since both actuators and sensors are sensitive to thermomechanical stress, large thermomechanical stress at the electrical contacts may bring risks to the actuator or sensor. Thermomechanical stresses on the electrical (metal) contacts may be as high as, for example, 100 MegaPascals (MPa) and may lead to large deformations of the electrical contacts. Summary of the invention

[0005] Embodiments of the present disclosure relate to a camera device (e.g., a wearable camera device) with optical image stabilization (OIS), the OIS having an asymmetric range of motion along two spatial dimensions. The camera device includes an image sensor, a lens assembly optically connected in series with the image sensor, and an OIS assembly. The OIS assembly initiates a first motion of at least one of the image sensor and the lens assembly along a first direction parallel to a first axis, the first motion having a first range. The OIS assembly also initiates a second motion of at least one of the image sensor and the lens assembly along a second direction parallel to a second axis, the second axis being orthogonal to the first axis, the second motion having a second range different from the first range. In some embodiments, the lens assembly and the image sensor allow a first motion along a first direction parallel to the first axis having a first range, and a second motion along a second direction parallel to the second axis having a second range, the second range being different from the first range.

[0006] The camera device presented herein may be part of a wristband system, such as a smart watch or some other electronic wearable device. Additionally or alternatively, the camera device may be part of a handheld electronic device (e.g., a smartphone) or some other portable electronic device.

[0007] According to a first aspect of the present disclosure, there is provided an imaging device, comprising: an image sensor; a lens assembly, which is optically connected in series with the image sensor; and an optical image stabilization (OIS) assembly, which is configured to: initiate a first movement of at least one of the image sensor and the lens assembly along a first direction parallel to a first axis, the first movement having a first range, and initiate a second movement of at least one of the image sensor and the lens assembly along a second direction parallel to a second axis, the second axis being orthogonal to the first axis, the second movement having a second range different from the first range.

[0008] In some embodiments, the first range is symmetric about the second axis, and the second range is symmetric about the first axis.

[0009] In some embodiments, the first range is symmetric about the second axis, and the second range is asymmetric about the first axis.

[0010] In some embodiments, after the first movement and the second movement, a central axis of the image sensor substantially overlaps an optical axis of the lens assembly.

[0011] In some embodiments, the OIS assembly includes a first pair of magnets and a second pair of magnets, each magnet of the first pair of magnets being positioned about a first axis and each magnet of the second pair of magnets being positioned about a second axis.

[0012] In some embodiments, a first dimension of each magnet from the first pair along an axis parallel to the second axis is smaller than a second dimension of each magnet from the second pair along an axis parallel to the first axis.

[0013] In some embodiments, a dimension of a magnet from the second pair along an axis parallel to the first axis is different than another dimension of another magnet from the second pair along an axis parallel to the first axis.

[0014] In some embodiments, the camera device further comprises one or more actuators configured to actuate the first motion and the second motion based on one or more signals from the OIS component.

[0015] In some embodiments, the first range and the second range depend on the stiffness of one or more springs coupled to the one or more actuators.

[0016] In some embodiments, the first range and the second range depend on the strength of one or more coils of the one or more actuators.

[0017] In some embodiments, the OIS assembly initiates the first movement and the second movement in response to the camera device changing orientation from the first orientation to the second orientation.

[0018] In some embodiments, the camera device rotates about the first axis when changing the orientation from the first orientation to the second orientation.

[0019] In some embodiments, when the imaging assembly is in a first orientation, an optical axis of the lens assembly is parallel to gravity, and when the imaging assembly is in a second orientation, the optical axis is orthogonal to gravity.

[0020] In some embodiments, the camera device is part of a smart watch.

[0021] According to a second aspect of the present disclosure, there is provided an imaging device, comprising: an image sensor; and a lens assembly, which is optically connected in series with the image sensor, wherein the lens assembly and the image sensor allow a first movement having a first range along a first direction parallel to a first axis, and a second movement having a second range along a second direction parallel to a second axis, the second axis being orthogonal to the first axis, and the second range being different from the first range.

[0022] In some embodiments, the camera device further includes an optical image stabilization component configured to initiate the first motion and the second motion.

[0023] In some embodiments, the first range is symmetric about the second axis, and the second range is symmetric about the first axis.

[0024] In some embodiments, the first range is symmetric about the second axis, and the second range is asymmetric about the first axis.

[0025] According to a third aspect of the present disclosure, a method is provided, comprising: initiating a first movement of at least one of an image sensor and a lens assembly in a camera device along a first direction parallel to a first axis, the first movement having a first range; and initiating a second movement of at least one of the image sensor and the lens assembly along a second direction parallel to a second axis, the second axis being orthogonal to the first axis, the second movement having a second range different from the first range.

[0026] In some embodiments, the method further comprises initiating the first movement and the second movement in response to the camera device changing orientation from the first orientation to the second orientation, wherein the camera device changing orientation from the first orientation to the second orientation comprises rotating the camera device around the first axis. BRIEF DESCRIPTION OF THE DRAWINGS

[0027] Figure 1A is a top view of an example wristband system according to one or more embodiments.

[0028] Figure 1B yes Figure 1A Side view of an example wristband system.

[0029] Figure 2A is a perspective view of another example wristband system according to one or more embodiments.

[0030] Figure 2B According to one or more embodiments Figure 2A A stereoscopic view of an example wristband system in which the watch body is released from the strap.

[0031] Figure 3 is a cross-section of an electronic wearable device according to one or more embodiments.

[0032] Figure 4A is a cross section of the imaging apparatus according to one or more embodiments in an upward (vertical) posture.

[0033] Figure 4B is a cross section of the imaging apparatus according to one or more embodiments in a forward (horizontal) posture.

[0034] Figure 5 Example movement of an electronic wearable device along two spatial dimensions is shown in accordance with one or more embodiments.

[0035] Fig. 6A An example OIS assembly of a camera device having a symmetric travel diagram is shown in accordance with one or more embodiments.

[0036] Figure 6B An example OIS assembly of a camera device having an asymmetric travel map is shown in accordance with one or more embodiments.

[0037] Fig. 7A Example motion trajectories of an actuator of a camera device according to one or more embodiments are shown.

[0038] Figure 7B An example travel graph of a camera device for compensating for large motion of the camera device in one direction in accordance with one or more embodiments is shown.

[0039] Figure 8 is a flow chart illustrating a process of initiating asymmetric travel for OIS at a camera device in accordance with one or more embodiments.

[0040] Fig. 9A An example lens reference alignment system is shown in accordance with one or more embodiments.

[0041] Fig. 9B According to one or more embodiments, Fig. 9A An example lens pick up head for a lens reference alignment system.

[0042] Fig. 9CAccording to one or more embodiments, Fig. 9A An example optical imaging system of a lens reference alignment system.

[0043] Fig. 10A An example alignment of a lens reference alignment system is shown in accordance with one or more embodiments.

[0044] Fig. 10B An example process for lens-referenced optical alignment is shown in accordance with one or more embodiments.

[0045] Fig. 10C An example final state after lens reference optical alignment and lens pick-up is shown in accordance with one or more embodiments.

[0046] Fig.11A An example of mounting a lens assembly into a lens barrel according to one or more embodiments is shown.

[0047] Fig. 11B An example process of installing a lens assembly into a lens barrel is shown in accordance with one or more embodiments.

[0048] Fig.12 An example lens barrel having a floating metal insert is shown in accordance with one or more embodiments.

[0049] Fig.13 An example lens barrel having an L-shaped metal insert is shown in accordance with one or more embodiments.

[0050] Fig.14 The formation of a Fig.12 Example process for a floating metal insert in the lens barrel.

[0051] Fig.15 The formation of a Fig.13 Example process for an L-shaped metal insert for a lens barrel.

[0052] The drawings depict various embodiments for purposes of illustration only. One skilled in the art will readily recognize from the following discussion that alternative embodiments of the structures and methods shown herein may be employed without departing from the principles described herein. DETAILED DESCRIPTION

[0053] Embodiments of the present disclosure relate to a camera device (e.g., a wearable camera device) having an OIS component and an autofocus component. The OIS component can enable an asymmetric (e.g., different range of motion along a first direction than along a second direction orthogonal to the first direction) range of motion. The asymmetry is such that the range of motion in the direction in which the camera device is expected to have more motion (e.g., the vertical direction) is longer than the range of motion in the orthogonal direction (e.g., the horizontal direction). The method can provide a better trade-off between the size of the OIS component and the performance of the camera device. One or more components of the OIS component can have a smaller footprint, which can achieve improved dynamic characteristics of the camera device and reduced power consumption at the camera device.

[0054] The camera device can be incorporated into a small form factor electronic device (e.g., an electronic wearable device). Examples of the electronic wearable device include a smart watch or a head-mount display (HMD). The electronic device may include other components (e.g., a tactile device, a speaker, etc.). Furthermore, the small form factor of the electronic device provides limited space between the other components and the camera device. In some embodiments, the electronic device may have a limited power source (e.g., due to reliance on a rechargeable battery).

[0055] In some embodiments, the electronic wearable device can operate in an artificial reality environment (e.g., a virtual reality environment). The camera device of the electronic wearable device can be used to enhance artificial reality applications running on an artificial reality system (e.g., running on an HMD device worn by a user). The camera device can be set on multiple surfaces of the electronic wearable device so that data from a local area around, for example, a user's wrist can be collected in multiple directions. For example, one or more images describing the local area can be collected, and these images can be sent and processed by the HMD device before being presented to the user.

[0056] The various embodiments of the present disclosure may include an artificial reality system or be implemented in combination with an artificial reality system. Artificial reality is a form of reality that has been adjusted in some way before being presented to the user. Artificial reality may include, for example, virtual reality (VR), augmented reality (AR), mixed reality (MR), hybrid reality, or some combination and / or derivative thereof. Artificial reality content may include fully generated content, or generated content combined with collected (e.g., real-world) content. Artificial reality content may include video, audio, tactile feedback, or some combination thereof, any of which may be presented in a single channel or multiple channels (e.g., stereoscopic video that gives the viewer a three-dimensional effect). In addition, in some embodiments, artificial reality may also be associated with applications, products, accessories, services, or some combination thereof, which are used to create content in artificial reality and / or be used in artificial reality in other ways. Artificial reality systems that provide artificial reality content can be implemented on a variety of platforms, including electronic wearable devices (e.g., headsets) connected to a host computer system, standalone electronic wearable devices (e.g., headsets, smart watches, bracelets), mobile devices or computing systems, or any other hardware platform capable of providing artificial reality content to one or more viewers.

[0057] Figure 1A is a top view of an example wristband system 100 according to one or more embodiments. Figure 1B yes Figure 1A 1 is a side view of an example wristband system 100. The wristband system 100 is an electronic wearable device and can be worn on a user's wrist or arm. In some embodiments, the wristband system 100 is a smart watch. The display screen 102 and / or one or more speakers 117 can be used to present media content to a user wearing the wristband system 100. However, the wristband system 100 can also be used so that media content is presented to the user in a different manner (e.g., by contact using a haptic device 116). Examples of media content presented by the wristband system 100 include one or more images, videos, audio, or some combination thereof. The wristband system 100 can operate in an artificial reality environment (e.g., a VR environment, an AR environment, an MR environment, or some combination thereof).

[0058] In some examples, the wristband system 100 may include multiple electronic devices (not shown), including but not limited to smartphones, servers, head-mounted displays (HMDs), laptop computers, desktop computers, gaming systems, IoT devices, etc. Such electronic devices may communicate with the wristband system 100 (e.g., via a personal area network). The wristband system 100 may have sufficient processing power (e.g., central processing unit (CPU), memory, bandwidth, battery power, etc.) to offload computing tasks from each of the multiple electronic devices to the wristband system 100. Additionally or alternatively, each of the multiple electronic devices may have sufficient processing power (e.g., CPU, memory, bandwidth, battery power, etc.) to offload computing tasks from the wristband system 100 to one or more electronic devices.

[0059] The wristband system 100 includes a watch body 104, which is coupled to a strap 112 via one or more coupling mechanisms 106, 110. The watch body 104 may include one or more coupling mechanisms 106, one or more camera devices 115 (e.g., camera devices 115A and 115B), a display screen 102, a button 108, a connector 118, a speaker 117, and a microphone 121. The strap 112 may include one or more coupling mechanisms 110, a retaining mechanism 113, one or more sensors 114, a tactile device 116, and a connector 120. Although Figure 1A and Figure 1B The components of the wristband system 100 are shown at example locations on the wristband system 100, but the components may be located elsewhere on the wristband system 100, on a peripheral device paired with the wristband system 100, or some combination thereof. Figure 1A and Figure 1B More components or fewer components than those shown. For example, in some embodiments, the watch body 104 may include a port for connecting the wristband system 100 to peripheral electronic devices and / or a power source. The port can enable charging of the battery of the wristband system 100 and / or communication between the wristband system 100 and the peripheral devices. In another example, the watch body 104 may include an inertial measurement unit (IMU) that measures changes in the position, orientation, and / or acceleration of the wristband system 100. The IMU may include one or more sensors, such as one or more accelerometers, one or more gyroscopes, one or more magnetometers, another suitable type of sensor that detects motion, a class of sensors for error correction of the IMU, or some combination thereof.

[0060] The watch body 104 and the strap 112 can have any size and / or shape configured to allow a user to wear the wristband system 100 on a body part (e.g., a wrist). The wristband system 100 may include a retaining mechanism 113 (e.g., a buckle) for securing the strap 112 on the user's wrist. The coupling mechanism 106 of the watch body 104 and the coupling mechanism 110 of the strap 112 can attach the watch body 104 to the strap 112. For example, the coupling mechanism 106 can be coupled to the coupling mechanism 110 by gluing, attaching, fastening, attaching, some other suitable method for coupling, or some combination thereof.

[0061] The wristband system 100 can perform various functions related to the user. These functions can be performed independently in the watch body 104, independently in the watch band 112, and / or performed in a communication manner between the watch body 104 and the watch band 112. In some embodiments, the user can select a function by interacting with the button 108 (e.g., by pressing, rotating, etc.). In some embodiments, the user can select a function by interacting with the display screen 102. For example, the display screen 102 is a touch screen, and the user can select a specific function by touching the display screen 102. The functions performed by the wristband system 100 may include, but are not limited to, displaying visual content to the user (e.g., displaying visual content on the display screen 102), presenting audio content to the user (e.g., presenting audio content via the speaker 117), sensing user input (e.g., sensing contact with the button 108, sensing biometric data using one or more sensors 114, sensing neuromuscular signals using one or more sensors 114, etc.), collecting audio content (e.g., collecting audio using the microphone 121), collecting data describing a local area (e.g., using the front camera device 115A and / or the rear camera device 115B), wireless communication (e.g., via cellular, near field, wireless fidelity (Wi-Fi), personal area network, etc.), communicating via wire (e.g., via a port), determining position (e.g., using sensor 114 to sense position data), determining a change in position (e.g., using an IMU to sense one or more changes in position), determining orientation and / or acceleration (e.g., using an IMU to sense orientation data and / or acceleration data), providing tactile feedback (e.g., using a tactile device 116), etc.

[0062] Display screen 102 can display visual content to the user. The displayed visual content can be directed to the user's eye gaze so that the user can easily view the content. The traditional display on the wristband system may direct the visual content in a static manner so that when the user moves or rotates the wristband system, the content may remain in the same position relative to the wristband system, causing the user to be difficult to view the content. The displayed visual content can be directed (e.g., rotated, flipped, stretched, etc.) so that the displayed content remains in substantially the same orientation relative to the user's eye gaze (e.g., the direction the user is looking at). The displayed visual content can also be modified based on the user's eye gaze. For example, in order to reduce the power consumption of the wristband system 100, when it is determined that the user is not looking at the display screen 102, the display screen 102 can dim the brightness of the displayed visual content, pause the display of the visual content, or turn off the power supply of the display screen 102. In some examples, one or more sensors 114 of the wristband system 100 can determine the orientation of the display screen 102 relative to the user's eye gaze direction.

[0063] The position, orientation and / or movement of the user's eyes can be measured in various ways, including by using optical-based eye tracking technology, infrared-based eye tracking technology, etc. For example, the front camera device 115A and / or the rear camera device 115B can collect data (e.g., visible light, infrared light, etc.) of a local area around the wristband system 100, including the user's eyes. The collected data can be processed by a controller (not shown) inside the wristband system 100, a controller located outside the wristband system 100 and communicating with the wristband system (e.g., a controller of the HMD), or a combination thereof to determine the user's eye gaze direction. The display screen 102 can receive the determined eye gaze direction and orient the displayed content based on the user's eye gaze direction.

[0064] In some embodiments, the watch body 104 can be communicatively coupled to the HMD. The front camera device 115A and / or the rear camera device 115B can collect data describing a local area, such as one or more wide-angle images of a local area around the front camera device 115A and / or the rear camera device 115B. The wide-angle image may include a hemispherical (e.g., at least hemispherical, substantially spherical, etc.) image, a 180-degree image, a 360-degree area image, a panoramic image, an ultra-wide-area image, or a combination thereof. In some examples, the front camera device 115A and / or the rear camera device 115B may be configured to collect images with a range between 45 degrees and 360 degrees. The collected data can be transmitted to the HMD and displayed to the user on the display screen of the HMD worn by the user. In some examples, the collected images can be displayed to the user in conjunction with an artificial reality application. In some embodiments, the images collected by the front camera device 115A and / or the rear camera device 115B can be processed before being displayed on the HMD. For example, certain features and / or objects (eg, people, faces, devices, backgrounds, etc.) of the acquired images may be subtracted, added, and / or enhanced before being displayed on the HMD.

[0065] The components of the front camera 115A and the rear camera 115B may be able to take pictures as follows: These pictures collect data describing a local area. The lens of the front camera 115A and / or the lens of the rear camera 115B can be automatically positioned at their target positions. The target position in the forward (or horizontal) posture of the front camera 115A can correspond to the position where the lens of the front camera 115A focuses on the preferred focal length (e.g., a distance of several decimeters). The target position in the forward (or horizontal) posture of the rear camera 115B can correspond to the position where the lens of the rear camera 115B focuses on the hyperfocal distance of the local area (e.g., a distance of about 1.7 meters). The upward (vertical) posture of the front camera 115A (or the rear camera 115B) corresponds to the posture where the optical axis is substantially parallel to gravity. And the forward (horizontal) posture of the front camera 115A (or the rear camera 115B) corresponds to the posture when the optical axis is substantially orthogonal to gravity.

[0066] When the front camera 115A (and the rear camera 115B) changes its posture from, for example, an upward posture to a forward posture, OIS can be applied by allowing a certain amount of displacement (i.e., travel) of the lens and / or image sensor of the front camera 115A (and the rear camera 115B) along at least one spatial direction. The travel range can be asymmetric, i.e., the displacement along a first direction can be different from the displacement along a second direction orthogonal to the first direction. For example, the displacement range in the direction in which the front camera 115A (and the rear camera 115B) is expected to have more movement (e.g., the vertical direction) is longer than the displacement range in the orthogonal direction (e.g., the horizontal direction). The following reference is made to Figure 6B , Fig. 7A and Figure 7B as well as Figure 8 Details are provided regarding the mechanisms used to achieve asymmetric travel in orthogonal directions.

[0067] Figure 2A FIG. 2 is a perspective view of another example wristband system 200 according to one or more embodiments. The wristband system 200 includes the wristband system 200 of the above reference. Figure 1A and Figure 1B Many of the same components are described. However, the design or layout of these components can be modified to integrate with different form factors. For example, compared with the watch body 104 and the strap 112 of the wristband system 100, the wristband system 200 includes a watch body 204 and a strap 212 of a different shape and with a different layout of components. Figure 2A Also shown is a coupling / release mechanism 206 for coupling the watch body 204 to the strap 212 or releasing the watch body 204 from the strap 212.

[0068] Figure 2B is a perspective view of an example wristband system 200 with the watch body 204 released from the watch band 212 according to one or more embodiments. Figure 2B Also shown is a camera device 215A, display screen 202, and button 208. In some embodiments, another camera device may be located on the bottom surface of watch body 204 and not on the Figure 2B In some embodiments ( Figure 2A and Figure 2B ), one or more sensors, speakers, microphones, tactile devices, retention mechanisms, etc. may be included on the watch body 204 or the strap 212. Since the wristband system 100 and the wristband system 200 have a small form factor that is easy and comfortable to wear on the user's wrist, the corresponding camera devices 115, 215 and various other components of the above-mentioned wristband system 100 and the wristband system 200 are designed to have even smaller form factors and are positioned close to each other.

[0069] As the camera device 215 changes its posture (e.g., from an upward posture to a forward posture), OIS can be applied by allowing a certain amount of displacement (i.e., travel) of the lens and / or image sensor of the camera device 215 along at least one spatial direction. The range of travel can be asymmetric with respect to orthogonal spatial directions, i.e., the amount of displacement along a first direction can be different from the amount of displacement along a second direction orthogonal to the first direction. For example, the range of displacement in a direction in which the camera device 215 is expected to have more movement (e.g., a vertical direction) can be longer than the range of displacement in an orthogonal direction (e.g., a horizontal direction). The following references Figure 6B , Fig. 7A and Figure 7B as well as Figure 8 Details are provided regarding the mechanism for achieving asymmetric travel in orthogonal directions at the camera device 215.

[0070] Figure 3 300 is a cross-section of an electronic wearable device 300 according to one or more embodiments. The electronic wearable device 300 can be worn on a user's wrist or arm. In some embodiments, the electronic wearable device 300 is a smart watch. The electronic wearable device 300 can be an embodiment of the wristband system 100 or the wristband system 200. Figure 3 The electronic wearable device 300 is shown in a forward (horizontal) posture. The electronic wearable device 300 includes a camera device 305, a display device 310, a controller 315, and a printed circuit board (PCB) 320. Figure 3 The components shown in FIG. 3 may be more or less than the components of the electronic wearable device 300 .

[0071] The camera device 305 can collect data (eg, one or more images) of a local area around the electronic wearable device 300. The camera device 305 can be an embodiment of the camera device 115 or 215. Figure 4A and Figure 4B Details are provided regarding the structure and operation of the camera 305.

[0072] Display device 310 can display visual content to a user on a display screen of display device 310. In addition, display device 310 can present audio content to a user, sense user input, collect audio content, collect data describing a local area (e.g., using camera 305), wirelessly communicate, via wired communication, determine a position, determine a change in position, determine an orientation and / or acceleration, provide tactile feedback, and / or provide some other functionality. The display screen of display device 310 can be an embodiment of display screen 102 or display screen 202.

[0073] The controller 315 may control the operation of the camera device 305, the display device 310, and / or some (one or more) other components of the electronic wearable device 300. The controller 315 may control OIS, autofocus, actuation, some other operation applied to the camera device 305, or some combination thereof. The controller 315 may also process data collected by the camera device 305. In addition, the controller 315 may control any of the aforementioned functions of the display device 310. In some embodiments, the controller 315 is part of the camera device 305.

[0074] PCB 320 is a fixed component of electronic wearable device 300 and provides mechanical support for electronic wearable device 300 (e.g., by serving as a base). PCB 320 can provide electrical connections for camera device 305, display device 310, and controller 315. PCB 320 can also electrically connect controller 315 to camera device 305 and display device 310.

[0075] Figure 4A 4 is a cross-section of the camera device 305 in an upward (vertical) posture according to one or more embodiments. The camera device 305 includes a lens barrel 405, a lens assembly 410, a shielding shell 415, one or more top reset autofocus springs 420A, one or more bottom reset autofocus springs 420B, one or more OIS suspension lines 423, a carrier 425, one or more actuators 430, one or more autofocus coils 435, a magnetic assembly 440, an infrared cut-off filter (IRCF) 445, an IRCF holder 450, an image sensor 455 and a PCB 460. The one or more top reset autofocus springs 420A and the one or more bottom reset autofocus springs 420B are collectively referred to as "one or more reset autofocus springs 420" in this document. In alternative configurations, different components and / or additional components may be included in the camera device 305. For example, in some embodiments, the camera device 305 may include a controller ( Figure 4A In an alternative embodiment (such as Figure 3 ), the controller 315 is a component of the electronic wearable device 300 that is positioned outside the camera device 305. The upward (vertical) posture of the camera device 305 corresponds to the following posture of the camera device 305: in this posture, the optical axis 402 of the lens assembly 410 is substantially parallel to gravity (e.g., parallel to Figure 4A On the other hand, the forward (horizontal) posture of the camera device 305 (e.g. Figure 4B ) corresponds to a posture of the camera 305 in which the optical axis 402 is substantially orthogonal to gravity (eg, parallel to Figure 4B ).

[0076] The camera device 305 can be configured to include both a focus assembly and an OIS assembly. The focus assembly of the camera device 305 can cause the lens barrel 405 to translate in a direction parallel to the optical axis 402. The focus assembly can provide an autofocus function for the camera device 305. The focus assembly can include one or more reset autofocus springs 420, one or more autofocus coils 435, and a plurality of magnets included in the magnetic assembly 440. The focus assembly can include more or fewer components.

[0077] The OIS assembly of the camera device 305 can cause the lens barrel 405 (and in some embodiments, the magnetic assembly 440 and the lens barrel 405) to translate in one or more directions perpendicular to the optical axis 402. Alternatively or additionally, the OIS assembly can cause translation of the image sensor 455. The OIS assembly can provide OIS functionality for the camera device 305 by stabilizing the image projected to the image sensor 455 through the lens barrel 405. The OIS assembly may include the lens barrel 405, the shielding shell 415, one or more OIS suspension wires 423, an actuator 430, and a plurality of magnets included in the magnetic assembly 440. The OIS assembly may include more or fewer components. The following references Fig. 6A and Figure 6B , Fig. 7A and Figure 7B as well as Figure 8 Provides more details on the structure and operation of the OIS component.

[0078] Lens barrel 405 is a mechanical structure or housing for carrying one or more lenses of lens assembly 410. Lens barrel 405 is a hollow structure with openings at opposite ends of lens barrel 405. These openings can provide paths for light (such as visible light, infrared light, etc.) so that light is transmitted between local area and image sensor 455. Inside lens barrel 405, one or more lenses of lens assembly 410 are positioned between two openings. Lens barrel 405 can be manufactured by a variety of materials from plastic to metal. In certain embodiments, one or more outer surfaces of lens barrel 405 are coated with polymer (such as, submicron thick polymer). Lens barrel 405 can be rotationally symmetrical about the optical axis 402 of one or more lenses of lens assembly 410.

[0079] The lens barrel 405 can be coupled to the magnetic assembly 440 via one or more reset autofocus springs 420. For example, one or more reset autofocus springs 420 are coupled to the lens barrel 405 and the magnetic assembly 440. In some embodiments, the magnetic assembly 440 is coupled to the shielding shell 415. In another example (not shown), one or more reset autofocus springs 420 are directly coupled to the shielding shell 415 and the lens barrel 405. One or more reset autofocus springs 420 are configured to control the positioning of the lens barrel 405 along the optical axis 402. For example, a plurality of reset autofocus springs 420 can control the positioning of the lens barrel 405 so that when current is not supplied to one or more autofocus coils 435, the lens barrel 405 is in a neutral position. In some embodiments, one or more reset autofocus springs 420 can be a shape memory alloy (SMA) wire. The neutral position of the lens barrel 405 is the positioning of the lens barrel 405 when the camera device 305 does not experience focusing (via the focus assembly) nor does it experience stabilization (via the OIS assembly). The one or more reset auto-focus springs 420 can ensure that the lens barrel 405 does not fall out or come into contact with the image sensor 455. In some embodiments, the one or more reset auto-focus springs 420 are conductors and can be coupled to one or more auto-focus coils 435. In these embodiments, the plurality of reset auto-focus springs 420 can be used to provide current to the one or more auto-focus coils 435. The one or more reset auto-focus springs 420 can be coupled to one or more OIS suspension wires 423 that provide current to the one or more reset auto-focus springs 420, so that the one or more reset auto-focus springs 420 can facilitate auto-focusing of the lens assembly 410. The one or more OIS suspension wires 423 can be positioned symmetrically about the optical axis 402.

[0080] The shielding case 415 may enclose some of the components of the camera device 305, such as Figure 4A . In other embodiments (not shown), shield shell 415 may enclose all components of camera device 305. Shield shell 415 may partially enclose lens barrel 405. Shield shell 415 may provide a space in which lens barrel 405 may translate along optical axis 402 and / or in a direction perpendicular to optical axis 402. In some embodiments, shield shell 415 provides a space in which lens barrel 405 may rotate about one or more axes perpendicular to optical axis 402. In some embodiments, shield shell 415 may be a Figure 4A. In alternative embodiments, shielding shell 415 may be circular, square, hexagonal, or any other shape. In embodiments where camera device 305 is part of another electronic device (e.g., smartwatch), shielding shell 415 may be coupled (e.g., mounted, fixed, attached, etc.) to another component of the electronic device, such as a frame of the electronic device. For example, shielding shell 415 may be mounted on a watch body (e.g., watch body 104) of a smartwatch. Shielding shell 415 may be made of a variety of materials from plastic to metal. In some examples, shielding shell 415 is made of the same material as the material of the electronic device to which shielding shell 415 is coupled, so that shielding shell 415 cannot be distinguished from the rest of the electronic device. In some embodiments, shielding shell 415 is made of a material that provides magnetic shielding to the surrounding components of the electronic device. In these embodiments, shielding shell 415 is a shielding can. In some embodiments, one or more inner surfaces of shielding shell 415 are coated with a polymer similar to the above-mentioned lens barrel 405.

[0081] The carrier 425 is directly coupled to the lens barrel 405. For example, the carrier 425 includes a first side that is in direct contact with the surface of the lens barrel 405 and a second side opposite to the first side. In some embodiments, the carrier 425 is coupled to the lens barrel 405 by an adhesive. One or more autofocus coils 435 can be fixed to the second side of the carrier 425. The carrier 425 has a curvature that is consistent with the curvature of the lens barrel 405. In some embodiments, more than one carrier 425 can be directly coupled to the lens barrel 405. In these embodiments, the number of carriers 425 can match the number of autofocus coils 435. The carrier 425 can be positioned at a unique position around the lens barrel 405 so that the carrier 425 is positioned between the corresponding autofocus coil 435 and the lens barrel 405. In some embodiments, the reset autofocus spring 420 can be coupled to the carrier 425.

[0082] One or more autofocus coils 435 are configured to conduct electricity by being supplied with current. One or more autofocus coils 435 can be positioned symmetrically about the optical axis 402. For example, Figure 4A As shown in FIG. 4 , the one or more auto-focus coils 435 may consist of two separate coils symmetrically positioned about the optical axis 402. The one or more auto-focus coils 435 are coupled to the one or more actuators 430 and provide current to the one or more actuators 430.

[0083] The one or more actuators 430 are configured to provide auto-focus to one or more lenses of the lens assembly 410. The one or more actuators 430 consume auto-focus actuation power when providing auto-focus to the one or more lenses of the lens assembly 410. In order to reduce (and in some cases minimize) the level of auto-focus actuation power consumption (e.g., to achieve a zero level of auto-focus actuation power), the relative positions of the lens assembly 410, the carrier 425, and the one or more actuators 430 along the optical axis 402 can be controlled during assembly of the camera device 305.

[0084] Magnetic assembly 440 includes a magnet holder for holding a plurality of magnets. The magnet holder can provide a rigid structure to support a plurality of magnets. In some embodiments, the magnet holder can enclose all sides of the magnet. In other embodiments, the magnet holder can enclose all sides of the magnet except the side facing one or more autofocus coils 435. In some embodiments, one or more outer surfaces of the magnetic assembly 440 are coated with a polymer similar to the above-mentioned lens barrel 405.

[0085] The plurality of magnets of magnetic assembly 440 generate a magnetic field that can be used to translate barrel 405 along optical axis 402 (e.g., to focus imaging device 305) and / or to translate barrel 405 perpendicular to optical axis 402 (e.g., to provide OIS for imaging device 305). The magnetic field for focusing imaging device 305 can be applied in a forward (horizontal) posture of imaging device 305, for example, to focus lens assembly 410 at a hyperfocal distance.

[0086] The individual magnets in the plurality of magnets may have different sizes or may have the same size. In some embodiments, each magnet is bent about the optical axis 402 to conform to the curvature of one or more autofocus coils 435 and the lens barrel 405. In some embodiments, each magnet is straight. For example, at least two opposing sides of each magnet may be parallel to a plane parallel to the optical axis 402. Each magnet in the plurality of magnets may include a rectangular cross-section, wherein one axis of the cross-section is parallel to the optical axis 402 and the other axis of the cross-section is perpendicular to the optical axis 402. In some embodiments, each magnet may include other types of cross-sectional shapes, such as a square or any other shape including at least one straight side facing one or more autofocus coils 435. Each magnet may be a permanent magnet that is radially magnetized relative to the optical axis 402. The magnets may be positioned symmetrically or asymmetrically about the optical axis 402. The following references Fig. 6A and Figure 6B More details are provided regarding the magnet structure of magnetic assembly 440 .

[0087] The image sensor 455 collects data describing the local area (e.g., one or more images). The image sensor 455 may include one or more individual sensors, such as a photodetector, a complementary metal oxide semiconductor (CMOS) sensor, a charge coupled device (CCD) sensor, some other device for detecting light, or some combination thereof. These individual sensors may be located in an array. For the camera device 305 integrated into the electronic device, the local area is the area around the electronic device. The image sensor 455 collects light from the local area. The image sensor 455 may collect visible light and / or infrared light from the local area around the electronic device. The visible light and / or infrared light is focused from the local area to the image sensor 455 via the lens barrel 405. The image sensor 455 may include various filters, such as IRCF 445. IRCF 445 is a filter configured to block infrared light from the local area and transmit visible light to the image sensor 455. IRCF 445 may be disposed in the IRCF holder 450.

[0088] PCB 460 is positioned below image sensor 455 along optical axis 402. PCB 460 is a fixed component of camera device 305 and provides mechanical support for camera device 305 (e.g., by serving as a base). PCB 460 can provide electrical connections for one or more components of camera device 305. In some embodiments, a controller can be located on PCB 460, and PCB 460 electrically connects the controller to various components of camera device 305 (e.g., one or more autofocus coils 435, one or more OIS suspension wires 423, etc.). In other embodiments (e.g., Figure 3 As shown in FIG. 3 , the controller 320 is located outside the imaging device 305 .

[0089] Figure 4B is a cross-section of the camera device 305 in a forward (horizontal) posture according to one or more embodiments. Figure 4B The cross-section of the camera device 305 in corresponds to the most typical use case of the camera device 305, wherein one or more lenses of the lens assembly 410 are also in a horizontal posture. In the forward posture of the camera device 305, the OIS assembly can provide that the central axis of the image sensor 455 substantially overlaps with the optical axis 402. In addition, in the forward posture of the camera device 305, the lens assembly 410 can be in a hyperfocal position relative to the image sensor 455. The hyperfocal position of the lens assembly 410 corresponds to the following position of the lens assembly 410 within the camera device 305: in this position, when the camera device 305 is in the forward posture, the lens assembly 410 is focused at the hyperfocal distance (e.g., 1.7 meters) within the local area.

[0090] Optical image stabilization

[0091] Figure 5 5 shows an example movement 500 of an electronic wearable device 505 along two spatial dimensions according to one or more embodiments. Figure 5 As shown, the electronic wearable device 505 (e.g., a smart watch) can be moved by a user along a first direction parallel to the x-axis and / or along a second direction parallel to the y-axis (e.g., along one or two spatial dimensions) when implementing a specific exposure of the camera device of the electronic wearable device 505. In some cases, the z-axis is substantially orthogonal to the gravity vector. The wearable device 505 can be an embodiment of the electronic wearable device 300, that is, the wearable device 505 can include the camera device 305.

[0092] The purpose is to compensate for blur in an image captured by the camera of the wearable device 505, which is introduced due to hand movement (including rotation about the x-axis) that occurs when capturing the image (i.e., during exposure of the camera). In order to reduce the degree of blur in the image captured by the camera, OIS can be applied (e.g., by an OIS component of the camera 305 and a controller 315). For example, movement of the optical axis during exposure of the camera (which movement may include rotation) may introduce an offset of the projection point at the image sensor of the camera, which results in a blurred image. When the orientation is changed from a first orientation (e.g., an upward or vertical posture) to a second orientation (e.g., a forward or horizontal posture) during exposure, the camera can rotate about at least one axis (e.g., the x-axis).

[0093] Blur can be reduced (i.e., completely avoided or reduced to below a threshold level) by offsetting the lens assembly and / or image sensor of the camera device, i.e., by applying one or more strokes of the lens assembly and / or image sensor, which can be initiated by the OIS component of the camera device. The offset (i.e., stroke) can be a function of the focal length and rotation angle of the lens. Longer exposures of the camera device may require a longer stroke to sufficiently reduce blur in images captured by the camera device. The OIS component can initiate movement (offset) of the lens assembly and / or image sensor in response to the camera device changing its orientation from a first orientation to a second orientation during exposure.

[0094] Fig. 6AAn example OIS assembly 600 of a camera device (e.g., camera device 305) having a symmetrical travel diagram 602 according to one or more embodiments is shown. OIS assembly 600 may include drive magnets 605A, 605B, 605C, and 605D positioned around an actuator 610 along an axis parallel to a first axis (e.g., an x-axis) and a second axis (e.g., a y-axis). Drive magnets 605A-605D may be magnets of magnetic assembly 440, and actuator 610 may be an embodiment of actuator 430. OIS assembly 600 may include a plurality of drive magnets 605A, 605B, 605C, and 605D positioned around an actuator 610 along an axis parallel to a first axis (e.g., an x-axis) and a second axis (e.g., a y-axis). Drive magnets 605A-605D may be magnets of magnetic assembly 440, and actuator 610 may be an embodiment of actuator 430. Fig. 6A The drive magnets 605A, 605C can be identical to each other and positioned so that their longest dimension (e.g., length) is along an axis parallel to the first axis. And the drive magnets 605B, 605D can be identical to each other and positioned so that their longest dimension (e.g., length) is along an axis parallel to the second axis. In addition, the longest dimension (e.g., length) of each drive magnet 605A, 605C is the same as the longest dimension (e.g., length) of each drive magnet 605B, 605D.

[0095] The drive magnets 605A, 605C can cause a first movement of the actuator 610 along a first direction parallel to the second axis, which further causes a first movement of the lens assembly (e.g., lens assembly 410) and / or the image sensor (e.g., image sensor 455) along the first direction. Similarly, the drive magnets 605B, 605D can cause a second movement of the actuator 610 along a second direction parallel to the first axis, which further causes a second movement of the lens assembly and / or the image sensor along the second direction. Because the longest dimensions of the drive magnets 605A-605D along the corresponding axes are the same, the travel map 602 generated by the OIS assembly 600 is symmetric with respect to the optical center 604 of both the first axis and the second axis. The optical center 604 can correspond to the optical center of the lens assembly and / or the image sensor. A first range of first motion along a first direction parallel to the second axis (i.e., a stroke range) may be between -S and S, and a second range of second motion along a second direction parallel to the first axis (i.e., a stroke range) may also be between -S and S (e.g., S = 100 micrometers (μm)), i.e., the stroke diagram may be symmetrical with respect to both the first axis and the second axis.

[0096] Figure 6BAn example OIS assembly 620 of a camera device (e.g., camera device 305) having an asymmetric travel diagram 622 according to one or more embodiments is shown. OIS assembly 620 may include drive magnets 625A, 625B, 625C, and 625D positioned about an actuator 630 along an axis parallel to a first axis (e.g., an x-axis) and a second axis (e.g., a y-axis). Drive magnets 625A to 625D may be magnets of magnetic assembly 440, and actuator 630 may be an embodiment of actuator 430. OIS assembly 620 may include a plurality of drive magnets 625A, 625B, 625C, and 625D. Figure 6B The drive magnets 625A, 625C may be identical to one another and positioned so that their longest dimension (e.g., length) is along an axis parallel to the first axis. And the drive magnets 625B, 625D may be identical to one another and positioned so that their longest dimension (e.g., length) is along an axis parallel to the second axis. However, the longest dimension (e.g., length) of each drive magnet 625A, 625C is different from the longest dimension (e.g., length) of each drive magnet 625B, 625D. As Figure 6B As shown in , the longest dimension of each drive magnet 625B, 625D along an axis parallel to the second axis is smaller than the longest dimension of each drive magnet 625A, 625C along an axis parallel to the first axis. In other words, a smaller drive magnet 625B, 625D can be used along an axis parallel to the first axis (e.g., the x-axis) (along which a smaller stroke may be required). On the other hand, a larger drive magnet 625A, 625C can be used along an axis parallel to the second axis (e.g., the y-axis) (along which a longer stroke may be required).

[0097] The drive magnets 625A, 625C can cause a first movement of the actuator 630 along a first direction parallel to the second axis, which further causes a first movement of the lens assembly (e.g., lens assembly 410) and / or the image sensor (e.g., image sensor 455) along the first direction. Similarly, the drive magnets 625B, 625D can cause a second movement of the actuator 630 along a second direction parallel to the first axis, which further causes a second movement of the lens assembly and / or the image sensor along the second direction. Because the longest dimension of the drive magnets 625A, 625C is longer than the longest dimension of the drive magnets 625B, 625D, the travel map 622 that can be generated by the OIS assembly 620 is characterized by: the travel along the second axis (i.e., controlled by the drive magnets 625A, 625C) is longer than the travel along the first axis (i.e., controlled by the drive magnets 625B, 625D). Since the drive magnets 625A, 625C are identical, the first travel range along the second axis (e.g., the y-axis) is symmetrical about the optical center 624, i.e., the first travel range can be between -Sy and Sy (e.g., Sy=130 μm). Similarly, since the drive magnets 625B, 625B are identical, the second travel range along the first axis (e.g., the x-axis) is symmetrical about the optical center 624, i.e., the second travel range can be between -Sx and Sx (e.g., Sx=70 μm). However, it should be noted that the first travel range (e.g., 2Sy=260 μm) is longer than the second travel range (e.g., 2Sx=140 μm). The optical center 624 can correspond to the optical center of the lens assembly and / or the image sensor.

[0098] In some embodiments, based on one or more signals from the OIS assembly, the actuator 630 actuates a first movement of the lens assembly and / or the image sensor along the second axis, and a second movement of the lens assembly and / or the image sensor along the first axis. The first range of the first movement and the second range of the second movement can depend on one or more springs (e.g., autofocus spring 420 and / or OIS suspension wire 423) coupled to the actuator 630 ( Figure 6B ). For example, a first spring coupled to the actuator 630 along an axis parallel to the first axis may have a first stiffness greater than a second stiffness of a second spring coupled to the actuator 630 along an axis parallel to the second axis, thereby producing a shorter stroke in a direction parallel to the first axis (e.g., the x-axis) and a longer stroke in a direction parallel to the second axis (e.g., the y-axis). Additionally or alternatively, the first range of the first motion and the second range of the second motion may depend on one or more coils (e.g., the autofocus coil 435) of the actuator 630 ( Figure 6BFor example, a first strength of a first coil coupled to the actuator 630 along an axis parallel to the first axis may be less than a second strength of a second coil coupled to the actuator 630 along an axis parallel to the second axis, thereby producing a shorter stroke in a direction parallel to the first axis (e.g., the x-axis) and a longer stroke in a direction parallel to the second axis (e.g., the y-axis).

[0099] Fig. 7A An example motion profile of an actuator 702 of a camera device (e.g., camera device 305) according to one or more embodiments is shown. Actuator 702 can be an embodiment of actuator 430. Actuator 702 can be coupled to actuator coil 704, which can provide a displacement of a lens assembly (e.g., lens assembly 410) along one or more directions parallel to one or more axes (e.g., x-axis and / or y-axis). By moving steps 705, 710, 715, Fig. 7A FIG. 4 shows the state of the wearable electronic device when a control button (eg, Figure 2B The motion trajectory of the actuator 702 during the exposure period of the camera device when the button 208 of the watch body 204 in the above embodiment is pressed is shown. The motion steps 705 to 715 show the rotation of the actuator 702 around the x-axis when the button is pressed. In addition to providing an asymmetric travel between the direction parallel to the x-axis and the direction parallel to the y-axis (e.g., the above reference Figure 6B As described above), it can also be designed to be asymmetric along one or more axes parallel to the x-axis and / or the y-axis, thereby providing further stroke asymmetry between the direction parallel to the x-axis and the direction parallel to the y-axis.

[0100] Figure 7B An example travel diagram 720 for compensating for large motion of a camera device (e.g., camera device 305) in one direction according to one or more embodiments is shown. Travel diagram 720 can be implemented by employing an OIS assembly of the camera device including an asymmetric actuator 702. In addition to or in lieu of designing an asymmetric actuator 702, travel diagram 720 can be implemented by designing a drive magnet (e.g., of magnetic assembly 440) having a longest dimension (e.g., length) along an axis parallel to the x-axis as an asymmetric magnet. For example, Figure 6B The drive magnets 625A and 625C in the embodiment can be designed to have different dimensions (lengths) along an axis parallel to the x-axis, wherein the drive magnet 625C has a longer dimension along an axis parallel to the x-axis than the drive magnet 625A, thereby providing a longer travel along the negative y-axis direction compared to the travel along the positive y-axis direction.

[0101] The travel graph 720 is characterized by having more travel in the direction of the negative y-axis (i.e., the portion of the y-axis below the optical center 722) than in the direction of the positive y-axis (i.e., the portion of the y-axis above the optical center 722) to compensate for the larger movement in that direction when a control button (e.g., button 208) is pressed during an exposure of the camera device. Therefore, the range of travel along the axis parallel to the y-axis can be asymmetric about the optical center 722, that is, the range of travel along the axis parallel to the y-axis can be between -Sy1 and Sy2 (e.g., Sy1=140μm and Sy2=100μm). The travel graph 720 is also characterized by having more travel along the axis parallel to the y-axis than the axis parallel to the x-axis because more travel is required in the direction of button movement (e.g., in the direction along the y-axis) than in another orthogonal direction (e.g., in the direction along the x-axis). The travel range along the direction parallel to the x-axis may be symmetrical about the optical center 722, but smaller than the travel range along the direction parallel to the y-axis, i.e., the travel range along the direction parallel to the x-axis may be between -Sx and Sx (eg, Sx = 70 μm).

[0102] Figure 8 8 is a flow chart illustrating a process 800 of initiating an asymmetric stroke at a camera device for OIS according to one or more embodiments. The steps of process 800 may be performed by one or more components of a camera device (e.g., camera device 305). Embodiments may include different and / or additional steps than the steps of process 800, or perform the steps of process 800 in a different order.

[0103] The camera device initiates 805 (e.g., via an OIS component) a first movement of at least one of an image sensor and a lens assembly in the camera device along a first direction parallel to a first axis (e.g., a horizontal axis or an x-axis), the first movement having a first range. The camera device initiates 810 (e.g., via an OIS component) a second movement of at least one of an image sensor and a lens assembly along a second direction parallel to a second axis (e.g., a vertical axis or a y-axis), the second axis being orthogonal to the first axis, the second movement having a second range that is different from (e.g., longer than) the first range.

[0104] In some embodiments, the camera device initiates a first movement and a second movement (e.g., by an OIS component) in response to the camera device changing its orientation from a first orientation (e.g., a vertical orientation or an upward orientation) to a second orientation (e.g., a horizontal orientation or a forward orientation). When the camera assembly is in the first orientation, the optical axis of the lens assembly is parallel to gravity, and when the camera device is in the second orientation, the optical axis is orthogonal to gravity. When the camera device changes its orientation from the first orientation to the second orientation, the camera device may rotate around the first axis. The first range may be symmetrical about the second axis, and the second range may be symmetrical about the first axis. Alternatively, the first range may be symmetrical about the second axis, and the second range may be asymmetrical about the first axis. After the first movement and the second movement, the central axis of the image sensor may substantially overlap with the optical axis of the lens assembly.

[0105] In some embodiments, the OIS assembly includes a first pair of magnets and a second pair of magnets, each magnet in the first pair of magnets being positioned about an axis parallel to the first axis and each magnet in the second pair of magnets being positioned about an axis parallel to the second axis. A first dimension of each magnet from the first pair along an axis parallel to the second axis may be smaller than a second dimension of each magnet from the second pair along an axis parallel to the first axis. A dimension of one magnet from the second pair along an axis parallel to the first axis may be different from another dimension of another magnet from the second pair along an axis parallel to the first axis.

[0106] In some embodiments, the camera device includes one or more actuators configured to actuate the first motion and the second motion based on one or more signals from the OIS component. The first range and the second range can depend on the stiffness of one or more springs coupled to the one or more actuators. Alternatively or additionally, the first range and the second range can depend on the strength of one or more coils of the one or more actuators.

[0107] Lens alignment with integrated barrel structure

[0108] Embodiments of the present disclosure also relate to methods and apparatus for performing lens alignment of an integrated lens barrel structure. The methods and apparatus presented herein can be used for any type of lens, including lenses that need to be activated during lens assembly. The methods and apparatus presented herein allow the installation of an actuated lens so that the installation process is compatible with existing lens assembly processes.

[0109] A lens reference alignment device is presented herein that aligns a target lens (e.g., a lens of lens assembly 410) with a reference system before the target lens is mounted in a lens barrel (e.g., lens barrel 405). During the optical alignment process, the target lens can be activated if necessary. The optical alignment process presented herein can be parallelized for all lens elements or selected lens elements. When the target lens is mounted in the lens barrel, the target lens and the reference system can be aligned with the lens barrel as a whole. A second optical alignment process can be performed during lens installation, but the target lens does not have to be activated. Assembly accuracy and precision depend primarily on the performance of the positioning system having a lens barrel workbench and a reference alignment device.

[0110] The optical alignment process may begin by selecting lens A as the target lens to be installed in the lens barrel. Lens A may be optically aligned with and attached to a reference system. Thereafter, lens A may be installed in the lens barrel. Then, another lens, lens B, may be selected as the target lens to be installed in the lens barrel. Lens B may be optically aligned with and attached to the same reference system. Thereafter, the reference system with lens B attached to the reference system may be aligned with the lens barrel. If desired, lens B may be optically aligned with the lens barrel. Finally, lens B may be installed in the lens barrel.

[0111] Fig. 9A An example lens reference alignment system 900 is shown in accordance with one or more embodiments. The lens reference alignment system 900 may include a lens holder 905, a lens pickup head 915, a fiberscope 920 (or an optical imaging system), and an image sensor 925. In some embodiments, the lens holder may be a separate component from the lens reference alignment system 900. The lens holder 905 may be a high precision device for holding a target lens 910, and the position of the lens holder 905 in space may be precisely controlled. The lens pickup head 915 may be a high precision device for picking up and transferring the lens 910 with very high positional precision and accuracy. The fiberscope 920 may include one or more optical imaging components for directing light from the light source 902 toward the image sensor 925. The image sensor 925 may capture an image of one or more objects in a local area of ​​the lens reference alignment system 900. The lens reference alignment system 900 as a whole may be a high precision device, the position of which in space is precisely controlled.

[0112] Fig. 9BAn example lens pickup head 915 of the lens reference alignment system 900 according to one or more embodiments is shown. Since the target lens 910 needs to be operated in a clean environment, the lens pickup head 915 cannot introduce any debris and residue to the surface of the target lens 910. The lens pickup head 915 can pick up and transfer the target lens 910 with very high positional precision and accuracy. The lens pickup head 915 may be able to firmly hold the target lens 910 without slipping. The lens pickup head 915 can place the target lens 910 into a structure (e.g., into a lens holder 905 or a lens barrel) and release it without introducing any position changes. In addition, the lens pickup head 915 can release the target lens 910 without any adhesion.

[0113] In one embodiment, the lens pickup head 915 is implemented as a mechanical tweezer 930. The mechanical tweezer 930 may include at least two tweezer tips or mechanical grippers so as to have a good force balance on the target lens 910. The mechanical tweezer 930 does not block the optical path of the target lens 910. In another embodiment, the lens pickup head 915 is implemented as a vacuum pickup tool 935 (e.g., a tip / chuck). The center of the vacuum suction head 940 of the vacuum pickup tool 935 may be reserved for the fiberscope 920. The vacuum tube 945 of the vacuum pickup tool 935 may be connected to a rubber tip on one side of the vacuum suction head 940. The vacuum suction head 940 may adjust the vacuum pressure based on the properties of the target lens 910. The vacuum pickup tool 935 may not block the optical path of the target lens 910.

[0114] Fig. 9C An example fiberscope 920 (or optical imaging system) of a lens reference alignment system 900 according to one or more embodiments is shown. The fiberscope 920 can be attached to a lens pickup head 915. The fiberscope can include one or more lenses, such as lens 9451, lens 9452, ..., lens 9453, in optical series. N , where N ≥ 1. The fiberscope 920 can move with the lens pickup head 915, and the relative positions of the fiberscope 920 and the lens pickup head 915 can be fixed and consistent in all cases. The fiberscope 920 can be very flexible and adaptable to bending. The fiberscope 920 does not introduce any imaging distortion, so the imaging quality is mainly determined by the optical alignment quality of the target lens 910.

[0115] The image sensor 925 of the lens reference alignment system 900 can be attached to one end of the fiberscope 920. The image sensor 925 can be interchangeable. The image sensor 925 can be of the same type as the image sensor of the camera device. The image sensor 925 can collect images of one or more objects in a local area. The quality (or other type of metric) of the collected image can be analyzed in real time by, for example, a computer (or a vision processor or controller). The image quality results can be used as a reference for the first optical alignment of the target lens 910.

[0116] The target lens 910 can be disposed on the lens holder 905. The diameter of the lens holder 905 can be adjusted to accommodate target lenses of different sizes. During the first optical alignment process, the position (e.g., x, y, z, angle) of the lens holder 905 can be controlled and adjusted. The position accuracy may need to be better than, for example, 1 μm. In some embodiments, the light source, optical stop, aperture, and object can be disposed close to the lens holder 905.

[0117] Fig. 10A An example alignment 1000 of the lens reference alignment system 900 is shown according to one or more embodiments. The lens holder 905 and the lens reference alignment system 900 can be moved and / or rotated by a high-precision mechanism such as a robotic arm or a worktable. The quality of the image captured by the image sensor 925 can be analyzed and used as feedback for position adjustment of the lens holder 905 and / or the lens reference alignment system 900 as a whole.

[0118] Fig. 10B An example process 1020 of lens reference optical alignment according to one or more embodiments is shown. At 1025, the target lens 910 can be placed at the lens holder 905. At 1030, the image sensor 925 can capture an image of an object in a local area of ​​the lens reference alignment system 900. At 1035, the computer (or vision processor or controller) can analyze the quality of the captured image. At 1040, a determination can be made whether the alignment requirements have been met. If the alignment requirements have been met, at 1045, the position of the target lens 910 and the captured image can be saved (e.g., in a memory of a computer). At 1050, the lens pickup head 915 can pick up the target lens 910. Otherwise, if the alignment requirements have not been met, at 1055, a command can be issued (e.g., by a computer) to change the position of the target lens 910 and / or the position of the lens reference alignment system 900. At 1060, the position adjustment of the target lens 910 can be made. Thereafter, process 1020 returns to step 1030 and image sensor 925 may capture a new image of the object in the local area and repeat steps 1035 and 1040 until the alignment requirements are met.

[0119] There are several steps to perform optical adjustments on the lens holder 905. First, the object position and positioning can be fixed. The position and positioning of the lens holder 905 can be adjusted to achieve the desired image quality metric. The position and positioning of the lens holder 905 can be adjusted with very high accuracy and precision in all three spatial directions (e.g., x-direction, y-direction, z-direction), pitch direction, roll direction, and yaw direction. The target lens 910 can be set in the lens holder 905 and move with the lens holder 905 without sliding. After the movement of the lens holder 905 stops, the target lens 910 can remain stationary.

[0120] There are several steps to perform optical adjustments on the lens reference alignment system 900. The lens reference alignment system 900 can change its position as an entire device. The lens reference alignment system 900 can adjust its position in all three spatial directions (e.g., x-direction, y-direction, z-direction), pitch direction, yaw direction, and roll direction with very high accuracy and precision. After the image captured by the image sensor 925 meets the image quality requirements, the lens reference alignment system 900 can remain stationary.

[0121] If the target lens 910 has an actuator (e.g., a tunable lens actuator or an OIS actuator), the actuator can be turned on so that the target lens is in, for example, one actuation state or two actuation states during the reference alignment process. The power circuit and driver can be mounted close to the lens holder 905 to provide a desired power distribution during the lens reference alignment process. The process of activating the target lens 910 during the lens reference alignment process can be started by placing the target lens 910 in the lens holder 905. Thereafter, the target lens 910 can be activated with a desired power distribution. Then, a lens-reference optical alignment can be performed, followed by the target lens 910 being picked up by the lens pickup head 915. Finally, the power applied to the target lens 910 can be turned off.

[0122] Fig. 10C An example final state 1060 after lens reference alignment and lens pickup according to one or more embodiments is shown. The lens holder 905 and the lens reference alignment system 900 can be moved separately. Alternatively, one of the lens holder and the lens reference alignment system 900 can be moved and the other can be fixed in order to achieve the desired image quality metric of the optical alignment. After performing the optical alignment, all position adjustments can be stopped. The lens pickup process does not introduce any relative motion between the target lens 910 and the lens pickup head 915. The lens pickup head 915 and the target lens 910 can be moved to the lens barrel together.

[0123] Fig.11A An example installation 1100 is shown in which a lens assembly 1105 is mounted into a lens barrel 1110 according to one or more embodiments. The lens assembly 1102 may include a plurality of optical elements (e.g., lenses). The lens pickup head 915 (with the lens reference alignment system 900 as a whole) and the target lens 910 may be moved together to the lens barrel stage 1115. The lens barrel stage 1115 may include a lens holder 1117 and an actuator 1119. In some embodiments, an actuator 1120 may be applied to switch the target lens 910 to an active state during optical alignment. The relative position of the lens reference alignment system 900 and the lens barrel may be accurately controlled. If desired, a mark alignment, a laser alignment, or a positioning sensor may be used to control the relative position of the lens reference alignment system 900 and the lens barrel. The lens pickup head 915 may release the target lens 910 to the lens barrel. If there are more stringent requirements for the lens assembly, a second optical alignment may be performed after the first optical alignment.

[0124] Fig. 11B An example process 1125 of lens assembly installation according to one or more embodiments is shown. At 1130, the target lens 910 can be transferred to the barrel stage. At 1135, the lens reference alignment system 900 can be aligned with the barrel stage. At 1140, the target lens 910 can be installed. At 1145, a determination can be made whether the tolerance requirement has been met. If not, at 1150, the target lens 910 can be released. If the tolerance requirement has been met, at 1155, a second optical alignment can be performed.

[0125] If there are more stringent requirements for the optical alignment of the lens assembly, a second optical alignment may be performed. During the second optical alignment, the position of the lens barrel and the lens reference alignment system 900 (together with the target lens 910) may be relatively adjusted to meet the requirements of image quality (or one or more other quality metrics). During this optical alignment process, the target lens 910 may not need to be activated. The optical imaging behavior of the target lens 910 and the lens reference alignment system 900 may become known during the previous alignment, and this information may be used to facilitate the second optical alignment.

[0126] To obtain imaging performance, the target lens 910 may not be powered on during this final lens assembly / installation process. The imaging performance of the target lens 910 (powered on or off) and the lens reference alignment system 900 may become known during the first optical alignment. During the second optical alignment, the imaging performance of the target lens 910 under zero power, reference alignment, and the installed lens barrel may be obtained. Then, the imaging performance of the target lens 910 under the desired power may be evaluated from the imaging performance of the target lens 910 and the lens reference alignment system 900 in the first optical alignment and the imaging performance of the target lens 910 under zero power.

[0127] The optical alignment process presented herein can be performed automatically. The first optical alignment (i.e., lens to reference alignment) can be performed in parallel for all lenses. However, the second optical alignment can be performed sequentially after the first optical alignment. If the lens barrel has very good tolerance control and optical alignment does not need to be performed on each lens, the first optical alignment can be bypassed for one or more lenses in the lens assembly. However, tunable lenses or lenses with actuators may still need to go through the first optical alignment to achieve improved optical alignment.

[0128] A new camera lens assembly and installation procedure and alignment device are presented herein. A target lens can first be optically aligned with a lens reference alignment system. The lens reference alignment system moves the target lens to the lens barrel with very high positioning accuracy and precise control. A second optical alignment can be performed between the lens barrel (with the target lens already mounted) and the target lens to further reduce the alignment error. The alignment error mainly depends on the position accuracy of the lens reference alignment system and the lens barrel worktable, both of which can be better than, for example, 1 μm. All optical alignment processes can be performed automatically, and the first optical alignment can be performed in parallel for multiple target lenses of the lens assembly to improve productivity in large-scale production.

[0129] The lens alignment process and alignment device presented in this article have several advantages. First, there is no need to activate the tunable lens or actuator during the lens installation process. Second, because the individual lenses of the lens assembly can be aligned with the same reference, improved assembly precision and accuracy can be achieved. Third, assembly is more flexible. For example, if the performance of a particular lens is worse than expected, the alignment process of that lens can be repeated until the performance requirements are met, and there is no need to perform repeated alignment processes on lenses that directly meet the performance requirements. Fourth, because optical alignment can be performed for each lens and in each installation, there are loose tolerance requirements for the target lens and lens barrel. Because of this, the yield of the camera module can be higher.

[0130] Metal insert molded barrel

[0131] Embodiments of the present disclosure also relate to a lens barrel with a metal insert that minimizes thermomechanical stress. In some embodiments, the lens barrel includes a metal insert that floats in space. In some other embodiments, the lens barrel includes an L-shaped metal insert that converts longitudinal deformation into a bending mode, and its stiffness or stress is reduced by at least one order of magnitude. Embodiments of the present disclosure also relate to a molding method for manufacturing a floating metal insert and an L-shaped metal insert in the lens barrel.

[0132] Fig.12 An example lens barrel 1200 with a floating metal insert 1205 according to one or more embodiments is shown. The floating metal insert 1205 can minimize thermomechanical stress by floating in space. Most of the body of the floating metal insert 1205 can be set to be free in space. The floating metal insert 1205 can have a smaller coefficient of thermal expansion (CTE) than the lens barrel 1200. Therefore, the floating metal insert 1205 can have a smaller thermal deformation than the lens barrel 1200.

[0133] Fig.13 An example lens barrel 1300 with an L-shaped metal insert 1305 according to one or more embodiments is shown. The L-shaped metal insert 1305 can convert longitudinal deformation into a bending mode, and its stiffness and thermal stress can be reduced by at least one order of magnitude, for example. When there is thermal expansion, the impact of the L-shaped metal insert 1305 on electrical contacts and connecting structures can be significantly reduced.

[0134] Fig.14 An example process 1400 of forming a floating metal insert 1205 of a lens barrel 1200 according to one or more embodiments is shown. At 1405, the outer mold 1402 can first be removed from the lens barrel 1200. At 1410, the slider 14041 can be removed from the lens barrel 1200. At 1415, the slider 14042 can be removed from the lens barrel 1200. And, at 1420, the slider 14043 can be removed from the lens barrel 1200 to form the lens barrel 1200 with the floating metal insert 1205.

[0135] Fig.15An example process 1500 of forming an L-shaped metal insert 1305 of a lens barrel 1300 according to one or more embodiments is shown. At 1505, the outer mold 1502 can be removed from the lens barrel 1300 and the L-shaped metal insert 1305. At 1510, the slider 15041 can be removed from the lens barrel 1300. At 1515, the slider 15042 can be removed from the lens barrel 1300. At 1520, the slider 15043 can be removed to form the lens barrel 1300 with the L-shaped metal insert 1305. At 1525, metal cutting can be performed at the L-shaped metal insert 1305 to obtain the L-shaped metal insert 1305 of the lens barrel 1300 with the appropriate size.

[0136] Additional configuration information

[0137] The foregoing description of the various embodiments has been presented for the purpose of illustration; the foregoing description is not intended to be exhaustive or to limit the patent rights to the precise forms disclosed. Those skilled in the relevant art may recognize that many modifications and variations are possible in light of the above disclosure.

[0138] Some parts of this description describe various embodiments in terms of algorithms and symbolic representations for operating on information. These algorithmic descriptions and representations are often used by technicians in the field of data processing to effectively convey the essence of their work to other technicians in the field. Although these operations are described functionally, computationally or logically, these operations should be understood to be implemented by computer programs or equivalent circuits or microcodes, etc. In addition, without loss of generality, sometimes referring to these arrangements of operations as modules also proves to be convenient. The described operations and their associated modules can be implemented in software, firmware, hardware, or any combination thereof.

[0139] Any of the steps, operations or processes described herein may be performed or implemented using one or more hardware or software modules, either alone or in combination with other devices. In one embodiment, a software module is implemented using a computer program product comprising a computer-readable medium, the computer-readable medium containing computer program code, which may be executed by a computer processor to perform any or all of the steps, operations or processes described.

[0140] Embodiments may also relate to an apparatus for performing the operations herein. The apparatus may be specially constructed for the desired purpose, and / or the apparatus may include a general-purpose computing device that is selectively activated or reconfigured by a computer program stored in a computer. Such a computer program may be stored in a non-transitory tangible computer-readable storage medium, or any type of medium suitable for storing electronic instructions, which may be coupled to a computer system bus. In addition, any computing system mentioned in this specification may include a single processor, or may be an architecture that employs a multi-processor design for increased computing power.

[0141] Embodiments may also be directed to products produced by the computing processes described herein. Such products may include information obtained from the computing processes, wherein the information is stored on a non-transitory tangible computer-readable storage medium, and may include any embodiment of a computer program product or other data combination described herein.

[0142] Finally, the language used in this specification is primarily selected for readability and instructional purposes, and the language may not be selected to define or limit the patent rights. Therefore, the scope of the patent rights is not intended to be limited by this specific embodiment, but by any claims published based on the application herein. Therefore, the disclosure of the embodiments is intended to illustrate rather than limit the scope of the patent rights, and the scope of the patent rights is set forth in the attached claims.

Claims

1. A camera device, comprising: Image sensor; A lens assembly, the lens assembly being optically connected in series with the image sensor; as well as An optical image stabilization (OIS) component, the OIS component being configured to: initiating a first movement of at least one of the image sensor and the lens assembly along a first direction parallel to a first axis, the first movement having a first range, and A second movement of at least one of the image sensor and the lens assembly is initiated along a second direction parallel to a second axis, the second axis being orthogonal to the first axis, the second movement having a second range different from the first range.

2. The imaging device according to claim 1, wherein: The first range is symmetrical about the second axis, and the second range is symmetrical about the first axis.

3. The imaging device according to claim 1 or 2, wherein: The first range is symmetrical about the second axis and the second range is asymmetrical about the first axis; and / or preferably, wherein, after the first movement and the second movement, a central axis of the image sensor substantially overlaps an optical axis of the lens assembly.

4. An imaging device according to any one of the preceding claims, wherein: The OIS assembly includes a first pair of magnets and a second pair of magnets, each magnet in the first pair of magnets being positioned about the first axis and each magnet in the second pair of magnets being positioned about the second axis.

5. The imaging device according to claim 4, wherein: A first dimension of each magnet from the first pair along an axis parallel to the second axis is smaller than a second dimension of each magnet from the second pair along an axis parallel to the first axis; and / or preferably, wherein the dimension of a magnet from the second pair along the axis parallel to the first axis is different from another dimension of another magnet from the second pair along the axis parallel to the first axis.

6. The camera device of any one of the preceding claims, further comprising one or more actuators configured to actuate the first movement and the second movement based on one or more signals from the OIS component.

7. The imaging device according to claim 6, wherein: The first range and the second range depend on the stiffness of one or more springs coupled to the one or more actuators; and / or preferably, wherein the first range and the second range depend on the strength of one or more coils of the one or more actuators.

8. An imaging device according to any one of the preceding claims, wherein: The OIS assembly initiates the first movement and the second movement in response to the camera device changing orientation from a first orientation to a second orientation.

9. An imaging device according to any one of the preceding claims, wherein: The camera device is part of a smart watch.

10. A camera device, comprising: Image sensor; as well as A lens assembly, the lens assembly being optically connected in series with the image sensor, wherein: The lens assembly and the image sensor allow a first movement along a first direction parallel to a first axis having a first range, and a second movement along a second direction parallel to a second axis having a second range, the second axis being orthogonal to the first axis, the second range being different from the first range.

11. An imaging device according to any one of the preceding claims, wherein: The camera device rotates about the first axis when changing the orientation from the first orientation to the second orientation; And / or preferably, wherein, when the camera assembly is in the first orientation, the optical axis of the lens assembly is parallel to gravity, and when the camera assembly is in the second orientation, the optical axis is orthogonal to gravity.

12. The camera device according to claim 10, further comprising an optical image stabilization component, the optical image stabilization component being configured to: initiate the first movement and the second movement; and / or preferably, wherein, The first range is symmetrical about the second axis, and the second range is symmetrical about the first axis.

13. An imaging device according to any one of the preceding claims, wherein: The first range is symmetrical about the second axis, and the second range is asymmetrical about the first axis.

14. A method comprising: Initiating a first movement of at least one of an image sensor and a lens assembly in the camera device along a first direction parallel to a first axis, the first movement having a first range; as well as A second movement of at least one of the image sensor and the lens assembly is initiated along a second direction parallel to a second axis, the second axis being orthogonal to the first axis, the second movement having a second range different from the first range.

15. The method according to claim 14, further comprising: The first movement and the second movement are initiated in response to the camera device changing orientation from a first orientation to a second orientation, the camera device changing orientation from a first orientation to a second orientation comprising rotating the camera device about the first axis.

Images