Semiconductor device

Abstract

To provide a semiconductor device for transmitting / receiving data using the unused addresses of a gyro sensor, and with which the number of wirings is reduced.SOLUTION: Provided is a semiconductor device comprising: a camera lens for correcting camera shake by controlling an X axis, a Y axis orthogonal to the X axis, and a Z axis orthogonal to the X and Y axes; a first semiconductor chip for receiving the X axis and Y axis data of the camera lens; a second semiconductor chip for receiving the Z axis data of the camera lens; and a gyro sensor for acquiring data regarding a camera shake state. The second semiconductor chip is connected to the first semiconductor chip via a chip select signal line, a data signal line, and a clock signal line of SPI communication, and the second semiconductor chip is connected to the gyro sensor via the chip select signal line, the data signal line, and the clock signal line of SPI communication. The second semiconductor chip transmits Z axis position data to a storage unit of the gyro sensor via SPI communication.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to a semiconductor device. [Background technology]

[0002] In video cameras or digital cameras, image stabilization is performed using either or both of an OIS (Optical Image Stabilizer) and an EIS (Electronic Image Stabilizer).

[0003] Patent Document 1 discloses a semiconductor device that reduces the risk that either the OIS or the EIS will be outside the correctable range when the OIS and the EIS are used together. The semiconductor device adjusts the position of the correction lens used for optical image stabilization based on information on the current position of the correction lens as well as position information of the output image of the electronic image stabilization relative to the captured image captured by the imaging element. This ensures an operating margin for the correction lens as well as a correction margin for the electronic image stabilization. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2019-106655 A Summary of the Invention [Problem to be solved by the invention]

[0005] Although it is possible to share data between two semiconductor chips by using SPI communication using a chip select signal line for communication between the two semiconductor chips, there is a problem that the number of wirings increases. Therefore, the object of the present disclosure is to provide a semiconductor device that transmits and receives data using unused addresses of a gyro sensor, thereby reducing the number of wirings.

[0006] Other objects and novel features will become apparent from the description of this specification and the accompanying drawings. [Means for solving the problem]

[0007] According to one embodiment, in the semiconductor device, the second semiconductor chip transmits data to the storage unit of the gyro sensor via SPI communication, and the first semiconductor chip uses the data. Effect of the Invention

[0008] According to the embodiment, it is possible to provide a semiconductor device in which unused addresses of the gyro sensor are used to transmit and receive data, thereby reducing the number of wirings. [Brief description of the drawings]

[0009] [Figure 1] 1 is a block diagram showing a configuration of an image stabilization device that controls a three-axis OIS lens using two two-axis OIS-ICs (Integrated Circuits) according to a first embodiment. [Diagram 2] FIG. 4 is a sequence diagram of an OIS process according to the first embodiment. [Diagram 3] FIG. 13 is a block diagram showing the X-axis correction process using the Z-axis lens position in the OIS process according to the first embodiment. [Figure 4] 4 is a schematic diagram showing unused areas of data addresses of the gyro sensor in the OIS processing according to the first embodiment. FIG. [Diagram 5] 5 is a flowchart showing the operation of a primary semiconductor chip of a two-axis OIS-IC for OIS processing according to the first embodiment. [Figure 6] 10 is a flowchart showing an operation of a secondary semiconductor chip of a two-axis OIS IC for OIS processing according to the first embodiment. [Figure 7] FIG. 11 is a sequence diagram of an OIS process according to the second embodiment. [Figure 8] 13 is a flowchart showing the operation of a primary semiconductor chip of a two-axis OIS-IC for OIS processing according to the second embodiment. [Figure 9] 13 is a flowchart showing the operation of a secondary semiconductor chip of a two-axis OIS IC for OIS processing according to the second embodiment. [Figure 10] 13 is a flowchart showing an operation of a HOST controller in OIS processing according to the second embodiment. [Figure 11] FIG. 11 is a diagram showing an example of EIS data content according to the second embodiment; [Figure 12] FIG. 1 is a diagram showing an example of EIS data content according to a related technique. [Figure 13] FIG. 13 is a sequence diagram of an OIS process according to the third embodiment. [Figure 14] FIG. 13 is a schematic diagram showing unused areas of data addresses of a gyro sensor in the OIS processing according to the third embodiment. [Figure 15] FIG. 13 is a block diagram showing a configuration of an image stabilization device according to a fourth embodiment, which controls a plurality of two-axis OIS-ICs and two-axis OIS lenses connected to each of the two-axis OIS-ICs. [Figure 16] FIG. 13 is a sequence diagram of an OIS process according to the fourth embodiment. [Figure 17] 13 is a flowchart showing the operation of a primary semiconductor chip of a two-axis OIS-IC for OIS processing according to the fourth embodiment. [Figure 18] 13 is a flowchart showing the operation of a secondary semiconductor chip of a two-axis OIS IC for OIS processing according to the fourth embodiment. [Figure 19] FIG. 13 is a schematic diagram showing unused areas of data addresses of a gyro sensor in the OIS processing according to the fourth embodiment. [Figure 20] 13 is a flowchart showing an operation of a HOST controller in OIS processing according to the fourth embodiment. [Figure 21] FIG. 13 is a diagram showing the time required for OIS processing according to the fourth embodiment and the time required for OIS processing according to a related technique. [Figure 22] FIG. 13 is a sequence diagram of an OIS process according to the fifth embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0010] In order to clarify the explanation, the following description and drawings are omitted and simplified as appropriate. In addition, each element shown in the drawings as a functional block performing various processes can be configured in hardware with a CPU, memory, and other circuits, and in software with a program loaded into memory. Therefore, it is understood by those skilled in the art that these functional blocks can be realized in various forms by hardware only, software only, or a combination thereof, and are not limited to any one of them. In addition, the same elements are given the same symbols in each drawing, and duplicate explanations are omitted as necessary.

[0011] (Description of the image stabilization device according to the first embodiment) Fig. 1 is a block diagram showing the configuration of an image stabilization device that uses two two-axis OIS-ICs to control a three-axis OIS lens according to a first embodiment. The image stabilization device according to the first embodiment will be described with reference to Fig. 1. Image stabilization device 100 is a semiconductor device that corrects camera shake and is used in an imaging device. Image stabilization device 100 corrects camera shake of a three-axis OIS lens using two two-axis OIS-ICs.

[0012] 1, image stabilization device 100 according to the first embodiment includes a three-axis OIS lens (hereinafter referred to as a camera lens) 101, a No. 1 two-axis OIS-IC (hereinafter referred to as a first semiconductor chip) 103, a No. 2 two-axis OIS-IC (hereinafter referred to as a second semiconductor chip) 102, a gyro sensor 104, and a gyro sensor storage unit 105. Image stabilization device 100 further includes a HOST controller 106.

[0013] The camera lens 101 is a lens controlled by a three-dimensional coordinate system having an X-axis, a Y-axis perpendicular to the X-axis, and a Z-axis perpendicular to the X-axis and Y-axis. The camera lens 101 is equipped with an X-axis position sensor 112 (X-Lens Position sensor) and an X-axis actuator 113 (X-VCM (Voice Coil Motor)). The camera lens 101 is equipped with a Y-axis position sensor 114 (Y-Lens Position sensor) and a Y-axis actuator 115 (Y-VCM (Voice Coil Motor)). The camera lens 101 is equipped with a Z-axis position sensor 110 (Z-Lens Position sensor) and a Z-axis actuator 111 (Z-VCM (Voice Coil Motor)).

[0014] The X-axis position sensor 112 and the X-axis actuator 113 are connected to the first semiconductor chip 103 and controlled by the first semiconductor chip 103. The Y-axis position sensor 114 and the Y-axis actuator 115 are connected to the first semiconductor chip 103 and controlled by the first semiconductor chip 103. The Z-axis position sensor 110 and the Z-axis actuator 111 are connected to the second semiconductor chip 102 and controlled by the second semiconductor chip 102.

[0015] The second semiconductor chip 102 is a primary semiconductor chip. The second semiconductor chip 102 stores Z-axis position data 107 by connecting to the three-axis OIS lens 101, and controls the Z-axis of the camera lens 101. The second semiconductor chip 102 is connected to the HOST controller by IIC (Inter-Integrated Circuit) communication or I3C (Improved Inter-Integrated Circuit) communication.

[0016] The second semiconductor chip 102 is connected to the gyro sensor 104 via a chip select signal line, a data signal line, and a clock signal line for SPI (Serial Peripheral Interface) communication. The second semiconductor chip 102 is also connected to the first semiconductor chip 103 via a chip select signal line, a data signal line, and a clock signal line for SPI communication. Although one data line is shown in the drawing, there may be two or more data lines in practice.

[0017] The second semiconductor chip 102 transmits Z-axis position data 107 via SPI communication to the gyro sensor storage unit 105. The second semiconductor chip 102 reads the data on the camera shake state and calculates the target position of the camera lens 101 on the Z axis.

[0018] The first semiconductor chip 103 is a secondary semiconductor chip. The first semiconductor chip 103 stores X-axis and Y-axis position data 108 by being connected to the camera lens 101. The first semiconductor chip 103 also controls the X-axis and Y-axis of the camera lens 101. The first semiconductor chip 103 is connected to the HOST controller by IIC communication or I3C communication.

[0019] The first semiconductor chip 103 constantly monitors the SPI data. Therefore, the first semiconductor chip 103 can obtain Z-axis position data 109. The Z-axis position data 109 is obtained from the Z-axis position data stored in the storage unit 105 of the gyro sensor via SPI communication. The first semiconductor chip 103 reads the gyro data, corrects it with the Z-axis position data, and calculates the target positions of the camera lens 101 on the X and Y axes.

[0020] The gyro sensor 104 acquires gyro data of the X-axis, Y-axis, and Z-axis, which is data on the state of camera shake. The gyro sensor 104 transmits the gyro data to the first semiconductor chip 103 and the second semiconductor chip 102 via SPI communication. Camera shake correction is performed in the first semiconductor chip 103 and the second semiconductor chip 102 using the data on the state of camera shake. The gyro sensor 104 includes a gyro sensor storage unit 105. The gyro sensor storage unit 105 includes a first area and a second area. The first area stores data on the state of camera shake, and the second area stores position data of the Z axis.

[0021] The HOST controller 106 acquires data on the state of camera shake and position data on the X-axis, Y-axis, and Z-axis from the connected second semiconductor chip 102 and first semiconductor chip 103. The HOST controller 106 uses the data on the state of camera shake and the position data on the X-axis, Y-axis, and Z-axis for EIS.

[0022] With this configuration, even if there is no chip select signal line connecting the second semiconductor chip 102 and the first semiconductor chip 103, the Z-axis position data can be transmitted and received by SPI communication using an unused address of the gyro sensor.

[0023] (Description of OIS Processing According to the First Embodiment) FIG. 2 is a sequence diagram of the OIS processing according to the first embodiment. FIG. 3 is a block diagram showing the X-axis correction processing using the Z-axis lens position in the OIS processing according to the first embodiment. FIG. 4 is a schematic diagram showing an unused area of ​​the data address of the gyro sensor in the OIS processing according to the first embodiment. FIG. 5 is a flowchart showing the operation of the primary semiconductor chip of the two-axis OIS-IC in the OIS processing according to the first embodiment. FIG. 6 is a flowchart showing the operation of the secondary semiconductor chip of the two-axis OIS IC in the OIS processing according to the first embodiment. The OIS processing according to the first embodiment will be described with reference to FIGS. 2 to 6.

[0024] As shown in FIG. 2, the image stabilization device 100 operates in the following sequence. (1) The HOST controller 106 transmits a start command to the second semiconductor chip 102. (2) The HOST controller 106 transmits a start command to the first semiconductor chip 103. (3) The second semiconductor chip 102 outputs the Z-axis lens position to the SPI line. At this time, the output is an unused address and the Z-axis lens position. Since the address is unused, the gyro sensor 104 performs NOP (No Operation) operation. Since the address is the Z-axis ID (Identification), the first semiconductor chip 103 recognizes this as information on the Z-axis lens position. The first semiconductor chip 103 uses the information on the Z-axis lens position to calculate the target position. (4) The second semiconductor chip 102 outputs a drive command for the gyro sensor 104 to the SPI line. The drive command is the ID of the gyro sensor. The gyro sensor 104 recognizes this as the ID of the gyro sensor. The first semiconductor chip 103 recognizes this as the ID of the gyro sensor. (5) The gyro sensor 104 outputs gyro data to the SPI line. The first semiconductor chip 103 calculates the target positions for the X and Y axes. The second semiconductor chip 102 calculates the target position for the Z axis.

[0025] 3, in the calculation of the target position of the first semiconductor chip in sequence (5), the lens position on the Z axis is used for the correction process of the X axis. Here, the X axis is taken as an example, but the Y axis is similar.

[0026] Raw data 301 of the X-axis gyro sensor is subjected to crosstalk correction using the Z-axis lens position 308 and limit value correction, and the X-axis target position is calculated.

[0027] In the case of an actuator in which the X-axis lens position shifts depending on the Z-axis lens position, the following crosstalk correction is required. X' = ​​Calculation result of X + (Lens position on Z axis - Center of Z axis) x Coefficient 1

[0028] In the case of an actuator in which the limit lens positions for the X and Y axes shift depending on the lens position for the Z axis, the following limit value correction is required. Max = Normal Limit Max + Z-axis lens position x coefficient 0 Min=Normal Limit Min+Z-axis lens position x coefficient 0

[0029] As shown in FIG. 4, the Z-axis lens position is output to the SPI line of the second semiconductor chip 102 in sequence (3). For example, the unused address 0x03 address and the data of the Z-axis lens position are transmitted to the SPI data signal line on the SPI clock after the start of communication by the SPI chip select signal line. The unused area is a part of the area of ​​the storage unit 105 of the gyro sensor, and is an area that is not designed to store data related to the operation of the gyro sensor, such as command data, program data, and data indicating a status. Therefore, even if data is stored in the unused area, the gyro sensor will not change its operation based on the data. The unused area is also called a "RESERVED AREA" or "UNUSED AREA". The unused address "UNUSED ADDRESS" indicates an address included in the unused area.

[0030] As shown in FIG. 5, the second semiconductor chip 102 operates as follows. Here, the OIS process operates at 1 kHz. First, it is determined whether 1 ms has elapsed since the start of OIS (step S501). If 1 ms has not elapsed (NO in step S501), the process returns to the start of OIS. If 1 ms has elapsed (YES in step S501), the second semiconductor chip 102 transmits Z-axis lens position data from chip select signal line 0 (CS (Chip Select) 0) (step S502). The Z-axis lens position data is the unused address 0x03 and the Z-axis lens position data. Next, the second semiconductor chip 102 acquires data from the gyro sensor 104 through chip select signal line 0 (step S503). Finally, the second semiconductor chip 102 calculates the target position of the Z-axis (step S504). Then, while the OIS is operating, steps S501 to S504 are repeated.

[0031] As shown in FIG. 6, the first semiconductor chip 103 operates as follows. First, it is determined whether the first semiconductor chip 103 has received a signal from the chip select signal line 0 (step S601). If the signal has not been received (NO in step S601), it is determined whether the OIS process is to be ended (step S607). If the signal has been received (YES in step S601), it is determined whether the address is an unused address of the gyro sensor (step S602). If the address is not an unused address, for example, the first address 0xA2, the target position (including crosstalk correction) shown in FIG. 3 is calculated (step S603). Next, the limit value is updated (step S604). If the address is an unused address, for example, the second address 0x03, it is recognized as Z-axis lens position data and the data of the Z-axis lens position data is held (step S605). Next, the limit value according to the Z-axis lens position is updated (step S606). After steps S604 and S606, it is determined whether or not to end the OIS processing (step S607). If the OIS processing is to be ended (YES in step S607), the OIS processing is ended. If the OIS processing is not to be ended (NO in step S607), the process returns to the start of the OIS processing (step S601).

[0032] In this way, even if there is no chip select signal line connecting the second semiconductor chip 102 and the first semiconductor chip 103, the Z-axis position data can be transmitted and received by SPI communication using an unused address of the gyro sensor.

[0033] (Description of OIS Processing According to the Second Embodiment) FIG. 7 is a sequence diagram of OIS processing according to the second embodiment. FIG. 8 is a flowchart showing the operation of a primary semiconductor chip of a two-axis OIS-IC of OIS processing according to the second embodiment. FIG. 9 is a flowchart showing the operation of a secondary semiconductor chip of a two-axis OIS IC of OIS processing according to the second embodiment. FIG. 10 is a flowchart showing the operation of a HOST controller of OIS processing according to the second embodiment. FIG. 11 is a diagram showing an example of EIS data content according to the second embodiment. FIG. 12 is a diagram showing an example of EIS data content according to the related technology. The OIS processing according to the second embodiment will be described with reference to FIGS. 7 to 12.

[0034] The image stabilization device according to the second embodiment has the same configuration as the image stabilization device 100 according to the first embodiment. The second embodiment differs from the first embodiment in that a host controller 106 performs EIS processing.

[0035] As shown in FIG. 7, the image stabilization device 100 according to the second embodiment operates in the following sequence. (1) The HOST controller 106 transmits a start command to the second semiconductor chip 102. (2) The HOST controller 106 transmits a start command to the first semiconductor chip 103. (3) The second semiconductor chip 102 outputs a gyro command to the SPI line. The output is the ID of the gyro sensor. The gyro sensor 104 recognizes the command as the ID of the gyro sensor. The first semiconductor chip 103 recognizes the command as the ID of the gyro sensor. (4) The gyro sensor 104 outputs gyro data to the SPI line. The second semiconductor chip 102 calculates the target position for the Z axis. The first semiconductor chip 103 calculates the target positions for the X axis and the Y axis. (5) The second semiconductor chip 102 outputs the Z-axis lens position and the target position to the SPI line. The first semiconductor chip 103 acquires the Z-axis lens position and the target position. (6) The HOST controller 106 acquires EIS data of the X-axis, Y-axis, and Z-axis from the first semiconductor chip 103 via IIC communication.

[0036] The second semiconductor chip 102 and the first semiconductor chip 103 exchange data on the hand shake state, lens position, and target position with the gyro sensor 104 at a calculation cycle of, for example, 1 kHz, and accumulate the EIS data. The HOST controller 106 reads the EIS data at an image reading cycle of, for example, 30 fps, and executes EIS processing.

[0037] As shown in FIG. 8, the second semiconductor chip 102 operates as follows. Here, the OIS process operates at 1 kHz. First, it is determined whether 1 ms has elapsed since the start of OIS (step S801). If 1 ms has not elapsed (NO in step S801), the process returns to the start of OIS. If 1 ms has elapsed (YES in step S801), the second semiconductor chip 102 transmits Z-axis data from chip select signal line 0 (CS0) (step S802). The Z-axis data is 0x03-lens position data and target position data. Next, the second semiconductor chip 102 acquires data from the gyro sensor 104 through chip select signal line 0 (step S803). Finally, the second semiconductor chip 102 calculates the target position of the Z axis (step S804). Then, while the OIS is operating, steps S801 to S804 are repeated.

[0038] As shown in FIG. 9, the first semiconductor chip 103 operates as follows. First, the first semiconductor chip 103 determines whether or not it has received a signal from the chip select signal line 0 (step S901). If it has not received a signal (NO in step S901), it determines whether or not to end the OIS process (step S907). If it has received a signal (YES in step S901), it determines whether or not the address is an unused address of the gyro sensor (step S902). If it is not an unused address, for example, if it is the first address 0xA2, it calculates the target position (including crosstalk correction) shown in FIG. 3 (step S903). Next, it updates the limit value (step S904). If it is an unused address, for example, if it is the second address 0x03, it is stored because it is Z-axis data (step S905). Next, it updates the EIS data according to the lens position and target position of the Z axis (step S906). After steps S904 and S906, it is determined whether or not to end the OIS processing (step S907). If the OIS processing is to be ended (YES in step S907), the OIS processing is ended. If the OIS processing is not to be ended (NO in step S907), the process returns to the start of the OIS processing (step S901).

[0039] 10, the HOST controller 106 operates as follows. First, the HOST controller 106 transmits a start command to the second semiconductor chip 102, which is the primary, via IIC communication. The HOST controller 106 also transmits a start command to the first semiconductor chip 103, which is the secondary, via IIC communication (step S1001). Next, the HOST controller 106 determines whether or not one frame of an image has been acquired (step S1002). If the EIS data is acquired (YES in step S1002), EIS processing is performed (step (S1003). The HOST controller 106 acquires EIS data of the X-axis, Y-axis, and Z-axis from the first semiconductor chip 103. If the EIS data is not acquired (NO in step S1002) and step S1003 is ended, the HOST controller 106 judges whether or not to end the camera function (step S1004). If the camera function is not to be ended (NO in step S1004), the process returns to step S1002. If the camera function is to be ended (YES in step S1004), the HOST controller 106 transmits a stop command to the second semiconductor chip 102, which is the primary, via IIC communication. The HOST controller 106 also transmits a stop command to the first semiconductor chip 103, which is the secondary, via IIC communication (step S1005). Finally, the HOST controller 106 terminates the OIS processing.

[0040] As shown in FIG. 11, when images are acquired at 30 fps, the shooting time per image is 33.3 milliseconds. When data such as lens position is acquired once every 4 milliseconds, the number of data per image is approximately 8. Three items of data are acquired: lens position data, target position data, and gyro raw data. As shown in FIG. 12, when images are acquired at the same time at 30 fps, lens position data is generated for each of the first semiconductor chip 103 and the second semiconductor chip 102. In addition to the table in FIG. 12, target position and gyro raw data are also generated in the same manner.

[0041] Therefore, the number of data in the second embodiment is 3×4×8=96, and the number of data in the related technology is 3×3×8+3×2×8=120. Therefore, the second embodiment can reduce the number of data. The theoretical communication time at 1 Mbps can be shortened from 2.22 msec to 1.76 msec. Also, the timing of acquiring data in the two IIC communications may differ, making EIS processing difficult. The method of the second embodiment accurately synchronizes data for all axes.

[0042] In this way, data for all axes can be obtained from a single semiconductor chip, reducing the amount of data communication required by the EIS.

[0043] (Description of OIS Processing According to Third Embodiment) Fig. 13 is a sequence diagram of the OIS processing according to the embodiment 3. Fig. 14 is a schematic diagram showing an unused area of ​​the data address of the gyro sensor in the OIS processing according to the embodiment 3. The OIS processing according to the embodiment 3 will be described with reference to Figs. 13 and 14.

[0044] The image stabilization device according to the third embodiment has the same configuration as the image stabilization device 100 according to the first embodiment. The OIS processing according to the third embodiment differs from the OIS processing according to the first embodiment in that the gyro sensor 104 transmits Z-axis position data and gyro data to the first semiconductor chip 103 at the same time.

[0045] As shown in FIG. 13, the image stabilization device 100 operates in the following sequence. (1) The HOST controller 106 transmits a start command to the second semiconductor chip 102. (2) The HOST controller 106 transmits a start command to the first semiconductor chip 103. (3) The second semiconductor chip 102 outputs the Z-axis lens position to the SPI line. At this time, the output is an UNUSED ADDRESS and the Z-axis lens position. The gyro sensor 104 stores the data because it is an unused address. The first semiconductor chip 103 ignores the data from the second semiconductor chip 102. (4) The second semiconductor chip 102 outputs the address of the UNUSED ADDRESS to the SPI line. (5) The gyro sensor 104 outputs the data of the UNUSED ADDRESS and the data of the gyro sensor. The first semiconductor chip 103 recognizes the data of the UNUSED ADDRESS and the data of the gyro sensor. The first semiconductor chip 103 calculates the target position based on these data. The second semiconductor chip 102 calculates the target position of the Z axis.

[0046] 14, in the storage unit 105 of the gyro sensor, the second unused area is continuous with the first area in which the data on the hand shake state is stored. The first semiconductor chip 103 sends the address of the unused area (0x20)+(0x80) to the SPI line in order to obtain the gyro data and the data of the unused area from the gyro sensor 104. Then, the first semiconductor chip 103 can obtain the Z-axis lens position data and the gyro data of the UNUSED ADDRESS.

[0047] By doing this, not only can Z-axis position data be sent and received via SPI communication using unused addresses in the gyro sensor, but the number of communications can also be reduced.

[0048] (Description of Image Stabilizer According to Fourth Embodiment) Fig. 15 is a block diagram showing a configuration of an image stabilization device that controls a plurality of two-axis OIS-ICs and two-axis OIS lenses connected to each of the two-axis OIS-ICs according to the fourth embodiment. The image stabilization device according to the fourth embodiment will be described with reference to Fig. 15. Image stabilization device 1500 is a semiconductor device that corrects camera shake and is used in an imaging device. Image stabilization device 1500 corrects camera shake using two or more two-axis OIS-ICs and two or more two-axis OIS lenses.

[0049] Image stabilization device 1500 according to the fourth embodiment includes a first two-axis OIS lens (hereinafter referred to as the first camera lens) 1501, a second two-axis OIS lens (hereinafter referred to as the second camera lens) 1502, No. 1 two-axis OIS-IC (hereinafter referred to as the first semiconductor chip) 1505, No. 2 two-axis OIS-IC (hereinafter referred to as the second semiconductor chip) 1506, a gyro sensor 1509, a HOST controller 1510, and a gyro sensor memory unit 1511. In addition, image stabilization device 1500 according to embodiment 4 may include a third biaxial OIS lens (hereinafter referred to as the third camera lens) 1503, a fourth biaxial OIS lens (hereinafter referred to as the fourth camera lens) 1504, a No. 3 biaxial OIS-IC (hereinafter referred to as the third semiconductor chip) 1507, and a No. 4 biaxial OIS-IC (hereinafter referred to as the fourth semiconductor chip) 1508.

[0050] The first camera lens 1501 is a lens controlled by two axes of a three-dimensional coordinate system including an X axis, a Y axis perpendicular to the X axis, and a Z axis perpendicular to the X and Y axes. The camera lens 1501 includes a two-axis position sensor and a two-axis actuator. The two-axis position sensor and the two-axis actuator of the three axes are connected to the first semiconductor chip 1505 and are controlled by the first semiconductor chip 1505.

[0051] The first semiconductor chip 1505 is a primary semiconductor chip. The first semiconductor chip 1505 is connected to the second semiconductor chip 1506 via a chip select signal line, a data signal line, and a clock signal line of SPI communication. The first semiconductor chip 1505 is also connected to a gyro sensor 1509 via a chip select signal line, a data signal line, and a clock signal line of SPI communication. The first semiconductor chip 1505 is connected to a HOST controller 1510 via IIC communication.

[0052] The first semiconductor chip 1505 receives commands through connection with the HOST controller 1510. The first semiconductor chip 1505 transmits commands from the HOST controller to a storage unit 1511 of the gyro sensor via SPI communication.

[0053] The second camera lens 1502 is a lens controlled by two axes of a three-dimensional coordinate system including an X axis, a Y axis perpendicular to the X axis, and a Z axis perpendicular to the X and Y axes. Position sensors for two of the three axes and actuators for the two axes are connected to and controlled by a second semiconductor chip 1506.

[0054] The second semiconductor chip 1506 is a secondary semiconductor chip. The second semiconductor chip 1506 is connected to the gyro sensor 1509 via a chip select signal line, a data signal line, and a clock signal line of the SPI communication. The second semiconductor chip 1506 is also connected to the first semiconductor chip 1505 via a chip select signal line, a data signal line, and a clock signal line of the SPI communication. The second semiconductor chip 1506 is connected to the HOST controller 1510 by IIC communication.

[0055] In addition, the second semiconductor chip 1506 constantly monitors the SPI data. If the address of the SPI data is a gyro address, it is recognized as gyro data and used to calculate the target position. If it is an unused address indicating command information, it is used as a command. In other words, the HOST controller 1510 transmits a command to multiple semiconductor chips once.

[0056] The gyro sensor 1509 acquires gyro data of the X-axis, Y-axis, and Z-axis, which is hand-shake state data. The gyro sensor 1509 transmits the gyro data to the first semiconductor chip 1505 and the second semiconductor chip 1506 via SPI communication. As in the fifth embodiment, the gyro sensor 1509 may transmit the gyro data to the HOST controller 1510 via SPI communication.

[0057] The third camera lens 1503 and the fourth camera lens 1504 have the same configuration as the second camera lens 1502, and therefore their explanation will be omitted. The third semiconductor chip 1507 and the fourth semiconductor chip 1508 have the same configuration as the second semiconductor chip 1506, and therefore their explanation will be omitted. In this manner, one of the multiple semiconductor chips is connected to one of the multiple camera lenses. There is no limit to the number of pairs of the third camera lens 1503 and the third semiconductor chip 1507 and the number of pairs of the fourth camera lens 1504 and the fourth semiconductor chip 1508.

[0058] This configuration allows the host controller to instruct multiple semiconductor chips with just one command transmission, thereby reducing the command transmission time.

[0059] (Description of OIS Processing According to Fourth Embodiment) FIG. 16 is a sequence diagram of OIS processing according to the fourth embodiment. FIG. 17 is a flowchart showing the operation of a primary semiconductor chip of a two-axis OIS-IC of OIS processing according to the fourth embodiment. FIG. 18 is a flowchart showing the operation of a secondary semiconductor chip of a two-axis OIS IC of OIS processing according to the fourth embodiment. FIG. 19 is a schematic diagram showing an unused area of ​​a data address of a gyro sensor of OIS processing according to the fourth embodiment. FIG. 20 is a flowchart showing the operation of a host controller of OIS processing according to the fourth embodiment. FIG. 21 is a diagram showing the time required for OIS processing according to the fourth embodiment and the time required for OIS processing according to a related technique. The OIS processing according to the fourth embodiment will be described with reference to FIG. 16 to FIG. 21.

[0060] As shown in FIG. 16, the image stabilization device 1500 operates in the following sequence. (1) The HOST controller 1510 sends a start command to the first semiconductor chip 1505. (2) The first semiconductor chip 1505 transmits a start command to an unused area of ​​the memory unit 1511 of the gyro sensor via SPI communication. The second semiconductor chip 1506, the third semiconductor chip 1507, and the fourth semiconductor chip 1508 monitor the SPI communication and receive the start command. The second semiconductor chip 1506, the third semiconductor chip 1507, and the fourth semiconductor chip 1508 start processing. The gyro sensor does not operate because the address is in an unused area. (3) The first semiconductor chip 1505 outputs a drive command for the gyro sensor 1509 to the SPI line. The drive command is the ID of the gyro sensor. The gyro sensor 1509 recognizes the command as the ID of the gyro sensor. The second semiconductor chip 1506, the third semiconductor chip 1507, and the fourth semiconductor chip 1508 recognize the command as the ID of the gyro sensor. (4) Gyro sensor 1509 outputs data of gyro sensor 1509 to the SPI line. First semiconductor chip 1505 acquires gyro data and calculates a biaxial target position. Second semiconductor chip 1506 acquires gyro data and calculates a biaxial target position. Third semiconductor chip 1507 acquires gyro data and calculates a biaxial target position. Fourth semiconductor chip 1508 acquires gyro data and calculates a biaxial target position. (5) The HOST controller 1510 transmits a mode change command, such as a command to change the shooting conditions, to the first semiconductor chip 1505. (6) The first semiconductor chip 1505 transmits a mode change command to an unused area of ​​the memory unit 1511 of the gyro sensor via SPI communication. The second semiconductor chip 1506, the third semiconductor chip 1507, and the fourth semiconductor chip 1508 monitor the SPI communication and receive the mode change command. The second semiconductor chip 1506, the third semiconductor chip 1507, and the fourth semiconductor chip 1508 change the mode. The gyro sensor does not operate because the address is in an unused area. (7) The HOST controller 1510 transmits a stop command to the first semiconductor chip 1505. (8) The first semiconductor chip 1505 transmits a stop command to an unused area of ​​the memory unit 1511 of the gyro sensor via SPI communication. The second semiconductor chip 1506, the third semiconductor chip 1507, and the fourth semiconductor chip 1508 monitor the SPI communication and receive the stop command. The second semiconductor chip 1506, the third semiconductor chip 1507, and the fourth semiconductor chip 1508 stop processing. The gyro sensor does not operate because the address is in an unused area.

[0061] As shown in FIG. 17, the HOST controller 1510 operates as follows. First, the camera function is started, and a start command is sent only to the first semiconductor chip 1505 by IIC communication (step S1701). Next, it is determined whether the HOST controller 1510 has acquired one frame of an image (step S1702). If it has been acquired (YES in step S1702), the HOST controller 1510 executes EIS processing (step S1703). If it has not been acquired (NO in step S1702) and after executing EIS processing (step S1703), the HOST controller 1510 determines whether to change the camera mode (step S1704). If it is to be changed (YES in step S1704), the HOST controller 1510 sends a mode change command only to the first semiconductor chip 1505 by IIC communication (step S1705). If no change is to be made (NO in step S1704), and after the mode change command has been sent (step S1705), the process returns to step S1702.

[0062] As shown in FIG. 18, the first semiconductor chip 1505 operates as follows. First, it is determined whether a command has been transmitted from the IIC (step S1801). If a command has not been transmitted (NO in step S1801), the first semiconductor chip 1505 waits. If a command has been transmitted (YES in step S1801), the first semiconductor chip 1505 transmits a command from the SPI line (step S1802). The command is, for example, an address 0x04, which is an unused area of ​​the gyro sensor, a command ID, and command data, as shown in FIG. 19. Next, the first semiconductor chip 1505 determines which command the IIC is (step S1803). If the command ID is 0x11, the hardware (HW) of the OIS is started and the start flag is set to 1 (step S1804). If the command ID is 0x22, the HW of the OIS is stopped and the start flag is set to 0 (step S1805). If the command ID is 0x33, the OIS mode is changed and command data is input to the mode (step S1806). Next, it is determined whether the start flag is 1 and time has elapsed (step S1807). If the start flag is 1 and time has elapsed, the first semiconductor chip 1505 acquires data from the gyro sensor 1509 (step S1808). Finally, the first semiconductor chip 1505 calculates the target position for two axes (step S1809). Then, if the start flag is not 1 or time has not elapsed (NO in step S1807) and after the target position has been calculated (step S1809), the process returns to step S1801, and steps S1801 to S1809 are repeated while the OIS is operating.

[0063] As shown in FIG. 20, the second semiconductor chip 1506 operates as follows. First, it is determined whether a command has been transmitted to the SPI line (step S2001). If it has not been transmitted (NO in step S2001), the second semiconductor chip 1506 waits. If it has been transmitted (YES in step S2001), the second semiconductor chip 1506 determines whether the SPI data indicates a command, for example, at address 0x04 (step S2002). If it does not indicate a command (NO in step S2002), the process returns to step S2001. If it indicates a command (YES in step S2002), the second semiconductor chip 1506 determines which command data 1 is (step S2003). If the command ID is 0x11, the hardware (HW) of the OIS is started and the start flag is set to 1 (step S2004). If the command ID is 0x22, the HW of the OIS is stopped and the start flag is set to 0 (step S2005). If the command ID is 0x33, the OIS mode is changed and the command data is input to the mode (step S2006). Next, it is determined whether the SPI data 0 is a gyro ID and the start flag is 1 (step S2007). If the gyro ID and the start flag are 1, the second semiconductor chip 1506 calculates the target positions of the two axes (step S2008). Then, if the SPI data 0 is not a gyro ID or the start flag is not 1 (NO in step S2007) and after the target position is calculated (step S2008), the process returns to step S2001, and steps S2001 to S2008 are repeated while the OIS is operating.

[0064] In this way, the time required for the HOST controller 1510 to send a command to one semiconductor chip by IIC is 38 μsec, as shown in Fig. 21. When the HOST controller 1510 transmits to four semiconductor chips, it takes 152 μsec in the related technology, but the method of the present disclosure can reduce this to 40.4 μsec.

[0065] (Description of OIS Processing According to Fifth Embodiment) 22 is a sequence diagram of the OIS process according to the fifth embodiment. The OIS process according to the fifth embodiment will be described with reference to FIG.

[0066] The image stabilization device according to the fifth embodiment has the same configuration as the image stabilization device 1500 according to the fourth embodiment. The OIS processing according to the fifth embodiment differs from the OIS processing according to the fourth embodiment in that a HOST controller 1510 calculates a target position.

[0067] As shown in FIG. 22, the image stabilization device 1500 operates in the following sequence. (1) The HOST controller 1510 sends a start command to the first semiconductor chip 1505. (2) The first semiconductor chip 1505 transmits a start command to an unused area of ​​the memory unit 1511 of the gyro sensor via SPI communication. The second semiconductor chip 1506, the third semiconductor chip 1507, and the fourth semiconductor chip 1508 monitor the SPI communication and receive the start command. The second semiconductor chip 1506, the third semiconductor chip 1507, and the fourth semiconductor chip 1508 start processing. The gyro sensor does not operate because the address is in an unused area. (3) The HOST controller 1510 sends a gyro read command to the first semiconductor chip 1505. (4) The first semiconductor chip 1505 sends a read command to the gyro sensor 1509 via SPI communication. (5) The first semiconductor chip 1505 reads data from the gyro sensor 1509 via SPI communication. (6) The HOST controller 1510 acquires gyro data by IIC communication from the first semiconductor chip 1505. The HOST controller 1510 calculates the target position of each lens. (7) The HOST controller 1510 transmits the target positions of each lens to the first semiconductor chip 1505. (8) The first semiconductor chip 1505 uses an unused area of ​​the memory unit 1511 of the gyro sensor to transmit a target update command to the second semiconductor chip 1506, the third semiconductor chip 1507, and the fourth semiconductor chip 1508. The first semiconductor chip 1505, the second semiconductor chip 1506, the third semiconductor chip 1507, and the fourth semiconductor chip 1508 control the position of each lens connected thereto. (9) The HOST controller 1510 transmits a stop command to the first semiconductor chip 1505. (10) The first semiconductor chip 1505 transmits a stop command to an unused area of ​​the memory unit 1511 of the gyro sensor via SPI communication. The second semiconductor chip 1506, the third semiconductor chip 1507, and the fourth semiconductor chip 1508 monitor the SPI communication and receive the stop command. The second semiconductor chip 1506, the third semiconductor chip 1507, and the fourth semiconductor chip 1508 stop processing. The gyro sensor does not operate because the address is in an unused area.

[0068] In this way, the first semiconductor chip 1505, the second semiconductor chip 1506, the third semiconductor chip 1507, and the fourth semiconductor chip 1508 can be configured not to calculate the target position. The HOST controller 1510 can transmit the target position only to the first semiconductor chip 1505 at high speed.

[0069] The above-mentioned first semiconductor chip 103, second semiconductor chip 102, first semiconductor chip 1505, second semiconductor chip 1506, third semiconductor chip 1507, and fourth semiconductor chip 1508 execute processing using a program. The HOST controller 106 and the HOST controller 1510 execute processing using a program. The program can be stored and provided to a computer using various types of non-transitory computer readable media. The non-transitory computer readable media includes various types of tangible storage media. Examples of the non-transitory computer readable media include magnetic recording media (e.g., flexible disks, magnetic tapes, hard disk drives), magneto-optical recording media (e.g., magneto-optical disks), CD-ROM (Read Only Memory), CD-R, CD-R / W, and semiconductor memory (e.g., mask ROM, PROM (Programmable ROM), EPROM (Erasable PROM), flash ROM, and RAM (Random Access Memory)). The program may be provided to the computer by various types of transitory computer readable media. Examples of the transitory computer readable medium include an electric signal, an optical signal, and an electromagnetic wave. The transitory computer readable medium may provide the program to the computer via a wired communication path such as an electric wire and an optical fiber, or via a wireless communication path.

[0070] The invention made by the inventor has been specifically described above based on the embodiments, but it goes without saying that the present invention is not limited to the embodiments already described, and various modifications are possible without departing from the gist of the invention. [Explanation of symbols]

[0071] 100 Image stabilization device, 101 camera lens, 102 second semiconductor chip, 103 first semiconductor chip, 104 gyro sensor, 105 gyro sensor memory, 106 HOST controller, 107 Z-axis position data, 108 X-axis and Y-axis position data, 109 Z-axis position data, 110 Z-axis position sensor, 111 Z-axis actuator, 112 X-axis position sensor, 113 X-axis actuator, 114 Y-axis position sensor, 115 Y-axis actuator, 1500 Image stabilization device, 1501 first camera lens, 1502 second camera lens, 1503 third camera lens, 1504 fourth camera lens, 1505 first semiconductor chip, 1506 second semiconductor chip, 1507 third semiconductor chip, 1508 fourth semiconductor chip, 1509 gyro sensor, 1510 HOST controller, 1511 gyro sensor memory

Claims

1. a camera lens that performs image stabilization by controlling an X axis, a Y axis perpendicular to the X axis, and a Z axis perpendicular to the X axis and the Y axis; a first semiconductor chip for receiving data of the X-axis and the Y-axis of the camera lens; A second semiconductor chip that receives data of the Z axis of the camera lens; a gyro sensor that acquires data on the state of camera shake; the second semiconductor chip is connected to the first semiconductor chip via a chip select signal line, a data signal line, and a clock signal line of SPI (Serial Peripheral Interface) communication; the second semiconductor chip is connected to the gyro sensor via the chip select signal line, the data signal line, and the clock signal line of the SPI communication; The second semiconductor chip transmits the Z-axis position data to a memory unit of the gyro sensor via the SPI communication.

2. the storage unit of the gyro sensor includes a first area and a second area; the first area stores data on the camera shake state; The semiconductor device according to claim 1 , wherein said second area stores said Z-axis position data.

3. the second semiconductor chip is a primary; The semiconductor device according to claim 1 , wherein the first semiconductor chip is a secondary chip.

4. the first semiconductor chip is connected to a HOST controller; The semiconductor device according to claim 1 , wherein the second semiconductor chip is connected to a HOST controller.

5. 3. The semiconductor device according to claim 2, wherein said first semiconductor chip reads Z-axis position data of said second region and performs a correction process.

6. the first semiconductor chip reads the data of the camera shake state and calculates a target position of the camera lens on the X-axis and the Y-axis; 2 . The semiconductor device according to claim 1 , wherein the second semiconductor chip reads data on the state of camera shake and calculates a target position of the camera lens on the Z axis.

7. the second semiconductor chip reads the data of the camera shake state, calculates a target position of the camera lens on the Z axis, and outputs the calculated target position to the second area; 3. The semiconductor device according to claim 2, wherein the first semiconductor chip reads the Z-axis position data of the second area and a target position of a camera lens on the Z-axis to store EIS (Electronic Image Stabilizer) data.

8. The semiconductor device according to claim 2 , wherein the first region is continuous with and follows the second region.

9. a first camera lens that controls two of three axes: an X axis, a Y axis perpendicular to the X axis, and a Z axis perpendicular to the X axis and the Y axis; a second camera lens that controls two of the three axes, the X-axis, the Y-axis, and the Z-axis; a first semiconductor chip that controls the first camera lens; a second semiconductor chip that controls the second camera lens; A gyro sensor for acquiring data on a camera shake state; the first camera lens and the second camera lens are used for image stabilization; the first semiconductor chip is connected to the second semiconductor chip via a chip select signal line, a data signal line, and a clock signal line of SPI communication; the first semiconductor chip is connected to the gyro sensor via the chip select signal line, the data signal line, and the clock signal line of the SPI communication; The first semiconductor chip is connected to a HOST controller via I2C (Inter-Integrated Circuit) communication, The first semiconductor chip transmits a command from the HOST controller to a memory unit of the gyro sensor via the SPI communication.

10. the storage unit of the gyro sensor includes a first area and a second area; the first area stores data on the camera shake state; 10. The semiconductor device according to claim 9, wherein said second area stores commands from said HOST controller.

11. 10. The semiconductor device according to claim 9, wherein the second semiconductor chip receives a command of the HOST controller from the first semiconductor chip via the SPI communication.

12. The second semiconductor chip is provided in a plurality of chips, The second camera lens is provided in a plurality of lenses, The semiconductor device according to claim 9 , wherein one of the plurality of second semiconductor chips is connected to one of the plurality of second camera lenses.

13. 10. The semiconductor device according to claim 9, wherein the second semiconductor chip acquires data on a state of camera shake and calculates a target position of the second camera lens.

14. 10. The semiconductor device according to claim 9, wherein the HOST controller acquires data on a state of camera shake and calculates target positions of the first and second camera lenses.

15. 10. The semiconductor device according to claim 9, wherein the first semiconductor chip is a primary chip, and the second semiconductor chip is a secondary chip.

Images